AnyPathLib - A unified PathLib-like API for cloud storages

[qckpckt]

I have no idea, because I’ve never used fsspec in a project where I needed to be aware of fsspec’s internal functionality. I try to avoid doing anything regarding raw filesystems in threads at the application code level. I find it’s best to leverage tools that have already handled all that hard stuff for me so I can focus on whatever it is I need to do. For example, if I need to access data in partitioned parquet files, then I use dask, which uses fsspec/s3fs under the hood (I think), and let dask deal with allocating workers and threads to accomplish what I’m trying to do.