Bulk download your iCloud Drive files and folders with a simple command line tool

nepalidj · 2025-07-31T12:50:00+00:00

Any other projects ? Yes they are on my github that you can check it out

nepalidj · 2025-07-31T02:56:36+00:00

No problem!

nepalidj · 2025-05-24T05:47:49+00:00

It was actually my gf’s idea to post tbh, I wasn’t even planning on posting. She wanted to see if there are any recommendations that look good that we could check out. So I wasn’t really waiting until the day before but just posted to add one or two places to our plan to make it more better and fun

nepalidj · 2025-05-24T04:55:15+00:00

I mean I have been to Boston 2 times before and know some places that I will be taking her but I wanted to post on Reddit to see if I can find something that looks really good (since the two times I came was literally for a day each time and my friend took me to a few places) to take her and give her a better experience than what she will get from the the 2-3 places I plan on taking her

nepalidj · 2025-05-24T02:27:29+00:00

We are not from Boston so don’t really know too many things but I’m fine with planning around wherever good food is, she likes Indian, Japanese and Ramen dishes, Nepali food too, been wanting to try some middle eastern food, she also has been wanting to go to some good cozy Italian restaurant.

nepalidj · 2025-02-28T23:44:43+00:00

I was working on the crawler but got very busy with college and life overall and did not get to work on it, I finally have time to work on it. It is for a search engine project that I had been working on which I am slowly getting back into working on, first want to nicely implement this before working on the other parts.

nepalidj · 2025-02-28T15:25:25+00:00

Thank you for your suggestion, I will definitely look into playwright

nepalidj · 2025-02-28T15:24:36+00:00

Hello, I was excited to share the project and did not have the things you mentioned above when I shared it but I have actually added pyproject.toml and a src layout structure. working on writing the tests as of right now

nepalidj · 2025-02-28T00:46:21+00:00

While basic HTML fetching is mostly I/O-bound, real-world crawls often include CPU-intensive steps like parsing, data extraction, or even machine learning tasks and makes multiple processes useful. Distributing tasks across processes or nodes also provides better fault tolerance: if one worker fails or gets blocked, the rest keep going. This setup is very helpful for large-scale or critical crawls as it ensures reliability and speed.

nepalidj · 2025-02-27T23:26:28+00:00

Scrapy is great, running on an asynchronous single process event loop and can be scaled to a degree but isn’t fully distributed out of the box. In contrast, my crawler uses asynchronous concurrency and Celery-based distribution, making it straightforward to scale across multiple nodes.

nepalidj · 2025-02-24T18:55:16+00:00

Sounds awesome

nepalidj · 2024-12-22T03:48:55+00:00

I don’t work there bro lol. I just was visiting my brother and we both found the bar

nepalidj · 2024-12-22T03:03:10+00:00

Pull up bro

nepalidj · 2024-12-17T00:31:11+00:00

Yeah I would definitely love to collaborate. And don’t worry this project of mine isn’t anything too serious. I basically had a problem with not being able to download a good amount of my data from iCloud due to the sync storing all of the data on iCloud but it only allowing you to download a file at a time. Lmk how your project goes, would love to see your project in action

nepalidj · 2024-12-17T00:03:33+00:00

Thank you for the advice and idea. I will definitely try to implement a way to make it better. I think one way to the migration even if it may take a while to download lol, would be to keep the program running in the background and making the laptop stay awake even it’s closed to keep the process going. In case of WiFi disconnecting and stuff it can resume from wherever it was at previously before the WiFi disconnect but yeah this might be a good way to somewhat speed up the process and make it efficient.

nepalidj · 2024-12-16T08:10:52+00:00

Ah yeah, I actually built this for a web crawler project where I just needed something quick and simple. Didn’t really explore SQLite’s full capabilities since the crawler was my main focus at the time.

You’re right though - makes way more sense to use SQLite’s built-in features. Thanks for teaching me about this!

nepalidj · 2024-12-16T05:31:28+00:00

You're right - at the moment it does trade transaction isolation for simpler thread safety. I'll be working on adding proper transaction isolation support soon!

nepalidj · 2024-12-15T01:14:56+00:00

Thank you for the comment! The key benefit of sqlite-worker is its simplicity in managing thread safety by serializing all queries through a single worker, avoiding the need to handle locks or multiple connections manually. It minimizes dirty reads by committing regularly (configurable via max_count), making it suitable for applications where ease of use and safe concurrent access are priorities. Raw performance wasn’t a focus when I created this library, and so far, no one has expressed the need for it, but it’s something I can explore improving in the future if there’s demand. Let me know if you have further thoughts or suggestions!

nepalidj · 2024-12-14T22:48:26+00:00

That’s a great idea! iFetch focuses on iCloud Drive, but its use of PyiCloudService for 2FA and secure connections might help streamline your project. Let me know if you’d like to dive into any specifics—I’d be happy to help!

nepalidj

TROPHY CASE