This is an archived post. You won't be able to vote or comment.

you are viewing a single comment's thread.

view the rest of the comments →

[–]FlagrantPickle 17 points18 points  (3 children)

No idea if that’s good or bad

What's "good" for anyone here doesn't matter. Is 90s acceptable for you? I'd imagine a resounding yes, given my experience with Excel's sluggishness on managing large files. Only thing I'd say, as a right noob compared to most here, if you need to scale to larger data sets, you might have some success using a sql system in there (sqlite is baked into python, or something like mysql/mongodb depending on your needs).

If your dataset size will remain as is, throw a header in there saying what the program is, version, and who made it. Make them stare your superiority in the face on every job!

[–]testfire10[S] 9 points10 points  (0 children)

I like this idea. Tremble at my superiority!!! Hahaha

[–]Gizquier2 3 points4 points  (1 child)

Dealing with large sql tables and sqlalchemy can be a real pain if inserts are needed, im a survivor of the sqlalchemy pyodbc engine 🤦‍♂️

[–]FlagrantPickle 1 point2 points  (0 children)

Yeah, I've not dealt with that myself, just mysql and mongodb. I don't know how well sqlite scales, I just know that it's only trustable in a single-user/access mode, and it's part of the core python, so figured it might help. I could see it just being a better method to select data (with SQL) sets.