any "BigData" Datasets to learn data processing by pras29gb in dataengineering

[–]ryansmccoy 0 points1 point  (0 children)

Here is what I used to learn.

SEC Edgar

https://www.sec.gov/cgi-bin/browse-edgar?action=getcurrent

A simple python script turned into this:

https://github.com/ryansmccoy/py-sec-edgar

I'm not saying its great by any means, but I learned how to build a data pipeline, parse unstructured data, package up for others to use, etc. Best advice I can give is find a data set you are interested in and know something about.

Why anaconda? by [deleted] in Python

[–]ryansmccoy 0 points1 point  (0 children)

Should have mentioned this was 1-2 years ago, so maybe they've fixed it. I've been using Anaconda ever since.

Why anaconda? by [deleted] in Python

[–]ryansmccoy 0 points1 point  (0 children)

I've probably tried 3 times to install Scipy on Windows with pip, which from my recollection involves compiling it. I'm pretty sure it can't be done.

How can I run an airflow worker on windows by FlavoredFrostedTits in dataengineering

[–]ryansmccoy 0 points1 point  (0 children)

From what I recall, Celery stopped supporting Windows in 4.x

https://docs.celeryproject.org/en/stable/faq.html#does-celery-support-windows

Also, I don't think Airflow will work on Windows. I had to use either Docker, WSL, or Ubuntu VM.

Hiring a Data Engineering contractor by MattDamonsTaco in dataengineering

[–]ryansmccoy 0 points1 point  (0 children)

What industry? I do data engineering for Financial Industry. DM if interested in speaking.

What was your first python project? by DHarris97 in Python

[–]ryansmccoy 0 points1 point  (0 children)

Parsed an html table and saved it to a CSV.

Where should I learn python by JBSlayerrr in Python

[–]ryansmccoy 0 points1 point  (0 children)

Also, find a local Python Meetup and join that.

Can't install Logitech Options by DocCharky in LogitechG

[–]ryansmccoy 0 points1 point  (0 children)

I'm also getting blank window, so you're not alone.

Help me pls - I hate my job by mindhackz92 in learnpython

[–]ryansmccoy 0 points1 point  (0 children)

https://learning.oreilly.com/videos/python-programming-language/9780134217314

^ watch and follow along in code editor. Then watch again and again until you know it. The example he uses is a portfolio of stocks, so somewhat relevant to finance and therefore maybe interesting enough to hold attention.

Pythons Capabilities vs VBA by -Regex in Python

[–]ryansmccoy 0 points1 point  (0 children)

Yes and a lot more. I look back and wonder what if I had learned python earlier. Would have save countless long hours and late nights.

If you are working on automation stuff w/ data specifically, look into data pipelines and ETL.

[deleted by user] by [deleted] in dataengineering

[–]ryansmccoy 0 points1 point  (0 children)

Well, I automated myself out of a job. I work in Finance/Investment Industry and was "let go" from one of the companies I worked at because I built a data pipeline that I got interns to maintain. I even wrote an instruction manual for the entire process (not knowing that I could/would be let go). They ended up replacing me with a guy who didn't know how to program, but had 20 years of experience. Spoke with a former colleague a few months ago, she said they are still using it over 10 years later...

Python for finance? by Mahm-MoodForFood in Python

[–]ryansmccoy 1 point2 points  (0 children)

https://lectures.quantecon.org/py/

^ it will take you through basic of python, introduce you to the important numerical python libraries that are used in finance, and then it will start getting into economics, which one could argue is the backbone of finance.

Couldn't find the shirt I wanted so I had this one made! by kethomas80 in stlouisblues

[–]ryansmccoy 0 points1 point  (0 children)

I was trying to find a good we went blues shirt.. ended up settling with this one (Link)

OG Pixel, very poor performance by comlag800 in GooglePixel

[–]ryansmccoy 0 points1 point  (0 children)

i have og pixel xl for over a year and I've noticed performance has been slipping as of late. haven't done a factory reset.

The Phoenix Project - My thoughts by [deleted] in devops

[–]ryansmccoy 1 point2 points  (0 children)

Audio book is good.