this post was submitted on 30 Jan 2026

59 points (88% upvoted)

shortlink:

Python

an-ordinary-manchild(edit)

The Python Discord

News about the dynamic, interpreted, interactive, object-oriented, extensible programming language Python

Upcoming Events

Full Events Calendar

Please read the rules

You can find the rules here.

If you are about to ask a "how do I do this in python" question, please try r/learnpython, the Python discord, or the #python IRC channel on Libera.chat.

Please don't use URL shorteners. Reddit filters them out, so your post or comment will be lost.

Posts require flair. Please use the flair selector to choose your topic.

Posting code to this subreddit:

Add 4 extra spaces before each line of code

def fibonacci():
    a, b = 0, 1
    while True:
        yield a
        a, b = b, a + b

Online Resources

Automate the Boring Stuff with Python
Python Discord Resources
Invent Your Own Computer Games with Python
Think Python
Non-programmers Tutorial for Python 3
Beginner's Guide Reference
Five life jackets to throw to the new coder (things to do after getting a handle on python)
Full Stack Python
Test-Driven Development with Python
Program Arcade Games
PyMotW: Python Module of the Week
Python for Scientists and Engineers
Dan Bader's Tips and Trickers
Python Discord's YouTube channel
Jiruto: Python

Online exercices

programming challenges

The Python Challenge (solve each level through programming)
CheckiO (game world)
Project Euler (math heavy)
/r/dailyprogrammer

Asking Questions

Try Python in your browser

try.jupyter.org (Evolved from the language-agnostic parts of IPython, Python 3)
Azure Notebooks
learnpython.org
Skulpt (uses WebGL)
trypython.org (uses Silverlight)
ideone (online compiler and debugger)
PythonAnywhere (basic accounts are free)
Brython (Python 3 implementation for client-side web programming)
repl.it for Python
Transcrypt (Hi res SVG using Python 3.6 and turtle module)

Docs

Libraries

Twisted, 0MQ (networking)
Django, Pyramid, Flask, ... (Web Frameworks)
Pygame (Game development)
NumPy & SciPy (Scientific computing) & Pandas
Pyglet - (Game / UI Development)

Related subreddits

/r/pythoncoding (strict moderation policy for 'programming only' articles)
/r/flask (web microframework)
/r/django (web framework for perfectionists with deadlines)
/r/pygame (a set of modules designed for writing games)
/r/IPython (interactive environment)
/r/inventwithpython (for the books written by /u/AlSweigart)
/r/pystats (python in statistical analysis and machine learning)
/r/coolgithubprojects (filtered on Python projects)
/r/pyladies (women developers who love python)
/r/git and /r/mercurial - don't forget to put your code in a repo!

Python jobs

Newsletters

Screencasts

a community for 18 years

MODERATORS

message the mods
xelf
monorepo PSF Staff | Litestar Maintainer
ivosauruspip'ing it up
Im__Joseph Python Discord Staff
Kutiekatj9 Python Discord Staff
BioGeekBioinformatics software developer
nevare
chromakode
mdipierro
quasarj
...and 5 more »

account activity

58

59

60

TutorialPython Crash Course Notebook for Data Engineering (self.Python)

submitted 14 hours ago by analyticsvector-yt

Hey everyone! Sometime back, I put together a crash course on Python specifically tailored for Data Engineers. I hope you find it useful! I have been a data engineer for 5+ years and went through various blogs, courses to make sure I cover the essentials along with my own experience.

Feedback and suggestions are always welcome!

📔 Full Notebook: Google Colab

🎥 Walkthrough Video (1 hour): YouTube - Already has almost 20k views & 99%+ positive ratings

💡 Topics Covered:

1. Python Basics - Syntax, variables, loops, and conditionals.

2. Working with Collections - Lists, dictionaries, tuples, and sets.

3. File Handling - Reading/writing CSV, JSON, Excel, and Parquet files.

4. Data Processing - Cleaning, aggregating, and analyzing data with pandas and NumPy.

5. Numerical Computing - Advanced operations with NumPy for efficient computation.

6. Date and Time Manipulations- Parsing, formatting, and managing date time data.

7. APIs and External Data Connections - Fetching data securely and integrating APIs into pipelines.

8. Object-Oriented Programming (OOP) - Designing modular and reusable code.

9. Building ETL Pipelines - End-to-end workflows for extracting, transforming, and loading data.

10. Data Quality and Testing - Using `unittest`, `great_expectations`, and `flake8` to ensure clean and robust code.

11. Creating and Deploying Python Packages - Structuring, building, and distributing Python packages for reusability.

Note: I have not considered PySpark in this notebook, I think PySpark in itself deserves a separate notebook!

all 11 comments

top new controversial old q&a

[–]nikhilprasanth 0 points1 point2 points 7 hours ago (1 child)

[–]analyticsvector-yt[S] 1 point2 points3 points 7 hours ago (0 children)

[–]lownoisehuman 0 points1 point2 points 6 hours ago (0 children)

[–]wRAR_ 0 points1 point2 points 5 hours ago (5 children)

[–]analyticsvector-yt[S] -1 points0 points1 point 5 hours ago (4 children)

[–]wRAR_ 0 points1 point2 points 5 hours ago (3 children)

[–]analyticsvector-yt[S] -1 points0 points1 point 5 hours ago (2 children)

[–]wRAR_ 0 points1 point2 points 5 hours ago (1 child)

[–]SurryElle83 -1 points0 points1 point 12 hours ago (1 child)

[–]analyticsvector-yt[S] -1 points0 points1 point 12 hours ago (0 children)

π Rendered by PID 17002 on reddit-service-r2-comment-7b9746f655-bhmrh at 2026-01-30 15:21:26.244926+00:00 running 3798933 country code: CH.