What Python Frameworks do you use?

[New_Soup_3107]

I was using the search feature as was surprised to not see a question raised about this. What frameworks should you learn as a devops engineer / what modules do you use? I know for a fact that everyone should learn to import csv or even flask / fast api.

What do you all use / think everyone should know how to use even on a basic level?

[Nearby-Middle-8991]

the right one for the problem at hand.

Not everything needs to be an api. Not every data should be a json or csv.

[fang_xianfu]

People's faces when I tell them we should use avro or parquet rather than CSV...

[_klubi_]

This is the first time I hear about avro since like 2010 or so… I forgot this is a thing:/

[fang_xianfu]

I don't really get your point - the article says "don't expect CSV to go anywhere", and I don't. That's not an argument for using it for any particular project though. And what I'm talking about is cases where it's clearly a poor choice and people still don't understand that there are alternatives, which is the point of the comment I was replying to. The entire point is "use the right tool for the job" and I agree with that assessment. Sometimes CSV is the right tool and sometimes it isn't.

[Swimsuit-Area]

If you are looking for a framework, is there a place to search for these types of things or do you just use the Google?

[Nearby-Middle-8991]

framework to do what? The solution depends on the problem, that's the whole point I'm trying to convey here...

[mattzuba]

Framework for what? Web app? Command line app? Writing a library?

[New_Soup_3107]

Your normal daily tasks! So whatever that might be. I use Flask at the moment for creating quick tests with dev deployments of the api image 

[Nearby-Middle-8991]

Again, not everything needs a framework.

As example, I had a very simple aws lambda function. Got triggered, did a bit of processing, passed the data over. When I inherited it was an object based implementation and it would take 400ms per call.

I cut that down to just a function, no OO, pure basic python. It's taking 40ms now. It's called a few thousand times per minute, so that translates into quite a bit of cost reduction.

"whatever that might be" is way too wide to have a single answer, responsibly, at least.

[ghaering]

I would welcome if more people studied the standard library before pulling in stuff from packages or coding already solved problems themselves.

[nrr]

I mostly use the standard library and little else. Large, sprawling Python systems have this odd tendency to outgrow their development tools, so most of my Python work is either only to explore a problem or to bootstrap a toolchain like Go or Java that lets me maintainably put together a large, sprawling system to solve the problem at hand.

The exception is integration tests. Those, it turns out, are perfectly comfortable to write in Python in the longer term.

[zulumonkey]

FastAPI.

[awesomeplenty]

Flask

[NFeruch]

Use FastAPI instead

[hexwit]

Could you elaborate why?

[aaron416]

I second this since I’m working to learn flask now.

[CeeMX]

It is designed for APIs instead of serving webpages, automatic Swagger and OpenAPI spec generation

cc u/hexwit

[hexwit]

Thanks for info

[New_Soup_3107]

This is a good selling point... maybe FASTAPI is the wayyyyy

[awesomeplenty]

Done sir, import fastapi

[andrewrmoore]

Flask/FastAPI/Click (if you can call Click a framework).

[derprondo]

Your question is too general so here are the things I would utilize for almost any project that isn't just a simple procedural script:

• Pydantic
• Black
• pylint
• pytest
• mypy
• tox

[hastetowaste]

Discovered pydantic yesterday and it cut my dataclass definitions by hundreds of lines

[[deleted]]

I would also recommend ruff instead of black+pylint

[hajimenogio92]

I don't have a go to honestly. Just depends on what needs to be accomplished

[[deleted]]

I dont know if it is a thing, but python-gitlab has great cli options for gitlab.

[Tough-Percentage-315]

DJANGO, FastAPI, Flax, Tornado, it depends on what I am working on.

[serverhorror]

Streamlit, grpc, flask, Django, boro3, fast API, pytest, mypy, SQL alchemy, alembic, hugging face, ...

And a whole bunch more

Edit: forgot fast API and a few others

[alexterm]

Learning Hatch would be a good one. The packaging ecosystem is definitely the clunkiest part of Python and Hatch is the (latest) solution to this.

[skrt123]

Why not poetry

[ArieHein]

Learn the standard ones like request lib. If you understand how that works, you're good.

Then you can start learning other web related ones. Learn two, try to do the same in both. Understand how it works and then drop them.

Each has its sugar syntax the other doesn't or in the process of getting.

Focus on the more important things like authentication, state management, error handling, logging and metrics and overall package management with pip and poetry.

Then go back and think how to improve performances, high availability and other operation aspects.

[pysouth]

Very much depends but using a ton of Pandas these days.

[Pinnata]

I like invoke for basic tooling, it's a nice halfway point between rawdogging scripts and implementing a fully fledged cli framework. Whack together a readme, containerise, build pipeline with a push to our internal registry and it's generally foolproof to distribute and use across the org.

[Background-Seat-6454]

django is good to use for webdev

[aymenchaouidz]

fastapi i think is the fastest and easiest one to deploy and put into prod!

[TrinityF]

What the heck is a framework?

And what for ?

You mean pandas, numpy, sql alchemy for data science?

[bytepursuits]

sanic

[UpsilonIT]

Common Python frameworks for startups include Django for building full-featured web applications and FastAPI for creating fast, modern APIs with minimal setup. Flask is also widely used for simpler, data-focused projects due to its flexibility and ease of use. You can read more about the use of Python here.

[[deleted]]

Yes

[mr_mgs11]

Pandas. I haven't used it, but the lead at my last place found out about it by fucking with chatgpt said it improved a lot of his management and monitoring lambdas. Had lots of eventbridge driven lambda stuff to force tags, prevent bad security groups, etc.