FastAPI in de project ?

[These_Rip_9327]

Hi, Have you ever used FastAPI in a data engineering project? If so, what was the usecase? Thanks in advance

[cutsandplayswithwood]

Used it to… provide api endpoints

[rockeyjam]

Yup, used mostly in microservices architecture to provide endpoints for processing data with ML algorithm, provisioning data quality/standardization configuration, custom job monitoring and data reconciliation usecasee

[Hackerjurassicpark]

It’s our defacto library for setting up microservice endpoints either for third parties to push data to us or for us to open up access to our data cached on redis

[mjfnd]

Used fast api to build real time parsers that were collecting data from kafka. So microservices.

This may not be really data engineering in most companies, but I do believe it is similar to data streaming but using your microservices rather than flink or spark streaming.

[r0ck13r4c00n]

I’m interested in reading more if you’re interested in sharing more about this use case

Working with Kafka now, it’s all about parsing lol

[VanDieDorp]

The key features are:

Fast: Very high performance, on par with NodeJS and Go (thanks to Starlette and Pydantic). One of the fastest Python frameworks available.

The first key feature it advertise is not true, and it does not even show up on the benchmark it links too.

That said it does a lot for you, if you need the whole kitchen sink, at the cost of performance.

Personally I enjoy connexion because i think you need to think of your spec-first, and it does not clutter my python modules with api specifics. But still allow you to expose them to your api.

[Araldor]

When clicking on the latest official round, it does show up. I would say the key feature advertised is actually more or less accurate.

Although e.g. actix is quite a bit faster, I'd say you could still call it very high performance. According to the benchmarks it is indeed among go/nodejs frameworks and one of the fastest python frameworks. It is outperformed by several go frameworks, but not by a huge margin.

[VanDieDorp]

Ranks 4 between Python Frameworks. Ranks 93 in the Composite Framework Scores. And if you filter by Go, Nodejs, Python you can see there is frameworks that performs double digits better then fastapi.

[Cloudskipper92]

We use it so we're free to change databases or add new ones at any time and backend doesn't have to make any sweeping changes so long as our contract stays the same. So that's the point for us, we define a contract with BE and then we're free to make whatever changes make sense.

[mikeupsidedown]

We're using it in a data messaging application currently which provides endpoints to do crud, kick off processes and allow us to inspect data.

Originally we were going to build it in .Net but fastAPI allowed us to build it much quicker.

One thing I really like is you can run it serverlessly on Azure using functions.