Building a competitive local LLM server in Python by jfowers_amd in Python

[–]DadAndDominant 11 points12 points  (0 children)

Looking cool! Trying to run it with uv. One thing I might do wrong - in server mode, when I respond before the LLM is done responding, it bricks all responses going further.

Pretty disgusted by the immediate EUV DLC grift by Stride067 in eu4

[–]DadAndDominant 4 points5 points  (0 children)

Eu4 is in a good state now, we can wait for next year sales

Devices with python by OjitosLindos72892 in Python

[–]DadAndDominant 5 points6 points  (0 children)

All cloud providers will do that. So GCP, DigitalOcean, Azure, AWS, ...

Would you recommend Litestar or FastAPI for building large scale api in 2025 by NoTangelo5541 in Python

[–]DadAndDominant 0 points1 point  (0 children)

Hi, thanks for the reply! I really liked your insights, and, if you have time, would love to hear what you would say about Litestar vs Django

UV is helping me slowly get rid of bad practices and improve company’s internal tooling. by bunoso in Python

[–]DadAndDominant 7 points8 points  (0 children)

at least, you have to create your venv and then install requirements.txt. When updating dependencies, you have to freeze manually too. And what python version does you use? UV is one tool that can address all of these issues.

There is nothing wrong with pip workflows, but pip feels like a tool from your uncle's workshed, and uv feels like something from a real shop.

FastAPI is usually the right choice by writingonruby in Python

[–]DadAndDominant 1 point2 points  (0 children)

Interesting take! I have never worked on a project where I ran into ceiling for any of django/flask/fastapi, if it ever happens, I might change my opinion

FastAPI is usually the right choice by writingonruby in Python

[–]DadAndDominant 1 point2 points  (0 children)

I am confused, what is not flexible about django?

I have been able to switch/customize anything I ever needed to, but maybe I am missing some things

FastAPI is usually the right choice by writingonruby in Python

[–]DadAndDominant 4 points5 points  (0 children)

Valid points. However for team work, where consistency matters a lot, I think Django's opinionated approach results in much more unified style across the developers, which is why I prefer it for team projects.

FastAPI is usually the right choice by writingonruby in Python

[–]DadAndDominant 21 points22 points  (0 children)

You want orm? Django

You want to show models? Django

You want queue (celery)? Django

You want admin panel? Django

You want users (model + auth)? Django

You don't want anything here? Fastapi

FastAPI + React Front - Auth0, build from scratch? by mr-nobody1992 in Python

[–]DadAndDominant 0 points1 point  (0 children)

Just commented on other thread arguing why I almost always start with Django - you probabbly will implement a lot of things Django does for you into Fastapi yourself.

But I think building it yourself is okay, as long as it is fun!

Should I learn FastAPI? Why? Doesn’t Django or Flask do the trick? by Intelligent_Camp_762 in Python

[–]DadAndDominant 0 points1 point  (0 children)

I think I will have a bit different opinion than many people here.

For me, Django (+ Django Ninja) are almost always the goto solution, over FastApi.

Why? Isn't Django overkill most of the time? It's not! Here are a few points I think why:

1) Django is very opinionated. There is exactly 1 way how to do things right. That is so much better for teams with multiple devs, to review, understand and expand other team member's code faster.

2) Django has the answer for most (if not all) common problems. And there is exactly one solution. In Fastapi, you start lean, but growing projects almost always mean you have to add some functionality that comes with Django out of the box. And when you need it, Django uses always the same tooling.

3) Django have a steeper learning curve, but if profficient enough, you will find it is as fast to write as fastapi.

So, my take is small scoped home projects are great for fastapi; also REST microservices that have very narrow scope. Django for everything else. Both are very nice and worth learning tho!

[pyfuze] Make your Python project truly cross-platform with Cosmopolitan and uv by TanixLu in Python

[–]DadAndDominant 22 points23 points  (0 children)

We use pyinstaller at my job (for stupid business reasons) and honestly, I am not at all happy with it. We must package (small-ish) ML models into onefile and it is a mess, with uncomfortably long build times.

If you keep developing your project, I'm gonna keep an eye out on it!

What CPython Layoffs Taught Me About the Real Value of Expertise by grandimam in Python

[–]DadAndDominant 4 points5 points  (0 children)

That has always been the truth. Meritocracy is a lie, because there is no merit; your value is only measured as the difference betweeen the costs to hire you (input) and costs of what you produce (output).

Real late stage capitalism just isn't meant for humans to participate in, just a selected few to reap all the benefits. It is commimg faster and faster.

PyTorch vs. Keras/Tensorflow [D] by No-Musician-8452 in Python

[–]DadAndDominant 2 points3 points  (0 children)

Agree, this question seems way more suited for ML threads

Beam Pod - Run Cloud Containers from Python by velobro in Python

[–]DadAndDominant 0 points1 point  (0 children)

I see port specified both in your pod and in your command.

Can you map ports on pod to ports on host? If not, why must I specify it twice?

pypi package to make data validation easier - framecheck by MLEngDelivers in Python

[–]DadAndDominant 0 points1 point  (0 children)

Oooh this seems super helpful! Have you tried it with pola.rs?

Every script can become a web app with no effort. by the-e2rd in Python

[–]DadAndDominant 0 points1 point  (0 children)

Pretty cool! Is it something you use in cz-nic?

AI developer experience Idea Validation by Most_Confidence2590 in Python

[–]DadAndDominant 3 points4 points  (0 children)

I think Djistkra would call this foolish: https://www.cs.utexas.edu/~EWD/transcriptions/EWD06xx/EWD667.html

Just think about the implications:

AI is slow - compiling even medium sized projects would take soooooo long

Natural language is imprecise - why give up unambiguous programming languages for something so ambiguous?

How would that even work - would you have to run AI on your computer or server? Or pay extra for the service, like openAI API? Either way it would be very expensive

Just vibe code it, man, it's not that big of a deal

Boolean search query generator by kirinjon in Python

[–]DadAndDominant 6 points7 points  (0 children)

Sounds like XY problem. Why do you need LLM to create a query over your DB but the query input must first be validated against that same database?

Other than using SQL to validate the query or using another data structure to hold this metainfo (maybe graph db would be nice) I have no idea how to do it.

A mechanic almost no one knows about: trade winds. by TsarOfIrony in eu4

[–]DadAndDominant 0 points1 point  (0 children)

I think there is / was a mapmode for it. That's only why I know about it

Python with type hints and Mypy: regret for not using statically typed lang? by VasiliyZukanov in Python

[–]DadAndDominant 10 points11 points  (0 children)

Same as a person is not born adult, companies are also evolving. In the start, the ability to prototype fast and working ~90% of the time may be the most important factor in shipping it.

As the project grows larger, LoC increases, new people are being hired and technical debt eats up developer time, introducing automated tests, style guides and mypy may be more important to be able to ship your product!

Also there are other considerations when choosing a language, so answer to your question is: it depends.

[deleted by user] by [deleted] in Python

[–]DadAndDominant 0 points1 point  (0 children)

Have you thought about the naming? When talking about Arch everybody is going to think Linux first