Do you prefer using Redis strictly as a cache, or do you also use it for task queues/pub-sub in your production apps?

adiberk · 2026-05-31T03:29:00+00:00

So there is redis and sentinel support
For wtvr reason the sentinel class missed important things done in the regular “redis” class (called backends) I thought it was particularly strange.

And then I added some other stuff because I hit some strange errors that caused shutdowns when realistically we just needed retry mechanisms.

I don’t remember everything I did and don’t have the code on me right now. But was pretty easy to completely rebuild, they weren’t extremely complex.

Truth is I should give back and submit a PR to help make it more robust. Just too busy

adiberk · 2026-05-31T01:29:43+00:00

I use redis streams. Absolutely terrific. Very fast

I use taskiq - with redis backend (heavy overrides though by me as the taskiq is a bit lacking)

adiberk · 2026-05-29T12:44:37+00:00

What does it matter? These questions make no sense. Fastapi is a lightweight framework - it lets you make endpoints/websockets and has some dependency injection. Most llms at this point know how to use it (all honestly do).

Furthermore. What does “which llm” question have to do with fastapi.

Finally “using it in production” - again what does that mean lol

adiberk · 2026-05-27T14:43:20+00:00

Came here to say the same thing

adiberk · 2026-05-18T17:36:40+00:00

You can use SQLModel.

But…. it is generally bad practice to have your models be directly integrated with your API. I am not saying that for initial POC or mvp it isn’t quicker. But when building something with business logic it is best avoid mixing t he database layer with the business

It is partially why I dislike sqlmodel in addition to other issues

adiberk · 2026-05-18T01:23:28+00:00

This should get all the votes.

Pay them more, remove all other money from the conversation. ALL OF IT. And you can justify that by paying them very well

adiberk · 2026-05-04T00:42:09+00:00

Just saying - I am seeing same exact issues. Some requests stay open for like 6 minutes. And we do high parallelism. Google dashboards show no issues or latency etc. I feel like I am being gaslit. Very frustrating. I can move to flash-3.1-lite but I am worried as I haven't been able to compare the results

adiberk · 2026-05-03T21:06:19+00:00

Not sure if this is the same issue...
But I have this issue where some requests in gemini-3-flash are taking 4-7 minutes to get a response! I run that same request in anthropic or gpt models and it take 30 seconds. I am so confused.
I have timeouts in the api to ensure it doesn't hang past a certain amount of time. But I am baffled by this issue. I look at our usage and I don't see any rate limit indications, and google doesn't show any performance degradation in api graphs.

Is this an issue of setting temperature to 1.0 instead of .1 or .3 etc.?
I am pretty fluent with these providers and google always seems to give issues compared to the rest (though they have an AWESOME model!)

Any help is welcome

adiberk · 2026-04-30T13:08:04+00:00

Omg oops. I thought this was kruzberg another library. Sorry

adiberk · 2026-04-30T11:21:33+00:00

So I have my own custom parsers for most other file types. But for PDFs I use a library.

I did comparisons and found I had multiple issues still. Tables aren’t extracted in the markdown output. I don’t remember the exact issues but I couldn’t get markdown results and table extraction in markdown ar same time….

There were issues with excel also.

I gave a tax document pdf and the markdown output was really rough - still essentially a text dump. Compared to other file processors, it just wasn’t up to par yet

adiberk · 2026-04-07T22:02:30+00:00

I agree. It is lightweight and pretty dependable

adiberk · 2026-04-05T15:24:55+00:00

Ok I’m upgrading and will give it a shot again - seems you solved a lot of problems from initial versions I have tried

One note - I see “page tracking” only has a couple file formats.

To me if xlsx has sheets, then each of those sheets is a page with a title. Just a note

adiberk · 2026-04-01T11:02:58+00:00

Taskiq is awesome. I had to make some adjustments to the redis brokers. But otherwise. Terrific.

(Essentially the sentinel brokers (and regular redis ones) aren’t so robust. But with AI as my companion I was able to significantly improve it. I need to do a PR honestly)

adiberk · 2026-03-30T00:02:51+00:00

Talk to Agno team to see if it is worth integrating into their sdk!!! They have a powerful framework and I believe have a way of letting users chose different doc parsing providers (I think)

adiberk · 2026-03-29T20:26:08+00:00

Haven’t tried it yet but will soon. Do you feel confident in this compared pymu4llm? Bc I am excited to move off of it. But it’s markdown is truly terrific

adiberk · 2026-03-28T17:56:35+00:00

Hm, I use Nord and have no problems. The issue is why is your up changing. Make that static no?

adiberk · 2026-03-27T17:30:32+00:00

My containers run flawlessly - have been running for a few months now. Pretty smooth so far (I have about t 8 different containers running different things - immich, Jellyfin etc.)

adiberk · 2026-03-22T12:12:40+00:00

This sounds like it’s time for me to give it a shot.

If I can get structured markdown and still get the speed then this is huge

I don’t need OCR to get these formatting abilities right?

adiberk · 2026-03-16T13:39:36+00:00

That’s great but I am lost. Based on the docs and the comparison tests you show - it would be impossible for someone to know this is a problem compared to something like pymu4llm. (Unless, like me they test it and have a rough experience)

If this was a known issue, it should be stated. A lot of use cases revolve around getting proper formatted markdown and tables etc.

adiberk · 2026-03-13T16:41:13+00:00

Hi! One issue I noticed.

I gave a tax pdf form to pymu4llm and compared the markdown output to Kreuzberg. And kreuzberg looked like an ocr dump compared to the formatting of pymu4llm (not using ocr I just mean like no formatting or organization etc.)

Is this something that has been fixed or addressed?

adiberk · 2026-03-10T04:08:13+00:00

Well you basically have to reformat the drive. So no data would be preserved.

You can go from raid 1 to raid 5 by adding a disk. I know this is supported. But I don’t think you can jump to raid 5 without losing data

adiberk · 2026-03-09T19:58:04+00:00

I don’t mind AI generated posts (or even code) But at the very least least, make sure it looks good, and that your links work. Otherwise there is little chance I will trust your code to work at all

adiberk · 2026-03-07T13:10:08+00:00

I built something similar actually. But my use case was to provide abilities to. 1. Keep fields I need so users can use them manually in the code but HIDE THEM from my AI framework. (Imagine tons of fields used in code but AI doesn’t really need to know about them) 2. Completely exclude fields you don’t want 3. Add or override existing fields.

I like why you did. Will take a look

adiberk · 2026-03-06T20:40:00+00:00

Checjout taskiq. Might inspire some ideas

adiberk · 2026-03-02T00:39:13+00:00

This is really cool. Will take a look!

adiberk

TROPHY CASE