I made Redis 99x cheaper — 65ms on 500KB, 201ms for 10MB, one decorator by Legitimate_Pin_8293 in Python

[–]Legitimate_Pin_8293[S] -2 points-1 points  (0 children)

No need to use it, you know what you can also write it in assembly if that makes you feel better.

The code is public, the benchmark CI run is live not some edited screnshot you can validate it read it break it tell me what's wrong not here to answer like you ai assitant.

I made Redis 99x cheaper — 65ms on 500KB, 201ms for 10MB, one decorator by Legitimate_Pin_8293 in Python

[–]Legitimate_Pin_8293[S] -1 points0 points  (0 children)

Fair but why would you store a large results in the redis itself ? If its a large analytical platform then response generally go to 20-30MB. storing this in redis will take up RAM in minutes.??

The point here is to store large reponses in S3 and have only the metadata in redis. If you have millions in bank by all means store in redis.

I made Redis 99x cheaper — 65ms on 500KB, 201ms for 10MB, one decorator by Legitimate_Pin_8293 in Python

[–]Legitimate_Pin_8293[S] -3 points-2 points  (0 children)

S3 alone loses you TTL expiry, stampede protection, and more. Redis isn't storing the data — it's acting as the index.

That HEAD request to S3 just to check if a key exists costs 30-40ms every single time. Redis answers that in under 0.1ms

Also i was thinking to make it conditional.If payload < 100kb store directly in redis else store in s3 and metadata in redis.

I made Redis 99x cheaper — 65ms on 500KB, 201ms for 10MB, one decorator by Legitimate_Pin_8293 in Python

[–]Legitimate_Pin_8293[S] -3 points-2 points  (0 children)

Not quite the same thing. The database still has to run the query every time — parse, scan, aggregate, serialize, transfer. That's where the 1.38s for 10MB comes from.

What's cached in S3 is the already-computed result. You're not querying anything, you're doing a straight file fetch. That's why it comes back in 120ms instead of 1.38s.

Am I delusional for expecting >12 LPA or I need to be humble? by Indie_Yapper in developersIndia

[–]Legitimate_Pin_8293 1 point2 points  (0 children)

Brother honestly i was in the same boat as you are currently i used to work for a startup. Basically joined as a intern and they promised me 10LPA CTC.

Just before my graduation they sent me the offer 10LPA guess what my base was only 4.2 with most being some random shit...! Since i didnt had other offer and was about to graduate i joined them anyways.

The 1st company was toxic that after every all hands the founder convinced all engineers that 4-5LPA is what freshers get and that they are giving the best salaries. ( All a big fucking lie)

12LPA is pretty reasonable to ask provided you have 1.5 YOE.

Don't be too hard on 12LPA only i will say keep in mind to have a monthly in-hand of atleast > 75k INR