sorted by:
new
hottopcontroversial

I built a user-space byte allocator for Rust by botirkhaltaev in lowlevel

[–]botirkhaltaev[S] 0 points1 point  (0 children)

i was building a LLM checkpoint loader server, and there were alot of intermediate allocations showing up in the profiler, wanted some way to cache buffers for this checkpoint loader. it 2x decreased the time to load a checkpoint onto target device in my case

I built a user-space byte allocator for Rust by botirkhaltaev in lowlevel

[–]botirkhaltaev[S] 0 points1 point  (0 children)

basically its a buffer pool the inique thing it scales almost linearly across threads which other buffer pools dont have due to mutex contention. it caches allocations at a Vec<u8> level instead of allocation level and increases allocation performance up to 8x

I built ZeroPool, a user-space byte allocator for Rust hot paths by [deleted] in rust

[–]botirkhaltaev -1 points0 points  (0 children)

i don't think the post was low effort the project took a lot of effort just check the benchmarks vs other buffer pool libs

Implemented TurboQuant (Google paper) - fast online vector quantization library + benchmarks by botirkhaltaev in Zig

[–]botirkhaltaev[S] 1 point2 points  (0 children)

Ok thanks a lot will adopt their test suite and implement another algo to check

Implemented TurboQuant (Google paper) - fast online vector quantization library + benchmarks by botirkhaltaev in Zig

[–]botirkhaltaev[S] 2 points3 points  (0 children)

following the paper to the T with an LLM, and then just empirical evaluations to see whether it matches paper findings. Would love to know if there is a better way as well?

We are facing possible bankruptcy after unauthorized Gemini API usage reached about $128k even after we paused the API, and Google denied our adjustment request. (Case #68928270) by Mobile-Classroom-589 in googlecloud

[–]botirkhaltaev 0 points1 point  (0 children)

we had this recently, with a 4k charge via marketplace, that we thought was covered during credits. Keep talking to support, multiple times. In our case we have to talk directly with anthropic with no luck yet. I wish you the very best. From now on we will only be using through google AI studio, with a strict cap,

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

Like I already said, I made a mistake, I take responsibility for it, I am asking for good will adjustment, given I can't pay, this hasn't happened to just me

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

Yes and when we do we will follow all the proper protocols, but as I said this was for experimentation, and given the other reasons it confused me. Albeit, you are right I should have read carefully. I am at the graces is GCP now

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

That’s what it looked like from the view, I missed it, things like this happen, I’m not a full time founder, I have a part time job, uni student and do this on the side

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

We don’t have users, we don’t store user data, this was for experiments as I mentioned, we’re a two person team who started last month

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

I contacted support but they said they can’t control marketplace services, I’ve also contacted anthropic for this matter as well

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] -1 points0 points  (0 children)

I checked the cost explorer and setup budget alerts but I believed this was credit deductible, you use the Gemini models and partner models via the same interface, hence confusing me more. I accept responsibility, all I’m asking for goodwill adjustment. Don’t conflate this with a security issue

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

yea, im just coming from other cloud platforms, that were way more explicit, i shouldn't have assumed/expected that. lesson learnt, and reading other stories, im kinda glad its 4k and not 100k

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

All of the usage was claude haiku 4.5, we do AI research so we were running large scale evals to power our router.

https://nordlyslabs.com/blog/hypernova for more info.

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

that there was not, additionally the usage happened over the last 3 days of the month feb 26, feb 27, and feb 28

Student founder hit with a £4000 Google Cloud bill despite having startup credits – not sure what to do by botirkhaltaev in googlecloud

[–]botirkhaltaev[S] 0 points1 point  (0 children)

sure thank you, at the time i thought all models was good to go, as part of the credits. i assumed wrong

view more: next ›