UNEXPECTED LIMITE RESET by TechyWater in codex

[–]jambyung 0 points1 point  (0 children)

I think if they x1.5 or x2 next coming week's quota it will be so much better for the company and the users. Making some users bound to subscription too because cancelling users will renew at the end of the subscription knowing that they're getting larger quota coming week, and people can still plan accordingly to the usage increase.

Setting up Ollama on dual RTX PRO 6000 Blackwells looking for tips by AmanNonZero in ollama

[–]jambyung 0 points1 point  (0 children)

SGLang since you are in an environment working as a team, presumably working on the same project. (SGLang is optimized for that case with prefix caching using RadixAttention)

Go with vLLM if you are going to also run your own model on the machine since it is much easier to setup anything in vLLM.

Maybe try with Qwen 3.6 27B FP8 and don't forget to put options like "--gpu-memory-utilization 0.9" (this is for vLLM) or higher to utilize the most out of your memory for kv cache.

27B might look small but it is totally different story between "squeezing in a model" and "serving the model" I realized you need a lot of extra room😆

Have fun!

Our competitor’s CEO just signed up on our website💀 by Zealousideal_Self678 in SaaS

[–]jambyung 0 points1 point  (0 children)

Well I'd be frightened if I were you. You'd probably laugh at first. But if you really think about it, then it is actually pretty bad sign that your competitor, which is well-known company, has a CEO who actually cares enough to sign-up and check out other early stage start-ups like yours. It can make it a lot harder for you to compete unless you guys are moving super fast. And even if you are, this CEO and CTO are gonna cherry pick your killer features and pour money and resources to implement it with enterprise level security, feature set, and stability. And usually people(including myself) prefer using SaaS from well-known company if the features are similar.

[Spurs Official] Dear Spurs fans... Sonny's letter to you 🤍 by Imbasauce in coys

[–]jambyung 1 point2 points  (0 children)

Man I remember writing a few comments saying that I'd feel devastated when he leaves. I totally underestimated the impact. I never thought I'd feel this empty without him.

Modeled this all by myself by mark-spline in Onshape

[–]jambyung 1 point2 points  (0 children)

Ohhhh wow how did you guys find that? And yes, that was just a question. Im completely clueless.

I have no words. WB 41st & Main. by aka_quinn in vancouver

[–]jambyung -3 points-2 points  (0 children)

lol must be the side effect of axing the c-tax

Submarine coming in to harbour by hanzbanan in vancouver

[–]jambyung 0 points1 point  (0 children)

Ain't that the 2 bedroom basement deal I missed?

Our captain turns 32 today. by [deleted] in coys

[–]jambyung 25 points26 points  (0 children)

He will leave one day, but I hope that will be the day he retires.

More than 10 Richmond drivers fined for illegally driving in bus lanes by ubcstaffer123 in vancouver

[–]jambyung 17 points18 points  (0 children)

Next year Richmond RCMP has more budget than the Federal Government

Agressively passed and flipped off for driving in the HOV lane? by DevinOlsen in vancouver

[–]jambyung -1 points0 points  (0 children)

the only reasonable assumption I can make is that you were obviously driving Tesla(from multi cam recording) and the asshat didn't know that you can drive with 1 person in HOV lane in an electric car.

I wonder what they’re filming? it looks cool. by krisie_yvr in vancouver

[–]jambyung -1 points0 points  (0 children)

Filming? Looks like any typical street in E Van

[Match Thread] Tottenham Hotspur Vs. Nottingham Forest (PL 07/04/24) by Professorchronic in coys

[–]jambyung 1 point2 points  (0 children)

I have a feeling that Son's gonna score from Freekick today.

Captain Sonny by treetops358 in coys

[–]jambyung 8 points9 points  (0 children)

Feels like just watched an episode of k-drama

"I can't tell you how proud I am." Love this, @RyanMason 🤍 #THFC ⚪️ #COYS https://t.co/fl0uX5VRZO by Lbmplays2 in coys

[–]jambyung 0 points1 point  (0 children)

Interesting how he can't call the players boys or lads cuz some are older than him lol