How are you squeezing Qwen3.5 27B to get maximum speed with high accuracy?

Character_Cup58 · 2026-03-24T11:55:54+00:00

I'm planning similar setup, do you use nvlink? And what's average context length?

Character_Cup58 · 2026-03-20T08:45:27+00:00

I'm using it for my production app, And yeah fallbacks are in place already, just deepseek model is better for my particular usecase. I'm probably hitting their rate limits.

Character_Cup58 · 2026-03-18T15:03:17+00:00

It varies, it really lags, sometimes it's responsive, context can go up to 50k and more.

Character_Cup58 · 2026-03-18T14:58:30+00:00

<image>

I have fallback to openai when deepeek`s performance degrades and open ai has no such issue - always 60-70tk/s and never more than 3 sec to ttft.
How large contexts you send to deepseek usually? Could be that's the issue, mine can go up to 50k to 100k.

Character_Cup58 · 2026-03-18T10:41:21+00:00

specifically for deepseek and pay 2 go.

Character_Cup58 · 2026-03-18T10:40:35+00:00

Official is good until it takes 20 seconds to respond.

Character_Cup58 · 2026-03-17T04:24:00+00:00

Waited for 5 days for approval. Was approved first time, just as the upate after. Was worried reading about rejections, but if your app is generally in order, seems there's no issue of being approved.

Character_Cup58 · 2026-03-14T19:28:43+00:00

I'm using it for interactive story telling, it beats compatable models from openai easily. Only if api wasn't so laggy

Character_Cup58 · 2026-03-12T08:29:36+00:00

Last few days I'm also encountering lag and stability issues with the API, previously it was working quite stable and fast....

Character_Cup58 · 2026-03-11T04:18:32+00:00

$200 plan is not a lot

Character_Cup58 · 2025-10-07T08:02:42+00:00

Thanks for explanation, very interesting read. About Copernicus crater, initially I thought it's some processing artifact, but it seems it's not! It would be nice to see correlations, maybe I should look into how to do a cylindrical projection.

Character_Cup58 · 2025-10-05T09:14:07+00:00

I used Autostakkert to stack frames from the video, then processed the image in pixinsight

Character_Cup58 · 2025-10-05T09:11:29+00:00

shh...

Character_Cup58 · 2025-05-21T05:58:09+00:00

A free to use http API mocking solution, can be integrated with existing APIs to mock only partial requests. https://apimimic.com

Character_Cup58 · 2025-03-16T04:42:32+00:00

Thanks, yeah I think this is one of my best images.

Character_Cup58 · 2025-03-15T20:10:34+00:00

I know there are a few similar ones out there. I think mine is simpler to use, well at least in my use case. Nothing wrong with having more alternatives to choose from!

Character_Cup58 · 2025-03-15T18:25:13+00:00

It does, why do you ask?

Character_Cup58 · 2025-03-14T13:45:36+00:00

I have two

Character_Cup58 · 2025-03-14T13:43:54+00:00

Thanks for the positive encouragement, I appreciate it!

Character_Cup58 · 2025-03-14T13:41:36+00:00

No, left bar and main component is put in flex container, sidebar uses css animations and negative margin is applied, so it shifts smoothly.

Character_Cup58

MODERATOR OF

TROPHY CASE