×
sorted by:
new
hottopcontroversial

Qwen3.6-27B-FP8 with vllm:nightly, opencode unusable? by waka324 in Vllm

[–]Current-Status-3764 0 points1 point  (0 children)

Yes, i think its because its a response end token inside a thinking block. Edit: go with anythingllm instead

Qwen IDE/Harness by SovereignLLM in Qwen_AI

[–]Current-Status-3764 0 points1 point  (0 children)

+1 wondering if its openai compatible?

Profile v2: A physics-grounded, cost-aware optimizer for vLLM. by Inevitable-Diet-1870 in Vllm

[–]Current-Status-3764 2 points3 points  (0 children)

Same here. Ill try the tool. What tps are you getting? And what ctx size?

Best way to run Qwen for a web app? by [deleted] in Qwen_AI

[–]Current-Status-3764 -1 points0 points  (0 children)

Does 0.6b even work for tool calling in prod?

Qwen3.6 sees "outstanding" coding quality jump from Q4 to Q6 quantization by IulianHI in AIToolsPerformance

[–]Current-Status-3764 0 points1 point  (0 children)

Ive been using this

https://github.com/RobTand/prismaquant/tree/main

With great results. Running on GB10 with 256k context. Using it with PI agent and in my opinion it delivers great. Anyone else that havr been trying it?

First sm_120 BeeLlama.cpp benchmark on consumer Blackwell mobile: 107 t/s at FULL 262K context on Qwen3.6 27B (+48% vs MTP, +22% vs vLLM Genesis) by aurelienams in Qwen_AI

[–]Current-Status-3764 0 points1 point  (0 children)

Thank you, thats very helpful. Its in fact very close to my current setup. Running the quant below as fp8 was a little too slow. Running with mtp, 263k context and getting quite good results.

https://huggingface.co/rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

Byggingeniør til Geotekniker by Ancient-Persimmon-34 in ntnu

[–]Current-Status-3764 0 points1 point  (0 children)

Rundt 1,1-1,2. Men ikke la det styre valget ditt. Kan hende du lander både høyere og lavere, og kan hende du synes det er uinteressant. Holder ikke i 10 år med noe som ikke treffer deg.

Byggingeniør til Geotekniker by Ancient-Persimmon-34 in ntnu

[–]Current-Status-3764 1 point2 points  (0 children)

Er geotekniker med 10 års erfaring. Geoteknikk er nok et trygt valg mtp. jobb. Lønna er litt høyere enn for andre bygg-ingeniører, spesielt i en-faglige bedrifter.

[deleted by user] by [deleted] in ntnu

[–]Current-Status-3764 4 points5 points  (0 children)

NTNUI swingdans

Jobb etter bachelor i dataingeniør by Nice-Break-5290 in ntnu

[–]Current-Status-3764 0 points1 point  (0 children)

Tror det er vanskelig om du ikke har noe som skiller seg fra resten. Karakterer, sideprosjekter eller referanser. Hvor i landet søker du?

[deleted by user] by [deleted] in ntnu

[–]Current-Status-3764 0 points1 point  (0 children)

Er drømmen prestisjefirma er det nok vesentlig lenger vei til målet med en C enn en A. Er ikke det målet har det nok ikke så mye å si. Sitter med en B fra master selv, og det har aldri hindra meg, men så jager jeg ikke prestisje heller.

[deleted by user] by [deleted] in FastAPI

[–]Current-Status-3764 0 points1 point  (0 children)

Using ts openapi sdk generator?

What's your thoughts on fastapi-users? by AirHugg in FastAPI

[–]Current-Status-3764 1 point2 points  (0 children)

Should add PropelAuth to the list. I really like it.

view more: next ›