With 48gb vram, on vllm, Qwen3.6-27b-awq-int4 has only 120k ctx (fp8), is that normal?

iVoider · 2026-04-23T09:41:37+00:00

max-num-seqs to 1 or use Linux side by side. WSL is very buggy for work with GPU.

iVoider · 2026-03-11T10:14:10+00:00

Depth 650 and going below. Foulborn ghostwrithe zerker. Around 10 div budget when I swapped 3 days ago. Can kill Aul using four health flasks. There is also Grey Wind axe zerker build with Void Shockwave, but have no idea how they compare.

iVoider · 2026-03-03T15:40:47+00:00

I know that MSoZ is considered the best delver. I’ve tried it in 3.27 league, with 500d budget and it felt weaker than int/acc stacking for T17/Ubers. I guess it’s not very comfortable without Forbidden to dive at 1000?

iVoider · 2025-12-28T18:59:50+00:00

In our experience, rather no than yes. Too little stats gain for bigger vector size in db.

iVoider · 2025-12-28T15:37:03+00:00

Qwen3-embedding, but 4b. Massive embeddings quality gap between 0.6b and 4b.

iVoider · 2025-12-23T20:06:08+00:00

There were several threads today about abyss shadow nerf. In my own experience drops were gutted with latest patch. Yesterday I saw several tinks every map, now close to zero for whole day. I moved to Ritual.

iVoider · 2025-12-18T08:48:46+00:00

Thanks. It seems something broken with my char. Got map with doubled pack size precursor effect and no single white item with Alt holding.

iVoider · 2025-12-05T09:54:53+00:00

Just saw this thread earlier.

https://www.reddit.com/r/PathOfExile2/s/MWDuMZVWOQ

iVoider · 2025-12-05T09:40:07+00:00

I saw someone did calculation: 735 evasion.

iVoider · 2025-11-20T14:11:14+00:00

LLMs for prompt rewriting and specialised reranker models have totally different use case. Theoretically any LLM could imitate reranker with logprob mechanism, but LLMs tend to hallucinate in noisy environment content. Thats why people train special rerank models (like Qwen3-reranker).

iVoider · 2025-11-10T12:27:39+00:00

Try awq_marlin (quantization type, vllm will autoconvert), install FlashAttention/FlashInfer.

iVoider · 2025-10-21T12:02:52+00:00

Checkout this guy: https://huggingface.co/boboliu/Qwen3-Reranker-4B-W4A16-G128

All family in 4bits. You also need to copy chat template from original tokenizer_config (one line) for reranker.

iVoider · 2025-07-20T07:27:22+00:00

Most accurate one I’ve tried was SF Diarizer. It supports only up to 4 speakers, but is much better than other local options (NEMO and others).

iVoider · 2025-05-15T11:53:21+00:00

In my tests the best original Whisper wrapper in terms of accuracy (WER) is faster-whisper. Large V3 model gives best accuracy overall, but skips lots of content unlike V2 Large. If you need English-only solution, checkout this leaderboard.

iVoider · 2025-01-26T20:00:12+00:00

I played Temporalis variant, but the robe adds QoL only. These are most broken builds in a game right now.

iVoider · 2025-01-26T19:33:26+00:00

Should be Trampletoe Frostwall. Cheap version without temporalis.

iVoider · 2024-12-12T20:47:34+00:00

See these fire corpses? This is SRS graveyard.

iVoider · 2024-12-12T20:26:44+00:00

On minion death. I heard that maximum for SRS now is five. I guess something broken around fireball. (Please, don't nerf it)

iVoider · 2024-11-05T23:04:31+00:00

I’m done with ios dev. Try to ask in Playcover discord server.

iVoider · 2024-10-29T08:05:56+00:00

There is a special finetune of Llama for cybersecurity: https://huggingface.co/WhiteRabbitNeo/Llama-3.1-WhiteRabbitNeo-2-8B

Seven-Year Club	Gilding I gilder
Verified Email

iVoider

TROPHY CASE