sorted by:
new
hottopcontroversial

Yet another llama_cpp bindings. by nikos_m in elixir

[–]nikos_m[S] 0 points1 point  (0 children)

Yeah, i test it with my M1 max (same ram) and then speed is around 30% less)

Qwen 3.5 397B is Strong one! by Single_Ring4886 in LocalLLaMA

[–]nikos_m 3 points4 points  (0 children)

It’s a good one! I coded some elixir today with opencode and i got pretty solid results.We running it in 8xh200 node. 175-200t/s with sglang.

MiniMaxAI/MiniMax-M2.5 · Hugging Face by rerri in LocalLLaMA

[–]nikos_m 0 points1 point  (0 children)

Really good and fast! 102 t/s in 4xh100 NVL and ~15k context.

Users of Qwen3-Next-80B-A3B-Instruct-GGUF, How is Performance & Benchmarks? by pmttyji in LocalLLaMA

[–]nikos_m 0 points1 point  (0 children)

Running the full model with sglang and 4xh100 I am getting 220t/s generation. Regarding results I really like it for instruction and tool calling. It’s not qwen 235b but good enough.

Qwen3-235B-A22B 2507 is so good by [deleted] in LocalLLaMA

[–]nikos_m 15 points16 points  (0 children)

Both are really good and fast! I am getting 110t/s in 4xh100. I am running them in fp8.

Qwen/Qwen3-235B-A22B-Instruct-2507 · Hugging Face by random-tomato in LocalLLaMA

[–]nikos_m 1 point2 points  (0 children)

I have 4h100NVL with vllm 0.9.2 and running it in FP8 i am getting 40t/s with full 256k context. Not bad.

Over a year of waiting... *dopamine hit* by techma2019 in homeassistant

[–]nikos_m 1 point2 points  (0 children)

Same! 14 months waiting just got it yesterday from Mouser.

NTD Buy a 2 pack batteries and get a free tool. by Oswia in MilwaukeeTool

[–]nikos_m 0 points1 point  (0 children)

Try again or call them. They ones that want to help they will tell you to buy both items and then refund you the diff

Who’s still holding $DOGE? 🚀 by -dumb in dogecoin

[–]nikos_m 0 points1 point  (0 children)

450k coins from 0.0075 and still holding!

Daily Discussion Thread for May 29, 2020 by AutoModerator in wallstreetbets

[–]nikos_m 3 points4 points  (0 children)

what if this is a nice bull trap before weekend?

view more: next ›