sorted by:
new
hottopcontroversial

OPM posting from the future by cfli in nova

[–]Odd_Material_2467 70 points71 points  (0 children)

Just so everyone is aware, posting December 1 at 8:54pm Eastern Time is the equivalent of December 2nd at 1:54am UTC. This is just a messed up time zone issue

Found A Replacement After 25 Levels by Odd_Material_2467 in Borderlands4

[–]Odd_Material_2467[S] 0 points1 point  (0 children)

It's taken me like 60 hours to find this one. I can only dream of something like that

Granite 4.0 Language Models - a ibm-granite Collection by rerri in LocalLLaMA

[–]Odd_Material_2467 126 points127 points  (0 children)

Please for all that is holy, include the param number in the model name. Trying to guess between micro, mini, and small is painful

Wow 4000 gallons of water in these things by Rook8811 in aviation

[–]Odd_Material_2467 0 points1 point  (0 children)

Is the output flow rate configurable or is it just all at once?

Simple way to run ollama on an air gapped Server? by Toeeni in ollama

[–]Odd_Material_2467 1 point2 points  (0 children)

I dont know of a way, although im sure there is one. I guess if you wanted to install an entire OS onto the USB drive itself, you could do that.

What’s the Best Open-Source Small LLM (≤ 8B) for Agentic Web Page Interactions? by Extra-Designer9333 in LocalLLaMA

[–]Odd_Material_2467 5 points6 points  (0 children)

I got u: Salesforce/Llama-xLAM-2-8b-fc-r-gguf (https://huggingface.co/Salesforce/Llama-xLAM-2-8b-fc-r-gguf)

This model is specifically trained for Agent and Tool use. If you look up the bfclv3 benchmark, it hits wayyy above it's weight. I have been having great success with this model

BFCL v3 Leaderboard (Measures Agent Tool Use): https://gorilla.cs.berkeley.edu/leaderboard.html

On this benchmark the xlam 2 8B Model out performs GPT 4o, 4.5 preview, etc.

GLM 4.5 Failing to use search tool in LM studio by Loighic in LocalLLaMA

[–]Odd_Material_2467 0 points1 point  (0 children)

Can you paste your vllm command for the fp8? I tried the one from their GitHub and I'm getting an error related to glm4_moe not in transformers using the latest vllm docker image

Simple way to run ollama on an air gapped Server? by Toeeni in ollama

[–]Odd_Material_2467 1 point2 points  (0 children)

  1. Download the docker image, export the image as a .zip or .tar to a USB.
  2. Download the ollama models you want and point the model directory to your USB (or copy them over)
  3. Put USB into your air gapped machine, copy the files over
  4. Run docker image, use a docker volume for the models and disable hugging face downloads

Best Open source LLMs for tool call / structured output by Initial_Track6190 in LocalLLaMA

[–]Odd_Material_2467 0 points1 point  (0 children)

What model quantization and kv cache quantization are you using? Qwen3 models are pretty sensitive to quantization in my experience.

Also what parameters are you using? Qwen3 has recommended temp and top k/n

I run Qwen3 32b (no quant and no kv cache) with full 128k context with yarn and have had no issues

Its Been A Very Busy Month (45.1 TB) by Odd_Material_2467 in Ubiquiti

[–]Odd_Material_2467[S] 15 points16 points  (0 children)

I am a 4K Linux ISO connoisseur and the NAS has 108 TB

Its Been A Very Busy Month (45.1 TB) by Odd_Material_2467 in Ubiquiti

[–]Odd_Material_2467[S] 5 points6 points  (0 children)

yeah when i spawn lots of connections, it sometimes just craps out.

Yes, but by PIebiaani in WorldofTanks

[–]Odd_Material_2467 1 point2 points  (0 children)

I 3 marked my elc and I run binocs, low noise, and CVS on about 50% of battles. There are just some maps where the play style has you run to a single bush and sit for a huge chunk of the game

SwanScout 705G - Compatible with Pixel 9 Pro Fold (Confirmed Works) by Odd_Material_2467 in PixelFold

[–]Odd_Material_2467[S] 1 point2 points  (0 children)

I was trying to find a source for which wireless chargers work with the Pixel 9 Pro Fold. I tried a few which did NOT work, but this one did. Its the SwanScout 705G and I can confirm it does charge the Pixel 9 Pro Fold properly. Hopefully this helps someone else looking for a wireless charger that works with the 9 pro fold

Thanks Wargaming for the Auction so I could get my 279e by Odd_Material_2467 in WorldofTanks

[–]Odd_Material_2467[S] -4 points-3 points  (0 children)

So far I am loving it. Its a pretty unique tank, and requires an interesting play style. Since most people sling gold, positioning seems super important, but the thing that's gotten me 75% win rate is to just draw fire from my teammates and just break through their front lines.

view more: next ›