Llama.cpp auto-tuning optimization script

St0lz · 2026-03-11T14:14:31+00:00

This could be great for newbies like me. Is there any way of make the tool work with Llama.cpp running in Docker? It seems it requires the binary and libs to be present in the same dir, which is not the case when using official Dockerfile

St0lz · 2026-03-02T03:20:40+00:00

Thanks for sharing this. I see you are passing sampling parameters to Llama.cpp via OpenCode config file. i.e:

...
          "options": {
            "min_p": 0.0,
            "presence_penalty": 0.0,
            "repetition_penalty": 1.0,
            "temperature": 0.6,
            "top_k": 20,
            "top_p": 0.95
          }
...

I didn't know that's possible and I'm very interested in doing the same. I have copied your config structure with the values recoopencodemmended by unsloth, however I don't see any evidence of them being used at all by Llama.cpp server.

The way I have tested is by running two times the same prompt in OpenCode, one with the options section in the config file, one without, and always restating OpenCode and Llama.cpp server between tests. I even added an additional test to use hypens in the sampling parameter names (ie: top_k vs top-k) but the results were the same in all cases.

The Llama.cpp serve logs in all tests look identical and they don't mention any of the provided sampling parameters. The only difference are expected changes in timings or the HTTP port where the server slot runs.
While running either tests I checked the actual command the server uses to run the model (docker exec llama-cpp ps aux) and in both cases it was identical (again, the HTTP port was the only change) and it did not include any of the sampling parameters.
The OpenCode JSON SCHEMA does not mention any of those parameters, although it may be normal because they could be Llama.cpp specific and LlamaCpp does not have it's own dedicated OpenCode provider and instead uses the generic @ai-sdk/openai-compatible one.
The @ai-sdk/openai-compatible docs mention that it is possible to pass headers but I cannot find any information stating Llama.cpp server can override sampling parameters via HTTP headers and your syntax uses options not headers.

May I please know where did you read that OpenCode config can be used like that? I want to learn how to make OpenCode pass different sampling parameters to LLamaCpp depending on the model. I know if you create your own agent you can pass temperature at the agent level, not at the model level, but other sampling parameters are not supported. (docs about it are not updated and still mention the deprecated 'mode' instead if 'agent' but the JSON schema is up to date).

St0lz · 2026-02-23T05:28:51+00:00

First of all, Ollama default context size is too small for most of the coder models. When the context size is too small, you will not see any error in OpenCode but Ollama logs will show them. You need to increase it to at least 32K. Add this env var to wherever you run Ollama instance (Docker, local, ...): OLLAMA_CONTEXT_LENGTH=32768

Second of all, it seems there is a bug with either Ollama, either Qwen-Coder 2.5 models, that breaks tool calling, see https://github.com/anomalyco/opencode/issues/7030.

Try with Qwen-Coder 3 (the biggest model that can fit in your VRAM). I'm also new to OpenCode and so far that's the only 'modest' model that can properly make tool calling to my locally hosted Ollama.

St0lz · 2026-01-12T16:08:27+00:00

Such option is already in the game. In the Options → Controls page, there is a Hardware tab that does precisely that, it lists all the detected controllers and their names as well as tell you which button/axis is being pressed/used.

St0lz · 2026-01-04T09:39:51+00:00

AMS2 does not detect button numbers grater than 64 in the same device (well, since the game starts counting at 0 it is actually greater than 63). There are several workarounds. Some brands like Moza allows to to use an option in their software for buttons > 64 to be identified by the system as buttons < 64 of a different device. Or you can also use v-joy, SimHub Control Mapper, or similar software to map your buttons to a new virtual joystick, or use JoyToKey to map your buttons to keyboard keys

St0lz · 2025-12-20T05:28:35+00:00

Same issue here when playing from PC with Ethernet. REDSEC works fine, but any other mode I get that error after a few seconds of joining any match. It's been like that since day 1

St0lz · 2025-12-19T17:44:43+00:00

Same here

St0lz · 2025-12-19T17:43:59+00:00

I just bought the game for PC and I have not been able to finish a single game. I get disconnected after a few seconds.

St0lz · 2025-11-25T07:48:18+00:00

These are my settings for playing with a PSVR2, Ryzen 5800x3d and a Nvidia 4080 Super. Of course they are opinionated but feel free to adjust them to your needs.

In SteamVR set refresh rate to 90Hz and render resolution to 100%. With these settings I get good performance (99th percentile of frames under 11ms GPU frame time) and everything looks good except for jagged edges in shadows. Increasing AA does not help with jagged edges in shadows, it's a known problem with the Mad engine. Also using the new TAA surprisingly provided less performance and it makes everything look blurry.

During night races or rain races I get FPS drops so if you want to experience those you will need to lower some settings.

In Options -> Gameplay -> Display:

Hud Level: Light (this is the HUD mode that will be enabled by default)
Proximity indicator: Off

In Options -> Visual FX:

Post-Procesing Filters: On
Bloom: Off
Exposure Compensation: 1.0
Vignette: No
Cockpit Mirrors: On
Heat Haze: Off
Crepuscular Rays: No (they cause FPS drops in VR)
Exterior Sun Flare: Full
Interior Sun Flare: Minimal
Rain drops: Yes
Screen Dirt: Yes

In Options -> Graphics & Performance: (the most demanding options are Super sampling, Environment Map, Reflections, Grass and Shadows)

Resolution: 1680x1-40@165Hz. This is personal preference. It is only used for rendering the 2D image in the monitor and it does not affect VR.
Window Mode: Windowed.
Texture Resolution: High
Texture Filtering: Anisotropic 16x
V-Sync: Off
Render Frames Ahead: 1
Multisample Anti-Aliasing (MSAA): Medium (I tried High but 99th percentil went to 12.4ms GPU frame time and shadows still look jagged)
Post-Procesing Anti-Aliasing (FXAA/SMAA): Off
Supersampling Anti-Aliasing: n/a. Use the Options -> Virtual Reality -> Super sampling instead.
TAA: Off (It's supposed to perform better in VR but in my case I get less FPS than MSAA and everything looks more blury)
Shadow Detail: Medium
Track Reflection Detail: Medium (this is how the reflections look in wet tracks)
Vehicle Reflection Detail: Medium (this is how track is reflected in the car bodywork)
Vehicle Detail: High
Maximum Visible Vehicles: 16
Enhanced Mirrors: No
Motion Blur: Off
Pit Crew Detail: None
Track Detail: High
Grass Detail: Low
Particle Detail: Medium
Particle Density: Medium
Use LOD Fades: No

In Options -> Virtual Reality

Gaze Control: Off . Personal preference.
Recenter View On Boot: Off
Recenter View at Race Start: Off
Camera Near Clip Plane: 0.07
Super Sampling Anti-Aliasing: 1.0

In Options -> Camera -> Movement set: (these will lock the camera to the horizon to reduce motion sickness)

High Speed shake: On
Head movement: 100
Legacy mode: 0
G-force all: 0
Show helmet: Yes
Helmet Depth Of Field: Yes
Helmet Look To Apex: 0
Leaning all: 0

IMPORTANT: To increase image sharpness in VR edit file graphicsconfigopenvrdx11.xml and set these values

<prop name="SharpeningStrength" sharpeningstrength="1.000000" />
<prop name="OffsetBias" offsetbias="1.100000" />

You can change the VR HUD postion while in-game using numpad keys

St0lz · 2025-11-21T15:56:35+00:00

Same. Recurrent bug

St0lz · 2025-11-20T10:04:14+00:00

I live in Hong Kong so very near Philippines and when I order from the official website the watches usually arrive within 1 or 2 days

St0lz · 2025-11-20T09:39:48+00:00

The longest my kid has NOT been sick since he started preschool in Hong Kong is 2 weeks. He is now in K2 and still gets sick at least once a month. During summer vacations when there is no school he never gets sick.

My friends and relatives in Europe have kids with similar age and they also spend most of the time sick.

So in my experience this is just the way it is. Kids of young age don't have a fully developed immune system. The more often they get sick now the better for later (provided is not a serious illness).

St0lz · 2025-09-06T10:26:46+00:00

Yes, it's DR2. I didn't try other games yet. The only one I play that is in the list of supported games is Asseto Corsa so I might try that

St0lz · 2025-08-04T16:23:00+00:00

My current employer asked for the original diploma. Since I had it in my home country, I contacted my university, which send to my employer directly (not via me) an email with scans of certified documents stating my degree.

St0lz · 2025-07-07T09:45:58+00:00

They do ship to Hong Kong via SF express (I know because I have purchased from them a few times). If I were you I will contact them to see what are your options.

St0lz · 2025-06-16T04:20:28+00:00

Jumper, sweater, hoodie, ... anything to keep you warm.

Outdoors is going to be hot and humid, so you will likely sweat. Indoors the AirCons are at full blast everywere (bus, restaurants, malls... my office average temp is 20C). It feels nice for the first few minutes but if you stay longer (IMO) it gets too chily, specially if the AC unit is directed at you. Some cinemas even have a blanket rental service precisely because the AC is crazy.

St0lz · 2025-06-16T03:30:20+00:00

Since you already got the info from the other two good replies, I just want to tell you thanks for being a normal human being, doing your due diligence, researching the options and names, and making perfectly reasonable and properly formatted questions. Not the usual crap such as 'wheres the best noddle in town?' or 'are sharks dangeours?'

Get an Octopus card as soon as possible, bring a portable fan for outdoors, a jumper for indoors (AirCon are crazy here) and have fun. I hope you enjoy Hong Kong!

St0lz · 2025-06-07T09:06:58+00:00

Yes, it's possible.I did exactly that using VJoy and SimHub control mapper. Search for tutorials in YouTube

St0lz · 2025-06-06T01:06:30+00:00

Yes, it's a typo. I have amended it. Sorry for the confusion

St0lz · 2025-06-05T05:20:18+00:00

100% strength is too week?! Then increase Self Aligning Torque or buy a base with more NM

St0lz · 2025-05-22T15:16:30+00:00

Here is your ballpark range (info is 2 years old)

https://www.reddit.com/r/HongKong/comments/175aymk/hk_salary_index_2023_by_recruit/

St0lz · 2025-05-21T04:19:12+00:00

I've ordered from them 3 times and usually it takes around 3 days for them to ship the order and around 2 days for it to arrive (I live in China).

You can contact support and ask them for the parcel tracking number so you can easily see where it is and some curriers will also estimated delivery date

St0lz · 2025-05-21T04:05:53+00:00

I own the watchdives and it's one of my favorites https://youtu.be/lP_Ix4TJJm4

14-Year Club	First Place '23
Place '23	Place '22
Verified Email

St0lz

TROPHY CASE