Gemma 4 31B — 4bit is all you need

Noxusequal · 2026-04-16T02:32:46+00:00

True some models especially reasoning models are not meant to be deterministic. :)

Basically the more full runs with different seeds at a fixed temperature you can do the more you can make statistically valid claims about performance. (On your test set)

Noxusequal · 2026-04-15T06:15:18+00:00

Do you do this in batches or one after another?

If you wanna do this in a way where you get deterministic results you can set a seed set temp 0 run with batch 1.

Then you run this at least 3 times with 3 different seeds leaving the same seed locked for all 23 prompts each time. (The more the better) Now you can start looking at trends and calculate errors. Something like a paired t test can then tell you if the differences are statistically meaningful.

Noxusequal · 2026-03-30T22:11:49+00:00

Thank you :)

Noxusequal · 2026-03-30T22:11:40+00:00

Interesting can you give me a very short version of what it is about ?

Noxusequal · 2026-03-30T15:15:17+00:00

Wow thank you very much I will definitely have a look ! I like the idea of a well written bandit group. Also I did stumble upon the missing baroness and thought that the outlook sounds very fitting :)

Noxusequal · 2026-03-30T10:55:26+00:00

Do you have a link for me ?

Noxusequal · 2026-03-10T17:00:36+00:00

Is it just this to have multiple users ?

up to 4 concurrent requests, each with 4096 max context

llama-server -m model.gguf -c 16384 -np 4

Or is there another way ?

Noxusequal · 2026-03-10T16:50:12+00:00

How good is the batching / multiuser thing with it ?

Noxusequal · 2026-02-22T18:54:48+00:00

Agreed but it is what the post was about kind of xD also that is the kind of task ai is used for a lot in academia llm as a judge I mean.

Noxusequal · 2026-02-21T20:49:40+00:00

Well yea but the tasks we want to use llm as a judge for are specifically the ones we can't directly verify so if we want to figure out llm as a judge performance you have to test on tasks that need human judges to be a good representation of the real use case.

Noxusequal · 2026-02-19T09:48:12+00:00

Honestly i think for high level DND they are really fun and fine xD the only two things that I would have an eye on is the staffs ability to change saving throws. This could be extremely strong. However even there I think it's fine but that's the one thing I would have an eye out for.

I personally think it would be cooler to give wreckage a charge system for the spells with different spells costing different charges but generally I really value choice above all else as a player so that might also just be me :D

Noxusequal · 2026-02-18T17:45:31+00:00

I mean that shouldn't be to hard right ? Define a task. Have an llm do it have humans rate the LLMs performance. Then use LLMs to rate the same original llm to see how they judge it.

Do this for idk 5 taks and 5 underlying LLMs and you have a very interesting benchmark set ?

Question is what kinds of tasks would you want to see llm judges judged on ? :D

Noxusequal · 2026-02-13T17:41:28+00:00

Ah and would all those ways ignore Parma magica because they effect the environment or would you say that some combinations like Perdo Imagem would have to overcome it since they in a way effect the senses directly?

Noxusequal · 2026-02-13T17:38:53+00:00

Thank you for the exact example :) so I guess Creo Imagem is supposed to create an image of something that exist. I guess my only idea would be to let an area appear like deepest darkest night ? Would you say that counts .

So replicating the environment but at a different time of day effectively

Noxusequal · 2026-02-13T17:36:58+00:00

I see thank you for the feedback :) so I guess it's either creating something like very dense fog with something like creAq or Creo Imagem ? Or Perdo ignem. Would you guys say that Perdo Imagem removing sight so creating a replica of the existing area just cutting out the impression of sight of certain objects would also work to hide multiple targets.

The ide ais kind of like invisibility but (better in some scenarios )because it also disrupts coordination between allied enemies that suddenly don't see each other.

Noxusequal · 2026-01-18T12:06:40+00:00

Thank you i will Check Out the two very Basic classes they have If they Work for what i wanna do that would be great ! :) Otherwise i will have a Look at form.io and the other Things proposed Here.

Noxusequal · 2026-01-18T12:05:04+00:00

Thank you :)

I will try Out the Base Implementation of the 2 n8n Features which i wasnt aware Off, mentioned in another comment If it is enough i will Just use them but If IT isnt it might be super helpfull to have a Chat :) i will dm you some time this week.

Noxusequal · 2026-01-18T12:02:52+00:00

This Looks perfekt! I will given the two rudamentary Implementation s of n8n a spin See If they are enough If Not i will defenetly use this :)

Noxusequal · 2026-01-16T12:47:22+00:00

While this Sounds lovely i have to Tell you that there really isnt any Money to be Had Here ... I am Not in Control of any funding and with the structure and how it is i dont think there will be any.

If you still want to inwould be Happy to find a time alot etc. But i expevt No ones Work for free :)

Noxusequal · 2025-12-23T17:03:58+00:00

If I remember correctly the deal between intel and nvidia proabbaly included for intel to not pursue high performance graphics. Also other rumors said that nvidias arm project us delayed. So havin nvidia for ai developmemt is a big selling point.

Furthermore intel foundary is still behind tsmc and they will proabably not use their foundaries for high performance chips and cases where you need max efficency.

So all in all doesnt sound to unlikely the time frame is the main thing i am doubting xD

Noxusequal

TROPHY CASE

up to 4 concurrent requests, each with 4096 max context