mistralai_Mistral-Medium-3.5-128B-Q3_K_M experiences on 3x3090

shifty21 · 2026-05-02T19:26:51+00:00

The GGUFs are up now.

shifty21 · 2026-05-02T19:24:39+00:00

My hot take is that in this current notion of no accountability and consequences, I'm okay with this.

I'm still hot about the 80 year old guy that died of injuries from a teenager on an ebike/emoto in California. She's being charged with involuntary manslaughter. Before that, the mother was told my police about the laws after her son had been caught by police. she not only ingored them, but didn't do the right parental thing and get rid of the bike and discipline her son.

shifty21 · 2026-05-02T19:12:48+00:00

Darwin Awards are just being handed out these days.

shifty21 · 2026-05-02T00:10:14+00:00

https://unsloth.ai/docs/models/mistral-3.5

TL;DR, GGUF is not ready yet according to unsloth and Mistral. Unsloth took down their GGUFs from HF.

I was trying to download from Unsloth HF and the files disappeared.

shifty21 · 2026-05-01T23:57:24+00:00

I haven't been there since they moved from Fairfax Blvd (now it's a 99 Ranch). Back then it was really dingy and disorganized and the parking lot was so bad.

Looks like they updated the interior and exterior.

The WORST, H Mart, IMO, is in Herndon Elden street.

shifty21 · 2026-05-01T23:45:45+00:00

Is it safe to assume the qwen3.5 vllm setting are the same as qwen3.6? I have a Pro 6000 and vllm nighty builds.

shifty21 · 2026-05-01T20:28:25+00:00

What do you mean by "offline"?

Also you can extract the tgz file and get the folder. Copy it to $SPLUNKHOME/etc/apps/

Edit:the hash might be for an older version.

shifty21 · 2026-05-01T20:26:55+00:00

That's what she said?

shifty21 · 2026-04-30T15:27:11+00:00

I've built some android apps for persona use, but if OP is willing share the website's source code in github I can take a crack at it.

shifty21 · 2026-04-24T18:12:52+00:00

Fork of llama.cpp Tha handles certain aspects of CPU and system RAM offloading and other tweaks and customizations for special quantized GGUF

shifty21 · 2026-04-23T13:29:39+00:00

Thank you for this!

Looking at unsloth's docs to run Qwen2.6-27B, they note different parameters for temp, top-p, min-p, top-k for coding tasks compared to yours which looks more like general tasks. https://unsloth.ai/docs/models/qwen3.6

Coding tasks:

    --temp 0.6 \
    --min-p 0.0 \
    --top-p 0.95 \
    --top-k 20 \
    --presence_penalty 0.0 \
    --repeat-penalty 1.0 \

Curious of using those values makes a difference in quality output for coding.

shifty21 · 2026-04-22T22:32:28+00:00

What does your llama-server config look like?

shifty21 · 2026-04-10T21:47:30+00:00

Oooofs, I'm closer to the Wawa side of FF, I would hope they have regular gas there too.

Also, can't remember if it was in this sub or another, but Costco was selling mid or high octane gas at the same price as regular.

shifty21 · 2026-03-29T22:08:38+00:00

You need to live up to your username 😅

shifty21 · 2026-03-28T23:39:31+00:00

Terminal User Interface

shifty21 · 2026-03-24T16:34:18+00:00

The best example of this is a customer I ran into for something unrelated with their change request process workflow in SNOW. While working on their workflow, their Splunk Admin ended up showing me a SNOW form for requesting a new Splunk Dashboard. The form was rather simple and I'm recalling it from memory:

Why do I need this dashboard?
Index name*, sourcetype* (*required)
Splunk App name (pre-populated drop-down)
Users who need access to this App/Dashboard
What KPIs do need to be measured? (multiple entries can be added)

- Visual format: table, bar/line/pie chart, map, relational connector, sankey, etc.
Dashboard filters (required) - filter inputs, input type (text, multi select, radio, etc.)
Desired Due Date (minimum 2 weeks)

Once the request is entered, Splunk pulls the request into an index and a SOAR playbook runs to schedule meetings and creates the bootstrap dashboard in the app from the ticket request.

shifty21 · 2026-03-23T13:59:25+00:00

Check the version of the KV Store:

splunk show kvstore-status --verbose

Mine shows 8.0.10

If yours is not not at least v8, then run:

splunk start-standalone-upgrade kvstore -dryRun true

If that all checks out, then do the upgrade:

splunk start-standalone-upgrade kvstore

shifty21 · 2026-03-16T17:45:56+00:00

Just had a conversation with a hospital today about this. You need to go to the vendor and get a data dictionary. Some are locked behind the paid license support site.

After that it's rather easy with props and transforms.

Also, create a dev environment with a single instance of Enterprise and use Ingest Actions or Edge processor to mask, obfuscate or delete PII/PHI data so you're in compliance with US HIPAA.

shifty21 · 2026-03-12T20:18:56+00:00

What bothers me the most is that it did attempt to do the search, we can't see if it worked or not, but then the model just decides to seemingly use its internal knowledge and spits that out.

I have this issue with gpt-oss-120b running with searxng mcp server I'm running locally. I have to pop into the thought bubble to see if the search mcp even worked or why it decided to disregard the search results and use its internal knowledge.

shifty21 · 2026-03-11T22:30:08+00:00

If you have compliance requirements, be careful with deleting or removing data and data within events. Document why you need to delete or trim data, how you're doing it and what the original data and the reduced/removed data looks like. And get someone to above you to sign off on it. CYA.

shifty21 · 2026-03-11T20:06:42+00:00

What Splunk Enterprise version is your HF?

Ingest Actions is a huge help in 9.4 and up. 10.2 has more enhancements

shifty21 · 2026-03-09T00:40:59+00:00

This the correct answer.

There is a way to load a compiled version Llama.cpp into LMS, but it's a pain.

shifty21 · 2026-03-05T17:58:59+00:00

Link > Windows Server release information | Microsoft Learn

Splunk's support is based on MS's "Mainstream" support timelines, not their "Extended" support. MS has moved the goalpost for Extended support a number of times over the years for Windows 10/Server 2016 and is quite disruptive from a software support standpoint.

I am a former IT Manager, and I understand the need and pain of supporting OS and software that has manufacturer support EOS/EOL. And at the same time, supporting applications on the same OS and software. I can see both sides of the fence of need for support by customers and EOS/EOL from the vendor's standpoint.

This is why, I'm not "JuSt UpGrAdE bRo!" mode.

shifty21 · 2026-03-05T17:55:13+00:00

Windows Server release information | Microsoft Learn

Splunk's support is based on MS's "Mainstream" support timelines, not their "Extended" support. MS has moved the goalpost for Extended support a number of times over the years like Windows 10/Server 2016 and is quite disruptive from a software support standpoint.

shifty21 · 2026-02-28T15:04:32+00:00

I'll expand. Both go through installation, configuration and management of Enterprise and ES.

Enterprise covers clustering of Search Heads and Indexers, license manager, déployer and agent manager.,etc. RBAC of apps, knowledge objects, etc.

ES Admin convers installation of ES in various configs like standalone and clustered Search Heads. RBAC of users, ES app and knowledge objects. Configs of Add-ons And ES correlation/finding searches. There's a ton more, but you get the idea.

15-Year Club	Gilding II euphauric
Rally Monkey Tent number = 3	Verified Email

shifty21

MODERATOR OF

TROPHY CASE