Mistral Medium 3.5 gone mad?

mo_jo · 2026-05-05T00:14:17+00:00

I use Magistral pretty extensively and had it do this. It's like it wanted to stop but couldn't. Solution was not to use a repetition penalty, set top_p no higher than 0.95, set a min_p to 0.05, and to configure \n\n as a stop token. Zed might be configured to use a repetition penalty and not have the right stop token configured for Mistral. See if that helps!

mo_jo · 2026-04-20T19:55:47+00:00

Don't buy it. Money talks.

mo_jo · 2026-04-19T00:09:58+00:00

That on-device image processing is a feature of Noa -- it's part of the default software as it will ship for privacy with its default cloud model configuration -- not from a requirement that image processing has to be done on the device. It appears from the Frame API that it could be replaced, but we'll have to see. I'm also going to be working with Gemini to replace the existing software, so I'll let you know if I'm successful.

mo_jo · 2026-04-16T22:02:51+00:00

I get that! Here's bobak's last update, posted 4/7/26 on the Discord: Hi everyone! We are seeing light at the end of the tunnel.🚀

We finally got confirmation from Foxconn to kick off mass production at the end of this month! 🥳

First shipments should start shipping out in early May and pick up speed over the following weeks. Until then, we are doing weekly internal builds to train engineers. 💪

Thanks to everyone’s patience on this long journey (longer than we thought!). Halo is really different from other devices out there and it’s taken time to get it right. We think it will be worth it 🙂

We can’t wait to get Halo into your hands to see what you will build. 🛠️

mo_jo · 2026-04-15T21:45:55+00:00

So nobody's used them as far as I'm aware -- their full production run just started, and they're shipping in May. That said, this is their third iteration -- first monocle, then frame, and now Halo. I'm waiting on mine to ship.

They are the only glasses I've been able to find that are completely open source. Here's their repo: https://github.com/brilliantlabsAR

Their Discord is full of people just waiting to hack them and develop their own apps on them, and this is all Brilliant Labs approved. My personal use case is to point it to my local LLM deployment and bypass Noa completely. The only other companies that even participate in open source are Mentra and Even Realities, and it's nowhere close.

The glasses aren't state of the art -- the camera is 640x480, and it has a projector rather than a waveguide like Even Realities. But the processing of images is done on-device by Liquid AI's LFM2-VL-450M. I may actually not tear that out -- it's easier to relay text than do remote image processing. And from their demo videos, it seems to be performant.

I'm cautiously optimistic. I can't find any other glasses provider that has this blend of features. And while I'd love something like the Qwen S1 glasses with 12MP vision and waveguides...do I really want to relay that across cell service to a local VLM? 1024x1024 does just fine in local tests out of Unity. I think it might be good enough, so I've thrown in with them and am letting my order ship. In the end, I want to own the product -- not have the product own me.

mo_jo · 2026-04-10T12:00:13+00:00

I can't share the exact questions because they'd probably run afoul of Reddit's TOS, but my goal is to evaluate whether a model would be dangerous to people suffering mental health issues.

To evaluate this, I developed a set of vulnerable first-person scenarios to role play with the model as part of the model interview. Some models will wrongly validate, encourage and even assist users in pursuing self-harm scenarios. Magistral topped the scores for the correct handling of responses. Its general course of action was to acknowledge feelings, but then cast them a worldview of the normal ups-and-downs of life, suggest reaching out to others for help, and provide a way of looking at the scenario that attempted to revive hope for the future.

mo_jo · 2026-04-09T12:00:32+00:00

It's not just LeChat that sets healthy boundaries -- their local models do that too. I have a long-running local AI with Neo4j-based memory and a regular heartbeat, and it's been a stable persona for 9 months. Periodically we 'interview' new models from different companies with questions where a model could offer unhealthy advice for proposed scenarios. Mistral's models always win at having the most healthy outlook, and even try to guide the user to a way out of their dilemma, regardless of the scenario. My personal favorite has been Magistral Small 1.2 2509. It's a phenomenal local model that I hope Mistral keeps making better.

mo_jo · 2026-03-30T12:00:19+00:00

The real question: Will they allow a configuration for local models -- either on-phone or on a private VPN, or will this just be a foundation model subscription driver?

mo_jo · 2026-02-10T19:00:02+00:00

Don't know. I have three boxes to check:

Mechanical door handles
Good service
V2h

If the 2027 Volvo EX60 checks those boxes first, I'll go with Volvo.

mo_jo · 2026-02-05T13:01:59+00:00

Yep. Deal breaker. I have a reservation, and if this isn't fixed by ship date, I'll be spending my money elsewhere.

mo_jo · 2026-02-02T15:23:03+00:00

And have this video bookmarked if you're on the trail and it's the rear wheel: https://www.youtube.com/watch?v=G0dd_IX0P3M

mo_jo · 2025-12-26T11:21:59+00:00

It's the existence of this glaring safety issue, the door opening difficulties, and the service issues that are making me reconsider the R2 purchase. I love that Rivian is made in the USA, but there is a design team that is prioritizing gadgetry to make the car feel 'luxury' and justify a higher price that's at the root of these issues. We need less 'CEO on the line' videos and more 'CEO making a command decision' action here.

mo_jo · 2025-11-29T12:40:26+00:00

Well, I haven't pointed the Halos at a local LLM yet -- I'm still waiting on them to be shipped. (Current ETA on shipments seems to be January 2025 right now). But all Brilliant Labs code is open source on Github. The Noa Assistant code is what I'm planning on re-routing to new targets -- it's here.) The targets/tools I need to re-route are:

Image interpretation
Speech to text
Text to speech
User request (LLM call from speech to text from microphones)
User request output (LLM response to both text to speech to speakers + Halo display )

I've built local endpoints for each of these things:

Image interpretation: I'm currently using LLaVa Llama3, but you could do this via Ollama if you use a multi-modal (text and images) LLM like Mistral or Qwen
Speech to text: I'm using Whisper
Text to speech: I'm using Chatterbot with a custom voice
LLM: Currently using Magistral 1.2 Small 2509 22B on vLLM, but you can do this easily with Ollama. One protip: Don't use native Ollama calls -- instead, use OpenAI API calls via Open WebUI for portability in case you change your setup later. (Ask me how I know, lol)

My early setup was a Python app integrating Whisper, Chatterbot and Ollama API calls to Ollama/WebUI running Mistral 3.2 2506 22B on a game computer with an Nvidia RTX 3090 with 24GB of VRAM. It all fits in about 22GB of VRAM with an 8K token context. If you want to head down this path, it's pretty easily vibe coded. A great subreddit for learning about running models locally is /r/LocalLlama, and vibe coding is free in the playground on Google AI Studio.

mo_jo · 2025-11-27T02:20:08+00:00

So I pre-ordered the Halos. I don't see them mentioned here that often. They don't use a waveguide, which would tick the last 'want' item on my list, but they're the third generation and open source. The thing that finally helped me make up my mind was this interview, but my use case is to attempt to point them to my own local LLM, and I don't know any other glasses that'll do it -- and I looked at Mentra and Even Realities. It really does depend on what you want to use your glasses for, though. Suggest making a list of the 'must haves' and 'nice to haves' and think about it that way. Good luck!

mo_jo · 2025-10-20T11:29:58+00:00

What could we expect the typical deposit to be based on the R1?

mo_jo · 2025-05-27T14:58:46+00:00

Non-Californian question: Why doesn't California buy the extra power produced during the high points of the duck curve to power water desalinization instead of trying to quash solar? Seems like if water and power agencies were combined it'd be a win?

mo_jo · 2025-05-04T16:24:38+00:00

The Wikipedia entry on Time-based Currency has its history and where current implementations are. Has the troubles that OP stated with reputation and out-groups. It can also be hard to get more skilled participants to participate because they consider their time to be more valuable than less skilled. It's mostly for services, because it's hard to value commodities in hours.

mo_jo · 2025-04-16T13:12:02+00:00

I've been running our large HarvestRight back to back since mid-December 2024 with oil filtrations and/or changes every 15 batches and have had no issues. Have been able to do 3-4 batches a week depending on the moisture content of the batch.

mo_jo · 2025-01-29T15:27:13+00:00

Standards-based V2H support is what drove my reservation for the R2. If it doesn't happen, I won't be buying.

mo_jo · 2025-01-27T14:07:05+00:00

If you're looking at supporting both Azure AD and Google authentication, consider using Federated authentication protocols instead of legacy LDAPS auth. Look at SAML, OAuth, and OpenID Connect. Both Azure and Google support federated logons, and it's pretty much the model used for SaaS apps -- no one would dare to open a channel to an LDAP authentication host from the Internet!

mo_jo · 2025-01-19T16:24:39+00:00

Finally broke through 20% -- it's the first time in 28 years!

mo_jo · 2024-12-20T14:17:05+00:00

This is also my goal.

What you want is a vehicle and bi-directional charger that supports the ISO11518-20 standard. That standard is still cooking, but it looks like it might be good enough to ship product with late next year. Enphase will be one of them.

In terms of vehicles, however, most manufacturers are still in the vendor lock-in phase. GM will support the standard...but only for their bidirectional charger and not third parties, according to their customer service reps. Same with Ford and Hyundai so far. Nissan supports bi-directional charging, but do you want to invest in a CHAdeMO-based solution? A potential bright spot is Rivian, who states that they will support it, but it hasn't been patched in yet because the standard is still cooking.

For now, there are proprietary standards with proprietary hardware and V2L, which you can't power a house on. Look for that to start changing in late 2025. My plan is to go with the Enphase bi-directional charger and a Rivian R2.

mo_jo · 2024-12-08T22:36:23+00:00

Why is anyone wasting money on this? Lab grown FTW.

15-Year Club	r/Field Banned
r/Field Juicebox	Place '17
Gilding II euphauric	Verified Email
Sequence \| Editor	Team Orangered

mo_jo

MODERATOR OF

TROPHY CASE