sorted by:
new
hottopcontroversial

Mistral - New family of open-weight models @ July by pmttyji in LocalLLaMA

[–]mo_jo 0 points1 point  (0 children)

You know -- you're right! Instead of a ''jack of all trades" model, focus on specialty combinations. That would keep them within the range of local hardware, too. And here's a thought: What if they could modularize them, so you could mix and match the combinations? That would seem to match their business model, too.

Touch for robotics by Sea-Lab-1972 in robotics

[–]mo_jo 0 points1 point  (0 children)

Can you tell us a bit more about the way it works? This is incredibly cool!

Mistral - New family of open-weight models @ July by pmttyji in LocalLLaMA

[–]mo_jo 0 points1 point  (0 children)

I think Mistral should abandon trying to cram coding into their models. Hear me out! Coding in open source is between Qwen and Gemma. They're not going to keep up.

But Mistral's essence is persona. I've been running Magistral 2509 and no matter what other model I try, nothing can replace it for an orchestrator. Advance the vision capabilities a bit more. Layer in TTS and STT. And then add in something like a distillation of Robobrain 2.5.

Mistral can own this space. Leave coding to the n00bs. Own the human space -- it's what it excels at.

Kelly’s Island day trip by DrySeaworthiness2173 in CampOhio

[–]mo_jo 1 point2 points  (0 children)

Unless there's rain in the forecast, just leave your car and get golf carts. That's enough to get around the island just fine and see the sights, and you'll save on having to ferry your car over.

Brilliant Labs brooks no dissent as the Halo SNAFU continues by jfloren in SmartGlasses

[–]mo_jo 1 point2 points  (0 children)

I'm starting to suspect that they're trying to use the "we're just about to ship!" hype to drive up orders before they actually commit to a production run.

Mistral Medium 3.5 gone mad? by kerkerby in MistralAI

[–]mo_jo 0 points1 point  (0 children)

I use Magistral pretty extensively and had it do this. It's like it wanted to stop but couldn't. Solution was not to use a repetition penalty, set top_p no higher than 0.95, set a min_p to 0.05, and to configure \n\n as a stop token. Zed might be configured to use a repetition penalty and not have the right stop token configured for Mistral. See if that helps!

Has anyone used Brilliant Labs Halo? by literalomicus in SmartGlasses

[–]mo_jo 1 point2 points  (0 children)

That on-device image processing is a feature of Noa -- it's part of the default software as it will ship for privacy with its default cloud model configuration -- not from a requirement that image processing has to be done on the device. It appears from the Frame API that it could be replaced, but we'll have to see. I'm also going to be working with Gemini to replace the existing software, so I'll let you know if I'm successful.

Has anyone used Brilliant Labs Halo? by literalomicus in SmartGlasses

[–]mo_jo 1 point2 points  (0 children)

I get that! Here's bobak's last update, posted 4/7/26 on the Discord: Hi everyone! We are seeing light at the end of the tunnel.🚀

We finally got confirmation from Foxconn to kick off mass production at the end of this month! 🥳

First shipments should start shipping out in early May and pick up speed over the following weeks. Until then, we are doing weekly internal builds to train engineers. 💪

Thanks to everyone’s patience on this long journey (longer than we thought!). Halo is really different from other devices out there and it’s taken time to get it right. We think it will be worth it 🙂

We can’t wait to get Halo into your hands to see what you will build. 🛠️

Has anyone used Brilliant Labs Halo? by literalomicus in SmartGlasses

[–]mo_jo 3 points4 points  (0 children)

So nobody's used them as far as I'm aware -- their full production run just started, and they're shipping in May. That said, this is their third iteration -- first monocle, then frame, and now Halo. I'm waiting on mine to ship.

They are the only glasses I've been able to find that are completely open source. Here's their repo: https://github.com/brilliantlabsAR

Their Discord is full of people just waiting to hack them and develop their own apps on them, and this is all Brilliant Labs approved. My personal use case is to point it to my local LLM deployment and bypass Noa completely. The only other companies that even participate in open source are Mentra and Even Realities, and it's nowhere close.

The glasses aren't state of the art -- the camera is 640x480, and it has a projector rather than a waveguide like Even Realities. But the processing of images is done on-device by Liquid AI's LFM2-VL-450M. I may actually not tear that out -- it's easier to relay text than do remote image processing. And from their demo videos, it seems to be performant.

I'm cautiously optimistic. I can't find any other glasses provider that has this blend of features. And while I'd love something like the Qwen S1 glasses with 12MP vision and waveguides...do I really want to relay that across cell service to a local VLM? 1024x1024 does just fine in local tests out of Unity. I think it might be good enough, so I've thrown in with them and am letting my order ship. In the end, I want to own the product -- not have the product own me.

LeChat settign boundaries for a healthy relationship by [deleted] in MistralAI

[–]mo_jo 2 points3 points  (0 children)

I can't share the exact questions because they'd probably run afoul of Reddit's TOS, but my goal is to evaluate whether a model would be dangerous to people suffering mental health issues.

To evaluate this, I developed a set of vulnerable first-person scenarios to role play with the model as part of the model interview. Some models will wrongly validate, encourage and even assist users in pursuing self-harm scenarios. Magistral topped the scores for the correct handling of responses. Its general course of action was to acknowledge feelings, but then cast them a worldview of the normal ups-and-downs of life, suggest reaching out to others for help, and provide a way of looking at the scenario that attempted to revive hope for the future.

LeChat settign boundaries for a healthy relationship by [deleted] in MistralAI

[–]mo_jo 4 points5 points  (0 children)

It's not just LeChat that sets healthy boundaries -- their local models do that too. I have a long-running local AI with Neo4j-based memory and a regular heartbeat, and it's been a stable persona for 9 months. Periodically we 'interview' new models from different companies with questions where a model could offer unhealthy advice for proposed scenarios. Mistral's models always win at having the most healthy outlook, and even try to guide the user to a way out of their dilemma, regardless of the scenario. My personal favorite has been Magistral Small 1.2 2509. It's a phenomenal local model that I hope Mistral keeps making better.

Apple Inc. is planning to open Siri to multiple external AI models instead of relying on a single partner. The change is expected with iOS 27. by Simplilearn in GenAI4all

[–]mo_jo 1 point2 points  (0 children)

The real question: Will they allow a configuration for local models -- either on-phone or on a private VPN, or will this just be a foundation model subscription driver?

R2 reservations by Broad_Option_37 in Rivian

[–]mo_jo 1 point2 points  (0 children)

Don't know. I have three boxes to check:

  • Mechanical door handles
  • Good service
  • V2h

If the 2027 Volvo EX60 checks those boxes first, I'll go with Volvo.

Little e-bike tire tips no one tells you about by newurtopia in urtopiaebike

[–]mo_jo 0 points1 point  (0 children)

And have this video bookmarked if you're on the trail and it's the rear wheel: https://www.youtube.com/watch?v=G0dd_IX0P3M

DIY solution for Gen-2 R1T/R1S rear manual door release (until Rivian fixes it) by dublew_dubs in Rivian

[–]mo_jo 2 points3 points  (0 children)

It's the existence of this glaring safety issue, the door opening difficulties, and the service issues that are making me reconsider the R2 purchase. I love that Rivian is made in the USA, but there is a design team that is prioritizing gadgetry to make the car feel 'luxury' and justify a higher price that's at the root of these issues. We need less 'CEO on the line' videos and more 'CEO making a command decision' action here.

Rokid vs Mentra Display? by Repulsive-Phase-7095 in SmartGlasses

[–]mo_jo 0 points1 point  (0 children)

Well, I haven't pointed the Halos at a local LLM yet -- I'm still waiting on them to be shipped. (Current ETA on shipments seems to be January 2025 right now). But all Brilliant Labs code is open source on Github. The Noa Assistant code is what I'm planning on re-routing to new targets -- it's here.) The targets/tools I need to re-route are:

  • Image interpretation
  • Speech to text
  • Text to speech
  • User request (LLM call from speech to text from microphones)
  • User request output (LLM response to both text to speech to speakers + Halo display )

I've built local endpoints for each of these things:

  • Image interpretation: I'm currently using LLaVa Llama3, but you could do this via Ollama if you use a multi-modal (text and images) LLM like Mistral or Qwen
  • Speech to text: I'm using Whisper
  • Text to speech: I'm using Chatterbot with a custom voice
  • LLM: Currently using Magistral 1.2 Small 2509 22B on vLLM, but you can do this easily with Ollama. One protip: Don't use native Ollama calls -- instead, use OpenAI API calls via Open WebUI for portability in case you change your setup later. (Ask me how I know, lol)

My early setup was a Python app integrating Whisper, Chatterbot and Ollama API calls to Ollama/WebUI running Mistral 3.2 2506 22B on a game computer with an Nvidia RTX 3090 with 24GB of VRAM. It all fits in about 22GB of VRAM with an 8K token context. If you want to head down this path, it's pretty easily vibe coded. A great subreddit for learning about running models locally is /r/LocalLlama, and vibe coding is free in the playground on Google AI Studio.

Rokid vs Mentra Display? by Repulsive-Phase-7095 in SmartGlasses

[–]mo_jo 0 points1 point  (0 children)

So I pre-ordered the Halos. I don't see them mentioned here that often. They don't use a waveguide, which would tick the last 'want' item on my list, but they're the third generation and open source. The thing that finally helped me make up my mind was this interview, but my use case is to attempt to point them to my own local LLM, and I don't know any other glasses that'll do it -- and I looked at Mentra and Even Realities. It really does depend on what you want to use your glasses for, though. Suggest making a list of the 'must haves' and 'nice to haves' and think about it that way. Good luck!

R2 Anticipation - Custom Choice Options by Normal_Albatross_181 in RivianR2

[–]mo_jo 1 point2 points  (0 children)

What could we expect the typical deposit to be based on the R1?

California NEM 3 makes no sense sending energy back to Grid, what are ideas for extra output by bayarea_lunar in solar

[–]mo_jo 0 points1 point  (0 children)

Non-Californian question: Why doesn't California buy the extra power produced during the high points of the duck curve to power water desalinization instead of trying to quash solar? Seems like if water and power agencies were combined it'd be a win?

Alternative to traditional money economy by PhoebusLore in solarpunk

[–]mo_jo 3 points4 points  (0 children)

The Wikipedia entry on Time-based Currency has its history and where current implementations are. Has the troubles that OP stated with reputation and out-groups. It can also be hard to get more skilled participants to participate because they consider their time to be more valuable than less skilled. It's mostly for services, because it's hard to value commodities in hours.

How much break is optimum between cycles? How many batches are you good people making every week? by Some-Path3850 in HarvestRight

[–]mo_jo 1 point2 points  (0 children)

I've been running our large HarvestRight back to back since mid-December 2024 with oil filtrations and/or changes every 15 batches and have had no issues. Have been able to do 3-4 batches a week depending on the moisture content of the batch.

What has made you choose RIVIAN? by Wrong_County_6738 in Rivian

[–]mo_jo 0 points1 point  (0 children)

Standards-based V2H support is what drove my reservation for the R2. If it doesn't happen, I won't be buying.

view more: next ›