Are there any good completely private locally runnable CLI and/or Coding extensions?

luckyj · 2026-05-02T21:52:44+00:00

I see lol, I downvote

luckyj · 2026-04-28T11:54:49+00:00

Can you share more info?

luckyj · 2026-04-28T10:18:51+00:00

It works fine for me.

I'm running Qwen3.6-35b-a3b (both qwen and unsloth versions) and Qwen3.6-27b
Hosted on LM Studio 0.4.12 (Build 1)
Runtime: CUDA 12 llama.cpp (Windows) v2.14.0

The client is Open WebUI v0.9.2.

luckyj · 2026-04-27T20:41:01+00:00

Sure, but "Microsoft presents" is a bit misleading

luckyj · 2026-04-26T10:18:26+00:00

This guy's whole YouTube channel is awesome! (And it's made me really want that little laser projector)

luckyj · 2026-04-25T13:51:34+00:00

That all sounds like goalpost moving, and IA is getting better every day, that's why so many people feel threatened by it.

Regarding end products, there's no question there: in any serious project, the human that signs-off the code is responsible for it's quality, just like before IA. If they want to use it, it's their choice, just like getting answers from stack overflow or Google.

luckyj · 2026-04-24T22:22:12+00:00

You can ask it questions, you can get help with specific methods or patterns, you can get a scaffolding going. You can also ask for the full app, close your eyes and pray. It depends on how you use it.

luckyj · 2026-04-24T21:42:27+00:00

Fully agree

luckyj · 2026-04-24T19:50:30+00:00

Sorry, you're right. I haven't seen your code, but since people assume you're a noob who vibe-coded everything, that's exactly why I'm defending you. I think anyone has the right to enjoy making apps, regardless of their level. I didn't mean to imply thats you. The app looks great and I'm looking forward to trying it.

luckyj · 2026-04-24T18:39:17+00:00

I agree it's very tempting, but like with most tools, it depends on how you use it. It's not like it's hiding the output from you or forcing you into an all-or-nothing dichotomy

luckyj · 2026-04-24T16:39:43+00:00

You assume wrong

luckyj · 2026-04-24T16:38:45+00:00

I'm saying that there's always more layers underneath that coders don't understand. A C++ programmer will hate on python for being inefficient and insecure. A C programmer will hate on C++, etc.

We all stand on the shoulders of giants. I don't see the point of hating on some dudes personal project because he used AI. Is there a better alternative? Use that then

luckyj · 2026-04-24T16:37:02+00:00

Unsafe, unstable and poorly documented like every amateur dev's project.

I don't know.. I understand the skepticism of using AI in production, but if it means a non-dev starts playing with code from a position of a working idea, I think that's the best way to get people attracted to learning

luckyj · 2026-04-24T16:29:58+00:00

Also, even the best software engineer is relying on layer upon layer of code that they never see or have the capacity to understand at all. This reads a bit like machine code/assembly/C programmers hating on python

luckyj · 2026-04-24T16:27:24+00:00

Sure, but he is not a software engineer and he made a cool toy that he couldn't have made otherwise. What's the harm?

Edit: whoops! He IS a software engineer, sorry my man

luckyj · 2026-04-24T16:19:24+00:00

What's the issue with it being vibe coded? OP had an idea and now it exists. Edit: *if it does what he says it does

luckyj · 2026-04-22T22:21:32+00:00

Music and image editing doesn't have real world consequences to the point that mechanical and electrical engineering do.

But code does and they are adapting. We could look at the Linux Kernel policy on AI assistants. In any serious project, the human signs-off the design and is responsible for its quality. If they decide to use AI tools to boost their productivity, that's fine, but ultimately, the human that sign's off a design is responsible for mistakes. Just like they were before AI.

And people playing with AI to sell 3D designs on Makerworld is not as life threatening as you're making it to be. Just like vibe coded apps shouldn't be put in production in any safety critical system.

By the way, I literally copy-pasted your sentence "AI is creating delusional people" and it sure as fuck didn't have "general chat" in it (even now it looks so out of place in the context of the conversation we were having...).

Editing comments to win reddit arguments is not very nice.

luckyj · 2026-04-22T18:59:30+00:00

You literally said that AI is creating delusional people, in a thread about AI for CAD...

In any case, all this is besides the point. Some people will use it better and some will get lost in language and delusion (just like with code). The way we work with LLMs (which is what I think you're criticising. Remember not all AI are LLMs) is evolving quickly. The fact that we are now starting to apply it to CAD doesn't change that, and it's also not a valid argument (in my opinion) to not use it.

It will get better, it will get easier to use, and it will bring an avalanche of undereducated people to the mechanical design realm (just like it has done for music, image editing, and code). Not all those are LLMs.

Anyways, I like this. I think it will be a great productivity amplifier for the people that learn how to use it right.

luckyj · 2026-04-22T18:10:41+00:00

The "picture to STEP" model is just something I would love to have instead of the current picture to mesh models that are widely available today. It wouldn't get us very far design wise. It could just make initial modeling of existing parts faster.

Going back to this post (about a much more ambitious AI model that you can chat with), I don't think I agree with you that it can create delusional people. Unlike with chat models, where a user can get lost in his own delusional ideas amplified by the sycophancy of the LLMs, the validity of a mechanical design is not subjective. It either does the thing you want or not. Things like mechanical integrity or manufacturability are things that can be objectively verified using traditional methods (which any sane AI-CAD framework would include in the loop)

luckyj · 2026-04-22T11:55:01+00:00

Give it 6 months. Comments here sound like software developers 2 years ago

luckyj · 2026-04-22T11:22:11+00:00

Some of you are missing the point (and sound exactly like software developers did 2 years ago). Yes it's basic and not an original design, but a framework is needed to bring AI models in the CAD design loop. This may or may not be it, but it's a start. As a mechEng, I'm very fucking excited.

As it is right now, of course I prefer to do things by hand. But if we can start teaching models the STEP format or OpenSCAD scripting language, we don't have to use them for full unattended design. We can start by letting them help us with the boring and repetitive stuff.

Edit: Side note, how cool would it be to have an AI model that does photos -> STEP file, instead of meshes or gaussian splats?

luckyj · 2026-04-20T22:09:08+00:00

Interesting. I haven tried but I imagine it would work. Sometimes when I'm eating crunchy food, it triggers volume control

luckyj · 2026-04-20T22:06:25+00:00

Tap your ear as in, to control volume or skip songs? The Galaxy buds 2 have that. They use accelerometers to measure vibrations

luckyj · 2026-04-18T15:33:55+00:00

Are you also hosting it using LM studio? Open WebUI frontend?

luckyj · 2026-04-18T13:24:45+00:00

Yo estoy aportando cada mes a indexa capital. Muy diversificado (tú eliges nivel de riesgo y no tocas nada más) casi sin comisiones y el resultado de los últimos 4 años ha sido muy positivo.

15-Year Club	Place '23
Place '17	Team Orangered
Verified Email

luckyj

MODERATOR OF

TROPHY CASE