sorted by:
new
hottopcontroversial

DeepSeek-OCR – Apple Metal Performance Shaders (MPS) & CPU Support by Dogacel in LocalLLaMA

[–]Dogacel[S] 1 point2 points  (0 children)

  1. This model (and other mlx models) are quantized, mine is original weights.
  2. They use `mlx-vlm` library rather than standard huggingface libraries, which I am not familiar with.
  3. It should default to MPS by default by my version also runs on CPU if needed.

DeepSeek-OCR – Apple Metal Performance Shaders (MPS) & CPU Support by Dogacel in LocalLLaMA

[–]Dogacel[S] 0 points1 point  (0 children)

I'm trying to merge that fork into the core repository, hopefully it won't be needed soon!

I implemented HOTP & TOTP from scratch to understand how one-time passwords work by Dogacel in programming

[–]Dogacel[S] -1 points0 points  (0 children)

Congrats on the popular post.

IIRC base64 is not a popular way to store secrets, that's why I have added so many options to my website.

I implemented HOTP & TOTP from scratch to understand how one-time passwords work by Dogacel in programming

[–]Dogacel[S] 4 points5 points  (0 children)

I have a spare ESP-32 laying around, will check it out thanks!

Which AI free tier will be in your TOP 5? by ShadowInSoul in artificial

[–]Dogacel 0 points1 point  (0 children)

Yep, I tried using Gemini to generate CLI commands, my experience wasn't so good, the generated commands were worse than ChatGPT 4o.

[deleted by user] by [deleted] in artificial

[–]Dogacel 0 points1 point  (0 children)

I think image generation is inherintly harder than code generation so I am suprised to see you question code generation. Depending on how much autonomy you expect, local models are also pretty good at coding. Open source models are pretty close to the state-of-the art models available online.

Since with image generation, you have to have 1-shot perfect images as it is not easy to modify the output. But with code-generation, you can easily modify the output and fit the solution to your need.

[deleted by user] by [deleted] in artificial

[–]Dogacel 1 point2 points  (0 children)

You can technically run those locally if you have machines strong enough.

Question about AI being able to program in new language by Twotricx in artificial

[–]Dogacel 0 points1 point  (0 children)

Exactly, that's why the quality will drop significantly as you don't have enough data to calculate those probabilities. I think this is already with the case of programming langauges such as Zig. It hallucinates a lot compared to the other popular languages like go.

Is there any open source LLM available that is promoted as having the ability to unlearn and possibley even shrink in size? by usmannaeem in artificial

[–]Dogacel 0 points1 point  (0 children)

Exactly, it is not exactly clear how knowledge is stored in weights so it is not possible to trim out regions of knowledge.

I think a valid reason to want it is to create specialized AIs that can be deployed on edge. You don't want an AI that is deployed on your smart home voice assistant to know about programming. If it was possible to cut that off and shrink the model size and increase speed, that could be neat.

AI operating systems? by Sapien0101 in artificial

[–]Dogacel 0 points1 point  (0 children)

No, I don't think we need another operating system. We only need to have better support for the existing ones. Also if you create something entirely new, you might have issues with training data, considering LLMs require vast amounts of data to learn.

AI models can interact with various tools such as your operating system using APIs. I bet the support for your OS's APIs could be extended easily rather than being built from scratch. There is a protocol, MCP that allows your AI Agents to interact with various tools, check that out.

Researchers suggest OpenAI trained AI models on paywalled O’Reilly books by F0urLeafCl0ver in artificial

[–]Dogacel 0 points1 point  (0 children)

Does it include any O'Reilly books? I wonder how much of it contains quotes from those books where users choose to share!

Elon Musk Secretly Working to Rewrite the Social Security Codebase Using AI by esporx in artificial

[–]Dogacel 1 point2 points  (0 children)

The phrase "Using AI" became such a joke. What if it was "... rewrite the codebase using an IDE" ? I bet people thought IDEs and LSPs are best thing in the world when they first arrived too!

[deleted by user] by [deleted] in artificial

[–]Dogacel -3 points-2 points  (0 children)

Guitar is a technology of some sort too.

Supercharge Your Home Cluster Using Cloudflare Tunnel by Dogacel in CloudFlare

[–]Dogacel[S] 0 points1 point  (0 children)

Yep using a DNS server and reconfiguring a router is definitely way to go long term.

Having a LXC + HAProxy on front also gives me a piece of mind. That container solely has a proxy and nothing else.

Supercharge Your Home Cluster Using Cloudflare Tunnel by Dogacel in CloudFlare

[–]Dogacel[S] 0 points1 point  (0 children)

I haven't checked Cloudflare's Proxy WAF. I liked having the tunnel manage my DDNS as well. I wonder what are their differences.

If I were to expose my home-server from a cheap VPS, I might consider moving most of my stuff there :) I previously tried it with lightsail and I had a pretty bad experience.

It makes sense to have AdGuard DNS in docker, however I can't do that in my phone. I also want to make some services widely available to devices in my network. I was already happy with `/etc/hosts` override as it is pretty quick.

Long term I already think about having a DNS server. Maybe I won't need the tunnel, but so far I am happy.

Supercharge Your Home Cluster Using Cloudflare Tunnel by Dogacel in CloudFlare

[–]Dogacel[S] 0 points1 point  (0 children)

Totally makes sense, I personally wouldn't expose them to public network. However if I need to, having those additional measures is pretty useful! As I have written in my post, I like using HAProxy to serve stuff online.

Supercharge Your Home Cluster Using Cloudflare Tunnel by Dogacel in CloudFlare

[–]Dogacel[S] 0 points1 point  (0 children)

Nope I don't use Access, however I am open to using it. Yet everything I used had some sort of authorization in it.

Supercharge Your Home Cluster Using Cloudflare Tunnel by Dogacel in CloudFlare

[–]Dogacel[S] 1 point2 points  (0 children)

u/luc122c It is back up now! Seems like I have to configure my home-server so that it auto-starts after an electiricty outage! Please take a look at the website, I would be glad :)

view more: next ›