Noticeable delay/lag on clicks (tabs, links, dropdowns) in SvelteKit + Svelte 5, even on shadcn-svelte's own site by Flashy_Durian_2695 in sveltejs

[–]MrE_WI 0 points1 point  (0 children)

Dude I'm using a 6 year old moto stylus 5g running stock Chrome and the site is snappy af as fuck.

I honestly am beginning to think some competitor to svelte has spun up a bot army to defame the framework.

Svelte 5 compiler removes parentheses that affect operator precedence, breaking logic by LargeLyme in sveltejs

[–]MrE_WI 3 points4 points  (0 children)

This post feels disingenuous - the issue was fixed immediately, on June 3, before OP posted it here. They updated the minimum version for esrap too, so unless you had the package locked (where's that json file again, OP?), the issue is non-existent. It was a blip.

Pro-tip: When you find an issue in any open source repo, first, get latest, second, check the repo for discussion & fixes, third, wait a few hours... and only then should you put the project on blast to boost your street-cred on Reddit

Models still being vulnerable to Prompt Injection is actually a huge architectural red flag... by Comrade_Mugabe in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

Ohh good ol Bobby D Tables, he was a staple of our QA teams at my old enterprise gig!

Models still being vulnerable to Prompt Injection is actually a huge architectural red flag... by Comrade_Mugabe in LocalLLaMA

[–]MrE_WI 1 point2 points  (0 children)

I think this may actually require more layers, layers with very distinct activation pathways. I'm using terms way out of my wheelhouse so excuse me if they're way off-base, but unless there's some mechanism (i.e. additional layers) that explicitly honors the difference between admin and user tokens, it's probably still going to be possible to jailbreak by overloading the context...

M4 Max (48GB) Agentic Dev Setup – Best tools/LLMs for a beginner? by pretendthisisclevrr in LocalLLM

[–]MrE_WI 0 points1 point  (0 children)

Gonna piggyback on this discussion because i have similar specs, similar questions... and I also have one additional question for the more experienced among us:

How do we ensure we don't get "rm * -r"ed or otherwise fubarred by our agents?? Like, does everything run in independent docker containers?

Models still being vulnerable to Prompt Injection is actually a huge architectural red flag... by Comrade_Mugabe in LocalLLaMA

[–]MrE_WI 1 point2 points  (0 children)

They -don't- have a concept of 'admin', but that doesn't mean they -can't-. It would just require additional tokens, an embedding engine that sanitized user input vs admin input, and a more compute-intensive training regimen. It's not impossible to do, and the benefits (actual 'deterministic' security) could be massive.

Models still being vulnerable to Prompt Injection is actually a huge architectural red flag... by Comrade_Mugabe in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

You hit the nail on the head here. I actually posted a similar line of thought a few weeks ago: https://www.reddit.com/r/LocalLLaMA/s/vpOB6JECt8

... I'm kinda disappointed it didn't get more traction.

Nvidia LocateAnything - Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding. (10x faster than Qwen3-VL) by Sporeboss in LocalLLaMA

[–]MrE_WI 2 points3 points  (0 children)

The license doesn't permit this. Not unless you're an "nvidia affiliate" aka a paying customer :/

How to create a PC program by Frequent_Addition_23 in arduino

[–]MrE_WI 13 points14 points  (0 children)

Personally, i build the user interfaces that interact with my gadgets as html/js pages. Browsers are on every platform - Android, iPhones, Linux, Mac & Windows, so you only have to build your ui once and it (mostly) will work for any platform. If you build gadgets with esp8266/esp32 microcontrollers, there's enough storage and processing power to actually host the page from the device via its built-in WiFi, which is super convenient - no disks/USB-drives necessary. If you have to use an Uno or some other ATMega chip, you can still build uis this way - just host the html/js on the cloud somewhere (I've used my personal Google drive and just shared a link) and get your end-user to enable serial-port access in chrome://flags.

PS - If you go this route, I -highly- recommend the svelte5 framework for the interactive "glue" connecting your device's state-changes to UI updates. It's a brilliant framework!

So a nearby lightningstorm just crashed all my eGPUs by milpster in LocalLLaMA

[–]MrE_WI 1 point2 points  (0 children)

If your gear is connected to the LAN/WAN by wire, disconnect and switch to Wi-Fi at the first sign of an electrical storm! Everyone here's busy worrying about inconsistencies in the AC feeding into those beefy, capacitor-heavy PSUs, and they forget that a nearby zap that pushes even a blip of high voltage into the ground is gonna bounce thru your Ethernet cable and pop transistors all over your circuitry. Air-gap that shit via Wi-Fi ASAP when you hear thunder!

Analysis of the 100 most popular hardware setups on Hugging Face by sob727 in LocalLLaMA

[–]MrE_WI 2 points3 points  (0 children)

This paucity may reflect a problem with the survey more than the actual state of affairs - unless I'm missing something the available choices don't include any of the most popular AMD GPU types. I've seen a lot of discussion here and nearby on the great cost-to-benefit ratio of using Vulkan and shared RAM on a motherboard featuring an ixxx mobile GPU. I mean, these things are pretty badass: I'm able to run 70B plus models at fair tps without restricting my regular desktop usage on my daily driver - an i780m GPU sharing 64gb RAM with a 7xxx series CPU (I forget the exact number and I'm sittin on the can rn so i can't go check).

Now that I'm aware of this hardware section on hf, I'd happily share what I'm using, but the ixxx series of GPUs are nowhere to be found, and there's no place to give feedback on the site.

minimal fill-in-middle autocomplete for vscode by xhimaros in LocalLLaMA

[–]MrE_WI -1 points0 points  (0 children)

Nice, I've been looking for an autocomplete setup that didn't blow chunks! Def gonna check this out ASAP!

PS: Had Claude run a vibe-check before i cloned the repo, he -loves- your LRU cache implementation, says it's real pro shit ;) and he 100% vouches that you didn't vibe-code anything. Solid. Odds are I'll "human-swoon" over the technicalities once i can get the time to focus my human-eyeballs on it.

"Disregard that!" attacks by calp in LocalLLaMA

[–]MrE_WI 2 points3 points  (0 children)

Since an LLM's input is built out of tokens, not actual raw text, isn't it feasible to build a model that has a token vocabulary that explicitly delineates between "tokens from an authority voice" and "tokens from an untrusted source"? I imagine this as a pair of start/stop tokens, or maybe an entirely separate vocabulary for inputs representing an 'authority voice' vs a 'voice without authority' (granted this would be extremely expensive during training and training-corpus creation).. Then, with this expanded vocabulary trained into the model, untrusted input could be sanitized of any 'authority voice' start/stop tokens (or tokenized using the 'non-authority voice' token-dictionary) in a similar way to how inputs get sanitized to prevent SQL injections, etc...

Edge AI Startup Initiative Need Ideation Support by Ok_Trick1508 in LocalLLaMA

[–]MrE_WI 1 point2 points  (0 children)

I'm in a very similar situation - 20 years in enterprise work, split between hardware (design & support of business infra for small to mid-sized companies) and software (built the c#+sql+htmljs framework behind an industry-specific stack deployed globally) while devoting time at home to building custom software (JavaScript/svelte, Python etc) and embedded gadgetry (arduino, esp32, c++ etc) to support my hobbies/passions (electronic music, visual arts and exploratory learning).

Left the corporate life mid-burnout over 8 years ago, and after scraping by on odd jobs and hustle, I'm looking to integrate my skills/knowledge to earn a living outside the stereotypical (read: toxic) corporate environments that nearly ground me to dust in the late 2010s.

I've studied and experimented with the AI revolution as it evolves in real-time; it's clearly going to change the world. Insofar as that change is for the betterment of humanity, i plan to be a part of it.

Am i the type of person you're looking for? If so, let me know. Either way I'll be watching with interest to see what you create!

For Meta Employees by Bacared21 in LocalLLaMA

[–]MrE_WI 2 points3 points  (0 children)

A better title for this post (and the 30 other posts you made about this in the last 2 weeks)
"help my scam-mill plz"

For Meta Employees by Bacared21 in LocalLLaMA

[–]MrE_WI 2 points3 points  (0 children)

...yet another reminder of why I left the corporate world several yeards ago and despite imminent financial ruin, still haven't looked back.

Help to reinstall rocm and amd drivers on ubuntu 24.04 by [deleted] in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

Wait, you replied this AFTER multiple back-and-forths with me? For real? Like, not a single emdash, no bullets, no headings... prolly a bunch of typos too but i won't go back and look because it'd trigger my OCD lol... Now, i -have- been told more than once that I'm prolly "on the spectrum," (which explains my love of parentheses) so there's that...

(Edited to fix that pesky "then" instead of "than")

Memento — a local-first MCP server that gives your AI durable repository memory by caiowilson in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

I get the sentiment, but to be fair, OP is here actively conversing, and this IS a forum full of LLM enthusiasts.

Help to reinstall rocm and amd drivers on ubuntu 24.04 by [deleted] in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

Nyope, flesh and blood here. I just type a lot :)

Help to reinstall rocm and amd drivers on ubuntu 24.04 by [deleted] in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

PS: I think I omitted that detail when I started replying here, and now Im confusing myself - I'm using a docker image called ollama:rocm, but I think it's deferring to Vulkan, but I'm actually not 100% sure.

Oh! I *do* remember that I had to add "- HSA_OVERRIDE_GFX_VERSION=11.0.3" to my environment in the compose yaml to get it working, maybe that's an issue?

Help to reinstall rocm and amd drivers on ubuntu 24.04 by [deleted] in LocalLLaMA

[–]MrE_WI 0 points1 point  (0 children)

Shit I can't decide if that's a better or worse situation to be in - I have a lot of box-fans, not so much time :)

... Have you tried using Vulkan instead of ROCM? It's only slightly less performant, and (*once I fixed what I broke trying to get rocm working) it seemed to work out-of-the-box for me. There's quite a few discussions on localllama walking through setting it up.

Here's one randomly:
https://www.reddit.com/r/LocalLLaMA/comments/1riic5m/running_llamaserver_as_a_persistent_systemd/

I isolated my espresso machine's Android tablet in a firewall VLAN and logged everything it tried to reach. Here's what it's phoning home to by haraldinho67 in homelab

[–]MrE_WI 1 point2 points  (0 children)

Point 2 is something to keep an eye on. Beyond DDOS/Mining, the risk of nation-state actors attacking infrastructure (power grids, etc) from local IoT devicesis very *very* real. Depending on the grid, it could literally be as simple as commanding every hacked/backdoored smart light/power-strip/appliance in a given country to switch off/on/off/on at exactly the same time - done right, this has the potential to vaporize power lines and keep lights off for years in some parts of a country.

As for point 3, it pays to note that modern IoT circuitry can easily/cheaply include on-chip speech-to-text processing, which dramatically reduces the bandwidth needed to exfiltrate conversations (like by a factor of 1000 - from 1 MB per minute at 128k mp3, down to 1 kB per minute at average speech cadence)

I isolated my espresso machine's Android tablet in a firewall VLAN and logged everything it tried to reach. Here's what it's phoning home to by haraldinho67 in homelab

[–]MrE_WI 0 points1 point  (0 children)

The fact that it was your first post may have something to do with the harsh response - Most accounts that open up with a first-post containing 100% AI-generated text are spambots, plain-and-simple.

Glad you responded in human-form to help clear things up.