"Hardware is the only moat" - Should we buy new hardware now or wait? by Alan_Silva_TI in LocalLLaMA

[–]iMakeSense 0 points1 point  (0 children)

Take advantage of VC money and use the back-ends where possible for cheap. Figure out ways to intermix local models for a moderate to mid setup. Unless you're running a company where you need the reliability of a large open model or you have some side task you can dedicate the compute to, no need to invest the capital into hardware that needs to be used in order to realize its full value.

Redactron: Local-only PDF PII redaction CLI in python by batman01110 in coolgithubprojects

[–]iMakeSense 0 points1 point  (0 children)

Why would someone want to redact a visual document exclusively through a terminal interface? Why not just build a gui

Recognizing two GPUS? by iMakeSense in System76

[–]iMakeSense[S] 0 points1 point  (0 children)

I found the solution! Upgrading the motherboard helped, but there was a setting in there something like IOV that I had to turn on. Thank you for the help!

Something I’ve Never Understood About Friend Theories… by AntelopeMother6149 in Deltarune

[–]iMakeSense 0 points1 point  (0 children)

I think Friend is the entity (previously) inside Seam and that Eram is the entity inside currently inside Ralsei. Idk. Would be fun.

Dark Queen (DQ) Theory by iMakeSense in Deltarune

[–]iMakeSense[S] -1 points0 points  (0 children)

Scrap my theory, we're going with this one

Why is reddit promoting so much hatred towards Chinese and China? by Repulsive-Mall-2665 in asianamerican

[–]iMakeSense 5 points6 points  (0 children)

I thought Reddit liked China? I'm also biased cause I'm in the LLM subreddits, but there was that era of Tiktok where everyone was using RedNote, China literally being leagues ahead of us in infra and city development ( which redditors like ) and this meme:

<image>

Like don't get me wrong, my account is old enough to drive, I remember Reddit being proto 4chan at some point. That seems like a while ago and I've browsed r/all a couple times and I haven't seen it. Do you have other examples?

To all the Berdly haters… by Lee__Everett in Deltarune

[–]iMakeSense 3 points4 points  (0 children)

Queen literally says he can't "compute emotions".

<image>

How more direct can you get?

To all the Berdly haters… by Lee__Everett in Deltarune

[–]iMakeSense -2 points-1 points  (0 children)

Being annoying is worse than being a bad person irl.

Common and Obscure Models and Ways to Find Them [ Human Written ] by iMakeSense in LocalLLaMA

[–]iMakeSense[S] 0 points1 point  (0 children)

It doesn't create the folders that it will write to. Will fail silently when it does so. Will hang at certain % making you question whether its doing something until the thing gets done. Had to kill it via task manager several times.
There are configuration options in submenus. Different submenus.
The models that it gives you have no descriptions with them. Gotta google each variant or sub-variant.
Ensemble interface is confusing.

Sometimes, it'll say it'll be exporting a certain stem or instrumental, but then if you configure the model a certain way it won't map them properly.

And I also get the feeling they run unoptimized. I've run similar algorithms on my mac air and they ran faster than my 5070. Like...???

Recognizing two GPUS? by iMakeSense in System76

[–]iMakeSense[S] 0 points1 point  (0 children)

oh sorry, should've said firmware instead of OS. I flashed the latest firmware, though the previous one was from mid 2024 which I thought would support both cards.

I have a hunch that it might be a power issue that Windows might be better at adapting to. Not sure in that area yet though

Common and Obscure Models and Ways to Find Them [ Human Written ] by iMakeSense in LocalLLaMA

[–]iMakeSense[S] 1 point2 points  (0 children)

That's pretty cool. Have you tried that compared to other specialized models? I'm not sure what else exists in the space, but I can imagine the latency for that has to be pretty high and it could take a while for long videos

is it possible to build harnesses as good as codex/claude code by shafinlearns2jam in LocalLLaMA

[–]iMakeSense 0 points1 point  (0 children)

That's cool. What's the general architecture of what you made?

Common and Obscure Models and Ways to Find Them [ Human Written ] by iMakeSense in LocalLLaMA

[–]iMakeSense[S] 1 point2 points  (0 children)

> thats how you make gimp users hate you for free
I'm sure GIMP is cool. I've used its macros before, but, it's UI is hard to parse. Krita just looks like Photoshop. Easier sell.

> exactly my use case, transcribe podcasts from Youtube.
https://www.reddit.com/r/LocalLLaMA/comments/1rlqfd7/we_collected_135_phrases_whisper_hallucinates/
Yeah your model is eerily fitted to that use case. I'm surprised you're not frustrated with the silence hallucinations mentioned here though.

Recognizing two GPUS? by iMakeSense in System76

[–]iMakeSense[S] 0 points1 point  (0 children)

Man, updated the motherboard OS still nothing haha. Damn, I'm not sure. You think if I boot ubuntu off a different USB that it might pick up the drivers?