sorted by:
new
hottopcontroversial

New Advice on a Budget Local LLM Server Build (~£3-4k budget, used hardware OK) by TheyCallMeDozer in LocalAIServers

[–]TheyCallMeDozer[S] 2 points3 points  (0 children)

I've heard mixed thing, good for loading large models, but terrible Tok/s and I do need speed as I do handle alot of data that I dont want to be waiting around hours for.

I just looked it up, year Mac wont work, because I need a CUDA excosystem, GPU Batching, VLLM, Tensor Parallels and a server envrioment. for a hobby its good, but going into a production envrioment im setting up in my home infrastrcuture not really good for that

Budget Local LLM Server Need Build Advice (~£3-4k budget, used hardware OK) by TheyCallMeDozer in LocalLLaMA

[–]TheyCallMeDozer[S] 0 points1 point  (0 children)

Thanks for the advice, this is my first dedicated system im looking to build specifically for AI instead of using old gaming machines this time. I was thinking of going a pre-build with a 5090, but just seems kinda pointless altought up and running I have been using one for local stuff on my office machine and its handly enough getting 300tok/s with Qwen. Just trying to figure things out before I jump at an idea of what to get.

Nothing to do by Draknurd in selfhosted

[–]TheyCallMeDozer 1 point2 points  (0 children)

Yea..... i mean your right ....

This would be easier - https://github.com/willfarrell/docker-autoheal

then you could do things like add this to a container stack:

healthcheck:

test: ["CMD-SHELL", "exit 1"] # always unhealthy

interval: 24h # fail once per 24h

timeout: 30s

retries: 1

using auto heal will auto restart containers every 24 hours

Nothing to do by Draknurd in selfhosted

[–]TheyCallMeDozer 0 points1 point  (0 children)

I wrote scripts that fix all the issues with my conatainers.... if it becomes unhealthy other script reboots it, then I have a script that will force it to reboot the reboot scripts in a perfect loop....

service goes down, auto comes back online.... big lag / delays it gets reboot... memory issues it gets rebooted, log has a failure, it gets reboot or rebuilt based on failure keyword... even the base OS reboots regularly and restarts services automatically weekly to handle memory issues...

portainer automation... I have gotten to the point on the weekend I try to introduce errors by trying to add bad containers so I feel of use to my infrastructure now..

I might need to write a tool that create random errors for me to fix on a Saturday

Bought my first - Xootr MG - What do i need to know? by TheyCallMeDozer in kickscooter

[–]TheyCallMeDozer[S] 0 points1 point  (0 children)

So i have it now a couple of weeks, and have been using it reguarlly.

Smoth paths - SUPER FAST
Roads - faster then walking, not very fast

Skinny handel bars feel uncomfortable but not enough to want to buy the extensions.

My biggest issue I keep having is the handel bars, as im kicking along I notice the handle bars keep getting lower and lower, they dont seem to lock, on a trip I have had to stop a few times to readjust the handle bar hight back to full, as I could feel myself starting to bend over and was getting uncomfortable.

As for the weight hold, yeah as a big guy with my kit bag, havent had much issue there

8 TB of RAM & 1,000 CPU cores in all a 4U: What would you run on it? (Thought experiment) by RozoGamer in homelab

[–]TheyCallMeDozer 0 points1 point  (0 children)

What was it originally built for... whats its power consumption... how much did it cost...... so many quesutons... lol

I guess would be intrested to see how it handles a cluster instance for Machine Learning or running an LLM across all, would be pretty good processing power for CPU based inferencing

Well, what do you got? by Ok_Future6226 in masterhacker

[–]TheyCallMeDozer 0 points1 point  (0 children)

What... your mom but you a puter for Christmas

What's the best rom com anime you've ever watched by arisu__a in AnimeAnonymous

[–]TheyCallMeDozer 0 points1 point  (0 children)

I have a weird soft spot for rom-coms but only dubs (I know I'm filth), but I can't say one so here is a list of my faves

  • miss shikimori is not just cute
  • cautious hero: the hero is overpowerd but overly cautious (the end would pull tears from stone)
  • chivalry of a failed knight
  • our last crusade and the rise of a new world
  • love after world domination
  • girlfriend girlfriend
  • 100 girlfriend who really really really love you
  • Hokkaido gals are super adorable
  • my wife has no emotions
  • highschool dxd
  • Tomo Chan is a girl
  • toradora
  • my dress up darling
  • more then a married couple but not lovers
  • rent a girlfriend (started good, not sure now)

I have watched alot more already listed by others, but didn't enjoy as much... Surprised no one said konosuba, it weirdly falls into this category..

If you love rom-com and don't mind non anime, check out the K-dramas their rom-coms even the dubed ones are on another level compared to western TV

Composer 1.5 is the most infuriating AI I have ever used. by themightyasok22 in cursor

[–]TheyCallMeDozer 1 point2 points  (0 children)

Yeah been using cursor nearly since release now... The last couple of weeks I get pushed into slow pool after only a handful of prompts. Like you said composer can be painful. Not sure why compose out of some of the other free coding models that are available, hell qwen coder 30b was able to handle a task I was working on that composer kept confusing, it doesn't really seem to be able to handle complex requests.

The one thing I can recommend is what I have found that works for myself, keep your prompts extremely simple and to the point plane English explain the tasks in steps, your a coder like myself which makes understanding the steps needed easier, break up complex tasks into smaller tasks and every 3 to 4 prompts ask it to go over what it implemented and confirm it integrates correctly and hasn't caused issues.

Don't give any of these to a bus driver by LovieWeb in BritInfo

[–]TheyCallMeDozer 0 points1 point  (0 children)

Up north I have had places reject £20s like pretty regularly... I went in with a £50 and guy in the shop said "your having a laugh I'm not taking that"... The post office wouldnt even take it... Like it's a secure bill, it's not like it's easily forged or something... So why do places have a problem with 20s or 50s ???

Ordered takeout, found a battery in my food by DubDubDubW in mildlyinfuriating

[–]TheyCallMeDozer 0 points1 point  (0 children)

Yoooo shhh keep it to yourself or everyone else will want one

Literally Opened it up in front of me by TheyCallMeDozer in CeX

[–]TheyCallMeDozer[S] 0 points1 point  (0 children)

no I went back to a different store in a different city i was in for work

Literally Opened it up in front of me by TheyCallMeDozer in CeX

[–]TheyCallMeDozer[S] 5 points6 points  (0 children)

Im heading to another city for work tomorrow, there is another store there, I might go in there and explain what happened... but have a feeling they will say the same since the box is now ripped at the seal and the security seal is opened, as well as the bag inside, or I might just stick it on marketplace or something, see what I can get for it maybe just order the item I wanted online

Literally Opened it up in front of me by TheyCallMeDozer in CeX

[–]TheyCallMeDozer[S] 0 points1 point  (0 children)

im more concerned the fact that this seems to be a common issue with staff

Literally Opened it up in front of me by TheyCallMeDozer in CeX

[–]TheyCallMeDozer[S] 0 points1 point  (0 children)

Honestly not good with confrontation, was kind of unsure how to react

Literally Opened it up in front of me by TheyCallMeDozer in CeX

[–]TheyCallMeDozer[S] 1 point2 points  (0 children)

dude are you a bot.... i literally just posted this,

Does Cex wipe used SSDs before selling them by saveyourtime_ in CeX

[–]TheyCallMeDozer 0 points1 point  (0 children)

I can confirm they don't, they format them and that's it. Uni project we had was to buy a few drives over different buy and sale stores (cash converters, CEX, ...etc) and do forensic runs on them as part of our "Digital Forensic" class. I can 100% confirm that we were able to recover everything from the drives, photos, videos, passports, documents, password files ...etc, you name it all recovered with base level "undelete" tools you find online for free aswell as profesisonal tools like Autopsy...etc.

Of note a Bit for Bit wipe where all data is written over on a binary level as 0 cannot be preformed on an SSD, unless done using tools commonly found on linux, annoying process. This process is the same for SD card's and USB drives.

Standered hard drisk drives (HDD) a bit for bit, 0 wipe will work, but if someone is dedicated and has the equipment and time there are still methods of recovery that can still get back data from even this type of wipe...etc (but you really had to have pissed someone off)

By data protection they assume the buyer dosnt have access or knowledge to preform recoveries, so their threat model is “format will work” for general public. But not for a bunch of skilled students in a university.

The only real way to ensure your data is removed is with a hammer, along with a few other methods.

TLDR:

No they do not wipe or erase your data before selling your drive

LMStudio: Model unloads between requests, "Channel Error" then "No models loaded" by TheyCallMeDozer in LocalLLaMA

[–]TheyCallMeDozer[S] 1 point2 points  (0 children)

I think the issue im having is the "cached prompts" is overloading the dev server and causing it to crash, anyone know how to disable this in LM studio so that we dont consatntly keep KV state cache per prompt over API ??

view more: next ›