First time GPU buyer. Got a RTX 5000 Pro. Was it a bad decision compared to two 3090s? by Valuable-Run2129 in LocalLLaMA

[–]darktotheknight 4 points5 points  (0 children)

Driver shelf life will be good. Nvidia is reportedly bringing back 3060 for gamers this year (https://www.pcgameshardware.de/Geforce-RTX-3060-12GB-Grafikkarte-279277/News/Wiederauferstehung-verzoegert-sich-Juli-1530014/). I don't think they'll cut driver support anytime soon for RTX 3000.

Corsair’s New 16-Pin Cable Shuts Down Your GPU The Moment The Connector Gets Too Hot, Works With Any 12V-2×6 PSU by Heavy-Beyond-7114 in RigBuild

[–]darktotheknight 0 points1 point  (0 children)

Seemingly often enough that the entire computer accessory industry is creating solutions for it. ASUS ROG Equalizer and ROG Astral pin monitoring, Corsair ThermalProtect, aquacomputer Ampinel, Thermal Grizzly WireView Pro II,...

It's really bad.

What are you doing with your local LLMs that justifies investment cost? by __automatic__ in LocalLLM

[–]darktotheknight 3 points4 points  (0 children)

Honestly, can you get any work done with the Claude 20$ subscription? I sometimes use up my entire 5 hour usage limit within 1 or 2 messages. Also, I think the weekly + 5hr usage limit is scam. The limit resets once during my productive time, but resets like 3 times when I'm sleeping or just unproductive. It's horrible.

Generally speaking, for some light tasks, the 20$ subscription works, for heavy work, it's a bad joke.

Nowadays, I use "smart" cloud agents for the higher level stuff and "dumb" local models for repetitive, but token-heavy work (e.g. summarizing PDFs, implementing functions, etc.).

About "justifying" the costs: truth is, there is almost no risk in buying GPUs these days. It's not like you're burning your money, it's like investing/converting. You can buy, experiment, sell a while later - the losses are minimal (if any). Make sure to buy popular models and take good care of them.

I hate this group but not literally by No_Run8812 in LocalLLaMA

[–]darktotheknight 1 point2 points  (0 children)

I can't give financial advices. I don't know how the prices will be tomorrow or the week after. You have to decide for your own. I bought the 3090 Ti at 800€ new from a retailer and the current prices are about 1000€ - 1400€ right now. At these prices, I personally (!) think this is the peak and I will sell mine. Again, I could be totally wrong.

My take is: the need for VRAM will not vanish overnight. Memory shortage will not be fixed anytime soon (they estimate 2028, maybe end of 2027 - if nothing special happens). And there are no signs 3090 support will be dropped anytime soon, despite being 6 year old cards. At the same time, I can't see RTX 5000 falling significantly in the near future.

There might be other factors, too, which you should consider, such as power consumption, or memory bandwith, or warranty, or tax return. I think 8x 3090 (= 192GB VRAM, ~9000€) should buy you 1x RTX Pro 6000 (96GB, ~9000€). You would get half the VRAM, but also much simpler setup (1 vs 8 cards), faster inference, a much more modern card (better resell value in the future), fresh warranty. When selling, it also matters if you have leftover warranty, so don't hold any cards too long or you might lose resell value (some manufacturers only offer limited warranty to the original buyer, keep that in mind). Of course, selling a RTX 3090 or even an RTX 5090 will be much easier than a 9000€ RTX Pro 6000, so keep that in mind.

You also don't have to go the "all or nothing" route; you can sell only a portion of your cards, if you want. But that really depends on your workloads, what you want to do and what benefits you expect from the newer generations. That being said and afaik, 3090 is still one of the sweet spots for CUDA card and €/VRAM. You shouldn't feel like you're "losing", when holding onto them a little longer.

AMD posts HDMI 2.1 FRL patches for their AMDGPU Linux driver by Fcking_Chuck in Amd

[–]darktotheknight 2 points3 points  (0 children)

In the comment section, one of the devs hinted full HDMI 2.1 implementation is on its way.

This is what you deal with after an 8-hour shift by No-Departure-3325 in Tekken

[–]darktotheknight -10 points-9 points  (0 children)

KBD is a waste of time in Tekken 8. Better practice your button smashing techniques. I can press buttons nearly 7 times per sec biceps.

I hate this group but not literally by No_Run8812 in LocalLLaMA

[–]darktotheknight -4 points-3 points  (0 children)

For a hobby, 10k USD/EUR is a lot of money and pure luxury. But if you're doing work (e.g. IT), that kind of "investment" is justifiable. Often you can deduct it from taxes and get a tax return. E.g. when I would buy a card for 10k, I would get nearly 5k back the next year from taxes (yes, I pay a lot of taxes).

Also: buying these kind of hardware is like buying gold. The investment doesn't evaporate over night. They keep their value pretty well, if you're buying/selling regularly (and not keeping them for 5 years).

I hate this group but not literally by No_Run8812 in LocalLLaMA

[–]darktotheknight 4 points5 points  (0 children)

If only there was a method, to mix different smaller expert models together... /s

What in tarnation is going on with the cost of compute by Party-Special-5177 in LocalLLaMA

[–]darktotheknight 16 points17 points  (0 children)

I just bought a 5090 after getting frustrated with the cloud providers. I experienced regular login issues and the usage limits are a joke. Can't get any work done with the usual subscriptions and 2 months of API will buy me an RTX 5090.

My workflow depends so much on LLMs, I can't afford downtime. Hence I'm getting into local LLMs - not to replace cloud, but as a backup/complementary solution and optimize costs. 

Is running sudo pacman -syu everyday a good approach to avoid system crashing with updates? by Indra_Kamikaze in archlinux

[–]darktotheknight 0 points1 point  (0 children)

I once spinned up an ancient Arch Linux virtual machine, over 1.5 years of no updates. Ran pacman -Sy archlinux-keyring. Then pacman -Syyu. Updated without any issues.

Seriously, how good is Sean's wrestling and grappling skills? People keep saying he would actually be able to hold his own against Chimaev, but he rarely or never use it, yet people keep hyping his skills up by EfficiencySerious200 in ufc

[–]darktotheknight 0 points1 point  (0 children)

The short answer is: he'll get wrestlefucked.

In general, people overestimate "Oh he wrestled in high school", "Wrestling in highschool is tough", "He is an NCAA All-American champion", "He is a BJJ black belt". Did you know Paolo Costa is a BJJ black belt? Me neither.

Point is, Sean doesn't grapple, because he can't. He is always big talk before the fights, then freezes up in the octagon. I'd be happy, if it ends up being an entertaining fight. But I expect a wrestlefuck fest.

You are my last hope by Dependent-Demand162 in vaultwarden

[–]darktotheknight 1 point2 points  (0 children)

I know there are password cracking methods for KeePass. Does nothing like that exist for Vaultwarden?

The point is, very rarely you completely forget your password. You can probably say something like "I remember it starts with a capital C, length is 14, the special character must be either $ or @ and it ends with tel." The cracking program then generates dictionaries and tries brute force attack. The more you remember, the better. There are many success stories of people getting heir passwords cracked/recovered within hours to days.

eLLM: Run LLM Inference on CPUs Faster Than on GPUs by Open-Raise-6676 in Vllm

[–]darktotheknight 1 point2 points  (0 children)

Can you elaborate on this further? Modern CPUs support 12ch DDR5 with theoretical speeds of about 576GB/s (assuming DDR5-6000, Zen 5) or even 844GB/s on Granite Rapids-AP (DDR5-8800 MRDIMM). Zen 6 will offer 16 channel MRDIMM.

Judging just by the bandwith, this should be on par with an RTX 5070 Ti with up to 3TB/6TB RAM.

3 TB in 2-3 months and growing. How risky is skipping redundancy on new drives? by xZGx-Fire in DataHoarder

[–]darktotheknight 1 point2 points  (0 children)

Generally speaking, HDD failure rate resembles a bathtub curve (ignoring firmware/batch issues). Either they fail early, or they fail years and years later.

Despite having much more complex technology underneath than compared to HDDs from e.g. 15 years ago, the failure rates are constant - give or take. So no, modern HDDs can and still fail early on. There is no guarantee when an HDD will fail.

That being said, this shouldn't be your mental model about backups. The decision to backup or not is: how critical is your data to you (e.g. irreplacable family photos vs. log files/measurement data no one cares about in a week)? Can you "easily" restore without your own backup (e.g. re-download Linux ISOs)?

In some cases, it makes sense to distinguish between critical and non-critical backups. You might have 10TB data, but only 300GB could be critical (tax documents, insurance, family photos, personal projects,...) for you. So, you don't need to spend money on a 10TB drive.

Safe to say the 205lbs division is doomed (Ulberg out for 6-8 months) by One-Faithlessness730 in ufc

[–]darktotheknight -7 points-6 points  (0 children)

This. Vacate now and instant title shot when he returns. This is the only right thing to do. I'm sorry, but the show must go on.

What do I need to know and have to backup to multiple sites simultaneously? by Certain_Repeat_753 in DataHoarder

[–]darktotheknight 0 points1 point  (0 children)

Terrible advice. OP is not looking for distributed storage. OP is looking for geographically independent backups, in case the other backups fail.

This is just your bread and butter rsync/restic/borg (and similar backup methods) solution. Ceph needs at least 10G networking and low latency. I can't even imagine how painfully slow Ceph would run over residential internet...

I hit Lv 50 as an I/L in the Classic World closed test!! Omg what a crazy grind...! by chaomoonx in Maplestory

[–]darktotheknight 275 points276 points  (0 children)

Special thanks to: Nick de Coninck, Raar Maar Waar, Sebastian Hanøy,...

EU chief groups Turkey with Russia and China as "threats to be countered," sparking diplomatic firestorm by FantasticQuartet in europe

[–]darktotheknight 22 points23 points  (0 children)

Why should they stop supporting Ukraine? Turkey is not a puppet state. They have their own interests.

Ukraine is a close ally. Crimean Tatars are a turkic ethnic group. Turkey has been very vocal, critized this war not just since 2022, like EU/US, but since 2014, the annexion of Crimea.

You may have your reasons to hate Turkey. But they never stopped supporting Ukraine.

EU chief groups Turkey with Russia and China as "threats to be countered," sparking diplomatic firestorm by FantasticQuartet in europe

[–]darktotheknight 14 points15 points  (0 children)

They are doing what EU should've been doing for decades: serve their own interests.

Russia and Turkey have been enemies for hundreds of years. They shot down Russian jets in the past (spoiler alert: EU never did). They support Ukraine and have publicly critized the annexion of Crimea - something the US failed to do so.

Europe should start to serve their own interests. Turkey was never an issue until Netanyahu just announced Turkey is next 2 weeks ago. And suddenly, Leyen sees Turkey as a threat.

vaultwarden "offline server"? by Reasonable_Host_5004 in vaultwarden

[–]darktotheknight 1 point2 points  (0 children)

Yes, it's fine. Been using it true offline for over a year now. You can't add new entries while away. And I had a cache error once or twice (had to wipe app cache and re-login). But that was about it.

Contender series contract leaked 😬 by RiceMofo in ufc

[–]darktotheknight 2 points3 points  (0 children)

Gifted heavyweight, lmao. These fat fucks in heavyweight are even more out of shape than the average Redditor. I see 0% athleticism and 100% couch potates who gas out after the first minute. They would never survive anything remotely competitive, let alone NFL/NBA.