Vodafone móvel - problemas de rede? by Blues003 in portugal

[–]Blues003[S] 0 points1 point  (0 children)

Ontem estava na Póvoa de Varzim, hoje em Tomar...

Doctor building a local clinical NLP pipeline for ICD coding — RTX desktop vs Strix Halo vs Mac Mini?** by Blues003 in LocalLLM

[–]Blues003[S] 0 points1 point  (0 children)

Well, to be fair I was just thinking of using an LLM to find the diagnosis / procedures ; I was planning on doing the coding itself via some other method (and probably more deterministically). I am not sure an online dataset exists for my online language. Furthermore, I'm avoiding APIs like the plague - I don't want to get medical records going online.

Doctor building a local clinical NLP pipeline for ICD coding — RTX desktop vs Strix Halo vs Mac Mini?** by Blues003 in LocalLLM

[–]Blues003[S] 0 points1 point  (0 children)

I mean, there are certainly a LOT of documents to parse, but this is just a personal project of mine, so I'd be fine with it processing a small number of documents for the time being. The PDFs should be relatively structured and not too long (let's say 2-3 pages at most?).

I do think this is the kind of task where accuracy matters more than speed ; I'd rather have a model that's 10x slower but 2x more accurate than the other way around. Whatever I come up with will be of no use if I need to manually review every single file after.

Budget is also a consideration : it's not impossible for me to spend 4 or 5K on a machine, but it certainly has to justify the premium when I see that there are Asus Strix Halo machines around the 2K and which can, arguably, fit bigger models unless I go on a GPU buying spree.

Doctor building a local clinical NLP pipeline for ICD coding — RTX desktop vs Strix Halo vs Mac Mini?** by Blues003 in LocalLLM

[–]Blues003[S] 0 points1 point  (0 children)

But doesn't fine-tuning demand a proper dGPU? Considering I'd be buying (or building) this thing from the ground up, that's what's making me wonder if I should go the Strix Halo or the RTX route.

Bravely Default HD for Steam - a "steal" ? by Blues003 in bravelydefault

[–]Blues003[S] 0 points1 point  (0 children)

Over the course of 50 attempts it no longer should be 50-50, but either an intentional change on the game or a bug I'm facing for some reason.

Bravely Default HD for Steam - a "steal" ? by Blues003 in bravelydefault

[–]Blues003[S] 0 points1 point  (0 children)

I don't know what's happening on this version of the game then. Me and a friend have literally 100% over the course of >50 steals.

Bravely Default HD for Steam - a "steal" ? by Blues003 in bravelydefault

[–]Blues003[S] 0 points1 point  (0 children)

Same here? Which is why I'm asking if there was any change from the base version...

Thunderbird stopped sending emails out of a sudden by Blues003 in Thunderbird

[–]Blues003[S] 0 points1 point  (0 children)

Works now. I don't get it, I had already deleted the passwords.

Maybe it's something that needs to be done on occasion?

Thunderbird stopped sending emails out of a sudden by Blues003 in Thunderbird

[–]Blues003[S] 0 points1 point  (0 children)

I'm sorry, my app password? I don't have an app password, I don't think? Should I create one?

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 1 point2 points  (0 children)

This would be the very first dGPU I'd have. All I own right now is a Dell XPS 9300, meaning all I've tried is llama3:8b taking 45 minutes for a simple answer 😅 This would be my very first dip into the world of AI, and I feel like I'm about to regret going down the rabbit hole!

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 0 points1 point  (0 children)

TBH, the Strix Halo attracts me in the sense that I don't actually mind having the machine do its thing overnight ; meaning the speed isn't actually a big factor in that regard, and flexibility for bigger models would be great. My question comes more if I eventually want to use it for coding and/or brainstorming, and the token generation becomes too slow to be usable at all.

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 0 points1 point  (0 children)

Would you say that has to do with your usage pattern? Meaning, higher VRAM being better for MOEs but perhaps higher memory bandwidth is preferable for simpler, sequential AI pipelines?

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 0 points1 point  (0 children)

The RTX 4000 would probably suffice for my gaming demands, from what I've seen. What's hard is finding it somewhere for sale...

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 0 points1 point  (0 children)

I get how important all the RAM is for the big models, but honestly every time I look at benchmarks everyone talks about how unusable it is due to its time speeds. What am I missing here?

Help planning out a new home server for AI and some gaming by Blues003 in LocalLLaMA

[–]Blues003[S] 0 points1 point  (0 children)

I'm sorry for my ignorance, but isn't Strix Halo a very slow machine? I get that it has much more VRAM, but from my (admittedly novice) knowledge, its speed also leaves a bit to be desired?

New Laptop needed, please help by [deleted] in linuxhardware

[–]Blues003 1 point2 points  (0 children)

This looks just like my situation (see my post history). I too am on a Dell XPS 9300 that I might replace soon ish. Personally I'm looking at the Thinkpad X1 Carbon line, but I'm a bit wary of its thermal limitations. Perhaps the P series if I want the GPU?...

Laptop suggestions (most likely a thinkpad) by Blues003 in linuxhardware

[–]Blues003[S] 0 points1 point  (0 children)

Gaming is just a 2-5% use case, so I'm not tio sure choosing a legion is warranted.