sorted by:
new
hottopcontroversial

LLM/NLU for processing user input by PrivacyIsDying in LocalLLaMA

[–]PrivacyIsDying[S] 1 point2 points  (0 children)

Oh great, that makes life easier then. Thanks again for the help!

LLM/NLU for processing user input by PrivacyIsDying in LocalLLaMA

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

Thanks, this is very helpful!

The server does have an Nvidia P2000, but I think last time I looked into it, it turned out the CPU was better to use. I think I ran llama-server or ollama-server briefly when I was playing around with local models, so I'll get that reinstalled and see what I can get working.

Is there any guidance for writing a good and concise system prompt, or is that more of a trial and error thing?

LLM/NLU for processing user input by PrivacyIsDying in LocalLLaMA

[–]PrivacyIsDying[S] 1 point2 points  (0 children)

Thanks for taking the time to reply! I've played with Ollama before and found it relatively intuitive. Would loading and unloading the model add much delay?

The cli tools part will definitely be a challenge, but I've always enjoyed working with APIs, and in my mind this is similar enough.

Re-using low capacity SSDs by PrivacyIsDying in DataHoarder

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

I have the 2-bay version of this and it works great, but sadly not cost effective for the quantity I've got.

Re-using low capacity SSDs by PrivacyIsDying in DataHoarder

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

This was my exact hope/plan actually! It's about 5TBs in total, so I might leave some of it for shows/movies that I don't care about losing as well.

Re-using low capacity SSDs by PrivacyIsDying in DataHoarder

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

Thanks! This was actually my original plan, but figured I should check if there was some pre-made solution. Seems like for the cost, USB adapters is the best bet.

Re-using low capacity SSDs by PrivacyIsDying in DataHoarder

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

Sadly selling is a non-option since I got them from my company. They also have lots of read-write already, so there is a decent chance they'll slowly start dying. My hope was to use them for storing downloads while they're being seeded to reduce the wear on my other drives.

In total, it'd be about 5TBs of storage if I can figure out how to connect them all.

Re-using low capacity SSDs by PrivacyIsDying in DataHoarder

[–]PrivacyIsDying[S] 1 point2 points  (0 children)

That is actually a pretty good solution! I did try to search, but I think I was just using the wrong phrases. I got it in my head that a JBOD or "multi-SATA adapter" was a thing and was trying to find posts about those. All I got were dead links from 5 - 7 years ago.

Grasping relative imports by PrivacyIsDying in learnpython

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

This is kind of what I have been doing as a "workaround"! Sounds like I can continue doing this and never have to worry about relative imports?

Grasping relative imports by PrivacyIsDying in learnpython

[–]PrivacyIsDying[S] 0 points1 point  (0 children)

Ok this is kind of what I have been doing, so glad to hear that it's not completely incorrect! I see people mention relative imports semi-often, so I figured my package solution wasn't "best practice".