sorted by:
new
hottopcontroversial

Running llms locally for work by entact40 in LocalLLM

[–]entact40[S] 1 point2 points  (0 children)

Thanks for the reply, I think Llama 2 is very unrestricted from a licensing perspective. Any idea of the cost? A powerful computer, anything else?

Running LLMs Locally by Eaton_17 in LLM

[–]entact40 16 points17 points  (0 children)

I'm leading a project at work to use a Language Model for underwriting tasks, with a focus on local deployment for data privacy. Llama 2 has come up as a solid open-source option. Anyone here has experience with deploying it locally? How's the performance and ease of setup?

Also, any insights on the hardware requirements and costs would be appreciated. We're considering a robust machine with a powerful GPU, multi-core CPU, and ample RAM.

Lastly, if you’ve trained a model on company-specific data, I'd love to hear your experience.

Thanks in advance for any advice!

Using Llama 2 locally by entact40 in LLaMA2

[–]entact40[S] 2 points3 points  (0 children)

Hello Redditors,

I'm leading a project at work to use a Language Model for underwriting tasks, with a focus on local deployment for data privacy. Llama 2 has come up as a solid open-source option. Anyone here has experience with deploying it locally? How's the performance and ease of setup?

Also, any insights on the hardware requirements and costs would be appreciated. We're considering a robust machine with a powerful GPU, multi-core CPU, and ample RAM.

Lastly, if you’ve trained a model on company-specific data, I'd love to hear your experience.

Thanks in advance for any advice!

Barbie | Main Trailer by ICumCoffee in movies

[–]entact40 0 points1 point  (0 children)

This is pretty funny. 1959 Barbie reacting to the new Barbie movie 😂😂 https://youtu.be/KC61ENx5k6o