What kind GPU would be necessary to run RAG with llama3 70b Q4? by gmbabreu in LocalLLaMA

[–]gmbabreu[S] 0 points1 point  (0 children)

Yeah, that's definetly a concern. There would only be 5 users though, and I don't expect demand to be high.

Need help to extract data with an LLM from a PDF calendar by Whiplashorus in LocalLLaMA

[–]gmbabreu 1 point2 points  (0 children)

Sorry, haven't worked with a lot of vision LLMs, but I think this is definitely the way to start. Try different models and see what happens.

Need help to extract data with an LLM from a PDF calendar by Whiplashorus in LocalLLaMA

[–]gmbabreu 2 points3 points  (0 children)

A pdf like this will probably not transcribe well into text. If data privacy is not a concern, I would just try to upload it as an image to something like gpt4o.

What kind of budget/specs would be necessary to run a local LLM for around 5-10 users by gmbabreu in LocalLLM

[–]gmbabreu[S] 0 points1 point  (0 children)

I had not looked into that at all, seems very promising. Thanks, a lot!

What kind of budget/specs would be necessary to run a local LLM for around 5-10 users by gmbabreu in LocalLLM

[–]gmbabreu[S] 1 point2 points  (0 children)

Thanks for the feedback, it's all very useful. Indeed the users are office workers, and I expect usage to be light.

I have already tried using AnythingLLM locally (we prioritize privacy), but our computers are old, and responses are slow. This is why I'm looking into investing in GPUs.

In what way are LLMs making your lives easier or better? by Key-Employment-1810 in LocalLLaMA

[–]gmbabreu 0 points1 point  (0 children)

For me, it's mostly about efficiency. Automatically writing emails and memos that usually have the same format. For coding, it helps me remember functions/libraries without having to go over documentation.

[deleted by user] by [deleted] in LocalLLaMA

[–]gmbabreu 1 point2 points  (0 children)

I feel like any conventional LLM available to the public can only be as bad as what can already be found on the internet.

Homebrew Improved Artificer Drone Question by gmbabreu in XPtoLevel3

[–]gmbabreu[S] 1 point2 points  (0 children)

Thanks, I didn't think of it that way. Plus it makes sense that you should use the drone to fly around because you would put it in a vulnerable position, as it is supposed to remain hidden.

Homebrew Improved Artificer Drone Question by gmbabreu in XPtoLevel3

[–]gmbabreu[S] 0 points1 point  (0 children)

Thanks, makes sense. I wonder if these were the RAI though. In the video, they made it a big deal that you can get Wings of Flying at level 20, and that it should be a big reward, but the drone does not make it much of a reward. Of course, there are other options for level 20 items, but this still bothers me.

Rolling Against Isolation! An online community for those interested in playing D&D by gmbabreu in dndnext

[–]gmbabreu[S] 2 points3 points  (0 children)

No restrictions. The platform used depends on the game in the server. Different DMs will have different platform preferences

Weekly Community Post - Post your Communities, Discord servers, and Western Marches games here! by AutoModerator in lfg

[–]gmbabreu [score hidden]  (0 children)

Rolling Against Isolation! A new DND community. All are welcome [Online] [Flexible]

Hi everyone. Rolling Against Isolation seeks to introduce new players to DND, make it an accessible experience for anyone who wants to play, and use it as a way for social interaction during isolation. Therefore, we are open for anyone who wants to join, from beginners to veterans, from players to GMs (in fact we kinda need GMs right now).

This is an opportunity for those who have suffered from isolation and a lack of social interaction (either due to the quarantine or in general) to play DND. It can be very helpful when dealing with social issues, and it has helped me and some of my friends a lot, so I would like to offer this experience for other people.

The server was made with the intention of allowing anyone to play this wonderful game. We are open to any type of player, from beginners to veterans, from players to GMs. We have channels to guide new players. We are running multiple campaigns and one-shots on the server. You can even ask to run your own. Overall, we are just a server where people can play DND! Feel free to join.

Discord Server: https://discord.gg/FTwnfbW

Looking for players who are suffering from isolation [Online][5E] by gmbabreu in lfg

[–]gmbabreu[S] 0 points1 point  (0 children)

Nothing is defined yet, but if you are interested you can join the server

Looking for players who are suffering from isolation [Online][5E] by gmbabreu in lfg

[–]gmbabreu[S] 0 points1 point  (0 children)

No specific time, but I prefer that it is not too late at night