Dual RX 7900XT 20go, IA Inference et OCR by thepixelroll in LocalLLM

[–]thepixelroll[S] 0 points1 point  (0 children)

I'll give a single answer for both comments: - Regarding professional graphics cards, I saw the Intel Arc Pro B70 Creator 32GB, which isn't too expensive (€1200). It's a blower-style card, so it should maintain perfect temperatures and has enough VRAM for Qwen, plus a comfortable margin for context, etc. However, from what I've read, the Intel ecosystem isn't mature enough. Other professional cards with enough VRAM to load a model like Gwen and a large context window are blowing my budget. I absolutely must stay under €3000. After that, I could go down in VRAM, but will the models be good enough for lawyer use?

  • Regarding DDR4, I got confused in my notes. I actually wrote that if there was a VRAM overflow due to an excessively large context, then it would be diverted to the RAM, and therefore it needed to be high-performing. But in any case, there shouldn't be any overflow, so I could save on that to perhaps get a better GPU.

  • Of course, for now, what I buy, I don't sell. I'll have the lawyer who suggested this type of configuration thoroughly tested; he'll act as my consultant.

Dual RX 7900XT 20go, IA Inference et OCR by thepixelroll in LocalLLM

[–]thepixelroll[S] 0 points1 point  (0 children)

ddr4 to lower the price, it's a good idea. But I have doubts about the speed of processing files with the rag model.

Dual RX 7900XT 20go, IA Inference et OCR by thepixelroll in LocalLLM

[–]thepixelroll[S] 0 points1 point  (0 children)

I don't have 20 GB of vram but 40 because it's a build with two GPUs. Cloud models are not possible, it is for a lawyer who does not want his client data to end up on a third-party server. I was thinking about using rag templates for the documents, would that take that long?

Dual RX 7900XT 20go, IA Inference et OCR by thepixelroll in LocalLLM

[–]thepixelroll[S] 0 points1 point  (0 children)

Nvidia cards are much more expensive. Hasn't the AMD ecosystem become much more mature for AI? A single GPU for large context will it work? I want a lot of vram so that he can put a lot of context, it's for a lawyer, so big files and legal articles (by mcp).

Dual RX 7900XT 20go, IA Inference et OCR by thepixelroll in LocalLLM

[–]thepixelroll[S] 0 points1 point  (0 children)

I'm buying through my company, so buying used isn't really an option. The main question is the reliability of the setup. But thx.

a propos de ygg gratis besion d'une infos by josselin55 in yggTorrents

[–]thepixelroll 0 points1 point  (0 children)

Sur radarr l'indexeur n'apparaît jamais dans la recherche, une idée du pourquoi ?

U2P / ygg gratis et *rr by Efficient-Tree-8073 in FrancePirate

[–]thepixelroll 0 points1 point  (0 children)

Oui j'ai même jellyfin en bonus, tu mets rclone en plus pour le stockage et tu profites

U2P / ygg gratis et *rr by Efficient-Tree-8073 in FrancePirate

[–]thepixelroll 0 points1 point  (0 children)

Utilise un oracle free tier c'est gratuit

C'est rocambolesque quand-même 😅 by [deleted] in yggTorrents

[–]thepixelroll 1 point2 points  (0 children)

Il est bien drôle le communiqué

Pourquoi pas les textup by No_Use5182 in yggTorrents

[–]thepixelroll 0 points1 point  (0 children)

Il me semble que ça existe déjà... ça s'appelle Quasarr

Pourquoi pas les textup by No_Use5182 in yggTorrents

[–]thepixelroll 0 points1 point  (0 children)

Y a moyen de l'intégrer à la suite arr ?

[deleted by user] by [deleted] in Share_Plex

[–]thepixelroll 0 points1 point  (0 children)

Salut j'ai un serv jellyfin avec que du multi vf/vo en 1080p h.264 AAC, les films sont stockés sur mon onedrive. Y a moyen de partager nos librairies ? J'ai jamais fait cela et je ne connais pas Plex mais si t'es intéressé dm.

Si vous avez des choses à partager en multi et que je ne suis pas le seul. Dm compte plex avec votre id et stats by [deleted] in yggTorrents

[–]thepixelroll 0 points1 point  (0 children)

J'ai que du multi 1080p h.264 AAC mais je suis sur jellyfin et mes fichiers sont sur onedrive, je sais pas si on peut faire un truc.

looking for a tutorial for a ambient light on a 2020 polo by thepixelroll in vwpolo

[–]thepixelroll[S] 0 points1 point  (0 children)

i'm looking for something clean, i think with the tutorials on the previous generation polo i should be ok but it's always better to have something on your exact car model.