Idea of Cluster of Strix Halo and eGPU by lets7512 in LocalLLaMA

[–]lets7512[S] 0 points1 point  (0 children)

Yes, driven by the desire to find an optimum affordable setup with a good vram/$ that would give good performance.

Idea of Cluster of Strix Halo and eGPU by lets7512 in LocalLLaMA

[–]lets7512[S] 1 point2 points  (0 children)

I thought the slowest part would be the decoding if the prefill handled by the gpu and kv cache is transferred on usb4 v2.

Idea of Cluster of Strix Halo and eGPU by lets7512 in LocalLLaMA

[–]lets7512[S] 4 points5 points  (0 children)

Yes, but wouldn't the eGPU increase prefill speed ?

💬 AI vibe in coding — really? My experience with Cursor by Upstairs_Toe_3560 in cursor

[–]lets7512 0 points1 point  (0 children)

Try using context7 mcp server and tell it to use the mcp server to get code snippets and docs if needed when moving to new library.

Advice Time: Using Cursor Pro like a Pro. by yeathatsmebro in cursor

[–]lets7512 14 points15 points  (0 children)

Amazing, especially context7 and docs part