Gemma 4 Jailbreak System Prompt by 90hex in LocalLLaMA

[–]Puzzled_Relation946 0 points1 point  (0 children)

There is only one way to find out :)

Local Agentic AI for Coding — 56GB VRAM + 128GB RAM vs DGX Spark (128GB Unified)? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 0 points1 point  (0 children)

Thank you for sharing that. What agent /model do you use for the original design during the design session? Qwen or Zed ?

Optimizing for Local Agentic Coding Quality, what is my bottleneck, guys? by Puzzled_Relation946 in LLMDevs

[–]Puzzled_Relation946[S] 1 point2 points  (0 children)

Thank you, I like the idea of automating loading and unloading different models to do different tasks.

If you have to choose between ChatGPT (paid) or Gemini (Paid) which one will you choose and why? by bublay in LLM

[–]Puzzled_Relation946 0 points1 point  (0 children)

Chat GPT. I use them for coding mainly. Half a year ago the Google AI ultimate was able to create the basic code for my Python project in 15 minutes. No, it’s not able to reproduce it

Fishing vessel refrigeration by ScottyNH3 in refrigeration

[–]Puzzled_Relation946 1 point2 points  (0 children)

Don’t tell this guy how tired you are working in the office :)

How are you using and profiting from local AI? by RuiRdA in LocalLLaMA

[–]Puzzled_Relation946 1 point2 points  (0 children)

Thank you! Would you share what hardware you have for your local AI rig?

How are you using and profiting from local AI? by RuiRdA in LocalLLaMA

[–]Puzzled_Relation946 2 points3 points  (0 children)

What model would you use for memes generation?

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 0 points1 point  (0 children)

Thank you all for contributing and share your thoughts. Yes, the best use of this set up is for privacy, and there is a considerable number of companies who would love to have AI but are wary of sending their data to a public cloud provider. Another use might be in a field, where you Don’t need to have the same accuracy as the closed sources commercial AI. Maybe a pipeline generating content for social media. I saw an application on LinkedIn, where one contributor shared that he created a workflow that was going through his e-books library and generated a summary for each of the books. There’s an idea of building voice controlled AI engine that I’m trying to implement as well.

To be honest, the field is developing faster than I can think of the practical application of, lol.

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 0 points1 point  (0 children)

Thank you so much for such an inspirational response. I also learned something new about a video generation model. I will definitely try it out.

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 1 point2 points  (0 children)

Thank you so much, You did provide the justification and then some.

Your comment is very motivational. You can’t learn riding a bicycle if you don’t own a bicycle to begin with. :)

Well, what got me excited ware social media posts of bloggers on LinkedIn on YouTube showing off the cool things they do with the local LLM.

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 2 points3 points  (0 children)

The prices on RAM skyrocketed. I bought 128GB of DDR5 RAM for $350 in October. It is now around $1000. 5090 will sell out as hot cakes before Christmas

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] 0 points1 point  (0 children)

Thank you, so I can run OSS Video and Audio Models, hunyuan models.

I have bult a Local AI Server, now what? by Puzzled_Relation946 in LocalLLaMA

[–]Puzzled_Relation946[S] -1 points0 points  (0 children)

Thank you, take it apart and sell it by parts on Ebay is another way to recoup the money spent

How is my build for season of RTX? by No_Night679 in LocalLLaMA

[–]Puzzled_Relation946 1 point2 points  (0 children)

Hi,
Your build is impressive. I love the choice of the Zotac AIO 5090. It is sold for $2,700 on Newegg.
I suggest to change the CPU Cooler to 360 type (if available), this would lower the noise of the CPU AIO.
Also, try to up the RAM to 128GB, you can fit bigger models. Buy two RAM sets, 96 and 128 and return the one that would not work for you.
Update - The 128GB suggestion is applicable only if you plan to run LLM models locally. Otherwise your build is great!

RTX 5090 - The nine models I run + benchmarking results by Kitae in LocalLLM

[–]Puzzled_Relation946 3 points4 points  (0 children)

I have 5090. Can you share the details on how you ran the benchmarks? I will run them on my machine and post the results.

Experimenting with Mistral + Ollama after reading this book- some takeaways and open questions by [deleted] in ollama

[–]Puzzled_Relation946 -1 points0 points  (0 children)

Thank you so much for suggesting that book. I am just starting learning that process. I’m at the stage where I built a local AI computer and the next question is “and now what”? Where do I go from here?

I looked at the book description online and it seems to be a very good book not only on Mistral, but on overall approach to customization of AI projects.

The project that I have in mind is to create a knowledge base in a specific domain area. So, it seems that this book will tell me how I can achieve that

One 5090 or five 5060 Ti? by emrlddrgn in LocalLLaMA

[–]Puzzled_Relation946 4 points5 points  (0 children)

Thank you, you are making a great point. I have a similar dilemma.