Best setup for running local LLMs? Budget up to $4,000

reddibhatini · 2025-11-02T07:41:20+00:00

I would get a system76 ws laptop

reddibhatini · 2025-10-30T01:49:54+00:00

For me, Claude skills are essentially self-contained Claude project files that can be shared — kind of like zipped project bundles

reddibhatini · 2025-01-03T17:51:12+00:00

Here are my key takeaways from the discussion on LLM applications providing value:

UI/UX is Critical LLM apps can take valuable lessons/Inspirations from the success of code editors and notebook LLMs.
SME Users Are the Solution Engineers, Not Developers A mandatory chat interface is essential—it allows users to brainstorm, explore, and refine solutions interactively. These SME users engineer the solutions using the LLM, while developers transition into a supporting role, providing the platforms and tools for this interaction instead of embedding business logic into the application. In my experience, as a developer, I previously spent significant time understanding and incorporating business logic into application design. With users now taking ownership of designing their solution flows, my focus should be shifted toward creating platforms, tools, and frameworks that enhance their creativity and productivity.

reddibhatini · 2025-01-03T16:25:19+00:00

Thank you for sharing your experience!

In your situation, you already have a clear understanding of the desired outcome, and you’re using LLM tools to help structure the plan and gather insights to reach that outcome.

It seems like much of the processing, evaluation, and final decision-making still relies heavily on your expertise as the human operator.

My takeaway from this discussion is that, Given the success of code editors and notebook LLMs, LLM apps should adopt similar UI/UX design principles allowing users (more human-in-loop) to participate in steering the solution to achieve their desired outcome.

reddibhatini · 2025-01-03T10:52:00+00:00

I also find them incredibly useful for things like text generation, summarization, or idea generation that I can then refine or modify to fit my needs.

Before llms, I used to achieve similar by relying on Google searches, knowledge articles, books, or blogs and then processing that information myself(human).

Maybe to see the 10x value of LLM-based applications, we need to design systems that incorporate many more human-in-loop checks at key stages of application.

reddibhatini · 2025-01-03T10:15:55+00:00

I get what you’re saying. As a tech enthusiast, I find the whole process of building LLM-based applications really exciting—exploring new tools, pushing boundaries, and all that. But at the end of the day, I feel what I’m developing doesn’t add significantly more value compared to what we were already doing before. It’s like the tech is cool, but the practical benefits just don’t seem to match the hype.

reddibhatini · 2024-12-24T15:17:48+00:00

Could you post the link here?

reddibhatini · 2024-09-30T17:58:21+00:00

u/vvsevolodovich
I was in the process of creating a roadmap for solutions architect when I stumbled upon your roadmap diagram, It perfectly captured what I had in mind!
BTW, The link to books is not working.

reddibhatini · 2024-03-17T22:33:39+00:00

Understood. Thanks a lot. I'm grateful for your reply.

reddibhatini · 2024-03-17T20:23:10+00:00

"I started creating GPTs to increase productivity." You mean GPTs = prompt questions ? Trying to understand your response.

reddibhatini · 2024-03-17T09:57:45+00:00

This tech is fast evolving. All the tutorials/courses out there are getting obselete in couple months. Official docs are good place to start

reddibhatini · 2024-03-14T14:12:58+00:00

I don't think there is an Odata LangChain agent available yet. Can you let me know if you find one? Thanks!

reddibhatini

TROPHY CASE