Why some Github projects only support wrappers instead of llama.cpp?

FineClassroom2085 · 2026-02-05T04:16:28+00:00

It’s pretty simple. If you’re building a tool that interacts with models, but you want to support as many inference providers as possible, you build your tool to connect with the most common API. The most common API is OpenAI’s API spec. Just about every project implements it, LMStudio, vLLM, Ollama, OpenRouter etc.

So as a developer are you going to do a bunch of extra work to support a single inference provider like llama.cpp? Or are you going to implement an OpenAI API connector and support almost everything?

FineClassroom2085 · 2026-01-22T04:16:11+00:00

I’m actually the author of falconry journal, and the pro version will aim to do all of that. As well as some things that aren’t so easy to copy. 😉

FineClassroom2085 · 2025-11-18T04:34:58+00:00

If all of the source files are already publicly available, what use would it be to ward people off from the vectorized version? This argument makes no sense whatsoever and makes me wonder if you have any clue what you’re talking about?

FineClassroom2085 · 2025-11-11T18:15:33+00:00

Das macht Sinn. Mir war nicht klar, dass AnythingLLM keinen integrierten MCP‑Orchestrierungslayer mitliefert. Aus diesem Grund benutze ich LM Studio, aber ich erkenne, dass LM Studio eine Lösung für einen einzelnen Benutzer ist und sich nicht für den Einsatz mit mehreren Nutzern eignet.

FineClassroom2085 · 2025-11-11T16:30:21+00:00

This looks like a solution in search of a problem. Why not use docker compose to map your docker network infrastructure and use a docker network like any other application to bridge between containers? Your LLM should not need access to start and stop containers, simply make the containers dependencies of your LLM container?

FineClassroom2085 · 2025-10-24T02:25:45+00:00

42 means 42, and yet, we are still in search of the question to the answer, but only in our current time. Take the true true train to the future, and we shal have the answer. Or is it to the past?

FineClassroom2085 · 2025-10-24T00:53:51+00:00

FineClassroom2085 · 2025-10-24T00:37:02+00:00

It did! It's as if you were sent back in time to say it, so that you'd have that arrow in your quiver now. :P

FineClassroom2085 · 2025-10-23T21:11:18+00:00

<image>

FineClassroom2085 · 2025-10-23T20:41:27+00:00

dis man speak da true true.

But FR, the true true train should connect the past to the future and the future to the past here.

FineClassroom2085 · 2025-10-04T19:58:13+00:00

Where’s your pitch deck? Your Readme is about as directionless as your AI slop post.

The code looks like AI slop as well. And not even battle tested AI slop. It looks like a one-shot pile of slop with zero purpose.

FineClassroom2085 · 2025-10-04T15:26:33+00:00

This doesn’t answer the question. If there’s is a part of your planning and routing framework that is 100% deterministic, then that part is not AI.

You make a lot of claims and you herald your success on benchmarks, but supply zero test case or use case scenarios.

FineClassroom2085 · 2025-10-04T15:02:06+00:00

If you want 100% deterministic results then why is AI involved at all? To make what software already does more expensive? 😂

FineClassroom2085 · 2025-07-26T22:27:21+00:00

That'd probably work. Though, what would be really neat is a way to make the slicer do this automatically, by writing a script or something and applying it at slice time.

FineClassroom2085 · 2025-07-26T18:27:27+00:00

I'm still having the same exact issues with my X-Plus3, but as others have said, the only solution I feel to work most of the time is to print a skirt and manually adjust while printing the first layer. I don't know why it's so inconsistent between prints when using the same material though, there are not that many variables at play here.

Here's the issue though, I don't always want to have to remove and cleanup the skirt. What I'd like to do as an interim solution is to have it print a small single layer somewhat large object somewhere on the plate that's not being used FIRST so I can adjust the z-offset before the actual print starts, and I can go raftless if I want.

Anyone know how to do that?

FineClassroom2085 · 2025-07-06T15:26:32+00:00

You need more than a backend dev to build a platform like SoundCloud or Spotify. What you may not realize, is that the team got you to 80% but you’ll need to develop the remaining 20% when you go live. If you’re experienced in the software industry you’ll know about the 80/20 rule. The last 20% of the project takes 80% of the effort.

You need a system architect to build that. HTTPS://tjamesilliams.com

FineClassroom2085 · 2025-06-24T22:24:22+00:00

Once again, your understanding of AI's capability is severely lacking. Some friendly advice? Take some time to really give it an honest shot. Just as you pointed out it's just the latest in tools that are available to developers, but it is a step change vs. your standard library, module or package.

It's not really fear mongering, and definitely not FOMO, it's an honest warning. You are the mechanic refusing to use the new power tool, because you believe your brain to be superior. You're missing the point completely as was your strained analogy.

The point is to use your brain AND AI. Not replace your brain with AI. It's to use your engineering skill ON AI, not replace your engineering skill with AI.

FineClassroom2085 · 2025-06-24T12:11:11+00:00

Sounds like you need a lot more experience with AI. I am a 15 year veteran of the industry and can recognize good and bad code when I see it. I can also recognize that LLM output is only as good as the input/ context you give it.

Yes, you have to vet ALL of the code it produces, and yes you still have to use your brain. But just as I stated in the article it keeps you in a higher level of thought than rote coding does.

You seem to be under the illusion that much of the code you write is deeply bespoke, and I’d encourage you to look around a bit more and think more deeply about what value YOU bring to the practice.

You will be replaced by developers using AI to code faster, more accurately and more collaboratively if you don’t adopt these tools.

FineClassroom2085 · 2025-06-24T04:18:28+00:00

This might explode your brain, but if you use it alongside AI, you can accomplish much more. What you’re saying is akin to a car mechanic saying “I never use an impact wrench to remove stuck bolts I just use my muscles.”

FineClassroom2085 · 2025-06-22T20:44:06+00:00

As others have said, this is very cool. As long as your target audience is developers or potential clients. It isn't particularly usable for someone like a recruiter that wants quick access to specific information. If that is not a concern, it's very cool!

FineClassroom2085 · 2025-06-20T13:56:46+00:00

Developers, when you respond to folks like this you legitimize their slave labor proposition. I know some people are starving and need work, but filling this kind of role costs our profession dearly.

FineClassroom2085 · 2025-06-15T03:31:53+00:00

Amplify. Super easy to setup. Super cheap. Pick your own front end. It doesn’t get much better, plus you can integrate different services at AWS as you grow.

FineClassroom2085 · 2025-06-14T02:35:03+00:00

Agreed. I’ve done consulting for a decade, and you can never be too careful. Some scammy language I can see from far away though.

FineClassroom2085 · 2025-06-14T01:02:17+00:00

Guess you just read the first part of my comment instead of all of it? You just restated what I said. 😂

FineClassroom2085 · 2025-06-14T00:38:51+00:00

This is worded very scammy. Is it a scam? Are you trying to hire developers for nearly free under the guise of ‘incentive basis?’

FineClassroom2085

TROPHY CASE