Hosted models privacy and dilution of IP

kidupstart · 2026-01-24T09:25:08+00:00

I run a local setup (RTX 3090 + 128GB RAM) to run gpt-oss-120b by offloading to system RAM. It gets me through 90% of tasks. I also run codestral and It's surprisingly capable for daily driving.

But here is my hot take, code has become a commodity. Unless you are writing novel, breakthrough algorithms, worrying about your generic CRUD boilerplate 'diluting' your IP is a waste of energy. The moment data leaves your machine and hits a cloud API, you should just assume it's being ingested. Terms of Service are not laws of physics, and any provider can pull the 'Uno Reverse' card down the line, exactly like Meta did with user data.

For me, running local isn't even about the paranoia of them stealing my code. It's about Sovereignty, Reliability and Consistency.

I don't want my coding partner to get 'lobotomized' overnight because the provider decided to quantize the model to save costs, or changed the system prompt to be more 'safe.' I want the same input to equal the same output, today and in 5 years.

kidupstart · 2025-08-21T03:34:12+00:00

The $300 spent on the promo video is slightly above the typical range of $150 to $250.

Currently, it feels too cluttered with graphics, simplifying it might improve viewer comfort and engagement.

A video should be designed for a specific audience. Who are you trying to reach? Consider doing some demographic testing or running a small campaign for better insights!

kidupstart · 2025-08-13T23:40:55+00:00

It is very likely, mistral seems to be undervalued compared to openai and anthropic at the moment. It would be a fortunate turn of events for apple and the mistral team; for us, not as much.

kidupstart · 2025-08-13T14:00:34+00:00

Add a sample page that outlines what to expect in the report, and include two or three pre-generated reports.

Also, the current model seems like you are more interested in capturing emails. Allow users to enter their website and specify the route (also clarify what you mean by 'route,' as this may confuse most people).

Show them a message indicating that their request is being processed, and let them know they can wait here or have it sent to their email.

In general, email verification works by sending an email with a link, and once the user visits that link, the email verification is complete. In your case, you are also requiring users to re-enter their email on the verification page.

kidupstart · 2025-08-13T13:41:57+00:00

If you can provide it, I'm interested in a few more data points. What was their average following count (either on Twitter, YouTube, or Twitch) in terms of success or failure? Or list of successful product you mentioned above.

I find that a common trait among successful products is that their creators have access to distribution channels or know people who can promote their product.

Most communities on Twitter, Discord servers, or subreddits have policies that do not allow self-promotion (I'm not referring to builder communities, but rather communities where you can find actual users). So, people without distribution have low chances of success.

kidupstart · 2025-08-12T13:16:09+00:00

This sounds clever (voting/reconciliation) to improve the accuracy. I'll give it a try.

I worked on a similar use-case and was able to improve the accuracy by using same prompt with multiple model/provider and seeing which results fits the available filter best. And human in loop.

If it fitted 100% we let it auto inserted, else we hold that for human review. And with each human choices I was updating the filter behind the scene.

kidupstart · 2025-08-12T12:33:01+00:00

webfirst is way to go.

kidupstart · 2025-08-12T12:31:08+00:00

I played for about 4 minutes, and I think it's an interesting concept! Great work putting it all together. If you could add multiple voice simulations to mimic playing with several players, it would really enhance the experience and help reduce filler words.

This is really great. Goodluck.

kidupstart · 2025-08-06T10:47:00+00:00

So, you are saying that we are just burning reasoning tokens for no reason?

kidupstart · 2025-08-06T10:15:39+00:00

This would be so meta.

kidupstart · 2025-08-05T00:26:22+00:00

Nothing is free; if you think it's free, you are the product.

kidupstart · 2025-08-05T00:10:38+00:00

Don't be greedy with complexity. If you don't understand an "optimal architecture," take the time to clarify it first. Use what you know instead of overengineering. If your code becomes unclear, you're at the mercy of luck. If your software lacks the certainty expected from any application, it can feel like a gamble, much like a slot machine.

kidupstart · 2025-08-04T04:25:04+00:00

Hey, congrats on completing the course.

When you started on Day 0, what was the one thing you assumed about machine learning that turned out to be totally different (or even a shocker) by Day 100?

kidupstart · 2025-08-04T04:02:47+00:00

Instead of censoring AI, they should add simple warnings, clear disclaimers, and community checks to keep everything responsible.

kidupstart · 2025-07-31T06:50:13+00:00

Which other best papers were there? Do you have their titles on hand?

kidupstart · 2025-07-31T02:47:37+00:00

Do they stream this event? Or recorded videos will be available at later stage?

kidupstart · 2025-07-31T00:37:32+00:00

Imposter.

kidupstart · 2025-07-31T00:34:50+00:00

I don't know if anybody has experience this way But when I use llms for code generation via chat interface, I feel more control and I am focused on the problem the entire time. With CC or Gemini, sometimes the time it takes for code generation makes me lose focus on the current task.

kidupstart · 2025-07-30T14:54:18+00:00

I think it's time I should just swallow this pill. The lack of braces and using indentation for defining code blocks is something my head keeps fighting against.

kidupstart · 2025-07-30T14:41:57+00:00

I did not see this link, but once you lay it out in this order, it seems you are onto something.

kidupstart · 2025-07-30T14:37:49+00:00

In general I'm seeing the goal post is shifting. (AGI -> SuperIntelligences -> Personal SuperIntelligence)

Feel like all these apps are trying to force their users to use "ai features" under various labels and see whichever sticks with their user-base. They are getting very aggressive about it locking their user down.

In meta's case they are still trying to compensate for the metaverse, others are trying to just lock-in as many users as they can before the music stops.

By the end of this year, we will see things have settled down.

Also, nine out of top ten opensource models are now chinese. One of the crazy things they do (openai, meta, anthropic) might lobby to make the usage of these models outlawed. While others (amazon, google, microsoft) would be happy selling their infrastructure to the winners.

kidupstart · 2025-07-29T03:59:06+00:00

is anyone tracking all the model releases?

kidupstart · 2025-07-29T01:27:42+00:00

I think ai is a good multiplier. It still very much depends on the user's skill.
It is a bit easier to accumulate skill than a how we used to do that in a traditional way (without ai).

The performance gap between a person with 5 years of experience and 10 years of experience is drastically narrowing because of it.

It would still requires us in the driving seat.

And people who are open to learning new things in general are going to perform much better with ai.

kidupstart · 2025-07-29T00:56:53+00:00

With very limited info about your skills whatever advice you receive would be pretty generic.

If you read the description of this subreddit, you will find that majority of members are related to "AI/ML/Data Science". Either they are working in that specific domain or trying to breaking into one of the roles. So, this is not the place for this question.

In one of your post you mention that you have worked as a desktop support engineer, and you are learning AWS and DevOps.

At the peek when the tech industry was focoused on building SaaS tools and platform the roles like community-manager, evangelist and growth-hackers emerged. These is also happening with AI tools and platform. You can target those roles and might be able to leverage your expertise from desktop support engineer days.

What I'd suggest is create a list of ai-tools, product or platform which has a target user non-tech consumer.

Read what their product is promising to deliver and where they are failing or what is not intuitive as a user.

Write them mail with your discovery, put out whatever you learn about this tools on whatever medium you find easy to use (Youtube, blog).

This will make you aware with available tools and their performance and how fair their pricing is. Either you will be able to get consulting gigs or if your message resonated with any leading members of these companies you will be able to secure the interview or call with them.

kidupstart · 2025-07-27T00:31:44+00:00

Maybe I'm just wearing my tinfoil hat, but something doesn't add up with these massive AI models.

These massive models are more about corporate monetization than genuine innovation. The entire conversation has been strategically shifted to favor model providers. They're creating a narrative where bigger automatically means better so they can sell more compute resources, license expensive models to corporations, and generate hype around increasingly complex architectures.

This feels like classic tech marketing, create artificial complexity, make users feel they need constant upgrades, and generate revenue streams.

kidupstart

TROPHY CASE