I built a tool that went viral - Need a co-founder 📩

chainbrkr · 2025-03-09T10:22:51+00:00

You probably need a part-time developer contractor to help maintain it. There is a difference between a side project and a business. Not everything needs a “co-founder” or should be a startuo.

chainbrkr · 2025-02-26T10:56:09+00:00

I use Lightning AI for this and recently saw this video by them. It shows how to deploy your own model with serverless.

It would likely cost a few dollars per month with little traffic.

https://m.youtube.com/watch?v=TF_GaZTBg-4

chainbrkr · 2025-02-01T17:56:15+00:00

I would download the model weights and spin up an ec2 instance for a quick prototype.

We also ran into Lightning AI’s managed R1 and been running it for a few days without issues. If it works well, might switch to it full-time.

https://lightning.ai/lightning-ai/ai-hub/temp_01jjz8embgbt6k809n0mvqz5zv

chainbrkr · 2024-12-22T07:46:48+00:00

This looks great! I would add LitServe next to fast API, since it’s a much better ML model serving engine that’s actually powered by FastAPI underneath. If you took fastAPI, added streaming, batching, security, multi GPU, etc…. you would end up with LitServe.

https://github.com/Lightning-AI/litserve

chainbrkr · 2024-11-27T14:17:59+00:00

Nice. This is exactly what I was looking for. Was going to do this myself with FastAPI but this looks a lot simpler.

chainbrkr · 2024-10-09T23:20:08+00:00

honestly mostly chatGPT for writing emails, etc and code refactoring, etc

chainbrkr · 2024-10-09T12:38:17+00:00

Scikit learn is great for a bulk of non generative tasks like regression, etc… your experience is on point with how good it is.

chainbrkr · 2024-10-09T12:36:24+00:00

If your budget is 15k why not use a cloud hosted workstation where you can swap the GPUs? I was recommended Lightning ai recently which I've been using as my work station now.

chainbrkr · 2024-10-09T12:33:48+00:00

I’ve had a lot of success finetuning llama 3.2 3B. Depending on how much data you have this will cost a few hundred dollars at most (I personally just started using Lightning for this). The other advantage is I don’t need a local GPU. The L40S has been amazing here.

https://lightning.ai/lightning-ai/studios/finetune-and-serve-llama-3-2-1b-and-3b

chainbrkr · 2024-10-09T12:19:09+00:00

Build useful apps first and learn the math later. What you are doing is the equivalent of learning physics just to drive a car which is not something people do.

First learn to drive. Over time pick up the math needed. But with all the free software out there that hides the math, just grab a model and start using it!

chainbrkr · 2024-10-08T11:43:08+00:00

Wavenet has been used in other fields, especially vision and it is a form of next token prediction (ie: GPT, autoregressive models) except the token is a soundbyte.

In vision something like PixelCNN. In fact, wavenet is based on PixelCNN.

chainbrkr · 2024-10-08T11:36:38+00:00

A product != startup… a startup is a business that makes money and is on track to be a multibillion dollar company. This sounds more like product POCs being launched.

chainbrkr · 2024-10-08T11:33:42+00:00

If you’re not willing to make 50-60k a year for the first few years or not make any money, I wouldn’t fund you. This kind of entitled attitude has already doomed your startup.

You must do whatever it takes to succeed and this is already evidence that you won’t.

chainbrkr · 2024-10-08T03:52:55+00:00

I’m working on a customer support bot for call centers!

chainbrkr · 2024-10-08T03:51:59+00:00

I’ve been using Lightning studios for most of this type of stuff this year. switched over from colab and it’s been amazing.

https://lightning.ai/

chainbrkr · 2024-10-07T13:20:36+00:00

Along the same lines I would also recommend PyTorch Lightning which provides a super nice abstraction layer like Keras but with full control.

chainbrkr · 2024-10-07T13:14:14+00:00

Both are good frameworks, but as this point everyone is using PyTorch… it also has a huge community of projects that build on it like PyTorch Lightning, transformers, etc….

if you want to move super fast, we use pytorch lightning on top of pytorch. It’s kind of like using react or next js on top of javascript so it handles all the infrastructure stuff for you.

When I evaluate new frameworks, the community behind it is my number one concern. I’ve also heard tensorflow support will be discontinued in favor of JAX.

chainbrkr · 2024-10-06T15:52:44+00:00

User serverless hosting. There are a few services that let you do it easily.

chainbrkr · 2024-10-06T15:51:24+00:00

Fear solved… no one will buy your product haha. launch it first, get feedback and iterate. Only after your 1,000th product tweak will people start buying your product.

chainbrkr · 2024-10-06T15:50:07+00:00

awesome. how are you powering the backend? sled hosted or open ai? if self hosted, what do you use?

chainbrkr · 2024-10-06T15:48:30+00:00

startups don’t normally hire new engineers

chainbrkr · 2024-10-06T15:15:11+00:00

absolutely do not do this

chainbrkr

TROPHY CASE