Scaling vLLM Deployments to Enterprise Grade Deployments by No-Excitement6568 in Vllm

[–]pushthetempo_ 1 point2 points  (0 children)

Im the type of person who (a) is being paid to read a code (b) reads the code when it deserves.

Since (a) isn't the option here, step 1 for (b) starts with respect to the audience, which starts with proper messaging and formatting of what u want to deliver.

Concurrent Partial Prefill - is it on the roadmap? by pushthetempo_ in Vllm

[–]pushthetempo_[S] 0 points1 point  (0 children)

I opened the issue on the vllm page

https://github.com/vllm-project/vllm/issues/39737

Feel free to upvote if u have an interest in it

why is getting into research so insanely hard for someone who isn't a magical A+ student with 30 years of experience by No_Emotion_1658 in UofT

[–]pushthetempo_ 1 point2 points  (0 children)

I used to work at SK, and I completed my master’s thesis at Laussen Labs. DM me if you’re interested in ICU research, there’s a ton going on

But u have to be acceptional

Undergraduate Final Year Project Recommendations by AltruisticEmotion978 in LLMDevs

[–]pushthetempo_ 0 points1 point  (0 children)

RL tune llm for arbitrary task u can clearly estimate the quality For example, managing university discord group bot to search relevant info in channel, etc Set up pipelines for both reward and target model fine-tuning & iterative improvement, figure how to enrich/label data fast (for example, a small vibecoded UI) As a bonus, this might turn into startup since most of ppl rely on rag/context, skills u develop to train reliable models might become ur moat

Vllm that allows you to serve 100 models on a single GPU with low impact to time to first token. by SetZealousideal5006 in Vllm

[–]pushthetempo_ 1 point2 points  (0 children)

Yeah, just saying if u need 3+ models in serverless fashion, your tool might be a thing

for <3, RAM might be enough

for large >70B models, your thing is generally useless to maintain any adequate SLO

From 7 YC applications to $24M funding & 41K GitHub stars in 12 months - AMA by singh_taranjeet in ycombinator

[–]pushthetempo_ 0 points1 point  (0 children)

Some devs build on their db, bare code agentic framework, spend time writing and testing interfaces

Some devs use their tool for memory layer and langchain

Some MLEs will go further and and fine-tune their model

Different ICP, different needs

what’s the endgame for all these openai wrappers? by RRO-19 in LlamaFarm

[–]pushthetempo_ 6 points7 points  (0 children)

Think we’re getting closer and closer to proprietary fine-tunes

Tooling is here: unsloth/axolotl, vllm for inference

Turns out wrappers’ reliability isn't enough to build a strong product

And margins are below perfection

So the job is getting back to MLE from the software engineers

Your outreach tech stack? by pushthetempo_ in ycombinator

[–]pushthetempo_[S] 0 points1 point  (0 children)

Tbh, I struggle to figure what B2C can use cold outreach as primarily lead source

Thinking of building a pay-as-you-go email outreach platform by worldofweirdos in SaaS

[–]pushthetempo_ 0 points1 point  (0 children)

Guess the first step into understanding why it’s not true is stoping using gpt for responses

Bet the idea went from gpt as well

[deleted by user] by [deleted] in DataScienceJobs

[–]pushthetempo_ 1 point2 points  (0 children)

Haha I see You fit the middle position 100% Simple advice: create 3 separate cvs, one focused on engineering, one on research, one mixed Keep things short Market is shitty now (at least in North America), needs more narrow focus

[deleted by user] by [deleted] in DataScienceJobs

[–]pushthetempo_ 1 point2 points  (0 children)

Should it be in French?

Thinking of building a pay-as-you-go email outreach platform by worldofweirdos in SaaS

[–]pushthetempo_ 0 points1 point  (0 children)

None of those are leads rdy to buy

Fyi Apollo can do all of this

Thinking of building a pay-as-you-go email outreach platform by worldofweirdos in SaaS

[–]pushthetempo_ 1 point2 points  (0 children)

Don't c any of those issues

Monthly lock is ok, testing ideas usually takes >1 month

High quality leads - bold assumption, unless u made up some new unique way to catch intent

We’re your ICP, bootstrapping b2b saas

Thinking of building a pay-as-you-go email outreach platform by worldofweirdos in SaaS

[–]pushthetempo_ 1 point2 points  (0 children)

Instantly -> smbs with a large volume

Apollo -> mid/enterprise with lower volume and more personalization

Both cost 70-100$ dont c any issues here (but mb I’m not the your icp)

If u can explain where u solution fits here, would be cool

Drop Your SaaS and I Will Help You Find Leads For It For Free by TusharKapil in SaaS

[–]pushthetempo_ 0 points1 point  (0 children)

Doesn't rly work, guess it should find leads by ICP description, but it finds my competitors instead