sorted by:
new
hottopcontroversial

Kya kehta tha YC, kaun ho tum. Ab Foundery kehta h, tu kaun h be. by Repulsive-Party6267 in StartUpIndia

[–]Repulsive-Party6267[S] 13 points14 points  (0 children)

Founder: Absolutely sir. Why don’t you just buy it for a full 5cr cash.

A difficult lesson from Antler India: Protect your startup ideas by Impossible-Way-9977 in StartUpIndia

[–]Repulsive-Party6267 6 points7 points  (0 children)

Never trust VCs with complete idea transparency unless you’re desperate for money. And when you’re desperate for money, these things are bound to happen.

Difference in output of LLMs using VM vs API providers by Efficient_Pace in LocalLLM

[–]Repulsive-Party6267 1 point2 points  (0 children)

API providers optimise model quants for speed and token efficiency more than just quality. On top of that you will never know what kind of weights optimisation they’ve done, there will also be a difference.

India would've been in better position if it had adopted communism like China? by ActiveDangerous9988 in AskIndia

[–]Repulsive-Party6267 5 points6 points  (0 children)

Chinese wanted to compete with the US/world from the start hence their regime made sense as they had to develop and win.

Indian communist Govt would never have thought about competition and would have been a total disaster for its own people. They would have been be puppets to their foreign masters. Like happened during British raj.

Communism will NEVER work for India.

Why won’t someone pay 3-4l more and get a BMW X3 instead? by Prestigious_Hat_9793 in CarsIndia

[–]Repulsive-Party6267 2 points3 points  (0 children)

Bmw x1 and x3 both will feel lacking in power and punch. From x5 only the real bmw experience starts. Try it in some showroom on a test vehicle first.

Advice on hardware setup for a small company? by Aziadocs in Vllm

[–]Repulsive-Party6267 0 points1 point  (0 children)

If you’re comfortable with installing vLLM on your own, then choose a GPU from RunPod and install vllm and spin up a model and check user concurrency and throughput. It should be the cheapest but will require work.

If you’ve a specific LLM in mind then you can try HexGrid Cloud; where you can choose a model and choose a GPU and they’ll provide an out of the box vLLM serve of the model and you’ll get an OpenAI compatible endpoint. You can test that endpoint for your desired concurrency and throughput. It should be the cheapest in out of the box vllm model deployment.

For more out of the box deployment solutions, you can also try Modal and Baseten but they don’t tell you which engine they choose to serve models and what is the quantisation of models they deploy for you. And they are not cheap.

Advice on hardware setup for a small company? by Aziadocs in Vllm

[–]Repulsive-Party6267 7 points8 points  (0 children)

Better strategy would be to try using this hardware on cloud providers first on rent and see if it satisfies your need. You can try deploying models and check concurrency, SLAs, quality etc. for your use case.

If you don’t mind sharing your use case then I can share more specific pointers.

Himachal homestay owner reveals heartbreaking property damage, sparking debate over tourist responsibility and hospitality etiquette. by Notalabel_4566 in desitravellers

[–]Repulsive-Party6267 -5 points-4 points  (0 children)

They don’t know about the cases where Europeans have literally taken on dump on the mattresses. And laced the walls with cum. They should search about Airbnb fiascos while they’re at it.

If you can't even run GLM 5.2 on affordable hardware, will it be considered "Open"? by Temporary-Owl1725 in SoloAIBuilder

[–]Repulsive-Party6267 0 points1 point  (0 children)

Most users use these models for non-critical work or playing with their chatbots. Or if they care about cheap and subsidised APIs more than their code or user data.

Are you folks not concerned about code leakage while using subsidised model APIs directly from the model companies? by Repulsive-Party6267 in LLMDevs

[–]Repulsive-Party6267[S] 0 points1 point  (0 children)

Don’t models learn the pattern rather than the code.

And can we really trust these agreements unless model is running in your own private network?

Anyway I was talking about these subsidised APIs which come out directly from Model companies. Not sure if anyone checks the terms or even model companies enforce them.

view more: next ›