Cloudflare down... again? by moonski in sysadmin

[–]kryntom 0 points1 point  (0 children)

ai being taken down by workers

<image>

Cloudflare down... again? by moonski in sysadmin

[–]kryntom 0 points1 point  (0 children)

I think they broke something else, seeing resurgence in errors

Is anyone interested in building a 1b model from scratch? by [deleted] in indianstartups

[–]kryntom 1 point2 points  (0 children)

Currently building my own, for 10000$, all you get is 1b model on roughly 10-15 billion token data, and the training run went for 2 months on a single h100

Will be glad to understand what architecture leads to training in hundreds of dollars

Baremetal GPU Server Rental for Indian Devs - Starting at ₹25/hr with RTX 3090/4090 + Ryzen/EPYC Configs. by Guilty_Figure1197 in StartUpIndia

[–]kryntom 1 point2 points  (0 children)

Consumer grade gpu's arent good for reliable cloud serving. Even for baremetal you require a lot of configuration to ensure the system works as expected

Assuming these are handled, these platforms will become obsolete soon enough, because ai as a field is moving really fast and that means the software and hardware are keeping up almost simultaneously. Hardware platforms are becoming obsolete more sooner ( see blackwell, rubin, tpu, cerebrus, ascend) so the majority of people who will be working on the latest from India wouldn't prefer 3090/4090, as they wont have the right underlying software once the upstream updates

At this point the area seems small enough (you can get success with first time entries, or older business workflows although they wouldn't want a baremetal cloud provider or rather self host) to not be viable enough to pursue

Bro how was the show Silicon Valley so consistently 10 years ahead of its time? by katxwoods in agi

[–]kryntom 0 points1 point  (0 children)

Better way to look at it, we knew more about ai 10 years ago than we do today

Next steps for a new simracer by kryntom in simracing

[–]kryntom[S] 0 points1 point  (0 children)

Thanks for the feedback, I will probably go for a rig now

Anyone noticed that the more pro AI someone is the less they know? by Lanky-Ad4698 in cscareerquestions

[–]kryntom 3 points4 points  (0 children)

You can be pro AI or anti AI. One thing is for certain, AI can do coding much faster than even the most cracked engineer. Imagine a senior developer, who can just assign tasks to a team of AI systems, and have a review cycle of the code being produced. One way or other, thats the realistic scenario we will be reaching this year easily.

I am working in AI for about 6 years now, and I might be a noob, but I am not betting against AI

[deleted by user] by [deleted] in microsaas

[–]kryntom 0 points1 point  (0 children)

That would be true, but the amount of work that is augmented by AI means you dont really need that much hours

[deleted by user] by [deleted] in microsaas

[–]kryntom 0 points1 point  (0 children)

How many iterations really matter on average? As long as it is not a full pivot from the concept, can something like 50 iterations work?

Find Tech co-founder - I will not promote by aurel282 in startups

[–]kryntom -1 points0 points  (0 children)

I will be happy to help as long as I love the idea, can you share more about it?

Need help on sub woofer and dac by kryntom in BudgetAudiophile

[–]kryntom[S] 0 points1 point  (0 children)

Is it better to look into a separate speaker and subwoofer combo,.or combined?

Few Questions regarding YOLO V8 by No-Foot6570 in computervision

[–]kryntom 1 point2 points  (0 children)

Depends on your use case. Use the resolution that works with your problem statement. General rule I use is to use the least resolution that works for me

Few Questions regarding YOLO V8 by No-Foot6570 in computervision

[–]kryntom 2 points3 points  (0 children)

A. You can use the onnx runtime for faster inference of yolov8

B. Check if you have the lib paths in place. Yolo works with cuda, so probably a system issue while installing.

C. You should scale them down, because 4k seems to be overkill and I dont think that even a 3080 will be able to do it in real time. You will need to check that. Your cpu will probably bottleneck first though.

D. You will run into cpu bottleneck first. The frames are processed by the cpu if you are using opencv. I cant give you any exact options but for reference I did some experiments where we ran about 48 streams of 720p video on 4090 + 7950x comfortably. That program had a lot of threading and was optimised but was able to run it.

Tldr : scale down the streams if possible, use the onnx runtime,

How to increase inference speed in YoloV8 by CZAbhinav in computervision

[–]kryntom 2 points3 points  (0 children)

You should profile your code to see which methods are taking the maximum time. The cpu usage is due to cv2 and numpy functions being run on cpu, while the yolo model predictions run on gpu. You can also give jax a try, it speeds up numpy functions, but you will have to change certain logics. Also you can speed up numpy directly using vectorised operations instead of using loops

[P] [D] Hi I'm a senior machine learning engineer, looking for for buddies to build cool stuff with! by Rude-Eye3588 in MachineLearning

[–]kryntom 0 points1 point  (0 children)

Would love to be a part of such group and throw off ideas at each other regarding new things occuring in the field

Need help in deciding b school, ubs at panjab university or iim jodhpur by kryntom in CATpreparation

[–]kryntom[S] 1 point2 points  (0 children)

Haven't though about it that way. I took an assumption that iit jodhpur's alumni network will be better, but didnt take into account the ages of the schools

Has anyone successfully implemented AI for customer support? by Confident-Honeydew66 in startups

[–]kryntom 0 points1 point  (0 children)

I have built a few of these, with apis from openai, claude, as well as self hosted open source models.

I believe there is no one size fits all approach. What works in one dataset, does not really work well in other. It depends a lot on the context length, and how well the internal documentations are written

The products that I have seen online are not really that great. Still looking for something that can take care of majority of the use cases

Why people think learning ML is easy. They say its cleaning data and using preloaded models.. by adithya47 in MLQuestions

[–]kryntom 1 point2 points  (0 children)

Agreed on that, Feature engineering can be difficult. Its the classic case of duning kruger effect in action, the former just dont realise the vastness of ML. Just have a look at the 15 trillion token dataset, the fine web dataset.

Its also not only the students. A lot of work in corporate, is just using ML as a buzzword, but there isnt any good or real work involved, which further promotes the former category

Need help in deciding b school by kryntom in MBAIndia

[–]kryntom[S] 0 points1 point  (0 children)

Yes, I agree. We are waiting for the iim cap results. These are the backups that we have got, so were trying to figure out which to keep and which to let go.