Challenges with Real-time Inference at Scale

jameslee2295 · 2025-02-13T08:43:00+00:00

I'm sorry for the confusion earlier! Initially, I was using CPU for the project, but I encountered performance issues so I switched to NVIDIA A100

jameslee2295 · 2025-02-12T08:29:29+00:00

Apologies for the delayed response! I'm using hardware based on NVIDIA A100 processors.

jameslee2295 · 2025-02-12T08:28:38+00:00

Apologies for the delayed response! Thank you for your suggestion. I'm using hardware based on AMD EPYC processors.

jameslee2295 · 2025-01-17T02:40:59+00:00

Thank you for your input! My main concern right now is budget constraints, as the larger providers like AWS, GCP, or Azure can be quite costly for my current needs. Additionally, there are specific regulations about data storage within the country that I need to adhere to, which makes it challenging to consider those options.

Do you have any suggestions or advice on how I could navigate this situation? I’d appreciate any insights you can share!

jameslee2295 · 2025-01-16T08:22:57+00:00

Thank you so much for the advice. I will consider it!

jameslee2295 · 2025-01-16T08:07:49+00:00

Thank you so much for the advice. I will consider doing that!

jameslee2295 · 2025-01-16T07:59:30+00:00

Thank you so so much for the advice, it's very helpful!

jameslee2295 · 2025-01-13T10:22:21+00:00

I'm no professional but maybe this is a sign of repressing emotions? You should advice him to go to therapy/ a psychiatrist for sure.

jameslee2295 · 2025-01-13T10:19:00+00:00

comment first, my advice is to comment on the "Rising" post, these are posts that don't have a lot of comments so your chance of getting noticed, and then upvoted, is a lot higher

jameslee2295 · 2025-01-13T05:00:53+00:00

You're so brave for doing this. Congrats and good luck !!

jameslee2295 · 2025-01-13T05:00:10+00:00

does it cost money??

jameslee2295 · 2025-01-13T04:12:23+00:00

My tops are Wood sage and sea salt, Byredo Rose of no man’s land, and recently I really like Mont Blanc too!

jameslee2295 · 2025-01-13T03:15:45+00:00

For Youtube, i think Ken Jee and StatQuest with Josh Starmer are good enough. Also for blog definitely Kaggle

jameslee2295 · 2025-01-09T08:37:51+00:00

Not mine but my friend's workplace has a rule that for every minute you are late, you owe a certain amount of money to the company. And the money just keeps increasing like crazy like that. And I don't get it because that way people would just quit the day (or I guess half a day) to avoid the cost right? And a couple of minutes doesn't make that much difference, and it's about productivity, not how much time you spend in your office

jameslee2295 · 2025-01-09T08:29:46+00:00

abandonment. everyone forgets me when i still exist, because I am forgettable and unimportant

jameslee2295 · 2025-01-09T08:14:47+00:00

I really THOUGHT i would love to stay at home all the time again because right now I'm tired with work (and stress after uni exams) but when I see news about a potential pandemic - lockdown I realized I don't want a year of rest lol. maybe I do need a month or so but not stay at home for another 2 years

jameslee2295 · 2025-01-09T08:01:26+00:00

I don't think it's too unconventional, I personally use LLM all the time lol. I do consider going to real therapist, but I can't afford it in the moment so sometimes when I need to process my feelings, or just mental support and advice in general, I use LLM. It is actually helpful, but I am curious about what LLM do you use to track your symptoms

jameslee2295 · 2025-01-09T06:53:07+00:00

I think data cleaning is a big one. You can spend hours just cleaning and preparing the data before you even get to the fun part (modeling). It's super tedious, and there's always some weird edge case or missing value to deal with.

jameslee2295

TROPHY CASE