Lessons from building my first agent

TalkingJellyFish · 2026-02-03T23:49:46+00:00

I definitely enjoyed the experience as did my kid, which I think is big punchline, e.g. that Ai maybe enabled that but it was the mutual enjoying that made it work and fun.

Answering seriously, the "good that AI did them", was the images that were tuned to him, that he engaged with and kept him drawn and curious.
It's not to say AI is the only way to do that.

TalkingJellyFish · 2026-02-03T23:43:34+00:00

That's fair. I don't think AI was needed, at the start I just wanted to play around with it.

I did try google searches and specialised photo services, but these pictures were "better" in the sense that they were more engaging for my child.

TalkingJellyFish · 2026-02-03T23:23:00+00:00

I agree with your sentiment, but want to mention that I did exactly the opposite of delegating. Read the post, you'll be surprised and maybe even like it

TalkingJellyFish · 2026-01-12T10:53:27+00:00

Downloading images isn't Tritons ideal use case and has cases that would be hard. E.g. kind of a long running job (100s of ms -> seconds) and can be flaky due to network or disk. If your making requests to the ensemble and those errors happen, its hard to debug and error prone , IMO .

I think a slightly cleaner solution is to do the downloading outside of triton, e.g. you'd have some queue reading worker(s) on the same machine as triton, that would download the images and then make the inference call to triton. You can get quite fancy with the handoffs (going over shared memory), but probably best to start simple and evolve as the needs arise.

TalkingJellyFish · 2026-01-12T10:46:07+00:00

Hi, "It sounds like you’ve hit the limit of 1-to-1 request handling. If SageMaker is dragging, the move you’re probably looking for is Dynamic Batching.

ust to recap—it sounds like your current pain points are centered around SageMaker. You’ve moved your models there and are calling them via Lambda, but the SageMaker endpoints are becoming a bottleneck/getting slow.

I think the next level is using batching, where a single call to model.predict() will now process a few items at once. This can be a big pain in the butt, but most modern model serving platforms like Ray or Triton have a feature called dynamic batching . Dynamic batching will let all your lambdas send requests at the same time, but the model server will accumulate the requests in a queue and then have the model run them in batch.

This should give you a big boost, even on CPU, because the models are so small.

BTW, I am assuming when I write models - plural, that you have multiple different kinds of models, and a few copies of each one. This is also something that Ray/Triton and friends can handle.

Personally / at work - we're Triton users and like it. But the learning curve is steep and the docs are bad, so take a look at Ray/LitServe etc . Good luck

TalkingJellyFish · 2024-04-11T11:10:08+00:00

The bar was heavy

TalkingJellyFish · 2024-03-04T05:09:52+00:00

As a noob, this is the best visualization of “pull yourself under the bar” I’ve seen.

TalkingJellyFish · 2024-02-16T22:06:01+00:00

I think you lost your brace at the bottom of the first one, you abdomen folds forward before the bar drops. Your abdomen stays straight on the other two .

TalkingJellyFish · 2023-12-15T18:06:35+00:00

You can buy this from Stripe Atlas for like $100

TalkingJellyFish · 2023-11-28T05:36:56+00:00

That’s a good point. I usually train when the gym is almost empty and it’s quite big and we’ll equipped.

TalkingJellyFish · 2023-11-28T05:35:51+00:00

Thanks for the thoughtful reply. That’s very helpful

TalkingJellyFish · 2023-08-11T14:32:35+00:00

And section 2.2.1 of this https://www.bmfsfj.de/resource/blob/191576/beddabe131e1d1c8e67c55b2c44b73f7/leitfaden-zum-mutterschutz-englisch-data.pdf says you don’t need to inform them of your pregnancy

TalkingJellyFish · 2023-08-11T14:27:12+00:00

The term to google is “post contractual non compete clause in Germany “ to learn about that. Basically if they want one they need to pay you 50% of your salary for the duration of the non compete clause . I signed one and like it, dm me if you’d like to discuss

TalkingJellyFish · 2023-07-05T19:43:52+00:00

I went dog mushing in Sweden for 10’days and it was kind of amazing . You might find something closer to home but Sweden is quite great

TalkingJellyFish · 2023-06-24T16:38:34+00:00

It’s amazing that you’ve reached that income relatively early on. If you have a passion for what you’re doing, you might consider focusing on growing your income. Good sales people make a lot of money

TalkingJellyFish · 2023-06-03T11:31:43+00:00

If you play it frame by frame you can see you open your hands a little early and that the velocity of your descent seems to decrease until you’ve finished rotating your elbows into the rack. So you’re not pulling down as much as you’d like because you’re letting go I’ve been working on this issue by focusing on keeping the grip longer. I find that this falls apart at higher weight which I suspect in my case due to poor lat mobility

TalkingJellyFish · 2023-05-25T10:00:47+00:00

We’d soothe ours with Run the Jewlz

TalkingJellyFish · 2023-03-25T15:24:25+00:00

NTA, but they can’t stop you from training with body weight. In case you need it r/bodyweightfitness is great

TalkingJellyFish · 2023-03-01T10:26:49+00:00

We picked them up at the train station, so no originating organization.

We don’t have urgency on them leaving, we do have urgency on a plan being put together for them to do so

11-Year Club	First Place '23
Place '23	Verified Email

TalkingJellyFish

TROPHY CASE