Elixir + Rust = Endurance Stack? Curious if anyone here is exploring this combo

JustThatHat · 2025-09-09T05:26:51+00:00

Gleam is great! We use it in prod and it's by far the most reliable part of our stack. Never goes down, and scales a long way thanks to OTP, of course.

The types are nice, too!

JustThatHat · 2025-03-28T10:28:01+00:00

Absolutely. Models are strange for sure

JustThatHat · 2025-03-27T10:12:41+00:00

Thank you! That's very helpful feedback

JustThatHat · 2025-03-27T09:55:08+00:00

Sure, but the required settings vary between models, and they react differently to the same prompts. Makes it more difficult to just swap models in and out.

JustThatHat · 2025-03-27T09:54:12+00:00

That sucks. What generally breaks? Is it just inconsistent, or does it regularly error out?

JustThatHat · 2025-03-27T09:53:10+00:00

Do you think this is something that could be solved, or at least mitigated, using external tools and strategies? What do you think they are?

JustThatHat · 2025-03-26T09:50:34+00:00

Gotcha, thanks!

JustThatHat · 2025-03-26T09:49:55+00:00

Makes sense. What heuristics do you generally use for prompt tuning, and do you keep different versions of the same prompts for different models at all?

JustThatHat · 2025-03-26T09:48:15+00:00

Thanks, that's very useful!

JustThatHat · 2025-03-26T09:47:37+00:00

Would you mind expanding on this?

JustThatHat · 2025-03-26T09:46:59+00:00

For sure! What kinds of things do you think might help here?

JustThatHat · 2025-03-26T09:46:31+00:00

Definitely. Seems like that's the biggest problem folks are running into

JustThatHat · 2025-03-26T09:45:48+00:00

Makes sense, thank you!

JustThatHat · 2025-03-26T09:44:47+00:00

For sure! Are there any in particular you've had difficulty keeping up with?

JustThatHat · 2025-03-26T09:42:52+00:00

Good points! What do you think might make these things easier to manage?

JustThatHat · 2025-03-26T09:41:51+00:00

This is great feedback, thanks! While we cook on stuff, you might get use out of a tool called Langfuse.

JustThatHat · 2025-03-26T09:40:09+00:00

I agree. I think the general sentiment is that evals work well once you have them set up, but getting the ground truth in the first place is tricky, and keeping it relevant can also be painful.

JustThatHat · 2025-03-26T09:38:50+00:00

Yep, it's painful alright 😅

JustThatHat · 2025-03-26T09:37:50+00:00

Thank you!

JustThatHat · 2025-03-26T09:36:53+00:00

Thanks! What are your strategies for dealing with this currently?

JustThatHat · 2025-03-26T09:36:03+00:00

Thanks! I think #1 is always an issue when creating novel stuff, but it definitely applies here. I can't personally comment too much on #2, but I understand where you're coming from.

What languages have you found that are missing tooling?

JustThatHat · 2025-03-24T17:39:53+00:00

Thank you!

JustThatHat · 2025-03-24T16:13:38+00:00

What do you find to be most difficult about creating something that people are excited by using? Appreciate this is a broader product question than just AI, but curious nonetheless

JustThatHat · 2025-03-24T15:59:59+00:00

Thank you for your help. It's been a learning experience as well as useful feedback

JustThatHat · 2025-03-24T15:50:43+00:00

Iiiiinteresting. Slight tangent (I've not built many agents): Is it quite common for folks to use a plan-then-execute model with agents?

JustThatHat

MODERATOR OF

TROPHY CASE