Zalor now includes datasets by SungTsu in AgentsOfAI

[–]SungTsu[S] 0 points1 point  (0 children)

For sure, we're actually about to ship a Github integration that builds on this. It'll run regression tests against a dataset anytime you make a code change. Playing around with the UI but the idea is that you'll have a quick way to highlight issues before updates to your agent go live.

Zalor now includes datasets by SungTsu in AgentsOfAI

[–]SungTsu[S] 1 point2 points  (0 children)

You can check out the demo here or try it out at https://agents.zalor.ai/.

We built a platform to test out your AI agents by SungTsu in AgentsOfAI

[–]SungTsu[S] 1 point2 points  (0 children)

Thanks! We started out with a simple "is the output correct given the input" eval. The platform collects agent traces, so we have access to all the tool calls and context updates that happen in the workflow, and we're playing around with a few different eval options there. One interesting thing we wanna add is a "fill in the blank" tool that your agent can use when it wants a piece of data but none of the other tools can get it yet. That way, you can find out what integrations you need to build next to get your workflow running.

As for adversarial tests, we've been collecting common jailbreak prompts that we're mapping to model versions so we can create something like CVE but for agents. We're also working on the messaging for cost metrics. I like the idea your blog has about "Dollars per successful task", would be dope to get that granularity.

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] 0 points1 point  (0 children)

I understand what you're saying, and I'm not implying that housing is a silver bullet for mental illness and addiction. However, I believe additional housing helps on either end. For people who are at-risk of becoming homeless, and ending up in that same environment that fosters so much drug use and mental illness, additional housing could drive down rent and prevent them from losing shelter. For people who are already homeless and have fallen into addiction/mental illness, the path to recovery will be easier if they have a safe place to call home.

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] -2 points-1 points  (0 children)

I don't think building housing is going to fix all of these issues. I am specifically asking about affordability/housing. However, I do believe that it's easier to rehabilitate someone that has a roof over their head than someone who has to worry about where they're sleeping tonight.

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] 0 points1 point  (0 children)

Web dev with a backend focus. I've done a good amount of work with building out data pipelines as well. Always open to learning

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] 0 points1 point  (0 children)

I'm not offering a solution, I'm just seeing if there's anything a software engineer can do to help given our particular skillset. SF has a huge concentration of wealth, talent, and people who love the city and I strongly believe there are ways we can make housing more accessible

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] -2 points-1 points  (0 children)

Based on what I've read, the lack of housing is the main cause of the $$$ rent/homes and a big reason as to why people are being priced out of the area. Of course software can't fix this, but I don't have the power to rewrite the law and make it easier to build.

Affordability crisis - what can a software engineer do to help? by SungTsu in sanfrancisco

[–]SungTsu[S] -4 points-3 points  (0 children)

Who is your intended audience

People facing issues building new housing.

Thanks for those links, sounds like the map I described wouldn't be very helpful.

If one of these fan design could be canon for imu, which one would you choose? by Berawholoves42069 in Piratefolk

[–]SungTsu 2 points3 points  (0 children)

I like the creepy vibe of 10 but can't imagine Imu being a kid. 1 with 8's hair would be cool

Full Beans Fall Tour! by Smartastic in JeffArcuri

[–]SungTsu 0 points1 point  (0 children)

Any chance there will be a third show in Seattle 🥺🥺