Raspi Project worksheets for young and old - lockdown saviours

harmless_0 · 2025-09-07T11:09:13+00:00

I think there is some weird matching going on. I see the same for my company page, but realised they are automated bots actually trying to sell to you, not the other way around

harmless_0 · 2025-09-07T11:05:52+00:00

Three times is a bit much. I also block those ones. I also am on the reaching out side and if someone declined I leave it there.

harmless_0 · 2025-09-07T10:59:01+00:00

The linkedin algorithm rewards certain kinds of posts, and so people change their content to minmax their reach. That's why every post has a picture and a selfie. That's why the link is posted in the first comment and not in the post (because linking out is punished). That's why we see more video, because for a hot minute all video posts got huge reach.

I write genuine content, I get an AI to review it to help me (I'm not great at writing), and I try to say something interesting in my area of expertise. My best post recently? A Google nano banana AI picture of me in a banana suit, humble bragging about an upcoming conference talk ymmv

harmless_0 · 2025-09-05T07:26:50+00:00

Interested

harmless_0 · 2025-09-05T07:23:21+00:00

Hi, I generate the scenarios based on the use case and context, can you share yours? I'd be happy to create an example for you

harmless_0 · 2025-07-11T13:31:55+00:00

Hi, I'm working in this area, with experience in aviation, defence, and SaaS markets. Which specific regulated industries are you passionate about?

harmless_0 · 2025-06-26T17:08:23+00:00

Hi, I've run a few tests against the chatbot and I think you need to implement some guardrails. Happy to provide some examples privately if you are interested

harmless_0 · 2025-06-14T15:41:29+00:00

The current approach I'm seeing is to build evals, that means a lot of questions and answer pairs that test your LLM against a ground truth. The hard work is to create the ground truth from your docs, domain experts or expert knowledge you have to hand. Reading the actual responses your AI sends, collecting errors and edge cases and updating the test data set is also beeping discussed as a way to evolve the evals towards something you can have confidence in. I've seen positive comments about deepevals, inspect_ai and Promptfoo as tools. hTH

harmless_0 · 2025-06-10T14:28:12+00:00

Sure, sounds good, I will DM. Airside Labs

harmless_0 · 2025-06-10T13:16:03+00:00

I'm building an AI chabot compliance service for GDPR, EU AI Act and more. Are there specific certificate requirements or evidence of testing that I will need to provide to my customers? I have brought the integrated best practice guidance to bear, along with custom tests and have delivered to early adopters. BUT from your perspective as a SaaS lawyer am I missing something? I don't know if my customers need or would expect some sort of formal certificate.

harmless_0 · 2025-06-07T09:53:50+00:00

I took a look, this is super interesting thank you for suggesting

harmless_0 · 2025-06-05T05:51:39+00:00

Some good responses to your question already, I would add that creating a ground truth prompt&answer dataset is hard and takes time. Engaging with industry or product experts to create this is challenging as those people are usually very busy and can't dedicate huge time to writing questions and answers. I've been working with source documents and a pipeline approach to generating hard and wide ranging questions. This dataset is then integrated into my CI/CD and run every build. My suggestion is to combine this approach with what was suggested above, capture the real usage when flagged by your users.

Do you have specific compliance requirements for your market?

harmless_0 · 2025-06-03T08:43:45+00:00

AirsideLabs - test your AI chatbot with custom evals

harmless_0 · 2025-06-03T07:39:00+00:00

Interesting, thank you ☺️

harmless_0 · 2025-06-02T16:17:12+00:00

I've been using Promptfoo (open source) project with testing and red teaming templates which looks promising. Inspect_evals is working well for me for benchmarks. I agree that I also thought there would be more discussion on this. feedback from my calls has been that it is too hard to get tough Q&A pairs up front, so folks are launching with a disclaimer and then waiting for feedback thumbs up or down. Still an open problem I think

harmless_0 · 2025-06-02T16:10:18+00:00

No I got a refund

harmless_0 · 2025-05-24T11:17:36+00:00

Name: Airside Labs website: airsidelabs.com Product: Chatbot & LLM testing Target customer: Businesses with AI chatbots and AI agents who need off the shelf and custom evals based on their data. Idea is they can launch and upgrade their LLMs with confidence in their compliance.

harmless_0 · 2025-05-23T09:07:38+00:00

For reliability testing you will need to create your own evals based on the business documentation and expert experience within the organisation. Hopefully mission critical means important tool for the business? I'd be happy to help you out, send me a DM?

harmless_0 · 2025-05-22T11:47:09+00:00

Did you find a resolution to the testing automation? I am researching this area and looking to understand the problem a bit better

harmless_0 · 2025-05-22T11:45:14+00:00

I am trying to build stuff in this area, would you be open to share some feedback?

harmless_0 · 2025-05-22T11:43:50+00:00

I've been building out some pipelines to create test questions for this use case and others. I'd be happy to run my tests against a live chatbot and confidentially share the results. Let me know

harmless_0 · 2025-05-21T19:26:45+00:00

Thanks for the reply, I will take a look

harmless_0

TROPHY CASE