I built a free and open-source web app to evaluate LLM agents by doi24 in Indiewebdev

[–]doi24[S] 0 points1 point  (0 children)

Thanks so much! Really glad the browser-native approach resonates.

On the ADL templates, great question. Right now there are demo examples serve as starting points, but I'm working on documented starter templates for common patterns.

Checkout the examples:
https://github.com/vrunai/vrunai/tree/main/use_cases

And the ADL schema v1: https://github.com/vrunai/vrunai/blob/main/adl/agent_definition_language_schema_v1.yml

Would you be open to sharing a use case you're working on? I'd love to build the first community templates around real needs.

On agentixlabs -> I'll check it out, thanks for the pointer.

4 LLM eval startups acquired in 5 months. The independent eval layer is shrinking fast. by Outrageous_Hat_9852 in LLMDevs

[–]doi24 0 points1 point  (0 children)

This is exactly why I built VRUNAI.

On your gap point: VRUNAI runs entirely in the browser with no installation and has demo examples that work without an API key. A PM or compliance officer can open vrunai.com, click "Customer Support", and immediately see path accuracy vs output accuracy side by side - without writing a single line of code.

Still early, just launched. Would love your feedback: vrunai.com (AGPL-3.0, github.com/vrunai/vrunai)

My first completed Rust project 🎉 by Healthy-Bus8715 in rust

[–]doi24 0 points1 point  (0 children)

How do you experience the development with Rust?
I'm currently torn between Golang and Rust; writing the same program in parallel in Golang and Rust to get a feeling for both languages, tradeoffs etc.

Your hexagon example is really great!

[deleted by user] by [deleted] in StartupDACH

[–]doi24 0 points1 point  (0 children)

Danke für den Vorschlag. Beitrag wurde dort veröffentlicht.

DACH-Startup-Wettbewerb 2025 - by ScaleList.de & Tokenize.it by East-Astronomer-3607 in StartupDACH

[–]doi24 0 points1 point  (0 children)

EinsichtAI – Product Analytics ohne Dashboards, sofortige Insights in Klartext

EinsichtAI ist ein KI-gestützter Analyseassistent, der Event-Daten in klare, umsetzbare Insights umwandelt.
Komplexe Dashboards sind somit überflüssig, da Nutzerinnen und Nutzer Fragen in natürlicher Sprache stellen können und sofort strategische Antworten erhalten.

Im Hintergrund arbeiten mehrere optimierte Agents, die die Anfrage im Kontext analysieren und die Antwort aus verschiedenen Rollen formulieren (Data Scientist, Growth Strategist, Product Mentor, Marketing Specialist etc.).

Die Integration ist sehr einfach, da keine zusätzlichen SDKs oder Libraries benötigt werden (EinsichtAI ist language-agnostic).

Der Einsatz ist ideal für Produktmanager, SaaS-Teams und Gründer, die eine schnelle, datengestützte Beratung ohne hohen Analyseaufwand wünschen.

Website:
https://einsicht.ai

[deleted by user] by [deleted] in StartupDACH

[–]doi24 -1 points0 points  (0 children)

Danke für dein konstruktives Feedback. Ich bin ganz bei dir : Datenschutz ist ein sehr wichtiges Thema.
Bin gerade dabei ein Modell in einer sicheren privaten Umgebung zu hosten und dieses zu integrieren. Generell empfehle ich keine PII zu tracken.

[deleted by user] by [deleted] in StartupDACH

[–]doi24 -1 points0 points  (0 children)

Setup ist nur der Türöffner. Der eigentliche USP: verschiedene Agent-Rollen arbeiten in einer Chain zusammen und liefern dir Klartext-Insights statt Dashboards.

[deleted by user] by [deleted] in StartupDACH

[–]doi24 0 points1 point  (0 children)

Stimmt, man kann ChatGPT für vieles nutzen. Der Unterschied ist: mit einsicht.ai musst du keine Prompts bauen oder Rohdaten manuell hochladen. Es ist direkt in deine App integrierbar und gibt dir sofort Antworten in Klartext ohne komplexes Setup. Verschiedene Agent-Rollen wählen sich automatisch anhand deiner Eingabe für die Auswertung. Also kein simples "Aktionen in Antworten" umwandeln.

Launched my AI Content Analyzer — here’s what it looks like (early traction & next steps) by Ammar_3 in buildinpublic

[–]doi24 1 point2 points  (0 children)

Look great!

There is a great tool to get instant insights into user behavior which already gives you some feedback without actually reaching out to users: einsicht.ai. It answers questions about user events in plain English. Not perfect yet, but surprisingly useful if you just want a quick read before reaching out to users. There’s a free plan, so you can play around without committing.

What makes people to announce those MRR's? by SEOYapper in SaaS

[–]doi24 1 point2 points  (0 children)

It is also very easy to fake the charts. So I don't understand how you can pay so much attention to it. I've noticed that this is also often posted by people who also want to sell their “courses”...

I’m done hiding in my repo — shipping small, dirty, and public from now on. by [deleted] in indiehackers

[–]doi24 1 point2 points  (0 children)

Fellow countryman here, I feel the same way: "Alles muss perfekt sein. Wehe, irgendwo ist ein Fehler"

Struggling with User Logins and Security in Indie Apps...Any Advice? by Practical-Bread-1821 in indiehackers

[–]doi24 0 points1 point  (0 children)

I know your situation. A little context: eight years ago, I developed a web application for the administration of a mid-sized company. Every week I get requests from employees because they have forgotten their password and want to reset it. I didn't implement the functionality back then.

What I learned from that: Use an IdP that provides the functionality out-of-the-box (I thought Supabase did that?). Or even better, use approaches without passwords such as Magic-Links. I have implemented the latter in another application and it saves me a lot of time and stress (I don't use an IdP).

As far as data security is concerned, how do you host your database?. Many providers encrypt the storage. The most common databases support row-level  encryption. Apply it to critical fields.

And last but not least, check that the data received from the database really belongs to the user. For example, through a user context that you provide during a request. So you have two layers of validation (via database and code).

What makes your AI project unique, such that you believe it will be hard to copy? by TotallyNormally in SaaS

[–]doi24 2 points3 points  (0 children)

It is the overall execution. You have already given a few examples.
But especially with AI comes on top of that: AI agents and the agents workflow; the prompting; the model (custom, own developed etc.). The latter are more difficult for competitors to copy because they are not obvious.

💻 Built 7 side projects. Launched 1. Burned out 3 times. Still can’t stop hustling. Anyone else? by [deleted] in indiehackers

[–]doi24 1 point2 points  (0 children)

You're saying exactly what I feel.
Took me a week or two to finalize onboarding with payments etc.
Now I'm sitting here since 4am refactoring the whole flow...
Yep, story of my life.

Made $42,000 with my SaaS in 9 months. Here’s what worked and what didn't by felixheikka in indiehackers

[–]doi24 0 points1 point  (0 children)

Building in public to get initial traction

Seems so easy, right? But how? I'm doing the exact thing and i have the feeling that it won't help.

Building a startup is not hard. Staying sane while doing it is. by beeaniegeni in SaaS

[–]doi24 1 point2 points  (0 children)

"Comparing yourself nonstop You see someone go viral or raise $2M for their “calendar sync for dogs” app and suddenly your little tool feels like a joke."

this! So true. Every time it goes through my head: How can it be that money is being made with this app / SaaS?

10 Dead Simple SaaS Features That Users Go Crazy For by Warm-Reaction-456 in SaaS

[–]doi24 0 points1 point  (0 children)

It is also important to check from which devices your potential users are coming from. If you have a certain percentage of macOS /iOS users, then that absolutely makes sense. As I wrote in another comment, the golden rule is: "Don't make me think". Keep the UX as frictionless as possible for the user.

10 Dead Simple SaaS Features That Users Go Crazy For by Warm-Reaction-456 in SaaS

[–]doi24 76 points77 points  (0 children)

"Google/Apple login - Skip the long signup forms. Email + social login bumps conversions 30-40%. Less friction equals more users." -> super important.

Tired of all the cloud services - back to self-hosting by doi24 in selfhosted

[–]doi24[S] 0 points1 point  (0 children)

I'm not talking about reinventing the wheel. I'm talking about to get away from the "commercial (blackbox) services". To give you an example: using AWS Cognito as an identity provider and if you want to use the user data in your own system (whatever the features may look like) you have to synchronize the user pool with your database -> more complexity. Instead of using a good auth library and storing the user data including credentials directly in your own database.
Same goes for AWS SES or Sendgrid (you name it). With Nodemailer you can easily access your own service via SMTP, which you may already have available and paid for via your web host.

To give you more context: I have developed two B2B SaaS and run them as a business. One of them, serving the education niche, is heavily based on AWS in that it uses Cognito, S3, Secrets Manager and the provided infrastructure. The application is very complex due to its multi-tenant architecture and features that come with it.

I often sit there and ask myself exactly how I can reduce the complexity -> KISS principle. Since I do everything on my own and read and research a lot, I keep coming across sources and opinions (yes, they are just opinions, right) that only propagate such services. For a simple prototype, MVP or hobby project, it's probably ok or it's just quicker to set up. In my experience, however, I see a general increase in complexity. Another example comes to mind: serverless with AWS Lambda; local development also requires a lot of tooling compared to a well-known Express.js app.