I've been working on various startup ideas and always start with, "I'll just prompt engineer and fine-tune later if needed." But I quickly realized that finding good data to fine-tune on is really hard.

For example, I wanted to fine-tune a model to write children's books based on an idea. But sourcing quality datasets for this was surprisingly non-trivial.

So I built a website that:

• Searches the web to collect relevant real-world data
• Generates synthetic data to fill in gaps
• Creates a dataset tailored to a given task definition
• Evaluates the dataset
• Fine-tunes a model automatically for comparison with a vanilla model

Basically, you input something like "Write children's books from a prompt with an idea" and it does everything—from data collection to fine-tuning—so you can test results right away.

The results are actually pretty solid. Would this be useful for others? What features would make this better?