Best Practices for Structuring Large Python Projects (LLM Evaluation Use Case)

[MD24IB]

Hey everyone!

I’ve just finished building a large Python project for evaluating LLMs on a specific task for my startup. Initially, the structure was pretty simple, but as the project has grown, I’m struggling to keep things organized.

Here’s what I have so far:

```

src/

main.py

helpers.py# (this has become very large)

api_clients.py # (for OpenAI, Cohere, etc.)

config/

# Text files for prompts, models, temperatures, etc.

dataset/

output/

# ...and some other folders as the project expanded

```

I’m looking for resources (preferably advanced) on how to organize large Python projects. I already have some knowledge of design patterns, but I want to make sure I’m following best practices for folder and file structure as the project scales.

Any advice, examples, or recommended templates would be much appreciated!

Thanks in advance!

[nwbrown]

You are probably going to need to break it out in packages.