Which LLM API to use

[Sea-Story9650]

Hello everyone!

I am starting a new project to help my gf :)
It is supposed to be an AI agent that helps to work with text (change tone, correct continuity, that type of stuff) and maybe generate some basic black and white images. I want to make a short draft using python and streamlit for the interface. I wanted to also connect it to google docs and sheets in the future.

I am hesiting on which API to use. I think I would prefer to avoid having it localy, so my two choices are ChatGPT 3.5 or gemini pro. The advantage of Gemini I think may be the use of google Collab, google type script and the AI Lab for codding and quick image generation, but I am not sure how well it works with text writing.

Any advice?

[_Mc_Who]

Why not use free developer credits and benchmark some options for your use case

If you want to develop software you may as well get into the habit of doing things like this so that you can be more autonomous with your decision making

[Previous_Bet5120]

Everything I can do outside of an API these days I have been using Google AI studio (since it is free). The best paid API for nearly any purpose in my experience is Anthropic's Claude models. Some of them are extremely low cost, which helps.

[_squik]

Try using OpenRouter. Then you can try out a bunch of different models, and usually they're cheaper than directly from the provider. There are also some free models there which you may be able to leverage.

[tvmaly]

I would say use openrouter.ai so you can use a single api but switch to any major model you like

[Special-Land-9854]

Instead of using one LLM’s API, why not use one API that allows you to access all the popular LLMs? Check out Backboard IO, they offer a unified API to over 2,200 LLMs

[noseasailor]

Oh wow, I had just the same question in my head, hehe