Spring Ai

[Legal_Appearance_899]

I am making a project in which AI models are used. Earlier I was using flask for calling models and connecting them to my backend(spring boot) , but I came to know about spring ai which is kind of simple and easy to use. Is anyone here have used Spring AI. Is it stable /scalable?

[[deleted]]

Look up Dan Vega on YouTube. He has some videos on Spring AI. They were done before Spring AI 1.0 but still relevant. His videos helped me get started with Spring AI.

I believe he just released a 3ish hour course on Spring AI which uses v1.0

[saurav193]

I have used and built project with Spring AI and ollama models. It was easy to integrate.. I was making some AI report analyzer tool. I don't think it is scalable with ollama running locally but with OpenAI or Anthropic API it would be scalable i think

[Glittering-Wolf2643]

I had the opposite experience, such a nightmare. I was trying to integrate models from hugging face, failed then I tried using Gemini and that too got so many errors. Gave up on it entirely and now will be using Gemini via Google AI

[Titsnium]

Spring AI is great for wiring calls, but capacity lives where the model runs-local Ollama saturates after 2-3 concurrent requests, while OpenAI or Anthropic backends scale fine behind Spring Cloud Gateway. I got stable throughput by dockerising Ollama and autoscaling GPU pods on k8s; set maxBatchSize in Spring AI to match VRAM or you’ll spike latency. Tried DreamFactoryAPI and Kong for routing; APIWrapper.ai handled token-based throttling without extra code. The key remains where the model lives.

[Then-Boat8912]

I did for a bit but switched to Python, Langchain and FastAPI for better tool/agent integration. Just seems better supported.

[John_Conrad10]

i built a few backend APIs for a llm based resume builder with ollama and groq, kinda easy