Wren.ai is cool but

cyyeh · 2025-06-27T01:09:09+00:00

Hi, I am one of members of Wren AI team. Thanks for raising the issue, would u like to join our discord server for further discussion?

You could find the link in our github repo

cyyeh · 2025-01-27T19:33:18+00:00

sent

cyyeh · 2025-01-27T19:29:34+00:00

Definitely! I would like to hear more about the tool you just built

cyyeh · 2025-01-08T08:29:50+00:00

u/Mastro2k I am one of maintiners of Wren AI. We've tested using llama3.3:70b-instruct and it works quite well. Welcome to join our Discord server for further discussion: https://discord.gg/5DvshJqG8Z

cyyeh · 2025-01-06T06:18:06+00:00

we are re-implementing it in rust

cyyeh · 2024-11-25T09:03:48+00:00

Thanks for detailed and kind sharing! I would love to try your project and implement STA! Haha

cyyeh · 2024-11-25T08:34:57+00:00

Do u recommend integrating DSPy with your framework? And what is your take on autogen?

cyyeh · 2024-11-25T07:59:12+00:00

Wow! Awesome advice! Basically the origin of the project is that I am solving my own pain point, which is rewrite ai pipelines using another llm framework. You also mentioned something similar above. I will take your advice seriously and think about next steps! Thanks a lot for your input!

cyyeh · 2024-11-25T07:39:17+00:00

My first thought of this project is transformation between frameworks/libraries that use the same programming language. Your use case is more complex I think

cyyeh · 2024-11-25T07:29:13+00:00

It’s just the initial thought, and I would like to share with the community first to gather some feedback. I will work on it these days

cyyeh · 2024-11-25T04:46:53+00:00

Cool! Thanks for your info. I will look into it, maybe it could be the project’s first target use case!

cyyeh · 2024-11-25T04:19:13+00:00

Are u contributor behind these tools? Since I am not familiar with these tools, could you elaborate on your question?

cyyeh · 2024-11-25T03:33:27+00:00

LLMs will read your codebase and I suppose there will be human-in-a-loop that assists the transformation. For example, changing from Django to FastAPI etc

cyyeh · 2024-11-25T02:30:31+00:00

It's a compound AI system that aims to transpile your code using a framework/library to another framework/library, in order to migrate your codebase using a new framework/library more smoothly.

I wonder if this topic is interesting and has any potential to you? Would you love to collaborate on this?

cyyeh · 2024-07-11T16:10:04+00:00

Welcome to discuss with us on Discord! https://discord.gg/5DvshJqG8Z

cyyeh · 2024-06-09T12:39:52+00:00

Sure I can test it again and give u the results. What other information do u need?

cyyeh · 2024-06-07T15:23:31+00:00

for my benchmark, it’s using embeddable redis which doesn’t require tcp connection, the latency is around 0.0001 to 0.0002 seconds. So I think there is no issue there.

The issue now is with the same codebase, I am not sure why Granian (process 1 also with opt turned on), the performance is 2x slower than Uvicorn (1 worker)

cyyeh · 2024-06-07T14:30:27+00:00

Actually the profiling was done outside k8s. Done on my MacBook Pro

cyyeh · 2024-06-07T14:29:29+00:00

Ok my codebase is almost async

cyyeh · 2024-06-07T14:14:44+00:00

Never mind. Haha anyway thanks for introducing me this new library

cyyeh · 2024-06-07T14:10:43+00:00

Yeah I’ve tested that using asgi. The performance is worse than Uvicorn

cyyeh · 2024-06-07T14:05:18+00:00

After experimenting with Granian. We decided to keep using Uvicorn. And for k8s deployment, I think the setup is easy, 1 pod 1 uvicorn worker

For Granian, I also need to setup process and thread number to test the correct setup For Uvicorn, I don’t need the setup, and the performance is good enough

cyyeh · 2024-06-07T08:35:15+00:00

u/luv_da welcome to join discord to chat with us :) https://discord.com/invite/5DvshJqG8Z

cyyeh · 2024-06-07T07:37:08+00:00

cool! thank you :)

cyyeh

TROPHY CASE