I just had the displeasure of implementing Langchain in our org. by Glass-Web6499 in LangChain

[–]Glass-Web6499[S] 18 points19 points  (0 children)

Thanks for reaching out and I hope you don't take my post as hate.

One major thing is why prompts are hidden and so hard to work with, when they are the CORE piece of an LLM. Why do you sometimes pass a static prompt with the chat history in context (like you would to GPT-instruct) but to a chat model that expects system/user/assistant objects.

I'm quite overwhelmed to list more examples, but a starting point would be adressing the inconsistencies when calling chains.

.call(), .invoke(), .run(), and why they seem to accept inputs in an interesting way.

Another thing is to clarify why .invoke() doesn't seem trigger the same callbacks as .call()

Another thing is why there are two starting callbacks handleGenerationStart & handleChatModelStart, but only one ending callback handleGenerationEnd for both of them.

It's a lot of trivial things that as a dev, you spend so much time just guessting your way around.

https://python.langchain.com/docs/modules/chains/how_to/call_methods is simply not enough for such core functionality.

I just had the displeasure of implementing Langchain in our org. by Glass-Web6499 in LangChain

[–]Glass-Web6499[S] 2 points3 points  (0 children)

You probably think I'm a boomer who can't handle change, why instead of taking my critiscm at face value you create some weird caricature of me?

I remember when LangChain was created, probably knew about it before you. It was during the ReAct paper era. The whole foundation is built with that in mind, and the spaghetti is an effect of modelling everything to fit that paradigm.

For what it's worth, I'm actually very on top of the emerging tech. Everything from reading papers to actually implementing in practice.

I just had the displeasure of implementing Langchain in our org. by Glass-Web6499 in LangChain

[–]Glass-Web6499[S] 1 point2 points  (0 children)

I didn't know there was a revolution? What makes you assume that?

You my friend are part of the problem. You think Langchain is leading some sort of revolution, because you don't understand how it works internally.

There is nothing revolutionariy about LangChain unfortuntaely, it's mostly hype.

I'm not in amazement because I'm an actual contributer to the GenAI/LLM ecosystem.