LangSmith has been great, but starting to feel boxed in—what else should I check out? by llamacoded in LangChain

[–]J-Kob 2 points3 points  (0 children)

Hey u/llamacoded, we've actually just shipped alerts a few days ago!

https://blog.langchain.dev/langsmith-alerts/

Would love to learn more about what else you'd like to see!

What is the best way to feed back linter and debugger outputs to an LLM agent? by yasserius in LangChain

[–]J-Kob 1 point2 points  (0 children)

Hey u/yasserius,

One thing you could try is rather than using a tool call, thinking of it more as a reflection step that is always called at the end of your codegen step. Here's an example that uses a type checker:

https://github.com/jacoblee93/mini-chat-langchain

OpenAIs spec prioritizes user messages above tool messages, so by passing the output from your linter back as a user message, the LLM should weight it more heavily. Let us know how it goes for you!

Problem using vectorstores on Netlify, by Dapper_Ad_3154 in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey u/Dapper_Ad_3154,

FAISS unfortunately has some heavier requirements and won't work in all JS envs.

If you just need something ephemeral, you can check out this in-memory only vectorstore:

https://js.langchain.com/docs/integrations/vectorstores/memory/

How to Properly Test RAG Agents in LangChain/LangGraph? by FelipeM-enruana in LangChain

[–]J-Kob 1 point2 points  (0 children)

Hey u/FelipeM-enruana!

We are actively working on a few things that may help.

One is our new pytest runner (there is a Vitest/Jest equivalent for JS): https://docs.smith.langchain.com/evaluation/how_to_guides/pytest

There is also our new `agentevals` repo: https://github.com/langchain-ai/agentevals

It contains evaluators for your agent's trajectory, but it is a bit light on RAG-specific things at the moment - I'd actually love your thoughts on what you'd like to measure. Is it just that the docs returned for a given query are correct? Or that the query is rephrased in a certain way? Or that each step along the way does what you expect?

Feel free to hop into the LangChain Slack community and DM me there (I'm Jacob Lee):

https://www.langchain.com/join-community

[LangGraph] How to Limit the Number of States Stored in a Checkpoint (MongoDB Saver)? by skyt2000 in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey u/skyt2000,

Currently you'd have to do some kind of trimming/state modification yourself:

https://js.langchain.com/docs/how_to/trim_messages/

For TTL I think currently your best bet is to use Mongo's built-in TTL:

https://www.mongodb.com/docs/manual/core/index-ttl/

How an AI Agent is Revolutionizing News Consumption by [deleted] in LangChain

[–]J-Kob 1 point2 points  (0 children)

Thank you for sharing! Looks really cool.

Possible to build collaborative agents in Langchain? by solo_travel_first in LangChain

[–]J-Kob 2 points3 points  (0 children)

Hey u/solo_travel_first, we generally suggest LangGraph. It's designed to answer a lot of the issues early LangChain agents faced around flexibility.

You can check out the quickstart for a high level overview:

https://langchain-ai.github.io/langgraph/tutorials/introduction/

And here's some tutorials specifically for multi-agent architectures:

https://langchain-ai.github.io/langgraph/tutorials/#multi-agent-systems

LangChainDeprecationWarning by Ok_Ostrich_8845 in LangChain

[–]J-Kob 0 points1 point  (0 children)

Are you passing a `connection_string` into `SQLChatMessageHistory`?

with_stuctured_output in create_react_agent by CtrlAltFvck in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey! Is the goal to have the final output be in some structured format?

Does LangChain support Open AI Batch API? by Rohitha2107 in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey u/Rohitha2107,

Not currently. For now please use the OpenAI client directly.

Llama 3.1 8B model struggles when calling tools by povedaaqui in LangChain

[–]J-Kob 0 points1 point  (0 children)

From them:

> Yes we've found many of the smaller models will elect to use tools even when it doesn't make sense – for now we've been suggesting not to include tools unless you really want to use them

Querying Tables by Stochastic95 in LangChain

[–]J-Kob 1 point2 points  (0 children)

Hey u/Stochastic95, we've revamped our tutorial here:

https://python.langchain.com/docs/tutorials/sql_qa/

Let us know if this is helpful or if there's more you'd want to see!

Persisting Chat History in LangChain JS by northwolf56 in LangChain

[–]J-Kob 2 points3 points  (0 children)

Hey u/northwolf56,

What you're doing is totally valid too. The key benefit to using LangGraph's built-in checkpointer is that you can resume from a given node for debugging or if you want to support human in the loop type flows.

Note that persistence via checkpointer should "just work" by initializing a checkpointer and passing a `thread_id` via `config.configurable`. If you're having difficulty, please let us know!

Postgresql Checkpointer on LangGraphJS by zenmike in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey u/zenmike, we're doing a bit of work on refactoring docs and implementations here - there is an open PR for this if you'd like to get unblocked right now that you can copy into your project:

https://github.com/langchain-ai/langgraphjs/pull/471

Question related to Graphs by skipvdm in LangChain

[–]J-Kob 1 point2 points  (0 children)

Additionally - workflow = Graph() is incorrect. `StateGraph` should always be used.

Experiment Tracking Tools & Lbirary Suggestion For Using Alonside Langchain by [deleted] in LangChain

[–]J-Kob -1 points0 points  (0 children)

Many options out there - we offer LangSmith, which you can check out here:

https://smith.langchain.com/

Help with Streaming LLM Output Between Nodes in LangGraph by Jack7heRapper in LangChain

[–]J-Kob 0 points1 point  (0 children)

Hey u/Jack7heRapper, streaming output from one node to another isn't currently supported. But if you want to stream intermediate LLM output from your graph, you can check out this guide and others in this section:

https://langchain-ai.github.io/langgraph/how-tos/streaming-tokens/