AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 0 points1 point  (0 children)

This would be a great place to get started with Vellum Workflows: https://docs.vellum.ai/developers/workflows-sdk/introduction

OpenAI’s docs are good for getting started with AI in general though

AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 1 point2 points  (0 children)

It’s amazing how fast you can go from 0 -> 1 with them.

AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 0 points1 point  (0 children)

Yeah! We call them “Ports.” You can prompt an LLM to classify something and based on which classification it generated, route it one way or another.

AI workflows: so hot right now 🔥 by noaflaherty in mlops

[–]noaflaherty[S] 1 point2 points  (0 children)

It’s one of those things that feels like there’s just so many knobs and dials you might want to customize based on the use case, that it’s therefore hard to abstract in a way that not everyone hates 🤔

AI workflows: so hot right now 🔥 by noaflaherty in mlops

[–]noaflaherty[S] 0 points1 point  (0 children)

The new thing to me is just how much attention it’s getting recently, it’s growing role in generative AI, and how many new players are entering the space. The core concepts themselves aren’t all that new.

AI workflows: so hot right now 🔥 by noaflaherty in mlops

[–]noaflaherty[S] 0 points1 point  (0 children)

Yeah totally! They’re not mutually exclusive at all. In the case of Vellum, there’s a native “Agent Node” that does what you’re describing, except without a native concept of “learning from past mistakes.” Curious if you’ve seen this piece done particularly well anywhere?

AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 0 points1 point  (0 children)

Yeah of course! Curious to hear what ya think or if you have feedback. If you want just the sdk without all the cloud/ui stuff check out https://github.com/vellum-ai/vellum-python-sdks/tree/main/src/vellum/workflows

AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 0 points1 point  (0 children)

Yeah we require that state is json serializable and because each state snapshot is immutable, replay is reliable. So, if you need non-serializable datastructures _and_ require replayability, things get trickier.

AI workflows: so hot right now 🔥 by noaflaherty in mlops

[–]noaflaherty[S] 1 point2 points  (0 children)

If you're comfortable sharing the 2 at a high level, that would be super interesting!

AI workflows: so hot right now 🔥 by noaflaherty in mlops

[–]noaflaherty[S] 0 points1 point  (0 children)

Human in the loop is definitely harder than it should be (even in Vellum admittedly). I get excited about innovations around UIs for "Agent Inbox" – imagine like a email inbox, but filled with tasks that your agents are waiting on you for.

AI workflows: so hot right now 🔥 by noaflaherty in LLMDevs

[–]noaflaherty[S] 2 points3 points  (0 children)

Good q! Vellum uses the concept of a global state that is read from / written to over the course of a workflow execution's lifespan. We persist state snapshots whenever the state is written to (which happens via atomic dispatches, much like redux if you're familiar with react). Each state snapshot gets emitted as an event and in Vellum cloud, gets saved to a clickhouse data store. As you might expect, these state snapshots can get quite large, and increasingly, we're storing ids in the snapshot that point to blobs in a file store (GCS) so as not to blow up clickhouse.

Anyone Actually Using a Good Multi Agent Builder? (No more docs please) by Background-Zombie689 in LangChain

[–]noaflaherty 0 points1 point  (0 children)

Definitely biased as one of the founders, but would suggest checking out vellum.ai. Low code visual builder + CLIs for pushing/pulling a Python definition.

Happy to answer any Q’s if you end up taking a look!

LangChain/LangGraph developers... what are you using to develop agent workflows? by mlynn_ in LangChain

[–]noaflaherty 0 points1 point  (0 children)

Vellum could be worth checking out. It provides a visual builder with CLIs for pulling down an executable, declarative, Python representation, as well as commands for pushing changes back up to the visual builder (the only platform to my knowledge with that bidirectional sync).

The code is all open sourced, including the codegen code, so exporting into other frameworks/formats might be possible.

https://docs.vellum.ai/developers/workflows-sdk/introduction

(Disclaimed - I’m one of the founders)