Dynamic agent node addition in workflow

[SomankarB]

Like we have graph.add_node and graph.compile we should have graph.recompile which can be called after graph.add_node to add agent nodes dynamically at runtime. There should be a graph.remove_node to remove nodes. It will help manage graph size as the complexity increases. What are your thoughts?

[ariel-frischer]

I was thinking about this method of add/removing nodes as a solution for dynamic parallelism: #770
Seems like langgraph does not seem to have that ability to change the graph during runtime? (new langgraph user here)
So perhaps you could generate a new dynamic subgraph, compile it, then invoke that during runtime? Gonna try that out.

[ariel-frischer]

Update: Found this in the documentation -> exactly what I was looking for: https://langchain-ai.github.io/langgraph/concepts/low_level/#send (use Send API)

[levi-katarok]

I'm interesting in a similar problem, I'd like to have flexible (albeit simple) graph structure that could be created at run time. I.e, when user 1 sends a request to a base agent, their chat can have access to X,Y agents, vs user 2 maybe has access only X,Z agents.

[ariel-frischer]

@levi-katarok
That looks similar to the code here: https://langchain-ai.github.io/langgraph/how-tos/branching/#conditional-branching

[levi-katarok]

Thanks! Yeah that's in the right direction for now. Down the road, I'm thinking if say I had 100 agents to choose from and I pull from a db that user 1 has access to agent_id 23,23, 29, I probably don't want one file with 100 conditional edges though.

[ariel-frischer]

Gotcha, yea seems like Send API could be the way to go but I'm no Langgraph expert by any means.

[rvndbalaji]

I worked on this and actually created a basic version of it

#1898

https://gist.github.com/rvndbalaji/2f50bf3d2fc635bf2f36f71c724e3347

[guidorietbroek]

I guess it should be integrated in LangGraph itself to support dynamic nodes and edges? Also the ability to add nodes and edges dynamically up front would be great to create custom graphs based on configs.