Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

added multiagent semantic conventions along with single agent additio… #2014

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

PRATIBHA-Moogi
Copy link

To address - #1961 (comment).
This PR addresses the need for defining multiagent semantic conventions

Fixes # NIL

Changes

Added multiagent application key attributes in addition to that added extra attributes for single agent application.

Merge requirement checklist

@PRATIBHA-Moogi PRATIBHA-Moogi requested review from a team as code owners March 25, 2025 06:40
Copy link

linux-foundation-easycla bot commented Mar 25, 2025

CLA Signed

  • ✅login: PRATIBHA-Moogi / (660103e)

The committers listed above are authorized under a signed CLA.

@PRATIBHA-Moogi PRATIBHA-Moogi force-pushed the multiagent-semantic-conventions branch from bf4b8ec to c2709e3 Compare March 25, 2025 06:42
@PRATIBHA-Moogi PRATIBHA-Moogi force-pushed the multiagent-semantic-conventions branch from c2709e3 to 660103e Compare March 25, 2025 06:43
Copy link
Contributor

@lmolkova lmolkova left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't believe we're ready to define multi-agent semantic conventions. We don't even have a clear definition of a single agent ones, especially when it comes to client-side agent frameworks.

Multi-agent support is tight to general-purpose workflow #1688 and as suggested in the #1961 (comment) may need a few attributes and events or spans defined (e.g. for transition between agents).

From general semconv perspective, we don't encourage defining attributes without a corresponding span/event/metric or at least an instrumentation that would use them. I don't believe these new attributes would apply to existing GenAI spans the conventions cover.

TL;DR: The suggestion is:

  • please help us finalize conventions for a single agent
  • if you're interested in multi-agent conventions:
    • consider how to express it in a more general way - any workflow involving agents, humans, or non-AI bots would have similar characteristics as multi-agent one
    • it's best to start by prototyping the actual instrumentation and thinking about information that would be unique and essential for multi-agent flows.

@PRATIBHA-Moogi
Copy link
Author

Thanks for your comments @lmolkova . I am working on it along with @gyliu513 . Regarding current gen_ai.agent.xx conventions, it doesn't represent a multiagent set of attributes. We can surely expand that one first. I also find bit of overlap on different concepts such as Workflow, flows, tasks, agents, tools, as well as runnable etc. as expressed by different agentic-application-frameworks e.g. langchain/langgraph, crew.ai, autogen, IBM Bee framework, Llamaindex etc. Is there we are maintaining a document to freeze on a common set of defnitions across these middleware framework ?

@gyliu513
Copy link
Member

@lmolkova totally agree with you, I will work with @PRATIBHA-Moogi to improve the single agent first, and then extend to multi-agent

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Development

Successfully merging this pull request may close these issues.

3 participants