diff --git a/docs/guides/observability.md b/docs/guides/observability.md index 63c181d..4ffedc6 100644 --- a/docs/guides/observability.md +++ b/docs/guides/observability.md @@ -114,7 +114,7 @@ LangSmith provides observability throughout the LLM application development life **Mistral integration Example:** -* All of the [langchain notebooks](https://github.com/mistralai/cookbook/tree/main/third_party/langchain) in the Mistral cookbook include LangSmith integration. +* All of the [langchain notebooks](https://github.com/mistralai//tree/main/third_party/langchain) in the Mistral cookbook include LangSmith integration. Here is an example tracking traces, input, output, documents, tokens, and status when we run the [corrective RAG example](https://github.com/mistralai/cookbook/blob/main/third_party/langchain/corrective_rag_mistral.ipynb) from the Mistral cookbook. @@ -217,6 +217,46 @@ AgentOps is an open-source observability and DevTool platform for AI Agents. It drawing + +### Integration with OpenLIT + +[OpenLIT](https://openlit.io/) is an open-source tool designed for complete LLM engineering, fully integrated with OpenTelemetry. It provides comprehensive OTel-native observability including GPU monitoring and exceptions monitoring, an experimentation playground, prompt management, and metrics for effective debugging. + +OpenLIT and Mistral Integration image + +**Pros:** + +* Open-source ([Github](https://github.com/openlit/openlit)) and easy to self-host in your environment +* OpenTelemetry-native & vendor-neutral SDKs +* Complete Observability for GenAI Stack, from LLMs to GPUs +* Cost tracking for custom and fine-tuned models +* Natively support Mistral SDK +* Integration with various frameworks + +**Mistral integration Example:** + +Image showing OpenTelemetry tracing for Mistral AI using OpenLIT + +To get started, You can follow the below steps + +1. Install the OpenLIT SDK + +```shell +pip install openlit +``` + +2. Add the following 2 lines to your application code automatically start collecting metrics and traces from Mistral AI usage in your Application + +```python +import openlit + +openlit.init() +``` +Here is an example tracking traces, input, output, documents, tokens, and status when we using Mistral AI Model (https://github.com/mistralai/cookbook/blob/main/third_party/openlit/cookbook_mistral_opentelemetry.ipynb) from the Mistral cookbook. + +For more details, checkout the [official OpenLIT docs](https://docs.openlit.io/latest/integrations/mistral) for Mistral AI Integration. + + ### Integration with phospho [phospho](https://phospho.ai/) is a text analytics platform that makes it easy to get answers, take decisions and reduce churn by data mining user messages. @@ -234,4 +274,4 @@ AgentOps is an open-source observability and DevTool platform for AI Agents. It - Check out the [phospho notebooks](https://github.com/mistralai/cookbook/tree/main/third_party/phospho) in the Mistral cookbook. -drawing \ No newline at end of file +drawing diff --git a/static/img/guides/obs_openlit1.png b/static/img/guides/obs_openlit1.png new file mode 100644 index 0000000..9732ff5 Binary files /dev/null and b/static/img/guides/obs_openlit1.png differ diff --git a/static/img/guides/obs_openlit2.gif b/static/img/guides/obs_openlit2.gif new file mode 100644 index 0000000..82b71f1 Binary files /dev/null and b/static/img/guides/obs_openlit2.gif differ