libs: add sambanova-lagchain integration package (#29417)

- **Description:**: Add sambanova-langchain integration package as suggested in previous PRs --------- Co-authored-by: Chester Curme <[email protected]>
langchain-ai · Jan 27, 2025 · 3b886cd · 3b886cd
1 parent aba1fd0
commit 3b886cd
Show file tree

Hide file tree

Showing 7 changed files with 370 additions and 85 deletions.
diff --git a/docs/docs/integrations/chat/sambanova.ipynb b/docs/docs/integrations/chat/sambanova.ipynb
@@ -19,7 +19,7 @@
    "source": [
     "# ChatSambaNovaCloud\n",
     "\n",
-    "This will help you getting started with SambaNovaCloud [chat models](/docs/concepts/chat_models). For detailed documentation of all ChatSambaNovaCloud features and configurations head to the [API reference](https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaNovaCloud.html).\n",
+    "This will help you getting started with SambaNovaCloud [chat models](/docs/concepts/chat_models/). For detailed documentation of all ChatSambaNovaCloud features and configurations head to the [API reference](https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.ChatSambaNovaCloud.html).\n",
     "\n",
     "**[SambaNova](https://sambanova.ai/)'s** [SambaNova Cloud](https://cloud.sambanova.ai/) is a platform for performing inference with open-source models\n",
     "\n",
@@ -28,21 +28,20 @@
     "\n",
     "| Class | Package | Local | Serializable | JS support | Package downloads | Package latest |\n",
     "| :--- | :--- | :---: | :---: |  :---: | :---: | :---: |\n",
-    "| [ChatSambaNovaCloud](https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaNovaCloud.html) | [langchain-community](https://python.langchain.com/api_reference/community/index.html) | ❌ | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain_community?style=flat-square&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain_community?style=flat-square&label=%20) |\n",
+    "| [ChatSambaNovaCloud](https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.ChatSambaNovaCloud.html) | [langchain-community](https://python.langchain.com/api_reference/community/index.html) | ❌ | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain_sambanova?style=flat-square&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain_sambanova?style=flat-square&label=%20) |\n",
     "\n",
     "### Model features\n",
     "\n",
-    "| [Tool calling](/docs/how_to/tool_calling) | [Structured output](/docs/how_to/structured_output/) | JSON mode | [Image input](/docs/how_to/multimodal_inputs/) | Audio input | Video input | [Token-level streaming](/docs/how_to/chat_streaming/) | Native async | [Token usage](/docs/how_to/chat_token_usage_tracking/) | [Logprobs](/docs/how_to/logprobs/) |\n",
+    "| [Tool calling](/docs/how_to/tool_calling) | [Structured output](/docs/how_to/structured_output/) | JSON mode | [Image input](//docs/how_to/multimodal_inputs/) | Audio input | Video input | [Token-level streaming](/docs/how_to/chat_streaming/) | Native async | [Token usage](/docs/how_to/chat_token_usage_tracking/) | [Logprobs](/docs/how_to/logprobs/) |\n",
     "| :---: | :---: | :---: | :---: |  :---: | :---: | :---: | :---: | :---: | :---: |\n",
-    "| ✅ | ✅ | ✅ | ✅ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | \n",
+    "| ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | \n",
     "\n",
     "## Setup\n",
     "\n",
-    "To access ChatSambaNovaCloud models you will need to create a [SambaNovaCloud](https://cloud.sambanova.ai/) account, get an API key, install the `langchain_community` integration package, and install the `SSEClient` Package.\n",
+    "To access ChatSambaNovaCloud models you will need to create a [SambaNovaCloud](https://cloud.sambanova.ai/) account, get an API key, install the `langchain_sambanova` integration package.\n",
     "\n",
     "```bash\n",
-    "pip install langchain-community\n",
-    "pip install sseclient-py\n",
+    "pip install langchain-sambanova\n",
     "```\n",
     "\n",
     "### Credentials\n",
@@ -82,8 +81,8 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "# os.environ[\"LANGSMITH_TRACING\"] = \"true\"\n",
-    "# os.environ[\"LANGSMITH_API_KEY\"] = getpass.getpass(\"Enter your LangSmith API key: \")"
+    "# os.environ[\"LANGCHAIN_TRACING_V2\"] = \"true\"\n",
+    "# os.environ[\"LANGCHAIN_API_KEY\"] = getpass.getpass(\"Enter your LangSmith API key: \")"
    ]
   },
   {
@@ -92,7 +91,7 @@
    "source": [
     "### Installation\n",
     "\n",
-    "The LangChain __SambaNovaCloud__ integration lives in the `langchain_community` package:"
+    "The LangChain __SambaNovaCloud__ integration lives in the `langchain_sambanova` package:"
    ]
   },
   {
@@ -101,8 +100,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "%pip install -qU langchain-community\n",
-    "%pip install -qu sseclient-py"
+    "%pip install -qU langchain-sambanova"
    ]
   },
   {
@@ -120,13 +118,12 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "from langchain_community.chat_models.sambanova import ChatSambaNovaCloud\n",
+    "from langchain_sambanova import ChatSambaNovaCloud\n",
     "\n",
     "llm = ChatSambaNovaCloud(\n",
-    "    model=\"Meta-Llama-3.1-70B-Instruct\",\n",
+    "    model=\"Meta-Llama-3.3-70B-Instruct\",\n",
     "    max_tokens=1024,\n",
     "    temperature=0.7,\n",
-    "    top_k=1,\n",
     "    top_p=0.01,\n",
     ")"
    ]
@@ -158,7 +155,8 @@
     "messages = [\n",
     "    (\n",
     "        \"system\",\n",
-    "        \"You are a helpful assistant that translates English to French. Translate the user sentence.\",\n",
+    "        \"You are a helpful assistant that translates English to French. \"\n",
+    "        \"Translate the user sentence.\",\n",
     "    ),\n",
     "    (\"human\", \"I love programming.\"),\n",
     "]\n",
@@ -215,7 +213,8 @@
     "    [\n",
     "        (\n",
     "            \"system\",\n",
-    "            \"You are a helpful assistant that translates {input_language} to {output_language}.\",\n",
+    "            \"You are a helpful assistant that translates {input_language} \"\n",
+    "            \"to {output_language}.\",\n",
     "        ),\n",
     "        (\"human\", \"{input}\"),\n",
     "    ]\n",
@@ -412,7 +411,8 @@
     "llm_with_tools = llm.bind_tools(tools=tools)\n",
     "messages = [\n",
     "    HumanMessage(\n",
-    "        content=\"I need to schedule a meeting for two weeks from today. Can you tell me the exact date of the meeting?\"\n",
+    "        content=\"I need to schedule a meeting for two weeks from today. \"\n",
+    "        \"Can you tell me the exact date of the meeting?\"\n",
     "    )\n",
     "]"
    ]
@@ -499,7 +499,6 @@
     "    model=\"Llama-3.2-11B-Vision-Instruct\",\n",
     "    max_tokens=1024,\n",
     "    temperature=0.7,\n",
-    "    top_k=1,\n",
     "    top_p=0.01,\n",
     ")"
    ]
@@ -546,7 +545,7 @@
    "source": [
     "## API reference\n",
     "\n",
-    "For detailed documentation of all ChatSambaNovaCloud features and configurations head to the API reference: https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaNovaCloud.html"
+    "For detailed documentation of all ChatSambaNovaCloud features and configurations head to the API reference: https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.ChatSambaNovaCloud.html"
    ]
   }
  ],

diff --git a/docs/docs/integrations/chat/sambastudio.ipynb b/docs/docs/integrations/chat/sambastudio.ipynb
@@ -19,7 +19,7 @@
    "source": [
     "# ChatSambaStudio\n",
     "\n",
-    "This will help you getting started with SambaStudio [chat models](/docs/concepts/chat_models). For detailed documentation of all ChatStudio features and configurations head to the [API reference](https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaStudio.html).\n",
+    "This will help you getting started with SambaStudio [chat models](/docs/concepts/chat_models). For detailed documentation of all ChatStudio features and configurations head to the [API reference](https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.chat_models.sambanova.ChatSambaStudio.html).\n",
     "\n",
     "**[SambaNova](https://sambanova.ai/)'s** [SambaStudio](https://docs.sambanova.ai/sambastudio/latest/sambastudio-intro.html) SambaStudio is a rich, GUI-based platform that provides the functionality to train, deploy, and manage models in SambaNova [DataScale](https://sambanova.ai/products/datascale) systems.\n",
     "\n",
@@ -28,29 +28,28 @@
     "\n",
     "| Class | Package | Local | Serializable | JS support | Package downloads | Package latest |\n",
     "| :--- | :--- | :---: | :---: |  :---: | :---: | :---: |\n",
-    "| [ChatSambaStudio](https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaStudio.html) | [langchain-community](https://python.langchain.com/api_reference/community/index.html) | ❌ | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain_community?style=flat-square&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain_community?style=flat-square&label=%20) |\n",
+    "| [ChatSambaStudio](https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.chat_models.sambanova.ChatSambaStudio.html) | [langchain-community](https://python.langchain.com/api_reference/community/index.html) | ❌ | ❌ | ❌ | ![PyPI - Downloads](https://img.shields.io/pypi/dm/langchain_sambanova?style=flat-square&label=%20) | ![PyPI - Version](https://img.shields.io/pypi/v/langchain_sambanova?style=flat-square&label=%20) |\n",
     "\n",
     "### Model features\n",
     "\n",
     "| [Tool calling](/docs/how_to/tool_calling) | [Structured output](/docs/how_to/structured_output/) | JSON mode | [Image input](/docs/how_to/multimodal_inputs/) | Audio input | Video input | [Token-level streaming](/docs/how_to/chat_streaming/) | Native async | [Token usage](/docs/how_to/chat_token_usage_tracking/) | [Logprobs](/docs/how_to/logprobs/) |\n",
     "| :---: | :---: | :---: | :---: |  :---: | :---: | :---: | :---: | :---: | :---: |\n",
-    "| ✅ | ✅ | ✅ | ❌ | ❌ | ❌ | ✅ | ✅ | ✅ | ❌ | \n",
+    "| ✅ | ✅ | ✅ | ✅ | ✅ | ❌ | ✅ | ✅ | ✅ | ❌ | \n",
     "\n",
     "## Setup\n",
     "\n",
-    "To access ChatSambaStudio models you will need to [deploy an endpoint](https://docs.sambanova.ai/sambastudio/latest/language-models.html) in your SambaStudio platform, install the `langchain_community` integration package, and install the `SSEClient` Package.\n",
+    "To access ChatSambaStudio models you will need to [deploy an endpoint](https://docs.sambanova.ai/sambastudio/latest/language-models.html) in your SambaStudio platform, install the `langchain_sambanova` integration package.\n",
     "\n",
     "```bash\n",
-    "pip install langchain-community\n",
-    "pip install sseclient-py\n",
+    "pip install langchain-sambanova\n",
     "```\n",
     "\n",
     "### Credentials\n",
     "\n",
     "Get the URL and API Key from your SambaStudio deployed endpoint and add them to your environment variables:\n",
     "\n",
     "``` bash\n",
-    "export SAMBASTUDIO_URL=\"your-api-key-here\"\n",
+    "export SAMBASTUDIO_URL=\"sambastudio-url-key-here\"\n",
     "export SAMBASTUDIO_API_KEY=\"your-api-key-here\"\n",
     "```"
    ]
@@ -85,8 +84,8 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "# os.environ[\"LANGSMITH_TRACING\"] = \"true\"\n",
-    "# os.environ[\"LANGSMITH_API_KEY\"] = getpass.getpass(\"Enter your LangSmith API key: \")"
+    "# os.environ[\"LANGCHAIN_TRACING_V2\"] = \"true\"\n",
+    "# os.environ[\"LANGCHAIN_API_KEY\"] = getpass.getpass(\"Enter your LangSmith API key: \")"
    ]
   },
   {
@@ -95,7 +94,7 @@
    "source": [
     "### Installation\n",
     "\n",
-    "The LangChain __SambaStudio__ integration lives in the `langchain_community` package:"
+    "The LangChain __SambaStudio__ integration lives in the `langchain_sambanova` package:"
    ]
   },
   {
@@ -104,8 +103,7 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "%pip install -qU langchain-community\n",
-    "%pip install -qu sseclient-py"
+    "%pip install -qU langchain-sambanova"
    ]
   },
   {
@@ -123,13 +121,12 @@
    "metadata": {},
    "outputs": [],
    "source": [
-    "from langchain_community.chat_models.sambanova import ChatSambaStudio\n",
+    "from langchain_sambanova import ChatSambaStudio\n",
     "\n",
     "llm = ChatSambaStudio(\n",
     "    model=\"Meta-Llama-3-70B-Instruct-4096\",  # set if using a Bundle endpoint\n",
     "    max_tokens=1024,\n",
     "    temperature=0.7,\n",
-    "    top_k=1,\n",
     "    top_p=0.01,\n",
     "    do_sample=True,\n",
     "    process_prompt=\"True\",  # set if using a Bundle endpoint\n",
@@ -163,7 +160,8 @@
     "messages = [\n",
     "    (\n",
     "        \"system\",\n",
-    "        \"You are a helpful assistant that translates English to French. Translate the user sentence.\",\n",
+    "        \"You are a helpful assistant that translates English to French.\"\n",
+    "        \"Translate the user sentence.\",\n",
     "    ),\n",
     "    (\"human\", \"I love programming.\"),\n",
     "]\n",
@@ -220,7 +218,8 @@
     "    [\n",
     "        (\n",
     "            \"system\",\n",
-    "            \"You are a helpful assistant that translates {input_language} to {output_language}.\",\n",
+    "            \"You are a helpful assistant that translates {input_language} \"\n",
+    "            \"to {output_language}.\",\n",
     "        ),\n",
     "        (\"human\", \"{input}\"),\n",
     "    ]\n",
@@ -364,7 +363,7 @@
    "source": [
     "from datetime import datetime\n",
     "\n",
-    "from langchain_core.messages import HumanMessage, SystemMessage, ToolMessage\n",
+    "from langchain_core.messages import HumanMessage, ToolMessage\n",
     "from langchain_core.tools import tool\n",
     "\n",
     "\n",
@@ -408,7 +407,8 @@
     "llm_with_tools = llm.bind_tools(tools=tools)\n",
     "messages = [\n",
     "    HumanMessage(\n",
-    "        content=\"I need to schedule a meeting for two weeks from today. Can you tell me the exact date of the meeting?\"\n",
+    "        content=\"I need to schedule a meeting for two weeks from today. \"\n",
+    "        \"Can you tell me the exact date of the meeting?\"\n",
     "    )\n",
     "]"
    ]
@@ -483,7 +483,7 @@
    "source": [
     "## API reference\n",
     "\n",
-    "For detailed documentation of all ChatSambaStudio features and configurations head to the API reference: https://python.langchain.com/api_reference/community/chat_models/langchain_community.chat_models.sambanova.ChatSambaStudio.html"
+    "For detailed documentation of all ChatSambaStudio features and configurations head to the API reference: https://python.langchain.com/api_reference/sambanova/chat_models/langchain_sambanova.sambanova.chat_models.ChatSambaStudio.html"
    ]
   }
  ],