[Droid] Add DBRX-Instruct Truss Example #263
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![factory-droid[bot]](https://avatars.githubusercontent.com/in/358017?s=60&v=4){kind=small}
…s including config.yaml, README.md, and model.py. Updated model.py with model loading and prediction logic. Updated config.yaml and README.md with relevant information.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary of Changes
This PR introduces a new Truss example for the DBRX-Instruct model. It includes the creation of a new directory and necessary files such as config.yaml, README.md, and model.py. The model.py file contains the core logic for loading the model and running predictions. The config.yaml file has been updated with the required Python version, dependencies, model metadata, and resource specifications. The README.md file provides an overview of the model, deployment instructions, API details, usage examples, and additional notes on generation parameters and limitations. This setup allows users to deploy the DBRX-Instruct model using Truss and Baseten.
Fixes BT-10520
Tips