Skip to content

Commit

Permalink
update outlines
Browse files Browse the repository at this point in the history
  • Loading branch information
souzatharsis committed Nov 25, 2024
1 parent 12512d6 commit f607f76
Show file tree
Hide file tree
Showing 8 changed files with 6 additions and 6 deletions.
Binary file modified tamingllms/_build/.doctrees/environment.pickle
Binary file not shown.
Binary file modified tamingllms/_build/.doctrees/notebooks/structured_output.doctree
Binary file not shown.
Original file line number Diff line number Diff line change
Expand Up @@ -587,7 +587,7 @@
"source": [
"### Outlines\n",
"\n",
"Outlines is a library specifically focused on structured text generation from LLMs. It provides several powerful features:\n",
"Outlines is a library specifically focused on structured text generation from LLMs. Under the hood, Outlines works by adjusting the probability distribution of the model's output logits - the raw scores from the final layer of the neural network that are normally converted into text tokens. By introducing carefully crafted logit biases, Outlines can guide the model to prefer certain tokens over others, effectively constraining its outputs to a predefined set of valid options. This provides fine-grained control over the model's generation process. In that way, Outlines provides several powerful features:\n",
"\n",
"* **Multiple Choice Generation**: Restrict the LLM output to a predefined set of options.\n",
"* **Regex-based structured generation**: Guide the generation process using regular expressions.\n",
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/notebooks/structured_output.html
Original file line number Diff line number Diff line change
Expand Up @@ -626,7 +626,7 @@ <h3><a class="toc-backref" href="#id10" role="doc-backlink"><span class="section
</section>
<section id="outlines">
<h3><a class="toc-backref" href="#id11" role="doc-backlink"><span class="section-number">3.3.4. </span>Outlines</a><a class="headerlink" href="#outlines" title="Permalink to this heading"></a></h3>
<p>Outlines is a library specifically focused on structured text generation from LLMs. It provides several powerful features:</p>
<p>Outlines is a library specifically focused on structured text generation from LLMs. Under the hood, Outlines works by adjusting the probability distribution of the model’s output logits - the raw scores from the final layer of the neural network that are normally converted into text tokens. By introducing carefully crafted logit biases, Outlines can guide the model to prefer certain tokens over others, effectively constraining its outputs to a predefined set of valid options. This provides fine-grained control over the model’s generation process. In that way, Outlines provides several powerful features:</p>
<ul class="simple">
<li><p><strong>Multiple Choice Generation</strong>: Restrict the LLM output to a predefined set of options.</p></li>
<li><p><strong>Regex-based structured generation</strong>: Guide the generation process using regular expressions.</p></li>
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/searchindex.js

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion tamingllms/_build/jupyter_execute/markdown/intro.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "93311d57",
"id": "10dc718d",
"metadata": {},
"source": [
"(intro)=\n",
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -587,7 +587,7 @@
"source": [
"### Outlines\n",
"\n",
"Outlines is a library specifically focused on structured text generation from LLMs. It provides several powerful features:\n",
"Outlines is a library specifically focused on structured text generation from LLMs. Under the hood, Outlines works by adjusting the probability distribution of the model's output logits - the raw scores from the final layer of the neural network that are normally converted into text tokens. By introducing carefully crafted logit biases, Outlines can guide the model to prefer certain tokens over others, effectively constraining its outputs to a predefined set of valid options. This provides fine-grained control over the model's generation process. In that way, Outlines provides several powerful features:\n",
"\n",
"* **Multiple Choice Generation**: Restrict the LLM output to a predefined set of options.\n",
"* **Regex-based structured generation**: Guide the generation process using regular expressions.\n",
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/notebooks/structured_output.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -587,7 +587,7 @@
"source": [
"### Outlines\n",
"\n",
"Outlines is a library specifically focused on structured text generation from LLMs. It provides several powerful features:\n",
"Outlines is a library specifically focused on structured text generation from LLMs. Under the hood, Outlines works by adjusting the probability distribution of the model's output logits - the raw scores from the final layer of the neural network that are normally converted into text tokens. By introducing carefully crafted logit biases, Outlines can guide the model to prefer certain tokens over others, effectively constraining its outputs to a predefined set of valid options. This provides fine-grained control over the model's generation process. In that way, Outlines provides several powerful features:\n",
"\n",
"* **Multiple Choice Generation**: Restrict the LLM output to a predefined set of options.\n",
"* **Regex-based structured generation**: Guide the generation process using regular expressions.\n",
Expand Down

0 comments on commit f607f76

Please sign in to comment.