Skip to content

Commit

Permalink
update toc
Browse files Browse the repository at this point in the history
  • Loading branch information
souzatharsis committed Dec 21, 2024
1 parent cbeec56 commit ef0024c
Show file tree
Hide file tree
Showing 12 changed files with 12 additions and 11 deletions.
7 changes: 4 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,10 @@
Sign-up to receive updates on [new Chapters here](https://tamingllm.substack.com/).
Receive updates on [new Chapters here](https://tamingllm.substack.com/).

<a href="https://www.souzatharsis.com/tamingLLMs" target="_blank">
<img src="tamingllms/_static/tamingcoverv1.jpg" style="background-color:white; width:50%;" alt="Taming LLMs Cover" />
</a>

Please [open an issue](https://github.com/souzatharsis/tamingLLMs/issues) with your feedback or suggestions!

# [Taming LLMs](https://www.souzatharsis.com/tamingLLMs)
*Publication Date: February 2, 2025*
Expand All @@ -20,8 +21,8 @@ Abstract: *The current discourse around Large Language Models (LLMs) tends to fo
| Chapter 4: Output Size Limitations | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/output_size_limit.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/output_size_limit.ipynb) | *Ready for Review* |
| Chapter 5: The Evals Gap | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/evals.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/evals.ipynb) | *Ready for Review* |
| Chapter 6: Safety Concerns | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/safety.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/safety.ipynb) | *Ready for Review* |
| Chapter 7: Preference-based Alignment | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/alignment.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/alignment.ipynb) | *Ready for Review* |
| Chapter 8: Breaking Free from Cloud Providers | | | WIP |
| Chapter 7: Preference-Based Alignment | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/alignment.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/alignment.ipynb) | *Ready for Review* |
| Chapter 8: Breaking Free from Cloud Providers | [html](https://www.souzatharsis.com/tamingLLMs/notebooks/local.html) | [ipynb](https://github.com/souzatharsis/tamingLLMs/blob/master/tamingllms/notebooks/local.ipynb) | WIP |
| Chapter 9: The Cost Factor | | | |
| Chapter 10: Frontiers | | | |
| Appendix A: Tools and Resources | | | |
Expand Down
Binary file modified tamingllms/_build/.doctrees/environment.pickle
Binary file not shown.
Binary file modified tamingllms/_build/.doctrees/markdown/toc.doctree
Binary file not shown.
Binary file modified tamingllms/_build/.doctrees/notebooks/local.doctree
Binary file not shown.
2 changes: 1 addition & 1 deletion tamingllms/_build/html/_sources/markdown/toc.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ Abstract: *The current discourse around Large Language Models (LLMs) tends to fo

## [Chapter 7: Preference-based Alignment](https://www.souzatharsis.com/tamingLLMs/notebooks/alignment.html)

## Chapter 8: Breaking Free from Cloud Providers
## [Chapter 8: Breaking Free from Cloud Providers](https://www.souzatharsis.com/tamingLLMs/notebooks/local.html)

## Chapter 9: The Cost Factor

Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/_sources/notebooks/local.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -882,7 +882,7 @@
"\n",
"### Results\n",
"\n",
"The KL divergence and perplexity results in {numref}`ppl1, ppl2` provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2's higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model's behavior.\n",
"The KL divergence and perplexity results in {numref}`ppl1` and {numref}`ppl2` provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2's higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model's behavior.\n",
" \n",
"\n",
"```{figure} ../_static/local/ppl2.png\n",
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/markdown/toc.html
Original file line number Diff line number Diff line change
Expand Up @@ -242,7 +242,7 @@ <h2><a class="reference external" href="https://www.souzatharsis.com/tamingLLMs/
<h2><a class="reference external" href="https://www.souzatharsis.com/tamingLLMs/notebooks/alignment.html">Chapter 7: Preference-based Alignment</a><a class="headerlink" href="#chapter-7-preference-based-alignment" title="Permalink to this heading"></a></h2>
</section>
<section id="chapter-8-breaking-free-from-cloud-providers">
<h2>Chapter 8: Breaking Free from Cloud Providers<a class="headerlink" href="#chapter-8-breaking-free-from-cloud-providers" title="Permalink to this heading"></a></h2>
<h2><a class="reference external" href="https://www.souzatharsis.com/tamingLLMs/notebooks/local.html">Chapter 8: Breaking Free from Cloud Providers</a><a class="headerlink" href="#chapter-8-breaking-free-from-cloud-providers" title="Permalink to this heading"></a></h2>
</section>
<section id="chapter-9-the-cost-factor">
<h2>Chapter 9: The Cost Factor<a class="headerlink" href="#chapter-9-the-cost-factor" title="Permalink to this heading"></a></h2>
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/notebooks/local.html
Original file line number Diff line number Diff line change
Expand Up @@ -1050,7 +1050,7 @@ <h3><a class="toc-backref" href="#id188" role="doc-backlink"><span class="sectio
</section>
<section id="results">
<h3><a class="toc-backref" href="#id189" role="doc-backlink"><span class="section-number">8.4.4. </span>Results</a><a class="headerlink" href="#results" title="Permalink to this heading"></a></h3>
<p>The KL divergence and perplexity results in <code class="xref std std-numref docutils literal notranslate"><span class="pre">ppl1,</span> <span class="pre">ppl2</span></code> provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2’s higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model’s behavior.</p>
<p>The KL divergence and perplexity results in <a class="reference internal" href="#ppl1"><span class="std std-numref">Fig. 8.7</span></a> and <a class="reference internal" href="#ppl2"><span class="std std-numref">Fig. 8.6</span></a> provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2’s higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model’s behavior.</p>
<figure class="align-center" id="ppl2">
<a class="reference internal image-reference" href="../_images/ppl2.png"><img alt="Perplexity" src="../_images/ppl2.png" style="width: 897.5px; height: 474.5px;" /></a>
<figcaption>
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/html/searchindex.js

Large diffs are not rendered by default.

2 changes: 1 addition & 1 deletion tamingllms/_build/jupyter_execute/markdown/intro.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
"cells": [
{
"cell_type": "markdown",
"id": "f4d2cd18",
"id": "299e545f",
"metadata": {},
"source": [
"(intro)=\n",
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/_build/jupyter_execute/notebooks/local.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -882,7 +882,7 @@
"\n",
"### Results\n",
"\n",
"The KL divergence and perplexity results in {numref}`ppl1, ppl2` provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2's higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model's behavior.\n",
"The KL divergence and perplexity results in {numref}`ppl1` and {numref}`ppl2` provide insights into model quality across different quantization levels. Q6 maintains near-perfect correlation (99.90%) with the base model and minimal KL divergence (0.004), indicating very close distribution matching. Q2's higher KL divergence (0.112) and lower correlation (98.31%) quantify its increased deviation from the base model's behavior.\n",
" \n",
"\n",
"```{figure} ../_static/local/ppl2.png\n",
Expand Down
2 changes: 1 addition & 1 deletion tamingllms/markdown/toc.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ Abstract: *The current discourse around Large Language Models (LLMs) tends to fo

## [Chapter 7: Preference-based Alignment](https://www.souzatharsis.com/tamingLLMs/notebooks/alignment.html)

## Chapter 8: Breaking Free from Cloud Providers
## [Chapter 8: Breaking Free from Cloud Providers](https://www.souzatharsis.com/tamingLLMs/notebooks/local.html)

## Chapter 9: The Cost Factor

Expand Down

0 comments on commit ef0024c

Please sign in to comment.