
Chapter 1
Breaking free from the cloud
Chapter 2
The silicon inside your machine
Chapter 3
The open source brain trust
Chapter 4
Living with a local assistant
Ch 3 · The open source brain trust

007skaty A desktop computer screen displays secure code running a private local AI model.
007skaty Model Quantization
Squeeze those sixteen bits down to four, now we can run it all on our own!

007skaty The anonymous 4chan post by llamanon containing the leaked LLaMA model torrent link.
007skaty Discover the pivotal leak that enabled running private AI locally on personal computers and changed the tech landscape.
Quiz
What is the name of the French AI startup famous for creating high-performing, open-source local models like Mixtral?

BETA
007skaty Sort incoming data into local drives to learn how offline computers run private AI.
007skaty Learn how running private AI models locally on your computer empowers global voices while keeping your data completely secure.

007skaty Open-source groups worldwide are building diverse AI models to ensure local technology represents different languages, cultures, and values.
Quiz
What is the name of the mathematical process used to compress large AI models so they fit on home computers?
Quiz
Which online platform acts as the primary global community hub for sharing open-source AI models?
Fun Fact
Model squeezing: Quantization can compress an AI model to the point where a high-school level digital tutor can easily fit onto a standard 8-gigabyte USB thumb drive.

007skaty Learn how model quantization and squeezing techniques allow you to run powerful private AI models locally on your own computer.

007skaty Quantization is a clever mathematical trick that compresses giant AI models so they can fit into a computer's standard memory.
Quiz
Which open-source AI model family was released by Google for local and lightweight use?
Quiz
Which company's leaked LLaMA model in 2023 accidentally triggered the open-source local AI boom?
Glossary
hugging face (noun)
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
007skaty Watch to learn about community hubs: the dedicated computers that allow you to run private AI models locally.
Quiz
What is the name of the popular open-source tool that lets users easily download and run local LLMs via a simple command line or desktop app?
Quiz
What unit of measurement is used to describe the size of an AI model's brain, such as 7B or 70B?


