

Private Local AI Models for Global Voices
Open-source groups worldwide are building diverse AI models to ensure local technology represents different languages, cultures, and values.
Chapter 1
Breaking free from the cloud
Chapter 2
The silicon inside your machine
Chapter 3
The open source brain trust
Chapter 4
Living with a local assistant
Ch 3 · The open source brain trust

007skaty A desktop computer screen displays secure code running a private local AI model.

007skaty The anonymous 4chan post by llamanon containing the leaked LLaMA model torrent link.
007skaty Model Quantization
Squeeze those sixteen bits down to four, now we can run it all on our own!
007skaty Watch to learn about community hubs: the dedicated computers that allow you to run private AI models locally.

007skaty Quantization is a clever mathematical trick that compresses giant AI models so they can fit into a computer's standard memory.
Fun Fact
Model squeezing: Quantization can compress an AI model to the point where a high-school level digital tutor can easily fit onto a standard 8-gigabyte USB thumb drive.


007skaty Open-source groups worldwide are building diverse AI models to ensure local technology represents different languages, cultures, and values.
Glossary
hugging face (noun)
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
An emoji depicting a smiling face with open hands, typically used to express warmth, support, or a hug. Founded in 2016, this collaborative platform hosts thousands of open-source models available for local offline processing.
Quiz
What unit of measurement is used to describe the size of an AI model's brain, such as 7B or 70B?

BETA
007skaty Sort incoming data into local drives to learn how offline computers run private AI.
007skaty Discover the pivotal leak that enabled running private AI locally on personal computers and changed the tech landscape.
Quiz
Which company's leaked LLaMA model in 2023 accidentally triggered the open-source local AI boom?
007skaty Learn how running private AI models locally on your computer empowers global voices while keeping your data completely secure.
Quiz
Which online platform acts as the primary global community hub for sharing open-source AI models?
007skaty Learn how model quantization and squeezing techniques allow you to run powerful private AI models locally on your own computer.


