LocalPilot Logo LocalPilot v0.1.1
GitHub
📖 Chapter 1: The Basics

The Plain-English Guide to Local AI

You do not need an engineering degree or a server farm to understand and run AI. Here is everything you need to know in everyday terms.

1

What is "Local AI"?

When you use online chatbots like ChatGPT or Claude, your words travel across the internet to giant data centers owned by large tech companies. Your conversations may be stored, used to train future systems, or read by third parties.

☁️ Cloud AI

  • • Sends your words over the internet
  • • Requires internet access and monthly fees
  • • Can be slow during peak hours
  • • Your data lives on external servers

💻 Local AI (LocalPilot)

  • • 100% runs inside your own computer
  • • Works on airplanes and off the grid
  • • Completely free with no subscriptions
  • • Zero chance of data leaking online

Local AI simply means downloading an AI model once onto your laptop's hard drive and running it directly, just like you would run a word processor or a media player.

2

The 3 Words You Will Hear (Demystified)

🧠 1. Model Weights (The Knowledge File)

Think of a model like a giant digital encyclopedia. The "weights" are just the downloaded file on your computer containing patterns learned from millions of books and articles. Common models are called Llama 3.2, Mistral, or Phi-3.

⚙️ 2. Inference Engine (The Reader)

Having a book on your desk does nothing unless someone reads it. The "inference engine" (like llama.cpp or Ollama) is the motor that reads the model file, understands your question, and writes back the reply word by word.

🪑 3. RAM / Memory (The Desk Space)

When you open a model, it needs to sit in your computer's short-term memory (RAM). If you have an 8 GB desk and try to put a 20 GB model on it, your computer will freeze. This is why LocalPilot exists: it measures your desk first and only lets you load models that fit comfortably!

3

Do I Need an Expensive Gaming PC?

No! Modern small models (like Llama 3.2 3B or Phi-3 Mini) are specifically designed to run on ordinary laptops:

🍏

Apple Silicon Macs

M1, M2, M3, M4 chips share memory between CPU and GPU, making them world-class for local AI right out of the box.

💻

Standard Laptops

Any modern Intel or AMD laptop with 8GB or 16GB of RAM can run compact models smoothly on the CPU.

🎮

Gaming PC with GPU

If you have an NVIDIA or AMD graphics card, LocalPilot automatically activates hardware acceleration for lightning speed.

4

Your First Conversation in 3 Commands

Step 1: Check your system safely
$ localpilot doctor
Step 2: See which models fit your computer
$ localpilot recommend
Step 3: Start chatting privately
$ localpilot chat llama3.2:3b
See Complete Install Instructions → Browse Popular Models →