No description
Find a file
Bob Roberts 10fe64f201 Enhance Claude OS documentation with comprehensive real-time learning system details
**WHAT_IS_CLAUDE_OS.md (Updated)**
- Completely rewritten with engaging, honest tone
- Added problem statement showing why Claude OS is needed
- Detailed explanation of 5 core pillars
- Real-world examples of what Claude OS enables
- Comparison table vs other AI coding tools
- Multiplier effect visualization
- 493 lines, 2,818 words (was much more basic)

**CLAUDE_OS_DEVELOPER_GUIDE.md (Significantly Enhanced)**
- Added Redis pub/sub and real-time learning system documentation
- Documented 10 learning patterns it detects with examples
- Added Redis queue monitoring commands
- RQ worker status and debugging commands
- Essential CLI commands and one-liners
- MCP registration commands with examples
- 3 available skills (initialize-project, memory, remember-this)
- 4 common development workflows
- Comprehensive debugging and troubleshooting section
- Real-time monitoring dashboard setup
- 1089 lines, 3,355 words (was 545 lines, 2,245 words)

This makes the system much more discoverable and usable.

🧠 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-10-27 20:05:35 -05:00
.github/workflows mostly working correctly 2025-10-24 16:17:47 -05:00
app Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
docs Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
frontend Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
mcp_server Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
tests Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
.env.example Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
.gitignore mostly working correctly 2025-10-24 16:17:47 -05:00
CLAUDE_OS_DEVELOPER_GUIDE.md Enhance Claude OS documentation with comprehensive real-time learning system details 2025-10-27 20:05:35 -05:00
entrypoint.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
PROJECT_SETUP_AND_COMMANDS.md Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
pytest.ini mostly working correctly 2025-10-24 16:17:47 -05:00
README.md Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
requirements.txt Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
restart_services.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
run_tests.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
setup_native.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
start_all_services.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
start_mcp_server.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
start_redis_workers.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
stop_all_services.sh Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
test_real_time_learning.py Almost got the mosnter finished 2025-10-27 17:41:44 -05:00
WHAT_IS_CLAUDE_OS.md Enhance Claude OS documentation with comprehensive real-time learning system details 2025-10-27 20:05:35 -05:00

Claude OS

╔═══════════════════════════════════════════════════════════════╗
║                                                               ║
║  ██████╗██╗      █████╗ ██╗   ██╗██████╗ ███████╗    ██████╗ ███████╗
║ ██╔════╝██║     ██╔══██╗██║   ██║██╔══██╗██╔════╝   ██╔═══██╗██╔════╝
║ ██║     ██║     ███████║██║   ██║██║  ██║█████╗     ██║   ██║███████╗
║ ██║     ██║     ██╔══██║██║   ██║██║  ██║██╔══╝     ██║   ██║╚════██║
║ ╚██████╗███████╗██║  ██║╚██████╔╝██████╔╝███████╗   ╚██████╔╝███████║
║  ╚═════╝╚══════╝╚═╝  ╚═╝ ╚═════╝ ╚═════╝ ╚══════╝    ╚═════╝ ╚══════╝
║                                                               ║
║           Localized Multi-Knowledge-Base RAG System           ║
║                    with MCP Integration                       ║
║                                                               ║
╚═══════════════════════════════════════════════════════════════╝

Production-grade RAG system with SQLite vector search, Ollama LLMs, and Model Context Protocol. Runs 100% locally on your machine.

License: MIT Python 3.11+ SQLite Ollama


🚀 What is Claude OS?

Claude OS is a localized RAG (Retrieval-Augmented Generation) system designed to make AI assistants deeply knowledgeable about your codebase and documentation. It combines:

  • 🗄️ SQLite + sqlite-vec - Lightweight vector database for semantic search
  • 🤖 Ollama - Local LLMs (llama3.1) with no API keys needed
  • 🔌 MCP Integration - Claude Desktop integration via Model Context Protocol
  • ⚡ React UI - Modern dashboard for managing knowledge bases
  • 📚 Multi-KB Support - Separate knowledge bases for different projects
  • 🧠 Advanced RAG - Hybrid search, reranking, and agentic modes

Perfect For

✅ Making Claude deeply familiar with your codebase ✅ Private, secure knowledge base (never leaves your machine) ✅ Team collaboration (share with coworkers easily) ✅ Integration with Claude Desktop via MCP ✅ Building AI-assisted development workflows


⚡ Quick Start (5-10 minutes)

Prerequisites

Before running the setup, ensure you have:

  1. Python 3.11+

    python3 --version
    
  2. Node.js 16+ (for React frontend)

    node --version
    

Installation

  1. Clone the repository

    git clone <repo-url>
    cd claude-os
    
  2. Run the setup script (handles Ollama, Python, models)

    chmod +x setup_native.sh
    ./setup_native.sh
    

    This will:

    • ✅ Install/start Ollama
    • ✅ Download LLM models (5-10 GB total)
    • ✅ Setup Python environment
    • ✅ Initialize SQLite database
  3. Start services

    ./start_all_services.sh
    

    This starts:

    • MCP Server (port 8051) - Backend RAG engine
    • React UI (port 5173) - Web dashboard
    • Ollama (port 11434) - LLM service
  4. Access the UI


🔌 MCP Integration with Claude Desktop

To use your knowledge bases with Claude Desktop:

Option 1: Via CLI (Easiest)

# Add PISTN knowledge base to Claude Desktop
claude mcp add pistn http://localhost:8051/mcp/kb/pistn

# Add PISTN Agent OS knowledge base
claude mcp add pistn-agent-os http://localhost:8051/mcp/kb/pistn-agent-os

Then in Claude Desktop, your knowledge bases are available as built-in tools. Ask Claude about your codebase directly!

Option 2: Manual Configuration

Edit ~/.claude_desktop_config.json:

{
  "mcpServers": {
    "pistn": {
      "url": "http://localhost:8051/mcp/kb/pistn"
    },
    "pistn-agent-os": {
      "url": "http://localhost:8051/mcp/kb/pistn-agent-os"
    }
  }
}

Then restart Claude Desktop.


📚 Managing Knowledge Bases

Create a Knowledge Base

  1. Visit http://localhost:5173
  2. Click "Create Knowledge Base"
  3. Choose type:
    • GENERIC - General documentation
    • CODE - Source code repositories
    • DOCUMENTATION - Technical docs
    • AGENT_OS - Spec-driven development

Upload Documents

  1. Select a knowledge base
  2. Click "Upload Documents"
  3. Choose files (supports .md, .txt, .pdf, .py, .js, .ts, .json, .yaml)
  4. Watch as documents are indexed

Query the Knowledge Base

Via Web UI:

  1. Select a KB from the dropdown
  2. Type your question
  3. View answer with source citations

Via Claude Desktop: Once added as MCP server, Claude can query automatically when working on your project.


🏗️ Architecture

┌─────────────────────────────────────────────────┐
│              Claude Desktop                      │
│         (or any MCP client)                      │
└───────────────────┬─────────────────────────────┘
                    │ MCP HTTP
┌───────────────────▼─────────────────────────────┐
│         MCP Server (Port 8051)                   │
│              FastAPI Backend                     │
└───────────────────┬─────────────────────────────┘
                    │
        ┌───────────┴────────────┐
        │                        │
┌───────▼────────────┐  ┌────────▼──────────┐
│   RAG Engine       │  │  React UI         │
│  (llama-index)     │  │  (Port 5173)      │
│  • Vector Search   │  │                   │
│  • Hybrid Search   │  └────────────────────┘
│  • Reranking       │
└───────┬────────────┘
        │
┌───────▼────────────────────────────────────────┐
│   SQLite + sqlite-vec (Local Database)         │
│  • knowledge_bases                             │
│  • documents (with embeddings)                 │
│  • Single-file database                        │
└────────────────────────────────────────────────┘
        │
        └─────────────────────┐
                              │
                    ┌─────────▼──────┐
                    │  Ollama        │
                    │  (Port 11434)  │
                    │ • llama3.1     │
                    │ • Embeddings   │
                    └────────────────┘

⚙️ Configuration

Environment Variables

The system uses sensible defaults, but you can customize via environment variables:

# SQLite Database
SQLITE_DB_PATH=data/claude-os.db  # Default: data/claude-os.db

# Ollama
OLLAMA_HOST=http://localhost:11434  # Default: localhost:11434
OLLAMA_MODEL=llama3.1:latest        # Default: llama3.1:latest

# MCP Server
MCP_SERVER_HOST=0.0.0.0         # Default: 0.0.0.0
MCP_SERVER_PORT=8051            # Default: 8051

📊 Performance

Native Ollama Setup (Current)

  • Response time: ~40 seconds per query
  • GPU acceleration: Full Metal GPU on Apple Silicon
  • Memory usage: 8-10GB (models + context)
  • CPU usage: 12 cores (M4 Pro, leaves 2 for system)

Why it's fast:

  • Direct GPU acceleration (no virtualization)
  • Efficient vector search in SQLite
  • Optimized RAG engine with caching
  • Single-file database with minimal overhead

📁 Project Structure

claude-os/
├── app/                    # Backend application
│   ├── core/              # Core modules
│   │   ├── config.py      # Configuration management
│   │   ├── sqlite_manager.py  # SQLite interface
│   │   ├── rag_engine.py  # RAG logic
│   │   └── ...
│   ├── db/                # Database schemas
│   └── ...
├── frontend/              # React UI (Vite)
│   ├── src/
│   │   ├── pages/
│   │   ├── components/
│   │   └── ...
│   └── package.json
├── mcp_server/           # MCP Server (HTTP)
│   ├── server.py         # FastAPI + MCP endpoints
│   └── ...
├── migrations/           # Database migrations
├── setup_native.sh       # Installation script
├── start_all_services.sh # Start all services
├── stop_all_services.sh  # Stop all services
├── requirements.txt      # Python dependencies
└── README.md             # This file

🐛 Troubleshooting

Database Issues

The SQLite database is automatically created at data/claude-os.db. If you encounter issues:

# Check if database exists
ls -lh data/claude-os.db

# Remove and recreate (WARNING: deletes all data)
rm data/claude-os.db
# Restart the server to recreate

Ollama Issues

# Check if Ollama is running
ollama list

# Start Ollama manually
ollama serve

# Check for specific model
ollama list | grep llama3.1

Port Already in Use

# Find process on port 8051 (MCP Server)
lsof -i :8051

# Find process on port 5173 (React UI)
lsof -i :5173

# Kill if needed (replace PID with actual process ID)
kill -9 <PID>

MCP Server Not Starting

# Check logs
tail -f /tmp/mcp_server.log

# Verify Python environment
source venv/bin/activate
python mcp_server/server.py

# Check port 8051 is accessible
curl http://localhost:8051/health

📖 Additional Documentation


🤝 Contributing

This is a personal development tool. Feel free to:

  • Modify for your specific needs
  • Add new KB types
  • Optimize RAG strategies
  • Contribute improvements back

📄 License

MIT License - Use it freely!


🎯 Next Steps

  1. First-time setup: Run ./setup_native.sh
  2. Start services: Run ./start_all_services.sh
  3. Create knowledge base: Visit http://localhost:5173
  4. Upload documents: Add your codebase/docs
  5. Integrate with Claude: Run claude mcp add ...
  6. Start coding: Ask Claude about your project!

Happy coding! 🚀