context-squeeze

🗜️ Context Squeeze

A deterministic context-compression layer for Claude (and any MCP client).

Squeeze codebases, files, and log streams down to the tokens that actually matter — using parsers and tree-walking, not another expensive LLM call.

▶️ See it in 50 seconds

https://github.com/user-attachments/assets/690e8c94-8535-4aaa-afdd-6e5316e96be3

---

[!NOTE] Status: MVP feature-complete on main, pre-first-release. All three tools work end-to-end over MCP and the CLI. APIs may still shift before 0.1.0. Follow docs/ROADMAP.md for live progress — stars, issues, and PRs are very welcome.

The problem

Every token Claude spends reading a 4,000-line file or a 50,000-line log dump is a token it can't spend reasoning. The usual fix — ask an LLM to summarize the input first — is slow, costs money, is non-deterministic, and routinely deletes the one variable or stack frame you actually needed.

The idea

Most of that bloat is mechanical, and machines can remove it deterministically.

Comments, docstrings, blank-line padding, import ceremony, repeated stack traces, timestamps, and ANSI noise carry little signal for a model that already understands code. Context Squeeze sits between Claude and your raw data as an MCP server, parses inputs with tree-sitter, and emits a compact, syntactically faithful projection that fits a token budget you choose.

 ┌────────────────┐   stdio / MCP    ┌──────────────────────┐        ┌─────────────────────┐
 │  Claude Desktop │◀───────────────▶│   Context Squeeze     │◀──────▶│  Filesystem / Git    │
 │  (or any client)│   JSON-RPC       │   MCP server (Rust)   │        │  source, docs, logs  │
 └────────────────┘                  └───────────┬──────────┘        └─────────────────────┘
                                                  │
                            ┌─────────────────────┼─────────────────────┐
                            ▼                     ▼                     ▼
                   ┌────────────────┐   ┌──────────────────┐   ┌──────────────────┐
                   │ tree-sitter AST│   │ Budget Allocator │   │  Log Distiller   │
                   │ strips fluff,  │   │ tiktoken-based   │   │ dedupes traces,  │
                   │ keeps structure│   │ collapse-to-fit  │   │ builds error map │
                   └────────────────┘   └──────────────────┘   └──────────────────┘

The three tools

MCP tool	What it does
inspect_codebase_skeleton(path)	Walks a directory (honoring .gitignore) and returns a condensed map of files with only their class/function/type signatures — the shape of a codebase at a fraction of the tokens.
fetch_squeezed_file(path, token_budget)	Reads one file, strips comments/docstrings/padding via the AST, then progressively collapses function bodies to signatures until the result fits token_budget — never breaking syntax.
summarize_log_stream(raw_text)	Collapses a 50,000-token log into a ~500-token error anatomy: timestamps stripped, duplicate stack traces folded with counts, repetitive lines clustered.

Why Rust

• Native tree-sitter — the C grammars compile straight in; no WASM, no FFI gymnastics.
• Fast and lightweight — a single static binary, ideal for a tiny local Docker image.
• #![forbid(unsafe_code)] across the workspace.

Design principles

1. Deterministic over clever. Same input + same budget ⇒ byte-identical output. No model in the hot path.
2. Context-preserving compression. It is better to return slightly more than to silently drop the line that holds the bug. Squeezing degrades gracefully and signals what was elided.
3. Local & private. Your code and logs never leave the machine. No API key required.
4. Honest budgets. Token counts are an offline approximation (OpenAI cl100k), conservative by design. See docs/ARCHITECTURE.md.

Quickstart

# Build from source (needs Rust 1.82+; on Windows, MSVC C++ build tools)
cargo build --release

# Try the engine from the CLI
./target/release/cx skeleton ./my-project
./target/release/cx squeeze ./src/big_file.rs --budget 800
./target/release/cx logs ./build.log

# Register the MCP server with Claude Desktop — see docs/USAGE.md

A real run of cx logs over a noisy service log:

# Log summary: 18 lines, 13 records → 8 distinct event(s)

## [ERROR ×4] lines 5–16
... ERROR upstream timeout calling payments at 10.2.3.4:443 (req 8f1c0a3e-…)

## [ERROR ×1] line 10
Traceback (most recent call last):
  File "/app/handlers/orders.py", line 88, in create_order
    total = order.total()
ValueError: invalid unit_price: None

Four timeouts with different IPs and request IDs fold into one event; the traceback is isolated and ranked by severity. See examples/.

Repository layout

context-squeeze/
├── crates/
│   ├── cx-core/   # the compression engine (parsing, budgeting, squeezing) — all the logic
│   ├── cx-mcp/    # thin MCP (stdio) server wrapper exposing the three tools
│   └── cx-cli/    # thin CLI wrapper for local use, tests, and benchmarks
├── docs/          # architecture, project spec, roadmap, usage
└── .github/       # CI and contribution templates

Documentation

• 📐 Architecture — how the engine is put together
• 📋 Project spec — vision, scope, goals, non-goals
• 🗺️ Roadmap — the fine-grained, phase-by-phase build plan
• 🤝 Contributing — how to get involved

Contributing

This is built in the open and contributors are genuinely welcome — parser edge cases, new language grammars, and budgeting heuristics are all great entry points. Start with CONTRIBUTING.md and the good first issue label.

License

MIT © Sudip Bhakta