Explore

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.

Python·Apache-2.0·★ 86k·No key

A robust MCP server for fetching and extracting web content using Trafilatura. Optimized for AI agents with clean markdown output.

Python·MIT·★ 3·Few stars·No key

Web Content Retrieval (full webpage, filtered content, or Markdown-converted), Custom User-Agent, Multi-HTTP Method Support (GET/POST/PUT/DELETE/PATCH), LLM-Controlled Request Headers, LLM-Accessible

Python·MIT·★ 7·No key

Open-source MCP server that gives AI agents web search (SearXNG) and clean Markdown crawling of pages, whole sites and logged-in areas. Self-hosted, no API key. Firecrawl-compatible API planned.

Python·MIT·★ 167·No key

MCP server that fetches URLs through real Chromium and returns clean Markdown

Python·MIT·Few stars·No key

A content exploration toolkit that helps LLMs surface high signal, unsummarized web content. It makes extensive use of clean APIs and Markdown conversion to enable targeted content extraction and know

Python·MIT·★ 4·Few stars·No key

Synthadoc: An open-source LLM knowledge compilation engine that turns raw documents into structured, local-first wikis. A transparent, human-readable alternative to traditional RAG, which can be self-

Skill·AGPL-3.0·★ 1.6k·No key

CodeAgent is an open-source coding agent that lives in your terminal. It understands your repository, plans multi-step changes, writes and edits files, runs commands and tests, and iterates until the

Python·MIT·★ 824·No key

Local-first, no-API-key MCP server for web search, fetch, and document reading. Multi-engine (DuckDuckGo, Mojeek, Startpage), smart Playwright fallback, FTS5 cache, LLM-tuned output.

Python·MIT·★ 145·No key

Download full-text PDFs by DOI: open access first (OpenAlex/Unpaywall/Crossref), then publisher TDM APIs, then your own logged-in Chrome. Rate-limited by default. CLI, local web UI, and an agent skill

Skill·MIT·★ 31·No key

Boss直聘爬虫 / BOSS直聘职位数据抓取工具，基于 Chrome CDP 协议复用真实登录态，绕过字体反爬，输出明文薪资 JSON/CSV + 薪资技能分析。A Chrome-CDP-based BOSS Zhipin job scraper/crawler.

Skill·MIT·★ 1.6k·No key

Self-hosted AI execution agent for Discord: runs shell commands and edits files on your hosts, drives browsers, schedules jobs and delegates to sub-agents, within per-user host access, a command gover

Python·MIT·★ 3·Few stars·No key

Free open-source AI YouTube Shorts generator and faceless video maker in Python. Any LLM (GPT, Claude, Gemini, Ollama) writes scripts; text-to-speech, stock footage or AI images, word-synced captions,

Python·MIT·★ 33·No key

PDF generation with Python, JavaScript/JSX and C# components or HTML/CSS. Deterministic Rust engine for reports, invoices and variable-data documents. MIT licensed.

Python·MIT·★ 90·No key

Generate native OmniGraffle .graffle files programmatically

Skill·MIT·★ 15·No key

An Agent Skill and Dify plugin to transform Markdown to files of DOCX, PPTX, XLSX, PNG, PDF, HTML, MD, CSV, JSON, XML.

Skill·Apache-2.0·★ 273·No key

OMI/Obsidian memory tooling (Open Knowledge Format) for AI agents: reproduce the integration on any machine, plus a local web app to view, edit, and add memory entries.

Python·Apache-2.0·★ 16·No key

Helps AI assistants access text content from bot-protected websites. MCP server that fetches HTML/markdown from sites with anti-automation measures using Scrapling.

Python·Apache-2.0·★ 122·No key

Opinionated Markdown converter with native LLM enhancement support.

Python·MIT·★ 3·Few stars·No key

Unified Python library for web scraping — single URL or whole-site → markdown, with stealth, JS rendering, and LLM-ready output

Python·MIT·★ 4·Few stars·No key

crawl4ai for video & audio — turn any YouTube video, podcast, or recording into clean timestamped markdown, or a verified TTS/STT training dataset. Runs locally.

Python·MIT·★ 19·No key

Annotated screenshots for AI agents: Skitch-style arrows, numbered steps, boxes, labels, solid redaction

Python·AGPL-3.0·★ 6·No key