Skip to content
Conduit

mcp server

neuralforge

Local AI workstation dashboard Neuralforge— manage LLMs, agents, RAG, Telegram AI bot with 14 meme personas & voice cloning, image/video/3D generation, and LoRA fine-tuning and SMM module from a singl

DefinitelyN0tMe/neuralforgecommunitylistedunreviewed

Set up

Runs on your computer. Pick your agent and operating system.

This project does not publish an install method we can turn into a config. Follow the README instead.

README

synced Oct 25, 2026

Why another AI dashboard? Because no other open-source project gives you LLM orchestration, automated SMM for 7 platforms, image/video/3D generation, RAG, fine-tuning, Telegram bot with 14 personas, voice cloning, and MCP integration for Claude — all in a single self-hosted panel with zero cloud dependencies.


Highlights

  • 🤖 12 AI Services managed from one UI — Ollama, ComfyUI, Whisper, Qdrant, SearXNG, and more
  • 📱 SMM AI Department — discover trends → generate posts → create images → auto-publish to Telegram, Twitter, Facebook, Instagram, Threads, LinkedIn, Discord simultaneously
  • 🧠 Multi-Agent System — 13 roles, 3 modes (Solo/Team/Orchestrator), 9 tools including web search, code execution, RAG
  • 🎨 Full Generation Pipeline — Image (FLUX) → Video (Wan2.2) → 3D (Hunyuan3D) with smart VRAM management
  • 📊 84 API Endpoints — everything is programmable, extensible, and automatable
  • 🔒 100% Local — your data never leaves your machine. No API keys required for core features

Table of Contents

What is this? · AI Model Stack · Features · Dashboard · Agents · RAG · LoRA · Pipeline · Telegram Bot · SMM · MCP Server · Quick Start · Requirements · FAQ


What is this?

A self-hosted web panel (localhost:9000) that unifies your entire local AI infrastructure into one powerful dashboard. No subscriptions, no cloud APIs, no data leaving your machine.

┌──────────────────────────────── NeuralForge ──────────────────────────────────┐
│                                                                                │
│  Dashboard     Agents       RAG        Telegram     LoRA        SMM           │
│  ┌────────┐   ┌────────┐  ┌────────┐  ┌────────┐  ┌────────┐  ┌────────┐    │
│  │GPU/VRAM│   │13 Roles│  │Qdrant +│  │14 Meme │  │Unsloth │  │7 Socials│   │
│  │Services│   │Solo    │  │ONNX GPU│  │Personas│  │LoRA    │  │Trend AI │   │
│  │Metrics │   │Team    │  │1800/sec│  │Voice   │  │16 base │  │Post Gen │   │
│  │Alerts  │   │Orchestr│  │Multi-DB│  │Cloning │  │models  │  │Analytics│   │
│  └────────┘   └────────┘  └────────┘  └────────┘  └────────┘  └────────┘    │
│                                                                                │
│  Pipeline: Image ──→ Video ──→ 3D   │   MCP Server: 24 tools for Claude      │
│  (ComfyUI)  (Wan2GP)  (Hunyuan3D)   │   + Music, TTS, STT, Search...        │
└────────────────────────────────────────────────────────────────────────────────┘

AI Model Stack

Every model runs locally via Ollama — no API keys, no cloud, no subscriptions.

LLMs (Text Generation & Reasoning)

ModelSizeVRAMUsed for
Qwen 3.635B (A3B MoE)~22 GBPrimary workhorse — agents, RAG, planner
Qwen 3.6 / 3.827B~17 GBSMM posts & trend analysis, tutor, vision
Qwen3-Coder30B (A3B MoE)~18 GBCoder, tester, security auditor roles
DeepSeek R132B / 14B~19 / 9 GBAnalyst & trade-analyst reasoning
Gemma 426B~17 GBTranslator — multilingual
Mistral Small24B~14 GBSummarization
Qwen 3.59B~7 GBTelegram bot — fast persona responses

Every model dropdown lists whatever is installed in Ollama — pull a model and it appears, delete one and it disappears. If a configured model is missing, model_resolver.py automatically substitutes the closest installed model of the same kind (general / light / code / reasoning / vision).

Vision (Image Understanding)

ModelSizeVRAMUsed for
MiniCPM-V8B~5 GBTelegram bot photo analysis — describes images, answers questions about photos sent to your account
Qwen3-VL8B~6 GBVision fallback, GUI/video understanding
Qwen 3.827B~17 GBTeam/orchestrator image analysis

Embeddings (RAG Search)

ModelSizeSpeedUsed for
bge-m3 (ONNX)560M1,800 docs/secGPU-accelerated document indexing
bge-m3 (Ollama)560M10 docs/secFallback CPU embedding

Audio (Speech & Music)

ModelSizeVRAMUsed for
Whisper (faster-whisper)base/large2-10 GBSpeech-to-text, 99 languages, diarization
Qwen3-TTS~4 GB~4 GBText-to-speech, 3-second voice cloning
ACE-Step 1.5~4 GB4-6 GBAI music generation — lyrics + style → full song

Image / Video / 3D Generation

ModelEngineVRAMUsed for
FLUX KleinComfyUI8-12 GBImage generation (SMM posts, pipeline)
Wan 2.2Wan2GP12-24 GBVideo generation from image + prompt
Hunyuan3D v2Gradio13-20 GB3D model generation from image

LoRA Fine-Tuning (16 base models)

ModelSizeTraining time
NVIDIA Nemotron 3 Nano4B~30 min
Llama 3.1 / 3.21B–8B30 min – 2h
Qwen 2.57B / 32B1–4h
Gemma 22B–27B30 min – 3h
Mistral v0.37B~1h
Phi 3.53.8B~40 min

Total unique AI models available: 30+ — all running locally, swappable per task, with automatic VRAM management.

Features at a Glance

FeatureDescription
GPUSmart VRAM ManagementExclusive groups auto-stop conflicting services. Never OOM again
DashboardReal-time MonitoringGPU temp, VRAM, RAM, CPU, disk — live metrics with health alerts
AgentsMulti-Agent Orchestration13 roles, 3 modes (Solo/Team/Orchestrator), shared memory, RAG tools
RAGVector Search at GPU SpeedONNX embeddings at 1,800 docs/sec, Qdrant DB, multi-collection search
Bot14 Telegram PersonasEach with unique personality — from Philosopher to Crypto Maniac
VoiceReal-time Voice CloningSend voice → get reply in your own voice with AI-generated text
LoRAFine-Tuning UI16 base models, dataset upload, live training output, adapter export
GenImage→Video→3D PipelineAutomated chain with smart VRAM switching between steps
MCPClaude Code Integration24 tools — let Claude manage your entire AI stack
SMM7-Platform Social MediaTrend Scout → AI Post Writer → Image Gen → Auto-Publish to all platforms
ExtYAML Module SystemAdd any new service in 10 lines of YAML

Dashboard

The main hub. Everything starts here.

Live Metrics:

  • GPU VRAM usage with free memory indicator
  • GPU temperature and power draw
  • RAM usage with available memory
  • CPU load across all threads
  • Disk usage with free space alerts

Service Management:

  • Start/stop any service with one click
  • Exclusive GPU groups — when you start ComfyUI, Wan2GP auto-stops (and vice versa). No more VRAM crashes
  • Service health indicators (running/stopped/starting)
  • Quick actions: "Start basics", "Stop heavy", "Free VRAM"

Monitoring:

  • Active Ollama models with per-model VRAM usage
  • GPU process list (what's eating your VRAM right now)
  • Qdrant RAG collections with vector counts
  • Storage breakdown by service (ComfyUI outputs, Wan2GP videos, etc.)
  • Health alerts: GPU overheating, low disk, service down — all visible at a glance

YAML Module System — add any service:

name: My New Service
category: generation
start_cmd: "python3 app.py --port 7777"
port: 7777
vram_estimate: "4-8 GB"
exclusive_group: heavy_gpu    # auto-stops conflicting services

Drop it in modules/ → restart panel → it appears. That's it.

AI Agents

A full multi-agent framework built into the panel.

13 Role Presets:

RoleWhat it doesDefault model
ResearcherWeb search, source analysis, fact compilationQwen 3.6 35B-A3B
AnalystData analysis, pattern recognition, insightsDeepSeek-R1 32B
CoderWrite, debug, refactor code in any languageQwen3-Coder 30B
WriterArticles, reports, creative writingQwen 3.6 35B-A3B
CriticQuality review, scoring, improvement suggestionsQwen 3.6 35B-A3B
SummarizerCondense long texts into key pointsMistral Small 24B
TranslatorMulti-language translation with contextGemma 4 26B
Email WriterProfessional emails from brief instructionsQwen 3.6 35B-A3B
TesterGenerate test cases, find edge casesQwen3-Coder 30B
Trade AnalystMarket analysis, trend identificationDeepSeek-R1 32B
TutorExplain concepts at adjustable complexityQwen 3.8 27B
Security AuditorCode/config security review, vulnerability scanQwen3-Coder 30B
Image AnalystDescribe and analyze imagesMiniCPM-V 8B

3 Execution Modes:

ModeHow it worksBest for
SoloSingle agent with toolsQuick tasks, Q&A
TeamAgent chain — each passes context to nextComplex multi-step tasks
OrchestratorAI creates plan → delegates to agents → reviews result (retries if score < 7)Ambitious tasks with quality control

15 Team Presets: Pre-configured agent chains for common workflows — "Research → Analyze → Write", "Code → Test → Review", "Translate → Edit", and more.

Agent Tools:

  • web_search — search the internet
  • read_url / deep_scrape — fetch and parse web pages
  • run_python — execute Python code
  • read_file / write_file — file operations
  • analyze_image — vision model for images
  • rag_search — search your vector database
  • analyze_file — PDF/CSV/code analysis

Memory System:

  • Shared memory between agents in a team
  • Long-term memory with keyword tokenization and search
  • Context passing modes: full chain or previous-agent-only

RAG (Retrieval-Augmented Generation)

Ask questions about your documents. The AI retrieves relevant passages and answers with citations.

Performance:

MethodSpeedGPU VRAM
ONNX GPU (bge-m3)1,800 texts/sec~2 GB
Ollama embeddings10 texts/sec~4 GB

That's 180x faster indexing with ONNX.

Capabilities:

  • Multi-format indexing — PDF, TXT, MD, DOCX, CSV, HTML
  • Batch processing — index entire directories recursively
  • Multi-collection — separate databases for different topics (e.g., "laws", "docs", "codebase")
  • Smart search — auto-detects which collection to search based on query
  • Context memory — remembers previous Q&A in the same chat session
  • Embedding cache — repeat queries are instant

Built-in chat interface:

  • Markdown rendering with syntax highlighting
  • Copy button on every response
  • Export conversation to Markdown file
  • Collection selector and search settings
  • localStorage persistence — your chat survives page reload

Example use case:

Indexed all 390 Estonian laws (52,314 vectors) — now ask legal questions in any language and get answers with article references.

LoRA Fine-Tuning

Train custom model adapters directly from the panel UI.

16 Base Models Ready to Fine-Tune:

ModelSizeNotes
Llama 3.18BGreat all-rounder
Llama 3.21B / 3BLightweight, fast
Mistral v0.37BStrong reasoning
Qwen 2.57B / 32BMultilingual
Gemma 22B / 9B / 27BGoogle's latest
Phi 3.53.8BMicrosoft, compact
+ customanyEnter any Unsloth-compatible model ID

Training UI Features:

  • Dataset upload (JSON, JSONL, CSV) or HuggingFace dataset ID
  • Auto-format detection (instruction/output, messages, or raw text)
  • Configurable: LoRA rank, alpha, epochs, batch size, learning rate, max sequence length
  • Live training output — see loss, progress, ETA in real-time
  • Timer showing elapsed training time
  • Stop button to cancel mid-training
  • Trained adapters listed with size and date

Powered by Unsloth — 2x faster training, 60% less memory than standard LoRA.

Generation Pipeline

Automated Image → Video → 3D chain with smart VRAM management between steps.

StepEngineVRAMAutomation
ImageComfyUI (FLUX Klein 4B)8-12 GBFully automated API
VideoWan2GP (Wan 2.2 / LTX)12-24 GBGradio API + manual fallback
3DHunyuan3D13-20 GBGradio API + manual fallback

VRAM is automatically freed between steps — only one heavy service runs at a time.

# 5 built-in examples
python3 pipeline.py --example robot     # chibi robot → animate → 3D model
python3 pipeline.py --example dragon    # crystal dragon → animate → 3D
python3 pipeline.py --example car       # cyberpunk car → animate → 3D
python3 pipeline.py --example cat       # cat astronaut → animate → 3D
python3 pipeline.py --example sword     # magic sword → 3D (skip video)

# Custom prompt
python3 pipeline.py "a golden crown with gems" --steps image,3d
python3 pipeline.py "a phoenix" --video-prompt "spreads wings and flies"

Telegram AI Bot

Not a Telegram bot — responds from your own account via Telethon User API.

14 Unique Personas:

PersonaStyle
🧘Philosopher"You wrote 'hi', but what is a greeting if not a scream of loneliness into the void?"
🧢Street Philosopher"bro, your argument is logically inconsistent, purely by Kant"
👾IT Demon"segfault in your logic, recompile that thought"
👵Granny from 2077"sweetie, browsing without a firewall again? you'll catch a virus!"
🕵️Noir Detective"The message came at 3am. Like all bad news in this city"
🏴‍☠️Nerd Pirate"arrr, your meme is a true treasure!"
🐱Cat Overlord"I'd help, but I need to lie down for 14 more hours"
🔺Conspiracy Nut"Telegram was created by Masons to track memes"
🎭Budget Shakespeare"To be online or not to be — that is the question!"
🧟Polite Zombie"good evening, could you... share some brains?"
📋Corporate Robot"let's sync on this in the next sprint"
🫎Capybara"why stress when you can just... not" + random capybara photo
🚀Crypto Maniac"RED CANDLE, I'M BANKRUPT, wait... GREEN! I'M RICH!"
🛠️CustomWrite your own character

Voice Clone Pipeline:

🎤 Voice in → ffmpeg (OGG→WAV) → Whisper STT → LLM response
  → unload LLM → Qwen3-TTS (clone voice) → ffmpeg (WAV→OGG) → 🔊 Voice out

Vision — Photo Analysis (MiniCPM-V 8B):

📸 Photo in → MiniCPM-V (image description) → LLM (persona-styled response) → 💬 Reply

Send a photo to your account → the bot describes it through the vision model → responds in character. Toggle on/off from panel UI.

Features:

  • Vision mode — understands photos via MiniCPM-V 8B (auto VRAM swap: unload LLM → load vision → analyze → unload → reload LLM)
  • Auto-detects language → responds in same language
  • Conversation memory (5 exchanges per user)
  • Session-based logs grouped by contact
  • Voice clone toggle from panel UI
  • Capybara persona sends random capybara photos via capy.lol API

SMM AI Department

Fully automated social media management system — from trend discovery to publishing across 7 platforms.

Complete Workflow:

Trend Scout → Post Writer → Image Gen → Content Queue → Auto-Publish
    │              │             │              │              │
    ▼              ▼             ▼              ▼              ▼
 6 Sources     2-Pass LLM    ComfyUI FLUX   Schedule +     7 Platforms
 (Reddit,HN,  (Scrape→       + ffmpeg      Calendar       simultaneously
  GitHub,RSS,  Summary→       resize        view           with retry
  SearXNG,     Platform
  GoogTrends)  posts)

7 Connected Platforms:

PlatformAuth MethodFeatures
TelegramBot APIText + Photo, channel posting
DiscordWebhookText + File upload
Twitter/XOAuth 1.0aText + Media upload (Pay-Per-Use)
FacebookPage Token (permanent)Text + Photo, Page posting
InstagramGraph API via FBPhoto + Caption (via imgur)
ThreadsThreads APIText + Image
LinkedInOAuth 2.0Text + Image (3-step upload)

Key Features:

  • Trend Scout v2 — Multi-source intelligence with niche routing (tech, crypto, food, fitness, art, gaming, education, business), geo-detection, CJK filtering
  • GitHub Trending — Hybrid search (API + trending page scrape), categories (Agent/LLM/RAG/Tool), velocity ranking, "already posted" markers
  • Post Writer — 2-pass generation: scrapes source article → LLM summary → platform-specific posts with correct tone/length/hashtags. Custom context support
  • Image Generation — AI-generated prompts → ComfyUI FLUX Klein → auto-resize for each platform. ComfyUI auto-starts and stops (VRAM management)
  • Content Queue — SQLite-backed, edit/duplicate/regenerate posts, schedule with date/time picker, auto-publish via background scheduler
  • Content Calendar — Weekly view with navigation, color-coded by status
  • Batch Generation — Generate N days of content in one click with auto-scheduling
  • Analytics — Metrics collection from FB/IG/Threads/LinkedIn APIs, per-platform breakdown, top posts ranking
  • Token Health — Auto-refresh for expiring tokens (Threads, LinkedIn), dashboard monitoring
  • Hashtag Manager — Per-platform limits (Instagram 28, Twitter 3, Discord 0), auto-trim at publish
  • Publish Preview — Review all posts + image before publishing with platform selection

MCP Server — Claude Code Integration

24 tools that let Claude Code directly manage your AI infrastructure:

CategoryTools
Systemget_system_status get_gpu_processes ollama_loaded_models check_health
Servicesstart_service stop_service stop_all_and_free_vram
RAGrag_search rag_list_collections rag_index_file rag_index_directory ask_rag
Agentsrun_agent run_agent_team run_orchestrator
Generategenerate_image run_pipeline
Fine-tunefinetune_start finetune_status finetune_stop
Utilsget_storage_info cleanup_storage run_backup convert_audio
// Add to your project's .mcp.json
{ "mcpServers": { "neuralforge": { "command": "/path/to/neuralforge/run_mcp.sh" } } }

Now Claude can: check GPU status, start services, search your RAG database, run agent teams, generate images, manage fine-tuning — all from natural language.

Quick Start

1. Clone & Install

git clone https://github.com/DefinitelyN0tMe/neuralforge.git
cd neuralforge
chmod +x install.sh
./install.sh

2. Get an LLM running

curl -fsSL https://ollama.com/install.sh | sh

# Pick a model for your VRAM
ollama pull qwen3.6:35b-a3b      # 22GB VRAM — fast MoE workhorse
ollama pull qwen3.6:27b          # 17GB VRAM — dense, high quality
ollama pull qwen3.5:9b           # 7GB VRAM — lightweight
ollama pull bge-m3               # embeddings for RAG

# Every model dropdown in the panel lists what is installed in Ollama,
# so newly pulled models show up automatically.

3. Start support services

# Qdrant for RAG (optional)
docker run -d --name qdrant -p 6333:6333 -v qdrant_data:/qdrant/storage qdrant/qdrant

4. Open the panel

http://localhost:9000

5. Set up Telegram Bot (optional)

The Telegram auto-responder answers private messages from your own account (Telethon user API, not a BotFather bot). It runs entirely from the panel UI — no code editing required.

  1. Get your Telegram API ID and API Hash from my.telegram.org → API development tools
  2. In the panel → Telegram tab → API Credentials → paste them → Save
  3. In the Telegram account card → enter your phone → Send code → enter the code (and your 2FA password if you have one) → Log in
  4. Click Enable. If Telegram ever revokes the session, the panel shows "Not logged in" — just log in again
  5. The bot comes with 14 pre-configured personas (Philosopher, Crypto Maniac, etc.) — customize or create your own

6. Set up SMM Publishing (optional)

Publish AI-generated posts to 7 social networks. All configuration is done through the panel UI.

  1. In the panel → SMM tab → + New Profile → follow the 4-step wizard
  2. On Step 2 (Platforms), each platform has built-in setup instructions:
    • Telegram: Create bot via @BotFather → paste token + channel
    • Discord: Server Settings → Integrations → Webhooks → copy URL
    • Twitter/X: developer.x.com → Create App → OAuth 1.0a keys
    • Facebook: developers.facebook.com → Create App (Business) → Page Token
    • Instagram: Same Meta app → connect IG Business Account to FB Page
    • Threads: Meta Developer App → Threads API → authorize
    • LinkedIn: linkedin.com/developers → Create App → OAuth 2.0
  3. Scan trends → Generate posts → Publish to all platforms with one click

Tip: Start with just Telegram + Discord (easiest, no API keys needed beyond bot token/webhook). Add other platforms later.

Requirements

ComponentMinimumRecommendedTested on
GPUNVIDIA 12GB VRAM24GB VRAMRTX 3090 24GB
RAM16 GB64+ GB128 GB DDR4
Disk50 GB free200+ GB2TB NVMe
CPU4 cores16+ coresThreadripper PRO 5955WX
OSUbuntu 22.04Ubuntu 24.04Ubuntu 24.04.2
Python3.103.123.12.3

Also needed: NVIDIA drivers, CUDA, Docker, ffmpeg, Ollama

Architecture

Browser ◄──────► FastAPI server.py :9000 ◄──────► Ollama :11434
                      │                              (LLM inference)
                      ├──► Module Manager
                      │     ├── ComfyUI :8188        (image gen)
                      │     ├── Wan2GP :7860          (video gen)
                      │     ├── Hunyuan3D :7870       (3D gen)
                      │     ├── ACE-Step :7880        (music gen)
                      │     ├── Qwen3-TTS :7890       (voice clone)
                      │     ├── Whisper :7895          (speech-to-text)
                      │     └── ... (add your own via YAML)
                      │
                      ├──► Qdrant :6333               (vector DB for RAG)
                      ├──► Telegram Bot               (Telethon user API)
                      └──► MCP Server                 (Claude Code bridge)

telegram_bot.py ◄──► Ollama (text) + Whisper (STT) + Qwen3-TTS (voice clone)
pipeline.py     ◄──► ComfyUI → Wan2GP → Hunyuan3D (sequential, VRAM-managed)
mcp_server.py   ◄──► server.py API (24 tools exposed to Claude Code)

Project Structure

neuralforge/
├── server.py                  # FastAPI backend (54 endpoints + WebSocket)
├── model_resolver.py          # Installed-model lookup + closest-model fallback
├── metrics.py                 # Observability: LLM calls, GPU & service samples
├── telegram_bot.py            # Telegram bot — 14 personas, voice clone, vision
├── pipeline.py                # Image → Video → 3D generation pipeline
├── mcp_server.py              # MCP server — 24 tools for Claude Code
├── smm/                       # SMM AI Department (modular package)
│   ├── __init__.py            # Router registration
│   ├── routes.py              # 30 SMM routes + scheduler + publishing
│   └── db.py                  # SQLite: queue, trends, analytics
├── templates/
│   └── index.html             # Single-page frontend (vanilla JS, no framework)
├── modules/                   # YAML service definitions (drop-in)
│   ├── ollama.yaml            # LLM inference
│   ├── comfyui.yaml           # Image generation
│   ├── wan2gp.yaml            # Video generation
│   ├── hunyuan3d.yaml         # 3D model generation
│   ├── ace-step.yaml          # Music generation
│   ├── qwen3-tts.yaml         # Text-to-speech + voice cloning
│   ├── whisper-webui.yaml     # Speech recognition
│   ├── reranker.yaml          # Qwen3-Reranker for RAG (autostart)
│   └── ...                    # add your own!
├── install.sh                 # Automated installer with path patching
├── requirements.txt           # Python dependencies
├── run_mcp.sh                 # MCP server launcher
├── scripts/sync_app_models.py # Check/fix Open WebUI & Perplexica model settings
├── docs/                      # PDF guide generators
├── backup.sh                  # Backup script
├── telegram_config.example.json
├── LICENSE
└── README.md

FAQ

Contributing

PRs welcome. The codebase is intentionally simple — vanilla JS frontend, single FastAPI backend, no build step.

Good first contributions:

  • New Telegram personas
  • New module YAML definitions
  • UI improvements
  • Automated Gradio API for Wan2GP / Hunyuan3D
  • Documentation / translations

License

MIT — do whatever you want with it.

Credits

ProjectUsed for
OllamaLocal LLM inference (Qwen, Mistral, Gemma, DeepSeek, Nemotron)
FastAPIBackend API (69 endpoints)
TelethonTelegram User API
QdrantVector database for RAG
bge-m3Multilingual embeddings (ONNX GPU-accelerated)
MiniCPM-VVision model — Telegram photo analysis
ComfyUIImage generation (FLUX Klein)
Wan2GPVideo generation (Wan 2.2, LTX-Video)
Hunyuan3D3D model generation
faster-whisperSpeech recognition (99 languages)
Qwen3-TTSText-to-speech & 3-second voice cloning
ACE-StepMusic generation
UnslothLoRA fine-tuning (2x faster, 60% less memory)
SearXNGPrivacy-first meta-search for AI agents
PerplexicaAI-powered search engine
Open WebUIChat interface for LLM models

↑↓ navigate openesc close