AI AGENT ADDONS

Flash Moe Inference

aradotso/trending-skills
AI & Agent Building
1,073installs

Flash-MoE lets you run a massive AI model called Qwen3.5-397B right on your MacBook. This model has 397 billion parameters but uses a clever mixture of experts design. It only loads the parts it needs from your SSD as you chat. The engine is built with pure C and Metal code. No Python or heavy frameworks are required. You get about 4.4 tokens per second on a MacBook Pro with 48GB of memory. This makes huge AI possible on a laptop you already own.

Anyone with an Apple Silicon Mac and enough free SSD space can run this skill. It is perfect for developers who want to test or use a very large language model locally. The skill handles all the tricky parts like streaming expert weights and running Metal shaders. You just download the model weights and run a few simple commands.

Add Flash Moe Inference skill to your workflow

Global

mkdir -p ~/.claude/skills/flash-moe-inference

Project

mkdir -p .claude/skills/flash-moe-inference

Source Repository

Stars
49
Forks
11
Watchers
49
Last Push
2 months ago
Created
2 months ago