This document provides the definitive setup for a high-performance, local AI development environment on an M4 Max (36GB RAM). It leverages Speculative Decoding, AST-based Indexing, and Kernel-level Memory Tuning.
On an M4 Max with 36GB, the "Sweet Spot" is running a 35B-parameter model (The Architect) and a 1.5B-parameter model (The Draft Model).
| version: "3.7" | |
| services: | |
| nutshell: | |
| image: cashubtc/nutshell:latest # The Docker image for Nutshell | |
| ports: | |
| - "3338:3338" # Expose port 3338 | |
| environment: | |
| - MINT_BACKEND_BOLT11_SAT=FakeWallet | |
| - MINT_PRIVATE_KEY=TEST_PRIVATE_KEY |
| <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN" "http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd"> | |
| <html xmlns="http://www.w3.org/1999/xhtml" lang="en-us" > | |
| <head> | |
| <title>Select asset to change | MBrain admin</title> | |
| <meta name="viewport" content="width=device-width, initial-scale=1.0"/> | |