Video Production Crew - Multi-Agent Letta System with LTX-2 LoRA

video-crew-gist.md

Video Production Crew - Multi-Agent Letta System

Created: 2026-01-13 Status: ✅ FULLY OPERATIONAL

---

Architecture

┌─────────────────────────────────────────────────────────────────┐
│                     LETTA SERVER (8283)                         │
│                                                                 │
│    ┌──────────────┐                                            │
│    │   DIRECTOR   │ ← Supervisor, coordinates team             │
│    │   (Claude)   │                                            │
│    └──────┬───────┘                                            │
│           │ send_message_to_agents_matching_tags               │
│           ▼                                                    │
│    ┌──────────────┐         ┌──────────────┐                  │
│    │    WRITER    │         │  CAMERAMAN   │                  │
│    │   (Claude)   │         │   (Claude)   │                  │
│    │              │         │ + ComfyUI    │                  │
│    └──────────────┘         └──────────────┘                  │
│                                                                 │
└─────────────────────────────────────────────────────────────────┘
         │                            │
         ▼                            ▼
┌─────────────────┐          ┌─────────────────┐
│  Claude Router  │          │    ComfyUI      │
│  (port 3000)    │          │  (port 8188)    │
└─────────────────┘          └─────────────────┘

---

Agent IDs

Agent	ID	Tags
Director	agent-22069f59-7a79-4890-bf4f-1f2a69696267	director, supervisor, video-team
Writer	agent-e565b3e8-4a59-440a-89ab-6c279d61cfb0	writer, creative, video-team
Cameraman	agent-f939736a-46fc-4115-a584-0a8cf896212a	cameraman, technical, video-team

---

Endpoints

Service	URL
Letta API	http://192.168.1.143:8283
Claude Router	http://192.168.1.143:3000
ComfyUI	http://192.168.1.143:8188

Auth Header: Authorization: Bearer e9acq0WgooNgt5ncWWSJEQ

---

Video Generation Workflow

Current: LTX-2 T2V Distilled with LoRA

The Cameraman uses the LTX-2 T2V Distilled with LoRA workflow:

• Base Model: ltx-2-19b-distilled-fp8.safetensors (27GB)
• LoRA: ltx-2-19b-distilled-lora-384.safetensors (7.6GB)
• Text Encoder: gemma-3-12b-it-bnb-4bit
• Upscaler: ltx-2-spatial-upscaler-x2-1.0.safetensors
• Resolution: 1920x1088
• Frame Rate: 24fps
• Duration: ~5 seconds (121 frames)
• Generation Time: ~3-4 minutes

Workflow Structure

CheckpointLoaderSimple (5228)
        │
        ├──► LoraLoaderModelOnly (5230) ──► CFGGuider Stage 1 (5232:5151)
        │
        └──► LoraLoaderModelOnly (5231) ──► CFGGuider Stage 2 (5232:5171)
                                                    │
                                                    ▼
                                           Two-Stage Sampling
                                                    │
                                                    ▼
                                         LTXVLatentUpsampler
                                                    │
                                                    ▼
                                            SaveVideo (5075)

---

Usage Examples

Send Video Request to Director

curl -s -X POST "http://192.168.1.143:8283/v1/agents/agent-22069f59-7a79-4890-bf4f-1f2a69696267/messages" \
  -H "Authorization: Bearer e9acq0WgooNgt5ncWWSJEQ" \
  -H "Content-Type: application/json" \
  -d '{"messages":[{"role":"user","content":"Create a video of a phoenix rising from flames in slow motion"}]}'

Direct to Cameraman (skip Writer)

curl -s -X POST "http://192.168.1.143:8283/v1/agents/agent-f939736a-46fc-4115-a584-0a8cf896212a/messages" \
  -H "Authorization: Bearer e9acq0WgooNgt5ncWWSJEQ" \
  -H "Content-Type: application/json" \
  -d '{"messages":[{"role":"user","content":"Generate a video: A samurai warrior in falling snow at night, moonlight on katana, cinematic film grain"}]}'

Check ComfyUI Queue

curl -s "http://192.168.1.143:8188/queue" | jq '{running: .queue_running | length, pending: .queue_pending | length}'

---

Tools Available

Agent	Tools
Director	send_message_to_agents_matching_tags, send_message_to_agent_and_wait_for_reply, archival_memory_*
Writer	send_message_to_agent_and_wait_for_reply, archival_memory_*
Cameraman	generate_video (ComfyUI LTX-2+LoRA), send_message_to_agent_and_wait_for_reply, archival_memory_*

---

Output Location

Videos are saved to: ~/ComfyUI/output/video/LTX-2_XXXXX_.mp4

---

Videos Generated This Session

File	Workflow	Prompt
LTX-2_00009_.mp4	LTX-2 + LoRA ✅	Samurai in snow
LTX-2_00008_.mp4	LTX-2 fp8 only	Phoenix rising from flames

---

SSH Access

ssh straughter@192.168.1.143

Mac's SSH key is already authorized.

---

Last Updated: 2026-01-13