Skip to content

Changelog

0.3.0 Release Notes

LOPs 0.3.0 makes more of the system authorable from inside TouchDesigner. You can build operators, prompts, skills, profiles, Flow routes, Graph projections, and TD-aware tools with LOPs itself, then reuse them as part of a more stable, unified operator family.

Main Themes

Authorable module layer

Any, Prompt, Graph, Flow Router, profile and skill builders, and TD-aware tool operators let you package module-backed operators, prompts, skills, profiles, tools, and reusable behavior inside TouchDesigner.

Any, Prompt, Graph, Flow Router, Build Agent Profile, Build Agent Skill, Tool TD Code, Tool TD Mod

Agent runtime and shared tools

Agent 2.0.0 adds skills, profiles, tool approval, public state and transcript APIs, activity events, and shared tool wiring across Agent, Voice Agent, Claude Code, and Agent Swarm.

Agent, Voice Agent, Claude Code, Agent Swarm, Tool TD Code, Tool TD Mod, Build Agent Profile, Build Agent Skill

Unified voice and speech stack

The older provider-specific speech operators converge around STT, TTS, Voice Activity, and Voice Agent.

STT, TTS, Voice Activity, Voice Agent

Composable retrieval, graph, and memory

Search Text, Search RAG, Search Merge, and Graph give search, semantic retrieval, result merging, and relationship memory clearer shared paths.

Search Text, Search RAG, Search Merge, Graph

New and Current Operators

  • Activity Viz - ActivityViz is an experimental inspector for agent and tool activity inside a TouchDesigner project. The 0.3.0 package ships the listener/core system plus eight bundled visual modules with conservative defaults: Terminal, Attention Field, Work Area, Buddy, Net Boy, Pixel Elk, Gluub Ray, and Nox. It is not positioned as a production dashboard or a standalone ActivityViz Config release.
  • Agent Swarm - Coordinates a lead Agent with multiple worker Agents. The lead delegates subtasks through injected tools and receives worker results back into its session.
  • Any - Host operator that loads a Python module and becomes whatever that module defines — custom parameters, tools, callbacks, DATs, and lifecycle from a single .py file.
  • Build Agent Profile - Agent profile authoring tool. Detects customized parameters on a target Agent and writes a portable, stackable profile JSON for reuse across projects.
  • Build Agent Skill - Analyzes a target LOPs tool operator and writes a reusable Python skill, skills_config DAT content, or Markdown reference.
  • Flow Router - Table-driven N-in dispatcher — matches CHOP events and/or DAT phrases against a library table to fire actions, set parameters, call methods, update flow context, or transition flow steps.
  • Graph - Knowledge graph operator — ingest observations from a source DAT, project them into nodes and edges via pluggable Python projection logic, query with keyword/hybrid/neighborhood modes, and expose graph tools to agents.
  • Prompt - Builds a composed prompt from tagged sibling DAT blocks, sorted by network position, with optional identity scoping.
  • Search Merge - Merges result tables from multiple retriever operators into one ranked result table using reciprocal rank fusion.
  • Search RAG - Unified RAG operator: builds vector index and searches it with embedding similarity + optional reranking. Exposes search as an agent tool.
  • Search Text - BM25 text search over tables, folders, or RAG indexes. Exposes search as an agent tool.
  • STT - Unified speech-to-text operator with swappable provider backends — handles transcription, streaming partials, and wake-word detection through a single Mode parameter.
  • TTS - Unified text-to-speech operator with swappable provider backends — synthesizes speech from text via local models (Kokoro, Pocket TTS) or cloud APIs (ElevenLabs, Cartesia).
  • Tool Op Context - Gives agents focused context about the user’s current TouchDesigner selection with analysis modes for troubleshooting, optimization, and content reading.
  • Tool TD Code - Gives agents a raw Python exec tool inside a live TouchDesigner session. Session globals persist between calls, safety patterns block dangerous operations, and optional module injection makes Python namespaces callable without imports.
  • Tool TD Mod - Gives agents a structured module interface instead of raw Python exec. Agents list, doc, source-read, and call typed Python functions organized into modules.
  • Voice Activity - Unified voice activity pipeline: echo cancellation + Silero VAD + Smart Turn v3 semantic end-of-turn. Replaces vad_silero.
  • Voice Agent - Unified realtime voice-to-voice operator with swappable provider backends — Gemini Live, OpenAI Realtime, xAI Grok Voice, and Hume EVI through a single Provider menu.

Deprecated / Replaced Operators


0.3.0
0.3.0 Release
May 8, 2026
108 operators57 new32 updated

New Operators

Updated Operators


Released 2026-03-27

LOPs went from ~50 operators to 87. The architecture got reworked under the hood — SideCar runs ML in subprocesses, tools have per-operator toggles, and there are whole new categories of things you can build now including state machines, MCP servers, and native Claude Code integration.

Agent Tools

The tool system got a ground-up overhaul. Tool DAT now tracks read state so agents know what they’ve already seen. Tool Parameter gives agents deeper access to TD parameters. There’s a new Tool Manager for coordinating which tools are available, Tool Request for structured HTTP tool calls, and Tool VFS for sandboxed agent file operations. Every operator’s GetTool() now supports individual enable toggles and presets.

SideCar Architecture

The SideCar got completely rewritten. All torch operations now run in a subprocess — RAG indexing, OCR, Florence vision, embeddings — keeping your TD UI responsive no matter what ML workloads are running.

MCP Support

MCP Client and MCP Server were already in LOPs, but 0.2.0 adds MCP Config — a tiered configuration system for managing server connections, tool permissions, and routing at project, folder, and user levels.

Settings & Updates

Settings UI gives you centralized configuration accessible from the op create dialog. Tox Updater lets operators self-update from the LOPs registry via your Patreon credentials. Python Manager now supports UV as a backend for faster, more reliable venv management.

The Flow System

LOPs now has a built-in state machine. Flow Controller lets you define steps, wire transitions, and set conditions — all through the parameter panel. Flow Action triggers step changes from CHOP events, Flow Trigger watches channels for edge-based firing, and Flow State tracks the full audit trail with Mermaid flowchart export. Build a pipeline where STT triggers search, search feeds RAG, RAG passes to an agent, and the agent routes to TTS — as a readable state graph in your network.

More Highlights

  • Claude Code — native bridge for running Claude Code sessions inside TD over WebSocket, with a companion viewer
  • Scope Controller — control Daydream Scope AI video server from TD via REST + Spout
  • SpeechVAD Silero rewritten with ONNX lite mode, STT Whisper streaming improved, two new STT engines (Parakeet local, Soniox cloud)
  • RAG v2 — async server-based indexing through SideCar, new BM25 for keyword search alongside vector, better web ingestion via Source Crawl4ai
  • Image & Visionfal.ai expanded model support, Gemini Image Gen gallery support, new ComfyUI operator
  • Gemini Live — continued improvements to real-time multimodal streaming

Released 2025-09-02

  • Agent Session - Persistent session management for agent conversations
  • Agent Orchestrator - Multi-agent coordination and delegation
  • Tool VFS - Virtual filesystem tool for agent file operations

Agent, Chat Viewer, Gemini Live, Gemini Image Gen, Search, Source Crawl4ai, STT AssemblyAI, STT Kyutai, STT Whisper, MCP Server, Tool DAT, Tool Parameter, Tool Monitor, RAG Index


Released 2025-07-31

Initial public alpha release of the LOPs ecosystem with 50+ operators for LLM integration, speech-to-text, RAG pipelines, tool calling, and more in TouchDesigner.