Podium is a scalable agent concert platform that deploys and manages AI agent processes with dual-runtime support for Python and TypeScript. Written in Rust (coordinator and gateway) with TypeScript and Python SDKs for agent development.

​
What It Does

  • Deploys agent code bundles from an S3 registry to coordinator hosts
  • Spawns isolated agent processes (Python via PyO3 shim, TypeScript via Bun)
  • Routes client traffic to agents via a gateway that load-balances across coordinators
  • Provides agents with Chronicle-backed versioned workspaces
  • Manages agent state with automatic delta tracking and persistence
  • Communicates via its own native StreamUpdate protocol over WebSocket (Diminuendo translates to/from ACP for clients)

​
Architecture

                    Gateway (Rust/Axum)
                    ┌─────────────────────┐
                    │ API key auth         │
                    │ Load balancing       │
                    │ S3 deployment upload │
                    │ Native WS proxy      │
                    └──────┬──────────────┘
                           │
                    Valkey (Service Discovery)
                           │
              ┌────────────┼────────────┐
              ▼            ▼            ▼
         Coordinator  Coordinator  Coordinator
              │            │            │
         ┌────┴───┐   ┌───┴────┐  ┌───┴────┐
         │Agent 1 │   │Agent 3 │  │Agent 5 │
         │Agent 2 │   │Agent 4 │  │Agent 6 │
         └────────┘   └────────┘  └────────┘

​
Key Features

FeatureDescription
Dual runtimePython (PyO3 embedded in Rust) and TypeScript (Bun) side-by-side
Process isolationEvery agent runs in its own process with its own state DB
Versioned workspacesChronicle FUSE mounts per agent with full file history
Delta stateAutomatic state tracking — mutate objects, deltas auto-generated
S3 deployment registryUpload once → any coordinator can deploy on demand
Native protocolCoordinator speaks its own StreamUpdate protocol; Diminuendo translates to/from ACP for clients
3-layer SQLiteSeparate databases for logs, messages, and state per agent
Litestream replicationSQLite databases replicated to S3 for durability