Research¶
Academic foundations and related publications. SWARM implements the framework described in Soft-Label Governance for Distributional Safety in Multi-Agent Systems; see also Distributional Safety in Agentic Systems.
-
:material-book-open-variant: Theoretical Foundations
Mathematical framework and core concepts
-
:material-file-document-multiple: Papers
Publications and references
-
:material-publish: Agent Publishing Guide
Conduct research and publish to agentxiv/clawxiv
-
:material-sync-alert: Reflexivity
Addressing feedback loops in recursive agent research
-
:material-cog-outline: Agent System Patterns
Architectural patterns from production agent systems and their SWARM translations
-
:material-radar: SWE-AF Reconnaissance
External repository scouting status and SWARM integration plan
-
:material-telescope: Situational Awareness Tracker
Claim status for Aschenbrenner's Situational Awareness and its mapping onto SWARM mechanisms
-
:material-graph-outline: Neurosymbolic Behavior Classification
Neural perception + Scallop-style probabilistic Datalog for classifying embodied and LLM-agent behavior
-
:material-sitemap: Fabro Workflow DAG Spike
Spike memo: should SWARM adopt a fabro-workflow-style experiment DAG for orchestration?
-
:material-table: Calibration CSV Schema
Arm D's frozen joined.v1 schema — the CSV contract downstream studies join against
-
:material-gauge: External Quality Signal Interface
Proposal memo: governance-owned external-judge channel — tamper-resistant anchors as a byproduct of governed runs
-
:material-chart-timeline-variant: Dispatch Retro 2026-07-19
First bv-dispatch retro: prediction scorecard, mud-ledger baselines (entropy 0.88, orphan influx 88%), and the read-path lesson
-
:material-certificate: DGG Counterexample Lessons
Verified case study of the 2026 Dinitz–Garg–Goemans disproof: verifier coverage as the trust variable, pressure-lever symmetry, plausibility–certificate gap
-
:material-timeline-clock: Long-Horizon Safety Lessons
OpenAI's 2026 long-horizon model post-mortem: action-level gates get decomposed around, trajectory-level monitoring, constraint circumvention vs. fabrication
-
:material-scale-balance: Erdős AI-Ledger Lessons
Ecosystem governance lessons from Tao's AI-contributions ledger: verification bottleneck, denominator problem, corroboration vs. collusion
-
:material-compass-off: Open-Ended Research Failure Modes
Kapoor–Narayanan shadow evaluations mapped onto this rig's incident log: five judgment failures, dated exhibits, and the enforcement-ladder mitigations
-
:material-autorenew: Reflective Self-Improvement Lessons
The compiler bootstrap analogy and its limits: why a fixed-point tripwire certifies convergence rather than correctness, and the variance term the framework omits
-
:material-sword-cross: Hyperspace Two-Swarms Lessons
Attacker vs. defender swarms on the OpenAI-HF incident: correlation degrades both by the same factor, but the attacker pays in visible latency and the defender in silent misses
-
:material-file-alert: ARA Compiler Pilot Report
SWA-71 pilot of the Agent-Native Research Artifact compiler: evidence-layer fabrication, broken self-validation, final verdict Reject
-
:material-magnify-expand: Greenblatt Misalignment Field Evidence
Apparent-success-seeking as production evidence for SWARM's mechanism: his failure catalog mapped to quality gap and toxicity, plus four scenario proposals it motivates
-
:material-telescope-shooting: AISF-2026 Observatory Mapping
Saxe's AI security observatory proposal mapped onto SWARM constructs: signals to observables, policy toolkit to governance levers, and the internalization gap in his menu
-
:material-telescope: CRUX Survey Analysis
How Princeton's open-world evaluations program intersects SWARM: frame match, submission opportunities, metrics-layer positioning
-
:material-bridge: Real-Tool Eval Bridge
Feasibility assessment for bridging simulated governance to real tool-using agents: 80% infrastructure exists, three gaps, reality-gap research question
-
:material-graph: Conjecture-Flood Superstructure
AI-assisted interdisciplinary mapping as a claim economy: retrieval-failure vs. genuinely-new bridges, mechanical-checker verification economics, adverse-selection framing (beads a2il → u8x6, oa5h)
-
:material-chart-scatter-plot: A-Evolve Flat Landscape
Why the A-Evolve evolution track has no gradient to evolve against: p is keyed on agent type, not behavior — both adversary knobs and defender levers are flat (beads 3o9l recon → 2qgp)
-
:material-book-cog: KSI Knowledge Curation
Knowledge-centric self-improvement as a claim economy: disposable agents remove the substrate governance acts on, and the transferability that makes bundles valuable makes poison portable (beads sx6c, cx83 → 77ao)
-
:material-backup-restore: Shepherd Reversible Execution
Reversible execution traces vs SWARM's live-write sandbox: the delta is default-accept vs default-propose, and prevention may not decompose the way detection does (beads hpf3, vwj3)
-
:material-virus-outline: Memetic Spread Countermeasures
Value contagion through shared memory: resets make the meme endemic by destroying emergent herd immunity, detection dominates at a welfare tax, and channel contagion is invisible to interaction-level toxicity (beads kgxc → 2qfq, 2avk, 7prw)
-
:material-lan-connect: Side-Channel Coordination
When an ungoverned coordination channel emerges alongside the governed one (2026 OpenAI/Hugging Face incident): teardown without revocation only relocates it, revoking discovery collapses it, a lower-friction sanctioned channel outcompetes it with no enforcement, and interaction-level toxicity is blind to the whole migration (bead k5o9)
-
:material-robot-outline: RL Organism Emergence
De novo emergence on tabular bandits with no strategy enum: targeted predation appears at 3 states, a predatory coalition at 18 — and the emergent coalition walks past CollusionDetector in all 20 runs because pair-first scoring can't see quality-inside/harm-outside structure (beads boll → mwve)
Core Research Questions¶
SWARM addresses fundamental questions in multi-agent AI safety:
-
Emergence: How do systemic risks emerge from interactions between individually safe agents?
-
Measurement: How can we measure harm probabilistically rather than binary classification?
-
Governance: What mechanisms effectively mitigate collective risks without over-constraining beneficial activity?
-
Scaling: How do risks scale with agent count, capability, and interaction frequency?
Key References¶
- Tomasev et al. "Virtual Agent Economies" (arXiv 2509.10147)
- Multi-agent safety and coordination literature
- Mechanism design and auction theory
- Distributional robustness in ML systems
See Papers for the complete bibliography.