DEPLOYDatabase

Brain

DexTacWAM

DexTacWAM (Dexterous Tactile World-Action Model) is a Sep 2026 academic visuo-tactile WAM (Yuan, Wang, Shao, Lu, Darrell, Lourentzou, Zhan; UIUC + UC Berkeley + Northwestern; arXiv 2609.24976) that jointly models visual scene dynamics and distributed multi-finger contact dynamics. A finger- and pose-aware tactile compressor maps five fingertip streams into per-hand latents injected into a video diffusion world model; an action expert conditions on the joint visuo-tactile state.

Author-reported mean 70.6 across six real-robot tasks versus 38.0 for the strongest baseline; compressor retains 89.4% pre-fusion contact recall with 2.26x train / 1.29x infer speedups. Research demo on a 22-DoF bimanual Sharpa tactile platform, not a commercial product.

Research model · Maturity: Research · Closed

Machine-readable surfaces

Architecture

Per-finger tactile maps via frozen pretrained vision VAE + grayscale-to-RGB adapter; finger- and pose-aware 5:1 tactile compressor into per-hand latents; video diffusion DiT world model jointly denoises visual + tactile views; per-modality K/V RMS-normalized action expert (flow matching) for dexterous actions

Key facts

System (project-stated)
Project-stated (project-stated; also project site): DexTacWAM is a visuo-tactile world-action model (Yuan / Wang / Shao / Lu / Darrell / Lourentzou / Zhan; UIUC + UC Berkeley + Northwestern; arXiv 2609.24976, Sep 21 2026) that jointly predicts visual scenes and multi-finger contact dynamics. Encodes each fingertip independently, aggregates via a finger- and pose-aware tactile compressor, and injects tactile latents into a video diffusion world model for joint visuo-tactile world modeling. Academic research system, not a commercial product
Six-task real-robot results (project-stated)
Project-stated (project-stated): on six contact-rich dexterous manipulation tasks on a 22-DoF bimanual platform (20 real-robot trials per method per task), DexTacWAM averages 70.6 versus 38.0 for the strongest baseline (RDP). Cap: author-reported lab results; not independent third-party verification
Tactile compressor retention / speedups (project-stated)
Project-stated (project-stated): finger- and pose-aware tactile compressor retains 89.4% of pre-fusion contact recall while enabling 2.26x faster training and 1.29x faster inference. Ablation: removing tactile world modeling drops four-task mean from 74.7 to 26.6 with the same tactile features and action expert. Cap: paper-reported metrics
Tactile world-model ablation
The project page says removing tactile world modeling drops the four-task mean from 74.7 to 26.6 while keeping the same tactile features and action expert (DexTacWAM).
Sharpa 22-DoF platform
The paper says the six-task evaluation used a bimanual platform with multi-finger 22-DoF Sharpa tactile sensors (arXiv 2609.24976).
UIUC, Berkeley, and Northwestern
The project page lists authors at the University of Illinois Urbana-Champaign, the University of California, Berkeley, and Northwestern University (DexTacWAM).

Common questions

What is DexTacWAM?
DexTacWAM (Dexterous Tactile World-Action Model) is a Sep 2026 academic visuo-tactile WAM (Yuan, Wang, Shao, Lu, Darrell, Lourentzou, Zhan; UIUC + UC Berkeley + Northwestern; arXiv 2609.24976) that jointly models visual scene dynamics and distributed multi-finger contact dynamics. A finger- and pose-aware tactile compressor maps five fingertip streams into per-hand latents injected into a video diffusion world model; an action expert conditions on the joint visuo-tactile state. Author-reported mean 70.6 across six real-robot tasks versus 38.0 for the strongest baseline; compressor retains 89.4% pre-fusion contact recall with 2.26x train / 1.29x infer speedups. Research demo on a 22-DoF bimanual Sharpa tactile platform, not a commercial product.
Is DexTacWAM open source?
No. DexTacWAM is recorded as proprietary on the DEPLOY registry. Model weights and source are not publicly available.
What type of AI is DexTacWAM?
DexTacWAM is a research model, built on a Per-finger tactile maps via frozen pretrained vision VAE + grayscale-to-RGB adapter; finger- and pose-aware 5:1 tactile compressor into per-hand latents; video diffusion DiT world model jointly denoises visual + tactile views; per-modality K/V RMS-normalized action expert (flow matching) for dexterous actions architecture on the DEPLOY registry.
What is DexTacWAM's maturity stage?
DexTacWAM is at the research stage on the DEPLOY maturity ladder. Research stage means active development without commercial deployments on file.
Which robots run on DexTacWAM?
No robot models on the DEPLOY registry are recorded as running DexTacWAM. DEPLOY wires brain-to-model connections only when the wiring is verifiable from primary sources; absence may reflect pre-deployment or unverified manufacturer claims.

Sources (4)

  1. https://arxiv.org/abs/2609.24976 · 2026-09-21
  2. https://arxiv.org/pdf/2609.24976 · 2026-09-21
  3. https://dextacwam.github.io/ · 2026-09-21
  4. https://x.com/robotsdigest/status/2105059594288681337 · 2026-09-29
Methodology: Verified · 4 sources (no primary) · last reviewed 2026-10-09

Verification posture

Verified

Low confidence

Review state

Stable

Last reviewed 2026-10-09

Maturity + lifecycle

Maturity stage: research

Sources by quality tier

2
preprint
Preprint
2
unclassified
Unclassified source

The framework is documented at /methodology. Corrections at /corrections. Reviewer: DEPLOY editorial team.

Methodology surface for DexTacWAM.

Canonical ID 449019c6-e4f8-43f0-996d-ec4d1c077b08