Skip to content

Build a robotics pack #196

Closed as not planned
Closed as not planned

Description

@larstalian

Context

Cyber and trading are both "agent talks to an external surface"
domains. Robotics is structurally different — the agent talks to a
simulator that has internal state, the action space is continuous,
"task success" is geometric / temporal rather than evidence-based.

OpenRange's RuntimeBacking protocol allows non-HTTP runtimes — but
nobody's actually built one. A robotics pack would be the
forcing function.

What this issue tracks

Sketch a robotics.tabletop pack that connects OpenRange's lifecycle
to a robotics simulator (MuJoCo, Isaac, similar):

  • A simple tabletop scenario (block-stacking, pick-and-place, etc.)
  • Runtime backing that wraps the sim — probably gRPC or shared memory
    rather than HTTP
  • Verifier that grades task success geometrically (cube on top of
    cube within tolerance)
  • Episode reset = sim reset; episode terminate = task success or
    step budget exhausted

Why it matters

Tests OpenRange's domain-agnostic claims at the extreme. If the
abstractions don't hold for robotics, that's structural drift worth
knowing about before we accumulate more cyber-shaped assumptions.

Where to start

  • docs/start_here.md — read first.
  • src/openrange/core/runtime_backing.py — the RuntimeBacking
    protocol. Robotics needs a non-HTTP backing; this is where the
    contract lives.
  • src/openrange/packs/cyber_webapp_offense_v1/ — the only
    reference pack today. Robotics will diverge from it heavily.

Acceptance

This is exploratory. If you want to drive it:

  1. Open a design doc PR proposing the ontology, entrypoint kind, and
    runtime backing shape.
  2. Discussion on whether the existing abstractions work or need to
    flex.
  3. Implementation only after the contract is agreed.

Notes

Pick a sim with reasonable Python bindings; the cost of a brittle
sim integration overwhelms the value of the pack itself. MuJoCo
Python bindings + a simple table scene is enough.

Activity

  1. added
    roadmapTracked on the public roadmap
    pack-otherNew / exploratory packs
    researchExploratory / no near-term plan
    on May 4, 2026
  2. changed the title [-][roadmap] Robotics pack (exploratory)[/-] [+]Build a robotics pack — MuJoCo / Isaac integration via non-HTTP backing[/+] on May 4, 2026
  3. changed the title [-]Build a robotics pack — MuJoCo / Isaac integration via non-HTTP backing[/-] [+]Build a robotics pack [/+] on May 4, 2026
  4. changed the title [-]Build a robotics pack [/-] [+]Build a robotics pack[/+] on May 4, 2026
  5. larstalian commented on Oct 12, 2026

    @larstalian
    ContributorAuthor

    No longer involved with this project, so closing my open issues. Feel free to reopen anything you still want to track.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    help wantedExtra attention is neededpack-otherNew / exploratory packsresearchExploratory / no near-term planroadmapTracked on the public roadmap

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions