solution / 06 · robotics teleoperation data

Robotics teleoperation data. Episodes a policy can learn from.

Teleoperated demonstrations recorded by operators trained on your task, not whoever was free that afternoon. Joint states, actions, poses, and camera streams aligned per episode, graded against written success criteria, with consent on file for anyone in frame and signed provenance on every episode.

Trained operators Per-episode success labels Signed provenance Pilot run before volume
Hero image · 840 × 1050
first reply
1day
a robotics data lead, inside one business day
fingerprints per episode
2+
file hash plus per-frame hashes on video
episodes on the receipt
100%
listed by ID and hash, signed
delivery formats
4
WebDataset, Parquet, JSON Lines, Croissant metadata

What is robotics teleoperation data?

Robotics teleoperation data is a collection of recorded episodes in which a person drives a robot through a task, using a leader arm, a VR rig, an exoskeleton, or a game controller, while the robot logs what it sensed and what it was told to do at every timestep. Enough well-chosen episodes and a policy can learn the task by imitation.

The catch is that a policy learns everything in the episodes, including the bad habits. A nervous operator teaches a nervous policy. Three operators with three strategies for the same drawer teach a model that cannot decide. Variation that came from mistakes rather than from the protocol teaches noise.

eeko's data practice records episodes the other way around: a written task protocol first, operators qualified against it, then production, with a review sample on everything that ships. It is the discipline behind our enterprise AI agents, pointed at the physical world. Operators are paid through our paid AI-training programs, and every session follows the rules on our data capture page.

Recording session image · 2100 × 900
One protocol, one calibrated rig, one qualified operator, every stream on the same clock.

Teleoperation datasets, stream by stream.

An episode is only as useful as the streams inside it and the metadata around it. Each piece below is agreed in the specification before the first session.

01 / proprioceptionCORE
Joint states and commanded actions
Positions, velocities, and efforts for every joint, with the commanded action at the same timestep, so observation and target line up without post-hoc alignment.
02 / poseCORE
End-effector and base poses
Cartesian pose of the tool and, for mobile manipulation, the base, in a frame you define. Calibration runs at the start of each session and is stored with the episode.
03 / visionCORE
Wrist, scene, and head cameras
RGB or RGB-D views aligned to the control stream. Resolution, frame rate, and placement are fixed in the protocol and checked by the reviewer each session.
04 / contactOPTIONAL
Force, torque, and tactile signals
Where your end effector carries force-torque or tactile sensors, those streams are logged at native rate and resampled to the control clock, with the raw stream preserved.
05 / labelsCORE
Outcome and phase labels
Each episode is graded against the written success criteria. Where the spec asks, reviewers also mark sub-task boundaries, grasp and release events, and the reason an attempt failed.
06 / metadataPROVENANCE
Task, variation, and provenance metadata
Which protocol, variation, object set, operator, rig, and calibration. Plus the fingerprint, the signed provenance record, the consent reference, and an independent timestamp.

Robot demonstration data starts with the operator.

The policy inherits the operator's habits, so the operator is the first thing we get right.

Operator qualification image · 1200 × 900
Qualification episodes are graded like production. Nobody records for you until they pass.

From a task description to a qualified operator

  • Protocol — initial conditions, object set, allowed strategies, variations, success criteria, and the rule after a failed attempt, written with your engineers and versioned.
  • Interface training — operators from the eeko teleoperation pool learn your rig until only the task remains.
  • Qualification — scored episodes per operator. Hesitation, off-protocol strategies, and sloppy resets fail the gate.
  • Production — sessions follow a variation schedule, so coverage comes from the plan, not from chance.
  • Live review — reviewers sample as it happens and pull an operator for retraining the first time an episode drifts.
  • Records — every episode names its operator, reviewer, protocol version, and rig.

Operators are paid per accepted hour at a rate stated before they start, so they stay for the whole project and your episodes look like they came from one hand.

Imitation learning data, scoped to your embodiment.

Spec and pilot batch first, then production in whichever of these forms you need.

Gripper and wrist camera image · 1200 × 900
Wrist camera, gripper state, and force signal logged against one clock. The grasp event is marked by a reviewer, not inferred.

Six things we produce for robot learning teams

  • Teleoperated episodes — tabletop, bimanual, and mobile manipulation recorded to your protocol on your platform or ours.
  • Synchronized streams — proprioception, actions, poses, cameras, and contact sensors aligned per episode, one table plus linked media.
  • Outcome labels — success, failure, and recovery, with failure reasons where the spec calls for them.
  • Phase and event annotation — sub-task boundaries, grasps, releases, and contacts marked by reviewers.
  • Egocentric human video — head- or chest-mounted recordings of people doing the task by hand, consent recorded per session, for cross-embodiment pretraining.
  • Protocol design — if you have a task but no protocol yet, we write one with your team and pilot against it.

Adjacent needs: licensed video datasets for world-model pretraining, and 3D and CAD datasets for the objects your robot will meet.

Every episode fingerprinted, every delivery signed.

A checkpoint should be traceable to the demonstrations behind it. That takes a record on each episode, not a line in a contract.

Intake and fingerprint image · 800 × 1000
Intake — hashed, frame-hashed, checked against the registry.
Reviewer scoring image · 800 × 1000
Review — scored by a named reviewer, decision on the record.
Delivery receipt image · 800 × 1000
Receipt — a signed list of every episode delivered, by ID and hash.

Fingerprint and duplicate check

At intake each episode gets a cryptographic hash of the file and a hash per video frame, compared with everything already registered. A re-submitted session or a re-encoded copy is caught before it pads your episode count.

Consent, licence, and timestamp per episode

The consent of anyone identifiable in frame, the licence terms, and an independent timestamp are recorded against the episode itself. Location fields are stripped. A signed provenance record ties all of it to the hash.

Hash-chained audit trail and signed receipt

Intake, review, acceptance, and delivery events are chained so none can be edited quietly. Your signed receipt lists every episode by ID and hash: what you hand to an auditor who asks what the policy learned from. Full method on our verified human data page.

From task description to a sealed dataset.

Fixed scope, fixed price per accepted episode, agreed after the pilot. A real person replies inside one business day.

STEP 01
Brief
Tell us the task, the embodiment, and the sensors. We reply with questions and a protocol outline, not a deck.
STEP 02
Protocol and spec
Initial conditions, variations, success criteria, episode schema, annotation depth, and consent rules, versioned. Operators qualify against it.
STEP 03
Pilot batch
A small run on the real rig. You train on it, we fix what it exposes, and the production price is set from measured throughput.
STEP 04
Production and delivery
Scheduled sessions, live review, weekly shards in your format, and a signed receipt listing every episode.

Robotics teleoperation data questions.

What is robotics teleoperation data?

Robotics teleoperation data is a set of recorded episodes in which a human operator drives a robot through a task with a controller, VR rig, exoskeleton, or leader arm, while joint states, commanded actions, end-effector poses, gripper state, and camera views are logged in sync. Each episode is a worked example a policy can imitate, and the set is only as good as the operators' consistency, the chosen variations, and the labels on each episode.

How much does robotics teleoperation data cost?

Cost is set per accepted episode and moves with task length and difficulty, the number of protocol variations, the sensors recorded, annotation depth such as phase boundaries, whether sessions run on your hardware or ours, and exclusivity. A short tabletop pick-and-place costs far less per episode than a long, contact-rich assembly. We price the production run only after a pilot batch, so the quote reflects measured throughput rather than a guess.

Can you record on our robot, or do you supply the hardware?

Either. If the embodiment matters, and for most policy work it does, we record on your platform and interface, at your site or on units shipped to our operators. Where the task is embodiment-agnostic, or you need human demonstrations rather than robot ones, we record with our own rigs and egocentric cameras. Setup, calibration routine, and episode schema are fixed during scoping so every session logs the same thing the same way.

What format do teleoperation episodes come in?

Episodes ship as WebDataset shards for streaming into training, as Parquet tables for the numeric streams with linked media files, or as JSON Lines with one record per episode, with Croissant metadata describing the set. If your stack expects a particular episode layout, such as specific key names or a timestep convention, we write it into the specification and check every delivery against it before it leaves us.

Do you include failed attempts in the dataset?

Only when your specification asks for them. Many teams keep failures and recoveries, labeled with the failure reason and the phase where it happened, because some methods learn from them and they make useful evaluation cases. Others want clean successes only. Either way, the signed receipt lists exactly which episodes were delivered, so an unlabeled failure never slips into a set that was meant to be successes only.

How do you handle people who show up in the camera streams?

Scene and head-mounted cameras capture operators, bystanders, and places. Anyone identifiable in an episode offered for training has consent recorded against that episode, and participants in egocentric sessions agree in advance to what is captured and how it may be used. Location fields and other personal metadata are removed before delivery. A recording that includes someone without consent on file is held back, not shipped.

Tell us the task. We will write the protocol.

Send the task, the embodiment, and the sensors you log. A robotics data lead replies inside one business day with a protocol outline and a pilot plan. No deck. A ranked list of what to record first.

Experienced within

  • SOC 2 Type II
  • ISO 27001
  • HIPAA
  • HITRUST r2
  • ISO 27701
  • PCI DSS
  • NIST CSF 2.0
  • CMMC
  • FedRAMP
  • GDPR

Markets served.

As an enterprise AI agency, eeko systems delivers production AI systems remote-first across the United States and internationally — including these markets:

New York City, New York (NY)

Los Angeles, California (CA)

Chicago, Illinois (IL)

Houston, Texas (TX)

Phoenix, Arizona (AZ)

Philadelphia, Pennsylvania (PA)

San Antonio, Texas (TX)

San Diego, California (CA)

Dallas, Texas (TX)

San Jose, California (CA)

Austin, Texas (TX)

Jacksonville, Florida (FL)

Fort Worth, Texas (TX)

Columbus, Ohio (OH)

Charlotte, North Carolina (NC)

Indianapolis, Indiana (IN)

San Francisco, California (CA)

Seattle, Washington (WA)

Denver, Colorado (CO)

Washington, District of Columbia (DC)

Boston, Massachusetts (MA)

El Paso, Texas (TX)

Nashville, Tennessee (TN)

Detroit, Michigan (MI)

Oklahoma City, Oklahoma (OK)

Portland, Oregon (OR)

Las Vegas, Nevada (NV)

Memphis, Tennessee (TN)

Louisville, Kentucky (KY)

Baltimore, Maryland (MD)

Milwaukee, Wisconsin (WI)

Albuquerque, New Mexico (NM)

Tucson, Arizona (AZ)

Fresno, California (CA)

Sacramento, California (CA)

Kansas City, Missouri (MO)

Atlanta, Georgia (GA)

Miami, Florida (FL)

Colorado Springs, Colorado (CO)

Raleigh, North Carolina (NC)

Omaha, Nebraska (NE)

Long Beach, California (CA)

Virginia Beach, Virginia (VA)

Oakland, California (CA)

Minneapolis, Minnesota (MN)

Tulsa, Oklahoma (OK)

Arlington, Texas (TX)

New Orleans, Louisiana (LA)

Wichita, Kansas (KS)

Cleveland, Ohio (OH)

Tampa, Florida (FL)

Bakersfield, California (CA)

Aurora, Colorado (CO)

Honolulu, Hawaii (HI)

Anaheim, California (CA)

Santa Ana, California (CA)

Corpus Christi, Texas (TX)

Riverside, California (CA)

Lexington, Kentucky (KY)

St. Louis, Missouri (MO)

Stockton, California (CA)

Pittsburgh, Pennsylvania (PA)

Saint Paul, Minnesota (MN)

Cincinnati, Ohio (OH)

Greensboro, North Carolina (NC)

Anchorage, Alaska (AK)

Plano, Texas (TX)

Lincoln, Nebraska (NE)

Orlando, Florida (FL)

Irvine, California (CA)

Newark, New Jersey (NJ)

Toledo, Ohio (OH)

Durham, North Carolina (NC)

Chula Vista, California (CA)

Fort Wayne, Indiana (IN)

Jersey City, New Jersey (NJ)

St. Petersburg, Florida (FL)

Laredo, Texas (TX)

Madison, Wisconsin (WI)

Chandler, Arizona (AZ)

Buffalo, New York (NY)

Lubbock, Texas (TX)

Scottsdale, Arizona (AZ)

Reno, Nevada (NV)

Glendale, Arizona (AZ)

Gilbert, Arizona (AZ)

Winston-Salem, North Carolina (NC)

North Las Vegas, Nevada (NV)

Norfolk, Virginia (VA)

Chesapeake, Virginia (VA)

Fremont, California (CA)

Garland, Texas (TX)

Richmond, Virginia (VA)

Baton Rouge, Louisiana (LA)

Boise, Idaho (ID)

San Bernardino, California (CA)

Spokane, Washington (WA)

Des Moines, Iowa (IA)

Modesto, California (CA)

Birmingham, Alabama (AL)

Tacoma, Washington (WA)

Fontana, California (CA)

Oxnard, California (CA)

Fayetteville, North Carolina (NC)

Huntsville, Alabama (AL)

Moreno Valley, California (CA)

Rochester, New York (NY)

Glendale, California (CA)

Yonkers, New York (NY)

Augusta, Georgia (GA)

Amarillo, Texas (TX)

Little Rock, Arkansas (AR)

Akron, Ohio (OH)

Shreveport, Louisiana (LA)

Grand Rapids, Michigan (MI)

Mobile, Alabama (AL)

Salt Lake City, Utah (UT)

Huntsville, Texas (TX)

Tallahassee, Florida (FL)

Overland Park, Kansas (KS)

Knoxville, Tennessee (TN)

Worcester, Massachusetts (MA)

Brownsville, Texas (TX)

New Port Richey, Florida (FL)

Jackson, Mississippi (MS)

Providence, Rhode Island (RI)

Fort Lauderdale, Florida (FL)

Sioux Falls, South Dakota (SD)

Tempe, Arizona (AZ)

Cape Coral, Florida (FL)

Springfield, Missouri (MO)

Pembroke Pines, Florida (FL)

Eugene, Oregon (OR)

Peoria, Arizona (AZ)

Corona, California (CA)

Lancaster, California (CA)

Rockford, Illinois (IL)

Salinas, California (CA)

Palmdale, California (CA)

Springfield, Massachusetts (MA)

Charleston, South Carolina (SC)

Duluth, Minnesota (MN)

London, England (ENG)

Dublin, Ireland (IRE)