Skip to main content

Motion Retargeting

Motion Retargeting maps human motion capture trajectories to the reference trajectory of a specified robot and maintains Robot Skill Models from them. The page maintains three databases: Human Motion, Robot Reference Trajectory, and Robot Skill Model, organized by their upstream-to-downstream relationships. The sidebar entry is Model → Action.

Motion Retargeting overview (grouped by three databases)

Prerequisites

ItemContent
Menu entryModel → Action
RouteOverview /retargeting; Human Motion /retargeting/human-motions; Robot Reference Trajectory /retargeting/robot-references; Robot Skill Model /retargeting/robot-skills
Required permission"View Skills / Actions"
Related permission"Manage Skills / Actions"
Visible rolesAdministrator, Project Manager
Effective rulesAdministrators are exempt from module permissions; other roles follow the role default template, and a user-level override takes precedence over the role default; an unconfigured module is denied

The default level of the Skills module for each role is as follows.

Role"View Skills / Actions""Manage Skills / Actions"
Project ManagerRead OnlyRead & write
CollectorRead OnlyDeny
AnnotatorRead OnlyDeny
AuditorRead OnlyDeny

The "Model → Action" menu is shown to Administrators and Project Managers only. For how to configure module permissions, see Module Permissions.

Data and Operations

Human Motion

Records the human joint motion trajectories collected by a motion capture system.

FieldRequiredDescription
Chinese NameYesTrajectory name, up to 255 characters
English NameNoName used in non-Chinese interfaces
Chinese DescriptionNoTrajectory description
English DescriptionNoDescription used in non-Chinese interfaces
ProjectYesOwning project
DifficultyNoEasy, Medium, Hard; default Medium
LabelNoCustom label; press Enter after typing to add
Sort OrderNoNon-negative integer; a larger value sorts earlier; default 0
Human Motion VideoYesMP4, recommended 9:16 portrait
Motion dataNoFile collected by the motion capture device

The overview and lists show the difficulty label for Human Motion only.

Robot Reference Trajectory

Records the reference trajectories of a specified robot performing actions in simulation, as the target of motion mapping.

FieldRequiredDescription
Chinese NameYesTrajectory name, up to 255 characters
English NameNoName used in non-Chinese interfaces
Chinese DescriptionNoTrajectory description
English DescriptionNoDescription used in non-Chinese interfaces
ProjectYesOwning project
Related human motionYesLinks one Human Motion
Robot ModelYesLinks one registered robot
DifficultyNoEasy, Medium, Hard; default Medium
LabelNoCustom label
Sort OrderNoNon-negative integer; a larger value sorts earlier; default 0
Robot Simulation VideoYesMP4, recommended 16:9 landscape
Reference trajectory dataNoRobot simulation file

Robot Skill Model

Records the Robot Skill Models trained from Robot Reference Trajectories.

FieldRequiredDescription
Chinese NameYesSkill name, up to 255 characters
English NameNoName used in non-Chinese interfaces
Chinese DescriptionNoSkill description
English DescriptionNoDescription used in non-Chinese interfaces
ProjectYesOwning project
Based on robot reference trajectoryYesLinks one Robot Reference Trajectory
Robot ModelInherited from the Robot Reference Trajectory; read-only in the form
DifficultyNoEasy, Medium, Hard; default Medium
LabelNoCustom label
Sort OrderNoNon-negative integer; a larger value sorts earlier; default 0
Real Robot VideoYesMP4, recommended 9:16 portrait
Skill model dataNoSkill model file

Data Relationships

RelationshipCardinalityDescription
Human Motion → Robot Reference Trajectory1:NOne Human Motion can be linked by multiple Robot Reference Trajectories
Robot Reference Trajectory → Robot Skill Model1:NOne Robot Reference Trajectory can generate multiple Robot Skill Models
Human Motion → Robot Skill ModelIndirectA Robot Skill Model is linked to a Human Motion indirectly through a Robot Reference Trajectory

The full chain across the three databases is: Human Motion → Robot Reference Trajectory → Robot Skill Model.

Search and Maintenance

DimensionApplicable databasesDescription
KeywordAll threeMatches Chinese and English names and descriptions
ProjectAll threeFilter by owning project
DifficultyAll threeEasy, Medium, Hard
RobotRobot Reference Trajectory, Robot Skill ModelFilter by Robot Model

The list shows 12 cards per page. A card shows the video preview, name, description, and labels, and a Human Motion card also shows the difficulty; videos support replay, enlarged playback, and download.

The entries and constraints for creating, editing, and deleting are as follows.

ActionEntryAllowed rolesConstraint
Upload"Upload" on the list pageAdministrator, Project ManagerRequires "Manage Skills / Actions"
Edit"Edit" on the detail pageAdministrator; Project Manager only for data they createdRequires "Manage Skills / Actions"
Delete"Delete" on the detail pageAdministrator; Project Manager only for data they createdSoft delete; can be restored from Trash

Upload and edit use the same form, which shows the corresponding data file, video, and relationship fields by type. The video file is required at creation; when editing, leaving it empty keeps the original video.

Constraints and Limits

ItemValueDescription
Video formatMP49:16 portrait recommended for Human Motion and Robot Skill Model, 16:9 landscape recommended for Robot Reference Trajectory
DifficultyEasy, Medium, HardDefault Medium
Sort OrderNon-negative integer; a larger value sorts earlierDefault 0
Relationship requirementsA Robot Reference Trajectory must select a Human Motion and a robot; a Robot Skill Model must select a Robot Reference TrajectoryValidation fails when missing
Skill model robotInherited from the Robot Reference TrajectoryCannot be specified separately in the form
Data visibilityData of the owning project, shared projects, and data the user createdNon-Administrators see only the above ranges
Edit and deleteThe creator or an AdministratorA Project Manager cannot operate on data created by others
DeleteSoft deleteCan be restored from Trash after deletion

Troubleshooting

SymptomPossible causeActionOwner
Message "Enter Chinese name"Chinese Name is emptyEnter the Chinese NameProject Manager
Message "Please select a project"No project is selectedSelect a projectProject Manager
Message "Select a video file"No video is selected, or the selected file is not a videoSelect an MP4 video fileProject Manager
Message "Select related human motion"The Robot Reference Trajectory has no linked Human MotionSelect one Human MotionProject Manager
Message "Select robot"The Robot Reference Trajectory has no Robot Model selectedSelect a Robot ModelProject Manager
Message "Select related reference trajectory"The Robot Skill Model has no linked Robot Reference TrajectorySelect one Robot Reference TrajectoryProject Manager
Load messages such as "Failed to load human motion data"API error, or no visibility permissionRefresh the page; confirm the account's visibility scope for the owning projectProject Manager, Administrator
Upload failsThe cloud connection is unavailable or the file cannot be readAn Administrator checks the cloud connection and retriesAdministrator
The list is emptyNo data under the current project and filtersSwitch the project or clear the filtersProject Manager
Detail shows "No data found"The data was deleted, or the account lacks visibility permissionConfirm in Trash, or have a project member view itAdministrator
PagePurpose
RobotsRobot model registration
Skill LibraryRobot skill library and version management
Model TrainingPolicy model training
Model InferenceDeploying checkpoints as inference services
TrashRestoring deleted data
Module PermissionsHow to configure module permissions