GraspGraphNet: Graph-Structured Multi-Embodiment Dexterous Grasp Generation

GraspGraphNet concept overview

GraspGraphNet represents each hand as a URDF-derived kinematic graph and updates robot-object world edges throughout grasp generation.

Abstract

Dexterous grasp generation across robot hands is challenging because hands differ in kinematic topology, actuation dimensions, and native command spaces. We introduce GraspGraphNet, a topology-aware grasp generation framework that represents each hand as a URDF-derived kinematic graph and directly generates executable palm poses and joint configurations. GraspGraphNet combines hierarchical object surface encoding, differentiable forward kinematics, and dynamic world-edge message passing to model evolving robot-object interactions. It applies conditional flow matching directly in executable palm-pose and joint-state space, avoiding post-processing optimization, inverse kinematics, and retargeting. Using a shared model trained on Barrett Hand, Allegro Hand, and Shadow Hand, GraspGraphNet achieves an average success rate of 83.48% with 0.040 s inference time per grasp on a 40-object benchmark. Without retraining, the same model achieves 72.70% success on controlled finger-removal variants, demonstrating robustness to hand-topology variations.

Method Overview

GraspGraphNet method overview

Robot Hand Graphs

Robot hands are represented as URDF-derived link-joint graphs, allowing one model to process different kinematic structures.

Dynamic World Edges

Robot-object interaction edges are recomputed as the hand moves, exposing the model to evolving local contact geometry.

Executable Generation

Conditional flow matching directly predicts palm poses and actuated joint states without test-time retargeting or IK.

URDF-derived robot graph representation
URDF-derived robot graph representation for multi-embodiment hand modeling.
Controlled finger-removal topology variants
Controlled finger-removal variants evaluate robustness to hand-topology changes.

World-Edge Visualizations

Generated grasps for three robot hand embodiments.

Barrett Hand generated grasp Allegro Hand generated grasp Shadow Hand generated grasp

Generated Grasp Results

Representative grasps across robot hands and object geometries.

Barrett Hand grasp result Barrett Hand grasp result Barrett Hand grasp result Barrett Hand grasp result Barrett Hand grasp result Allegro Hand grasp result Allegro Hand grasp result Allegro Hand grasp result Allegro Hand grasp result Allegro Hand grasp result Shadow Hand grasp result Shadow Hand grasp result Shadow Hand grasp result Shadow Hand grasp result Shadow Hand grasp result

Real-Robot Experiments

Real-world experimental setup and objects

BibTeX