Embodied AI

SPA: 3D Spatial-Awareness Enables Effective Embodied Representation
A novel representation learning framework that emphasizes the importance of 3D spatial awareness in embodied AI.
Haoyi Zhu 朱皓怡, Honghui Yang, Yating Wang, Jiange Yang, Limin Wang, Tong He
Cite Project PDF Arxiv Twitter Code HuggingFace Model RealWorld Code
SPA: 3D Spatial-Awareness Enables Effective Embodied Representation
Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
Extensive experiments prove that point cloud observations are beneficial for robot learning.
Haoyi Zhu 朱皓怡, Yating Wang, Di Huang, Weicai Ye, Wanli Ouyang, Tong He
Cite Project Github PDF Arxiv
Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
RH20T: A Robotic Dataset for Learning Diverse Skills in One-Shot
Abstract: A key challenge in robotic manipulation in open domains is how to acquire diverse and generalizable skills for robots. Recent research in one-shot imitation learning has shown promise in transferring trained policies to new tasks based on demonstrations.
Hao-Shu Fang, Hongjie Fang, Zhenyu Tang, Jirong Liu, Junbo Wang, Haoyi Zhu 朱皓怡, Cewu Lu
Cite Project PDF Arxiv
RH20T: A Robotic Dataset for Learning Diverse Skills in One-Shot
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Building open-ended agents with internet-scale knowledge in Minecraft.
Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu 朱皓怡, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv Twitter Code Database Blog Video
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge