Embodied AI

SPA: 3D Spatial-Awareness Enables Effective Embodied Representation
A novel representation learning framework that emphasizes the importance of 3D spatial awareness in embodied AI.
Haoyi Zhu 朱皓怡, Honghui Yang, Yating Wang, Jiange Yang, Limin Wang, Tong He
Cite Project PDF Arxiv Twitter Code HuggingFace Model RealWorld Code
SPA: 3D Spatial-Awareness Enables Effective Embodied Representation
Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
Extensive experiments prove that point cloud observations are beneficial for robot learning.
Haoyi Zhu 朱皓怡, Yating Wang, Di Huang, Weicai Ye, Wanli Ouyang, Tong He
Cite Project Github PDF Arxiv
Point Cloud Matters: Rethinking the Impact of Different Observation Spaces on Robot Learning
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge
Building open-ended agents with internet-scale knowledge in Minecraft.
Linxi Fan, Guanzhi Wang, Yunfan Jiang, Ajay Mandlekar, Yuncong Yang, Haoyi Zhu 朱皓怡, Andrew Tang, De-An Huang, Yuke Zhu, Anima Anandkumar
Cite Project PDF Arxiv Twitter Code Database Blog Video
MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledge