Fei Xia
Senior Research Scientist
Google DeepMind
[Github]
[Google Scholar]
[LinkedIn]
[Twitter]
[Youtube]
xf1280 at gmail.com
About me
I'm a Senior Research Scientist at Google DeepMind where I work on the Robotics team. I received my PhD degree from the Department of Electrical Engineering, Stanford University. I was co-advised by Silvio Savarese in SVL and Leo Guibas. I was supported by Stanford Graduate Fellowship and Qualcomm Innovation Fellowship. During my PhD, I have done research internships with Dieter Fox at Nvidia, Alexander Toshev and Brian Ichter at Google. I obtained my bachelor's degree from Tsinghua University in 2016. [formal bio in EN/CN] Research Interest
My mission is to build intelligent embodied agents that can interact with complex and unstructured real-world environments, with applications to home robotics. I have been approaching this problem from 3 aspects: 1) Large scale and transferrable simulation for Robotics. 2) Learning algorithms for long-horizon tasks. 3) Combining geometric and semantic representation for environments. Most recently, I have been exploring using foundation models for robot decision making.
News:
2024.1 I serve as an area chair of the first Conference of Language Modeling, consider submitting your work there.
2023.10 See my guest lecture at Stanford CS25 for a quick overview of my work.
2023.3 PaLM-E is out - a 562B general purpose Embodied Vision-Language Model.
2023.1 5 papers accepted to ICRA 2023, including NLMap-SayCan, and Code as Policies.
2022.9 4 papers accepted to CoRL 2022.
2022.8 Checkout our latest release of PaLM-SayCan, a method that ground natural language in robotic affordances.
2021.9 2 papers accepted to CoRL 2021.
2021.7 2 papers accepted to IROS 2021.
2021.5 I defended my PhD Thesis titled "Large Scale Simulation for Embodied Perception and Robot Learning".
2021.3 I will join Robotics at Google as a Research Scientist in the Fall.
2021.3 ReLMoGen accepted to ICRA2021.
2020.12 The wait is over! iGibson v1.0 was released! It comes with many new features and fully interactive environments, checkout the website for more details.
2020.4 iGibson was released! It is a large-scale interactive environment for robot learning.
2020.3 I am co-hosting CVPR Challenge "Sim2Real Challenge with Gibson". It is the first Sim2Real challenge in CVPR.
2019.7 AdaFDR was accepted to Nature Communications.
2019.5 Will Shen and I won Qualcomm Innovation Fellowship as a team. Thank you Qualcomm!
2019.5 AdaFDR won best paper award at RECOMB2019.
2018.4 We will host a demo for Gibson Env at CVPR'18. Come and check it out!
2018.2 One paper accepted to CVPR'18 (spotlight).
Education
Aug. 2016 - Sept. 2021, Department of Electrical Engineering, Stanford University, PhD.
Aug. 2012 - Jul. 2016, Department of Automation Tsinghua University, Bachelor of Engineering.
Selected Publications
[full list]
- Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, Andy Zeng, Igor Mordatch, Pete Florence. PaLM-E: An Embodied Multimodal Language Model. ICML 2023.
[pdf][website]
- Wenlong Huang*, Fei Xia*, Ted Xiao*, Harris Chan, Jacky Liang, Pete Florence, Andy Zeng, Jonathan Tompson, Igor Mordatch, Yevgen Chebotar, Pierre Sermanet, Noah Brown, Tomas Jackson, Linda Luu, Sergey Levine, Karol Hausman, Brian Ichter. Inner Monologue: Embodied Reasoning through Planning with Language Models, CoRL, 2022.
[pdf][website][video]
- M. Ahn, A. Brohan, N. Brown, Y. Chebotar, O. Cortes, B. David, C. Fu, Ch. Finn, K. Gopalakrishnan, K. Hausman, A. Herzog, D. Ho, J. Hsu, J. Ibarz, B. Ichter, A. Irpan, E. Jang, R. Jauregui Ruano, K. Jeffrey, S. Jesmonth, N. J Joshi, R. Julian, D. Kalashnikov, Y. Kuang, K.-H. Lee, S. Levine, Y. Lu, L. Luu, C. Parada, P. Pastor, J. Quiambao, K. Rao, J. Rettinghouse, D. Reyes, P. Sermanet, N. Sievers, Cl. Tan, A. Toshev, V. Vanhoucke, F. Xia (co-corresponding author), T. Xiao, P. Xu, S. Xu, M. Yan, A. Zeng (alphebatically listed), Do As I Can, Not As I Say: Grounding Language in Robotic Affordances, CoRL (oral), 2022.
[pdf][website][video]
-
Sanjana Srivastava*, Chengshu Li*, Michael Lingelbach*, Roberto Martín-Martín, Fei Xia, Kent Vainio, Zheng Lian, Cem Gokmen, Shyamal Buch, C. Karen Liu, Silvio Savarese, Hyowon Gweon, Jiajun Wu, Li Fei-Fei. BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environments. Conference on Robot Learning (CoRL) 2021
[pdf][project]
-
Chengshu Li*, Fei Xia*, Roberto Martín-Martín*, Michael Lingelbach, Sanjana Srivastava, Bokui Shen, Kent Vainio, Cem Gokmen, Gokul Dharan, Tanish Jain, Andrey Kurenkov, C. Karen Liu, Hyowon Gweon, Jiajun Wu, Li Fei-Fei, Silvio Savarese
iGibson 2.0: Object-Centric Simulation for Robot Learning of Everyday Household Tasks.
Conference on Robot Learning (CoRL) 2021
[pdf][project]
-
Fei Xia*, Chengshu Li*, Roberto Martín-Martín, Or Litany, Alexander Toshev, Silvio Savarese. ReLMoGen: Leveraging Motion Generation in Reinforcement Learning for Mobile Manipulation. ICRA2021.
[pdf][project]
-
Bokui Shen*, Fei Xia*, Chengshu Li*, Roberto Martín-Martín*, Linxi Fan, Guanzhi Wang, Shyamal Buch, Claudia D'Arpino, Sanjana Srivastava, Lyne P. Tchapmi, Micael E. Tchapmi, Kent Vainio, Li Fei-Fei, Silvio Savarese. iGibson 1.0: A Simulation Environment for Interactive Tasks in Large Realistic Scenes. IROS 2021.
[pdf][project]
-
Fei Xia, William B Shen, Chengshu Li, Priya Kasimbeg, Micael Edmond Tchapmi, Alexander Toshev, Roberto Martín-Martín, Silvio Savarese. Interactive Gibson Benchmark: A Benchmark for Interactive Navigation in Cluttered Environments. ICRA20 + RAL.
[pdf][project]
-
Noriaki Hirose, Fei Xia, Roberto Martín-Martín, Amir Sadeghian,
Silvio Savarese (2019). Deep Visual MPC-Policy Learning for Navigation. IEEE Robotics and Automation Letters .
[pdf][project]
Fei Xia*, Amir R. Zamir*, Zhiyang He*, Alexander Sax, Jitendra Malik, Silvio Savarese. Gibson Env: Real-World Perception for Embodied Agents.
CVPR 2018 (spotlight, Nvidia Pioneer Research Award). [pdf] [code] [project]
Fei Xia*, Martin Zhang*, James Zou, David Tse. NeuralFDR: learning decision threshold from hypothesis features.
NIPS 2017. [pdf] [code]
(* Equally contributed to the project.)
Previous Computational Biology papers
-
Martin J. Zhang, Fei Xia, James Zou, "AdaFDR: a Fast, Powerful and Covariate-Adaptive Approach to Multiple Hypothesis Testing", Preliminary version selected as Best Paper Award of RECOMB 2019, also in Nature Communications, 2019. [pdf] [software] [code to reproduce the paper]
Qiao Liu, Fei Xia, Qijin Yin, Rui Jiang. Chromatin accessibility prediction via a hybrid deep convolutional neural network
Bioinformatics. [pdf] [code]
Govinda M Kamath*, Ilan Shomorony*, Fei Xia*, Thomas A Courtade, David Tse. HINGE: long-read assembly achieves optimal repeat resolution.
[pdf] [code]
Genome Research Vol 27 2017.
Ilan Shomorony, Govinda M Kamath, Fei Xia, Thomas A Courtade, David Tse. Partial DNA assembly: a rate-distortion perspective.
[pdf]
ISIT 2016.
Honors and Awards
- 2023 Conference of Robot Learning Special Innovation Award for paper "Do As I Can, Not As I Say: Grounding Language in Robotic Affordances"
- 2019 Qualcomm Innovation Fellowship
- 2019 RECOMB Best Paper Award
- 2018 Nvidia Pioneer Research Award at CVPR
- 2016 Stanford Graduate Fellowship (Michael J. Flynn Fellow), Stanford University
- 2015 Chang Jiong Scholarship (Highest honor in Dept. of Automation, 1/560)
- 2014 Fang Chongzhi Scholarship (Highest honor in Dept. of Automation, 1/560)
- 2014 China Scholarship Council Excellent Undergraduate Fellowship
Teaching Experiences
- Teaching Assistant, CS231N (Spring 2018)
- Teaching Assistant, CS231A (Winter 2017)
Press Coverage
2024.1 I serve as an area chair of the first Conference of Language Modeling, consider submitting your work there.
2023.10 See my guest lecture at Stanford CS25 for a quick overview of my work.
2023.3 PaLM-E is out - a 562B general purpose Embodied Vision-Language Model.
2023.1 5 papers accepted to ICRA 2023, including NLMap-SayCan, and Code as Policies.
2022.9 4 papers accepted to CoRL 2022.
2022.8 Checkout our latest release of PaLM-SayCan, a method that ground natural language in robotic affordances.
2021.9 2 papers accepted to CoRL 2021.
2021.7 2 papers accepted to IROS 2021.
2021.5 I defended my PhD Thesis titled "Large Scale Simulation for Embodied Perception and Robot Learning".
2021.3 I will join Robotics at Google as a Research Scientist in the Fall.
2021.3 ReLMoGen accepted to ICRA2021.
2020.12 The wait is over! iGibson v1.0 was released! It comes with many new features and fully interactive environments, checkout the website for more details.
2020.4 iGibson was released! It is a large-scale interactive environment for robot learning.
2020.3 I am co-hosting CVPR Challenge "Sim2Real Challenge with Gibson". It is the first Sim2Real challenge in CVPR.
2019.7 AdaFDR was accepted to Nature Communications.
2019.5 Will Shen and I won Qualcomm Innovation Fellowship as a team. Thank you Qualcomm!
2019.5 AdaFDR won best paper award at RECOMB2019.
2018.4 We will host a demo for Gibson Env at CVPR'18. Come and check it out!
2018.2 One paper accepted to CVPR'18 (spotlight).
Aug. 2016 - Sept. 2021, Department of Electrical Engineering, Stanford University, PhD.
Aug. 2012 - Jul. 2016, Department of Automation Tsinghua University, Bachelor of Engineering.
Fei Xia*, Amir R. Zamir*, Zhiyang He*, Alexander Sax, Jitendra Malik, Silvio Savarese. Gibson Env: Real-World Perception for Embodied Agents. CVPR 2018 (spotlight, Nvidia Pioneer Research Award). [pdf] [code] [project]
Fei Xia*, Martin Zhang*, James Zou, David Tse. NeuralFDR: learning decision threshold from hypothesis features. NIPS 2017. [pdf] [code]
Previous Computational Biology papers
-
Martin J. Zhang, Fei Xia, James Zou, "AdaFDR: a Fast, Powerful and Covariate-Adaptive Approach to Multiple Hypothesis Testing", Preliminary version selected as Best Paper Award of RECOMB 2019, also in Nature Communications, 2019. [pdf] [software] [code to reproduce the paper]
Qiao Liu, Fei Xia, Qijin Yin, Rui Jiang. Chromatin accessibility prediction via a hybrid deep convolutional neural network Bioinformatics. [pdf] [code]
Govinda M Kamath*, Ilan Shomorony*, Fei Xia*, Thomas A Courtade, David Tse. HINGE: long-read assembly achieves optimal repeat resolution. [pdf] [code] Genome Research Vol 27 2017.
Ilan Shomorony, Govinda M Kamath, Fei Xia, Thomas A Courtade, David Tse. Partial DNA assembly: a rate-distortion perspective. [pdf] ISIT 2016.