About Me

I am currently a researcher at the Guangdong Lab of AI and Digital Economy (SZ), focusing on pioneering advancements in principled artificial intelligence research. Previously, I was a senior researcher at Tencent, where I contributed to cutting-edge technology projects. My academic journey includes a Research Fellow position at the National University of Singapore’s (NUS) School of Computing, within the MapleCG group, under the esteemed guidance of Prof. Bryan Low. I earned my Ph.D. from NUS in 2022, under Prof. Low’s mentorship, following a B.Sc in Computer Science and Technology from Huazhong University of Science & Technology, China, in 2017.

Openings: Our principled AI research group ($\pi$-Group), specializing in AI learning and optimization theories, seeks researchers and engineers to explore core AI theories, develop sophisticated optimization algorithms, and create practical, robust AI solutions. Interested candidates should contact directly at shuyao@gml.ac.cn.

Research Interest

Currently, my research interests include but are not restricted to the following aspects of Machine Learning and Deep Learning:

  • Deep Learning Theory, e.g., Neural Tangent Kernel, Statistical Learning Theory.
  • Optimization & Decision-Making, e.g., Zeroth-Order Optimization, Bayesian Optimization, Bandit Algorithm, Reinforcement Learning.
  • Generative Models, e.g., Large Language Model, Diffusion Model.
  • Data-Centric AI, e.g., Data Optimization, Data Valuation, Data Ownership.
  • Automated Machine Learning, e.g., Automated Data Optimization, Neural Architecture Search, Hyper-parameter Optimization.

Education Background

Career Background

  • 2024.01 - Now, Researcher (PI of Principled AI Research Group), Guangdong Lab of AI and Digital Economy (SZ)
  • 2023.08 - 2023.12, Senior Researcher (Tencent Talent), Tencent
  • 2022.04 - 2023.06, Research Fellow (PostDoc.), National University of Singapore (NUS)
  • 2021.09 - 2022.04, Research Assistant, National University of Singapore (NUS)

What’s New

  • 2024.01: Our paper on “Training-free NAS” is accepted to ICLR 2024!
  • 2023.09: Our two papers are accepted to NeurIPS 2023!
  • 2023.05: I am honored to be the recipient of IMDA Excellence in Computing Prize (Best Ph.D. Thesis in NUS School of Computing) 2023 & the valedictorian for the class of NUS School of Computing Ph.D. graduates!

Honors and Awards

  • Valedictorian for the class of Ph.D. graduates, School of Computing, NUS, 2023 (the script)
  • IMDA Excellence in Computing Prize (Best Ph.D. Thesis), School of Computing, NUS, 2023 (the news)
  • Dean’s Graduate Research Excellence Award, School of Computing, NUS, 2022 (the news)
  • 2nd prize of 5th AutoML Challenge (AutoML for Temporal Relational Data) in the KDD Cup 2019 provided by 4Paradigm, ChaLearn and Microsoft, June 2019 (our solution, the news)
  • Honor of Outstanding Student, 2015
  • 2nd prize for The Chinese Mathematics Competitions (Non-professional), 2013

Professional Services

  • Program Committee (PC) member/reviewer of
    • ICML: 2022,2023,2024
    • NeurIPS: 2022,2023
    • ICLR: 2023,2024
    • AAAI: 2024
    • IJCAI: 2024
    • TPAMI: 2023
    • AAMAS: 2023,2024
    • UAI: 2023,2024
    • AISTATS: 2023,2024
    • RLC: 2024
    • TIT

Teaching Activities

  • TA for CS3244 Machine Learning, NUS (Spring 2021)
  • TA for CS5242 Neural Networks and Deep Learning, NUS (Fall 2019)
  • TA for CS5242 Neural Networks and Deep Learning, NUS (Spring 2019)