Bo Zhao

Bo Zhao

PhD student at UC San Diego

I am a final year computer science PhD student at the University of California, San Diego, advised by Rose Yu. I received my Master’s degree in computer science from Georgia Institute of Technology, and Bachelor degrees in computer science and physics from the University of Illinois at Urbana-Champaign.

I am interested in mathematical structures in deep learning. Currently, I am studying symmetries in the parameter space of neural networks, as well as their impact on optimization, generalization, and the loss landscape.

Check out our new survey paper (to appear in TMLR): Symmetry in Neural Network Parameter Spaces.

Publications

Conference

  • Understanding Mode Connectivity via Parameter Space Symmetry
    Bo Zhao, Nima Dehmamy, Robin Walters, Rose Yu
    International Conference on Machine Learning (ICML), 2025
    [arXiv]

  • Understanding the Difficulty of Solving Cauchy Problems with PINNs
    Tao Wang, Bo Zhao, Sicun Gao, Rose Yu
    Learning for Dynamics and Control Conference (L4DC), 2024
    [arXiv] [code]

  • Improving Convergence and Generalization Using Parameter Symmetries
    Bo Zhao, Robert M. Gower, Robin Walters, Rose Yu
    International Conference on Learning Representations (ICLR), 2024 (Oral presentation)
    [arXiv] [code]

  • DYffusion: A Dynamics-informed Diffusion Model for Spatiotemporal Forecasting
    Salva Rühling Cachay, Bo Zhao, Hailey Joren, Rose Yu
    Advances in Neural Information Processing Systems (NeurIPS), 2023
    [arXiv] [code] [blog]

  • Symmetries, Flat Minima, and the Conserved Quantities of Gradient Flow
    Bo Zhao*, Iordan Ganev*, Robin Walters, Rose Yu, Nima Dehmamy (*equal contribution)
    International Conference on Learning Representations (ICLR), 2023
    [arXiv] [code]

  • Symmetry Teleportation for Accelerated Optimization
    Bo Zhao, Nima Dehmamy, Robin Walters, Rose Yu
    Advances in Neural Information Processing Systems (NeurIPS), 2022
    [arXiv] [code] [video]

  • LIMO: Latent Inceptionism for Targeted Molecule Generation
    Peter Eckmann, Kunyang Sun, Bo Zhao, Mudong Feng, Michael Gilson, Rose Yu
    International Conference on Machine Learning (ICML), 2022
    [paper] [code] [video] [website]

  • Concentric Spherical Neural Network for 3D Representation Learning
    James Fox, Bo Zhao, Beatriz Gonzalez Del Rio, Sivasankaran Rajamanickam, Rampi Ramprasad, Le Song
    International Joint Conference on Neural Networks (IJCNN), 2022
    [paper] [pdf] [code]

Journal

  • Symmetry in Neural Network Parameter Spaces
    Bo Zhao, Robin Walters, Rose Yu
    To appear in Transactions on Machine Learning Research (TMLR), 2025
    [arXiv]

  • Multiple Aging Mechanisms in Ferroelectric Deuterated Potassium Dihydrogen Phosphate
    Gregory A. Fields, Samuel F. Cieszynski, Bo Zhao, Kidan A. Tadesse, Mohammed A. Sheikh, Eugene V Colla, and M. B. Weissman.
    Journal of Applied Physics 125, 194102, 2019
    [paper] [pdf]

Preprints and recent workshops

  • Data-Free Transformer Quantization Using Parameter-Space Symmetry
    Lucas Laird, Bo Zhao, Rose Yu, Robin Walters
    Workshop on High-dimensional Learning Dynamics (HiLD) at ICML 2025

  • Improving Learning to Optimize Using Parameter Symmetries
    Guy Zamir, Aryan Dokania, Bo Zhao, Rose Yu
    Workshop on Neural Network Weights as a New Data Modality at ICLR 2025
    [arXiv] [code]

  • Finding Symmetry in Neural Network Parameter Spaces
    Bo Zhao, Nima Dehmamy, Robin Walters, Rose Yu
    Workshop on Unifying Representations in Neural Models (UniReps) at NeurIPS 2024
    [OpenReview]

  • Emergence of Hierarchical Emotion Organization in Large Language Models
    Bo Zhao*, Maya Okawa*, Eric J. Bigelow, Rose Yu, Tomer Ullman, Ekdeep Singh Lubana, Hidenori Tanaka
    Workshop on Scientific Methods for Understanding Deep Learning at NeurIPS 2024
    [arXiv] [blog]

Teaching

  • Teaching Assistant, CS 291A Generative AI, UC San Diego (Fall 2025)

  • Teaching Assistant, CS 4641 Machine Learning, Georgia Tech (Fall 2020)

  • Lead Course Assistant, CS 225 Data Structures, UIUC (Spring 2019)

  • Course Assistant, CS 225 Data Structures, UIUC (Fall 2017, Spring 2018, Fall 2018)

Academic Service

  • Reviewer: ICML (2022—2025), NeurIPS (2022—2025), ICLR (2024—2025), AISTATS (2024—2025), AAAI (2025), TMLR (2024—2025)

Experience

  • Capital One, Applied Research Intern, 2025.6—2025.8

  • NTT Research, Research Intern, 2024.6—2024.9

  • IBM, AI Intern, 2022.6—2022.9

Honors and Awards

  • Rising Stars in EECS, MIT and Boston University, 2025

  • Rising Stars in Data Science, Stanford University, 2025

  • NVIDIA Graduate Fellowship finalist, 2025

  • Qualcomm Innovation Fellowship finalist, 2024

  • DeepMind PhD Fellowship, 2023

Education

  • Ph.D. in Computer Science, University of California San Diego, 2021—2026 (expected)

  • M.S. in Computer Science, Georgia Institute of Technology, 2019—2021

  • B.S. in Computer Science, University of Illinois at Urbana-Champaign, 2016—2019

  • B.S. in Physics, University of Illinois at Urbana-Champaign, 2016—2019