Welcome to my homepage! I’m a junior student of Computer Science at the University of Michigan and an Undergraduate Research Assistant at SLED lab and VisionX. Before transferring to the University of Michigan, I’m a student at the University of Nottingham, pursuing B.S. CS with AI. I’m interested in unsupervised/self-supervised learning and generative models, also interested in doing stupid things.

My research journey began with a strong focus on generative models in computer vision, particularly in Generative Adversarial Networks (GANs) and diffusion models. Currently, my work has expanded to encompass a broader range of topics, including computer vision, natural language processing, 3D models and robotics.

I am proud to collaborate with distinguished academics such as Prof. Saining Xie, Prof. Joyce Chai and Prof. Honglak Lee.

I will apply for the phd program of Fall 2025, so feel free to contact me!

News

• 2024.04:  Join VisionX of Prof. Saining Xie as a Research Intern.
• 2024.03:   Preprint of UniCtrl is available.
• 2024.02:   InfEdit to appear in CVPR 2024.
• 2024.01:   Join Mewtant inc. and PixAI.art as a ML Research Engineer.
• 2023.10:   CycleNet to appear in NeurIPS 2023, and the preprint is available.
• 2022.11:   The preprint version and demos of ACE are available.

Publications

Preprint

UniCtrl: Improving the Spatiotemporal Consistency of Text-to-Video Diffusion Models via Training-Free Unified Attention Control

Xuweiyi Chen*, Tian Xia*, Sihan XU†

†Correspondence

[Project][Arxiv][Demo][Code]

CVPR 2024

Inversion-Free Image Editing with Natural Language

Sihan XU*, Yidong Huan*, Jiayi Pan, Ziqiao Ma, Joyce Chai

*First author

[Project][Arxiv][Demo][Code]

NeurIPS 2023

CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation

Sihan XU*, Ziqiao Ma*, Yidong Huang, Honglak Lee, Joyce Chai

*First author

[Project][Arxiv][Code]

Michigan AI Symposium 2022

ACE: Zero-Shot Image to Image Translation via Pretrained Auto-Contrastive-Encoder

Sihan XU*†, Zelong Jiang*, Ruisi Liu*, Kaikai Yang, Zhijie Huang

*First author and †Correspondence

[Arxiv][Demo]

Experience

• 2024.01 - present, ML Research Engineer @ Mewtant inc. and PixAI.art
• 2023.02 - present, Undergraduate Research Assistant @ SLED Research Lab and UMich

Projects

• Transferwiki - Founder

  TransferWiki is a platform created to assist students from mainland China who are planning to transfer to universities abroad, particularly in the United States, Canada, and the United Kingdom. This platform addresses the challenges and information asymmetry faced by students during the transfer process.

Honors and Awards

• Silver (TOP 4%) at Google Smartphone Decimeter Challenge Competition.
• TOP 1 at UoN Hackathon.

Educations

• 2022.09 - 2025.06, B.S Computer Science, University of Michigan, Ann Arbor (Pursuing Honor Degree)
• 2020.09 - 2022.06, BSc Hons Computer Science with AI, University of Nottingham, Ningbo China (First Class Honor)