Sihan Xu

Sihan Xu (Si.X)

Computer Science Undergraduate

University of Michigan

Email: sihanxu [at] umich [dot] edu

Google Scholar Github Twitter Feedback

Looking for Fall 2025 Ph.D. position. See my statement here.

Research

My work aspires to develop systems that learn meaning representations and generate consistent semantics autonomously with minimal supervision involved. My philosophy is to pursue minimal parameterizations that effectively represent the maximal information within the input data distribution. By embracing this vision, I design algorithms for

(1) self-supervised learning or learning with minimal semantic supervision and
(2) generate consistent semantics given multimodal conditioning, with a primary application to visual generation (for now).

Sihan Xu

Represenation Learning

Generative Algorithms

Others

Publications

(* indicate equal contribution, indicate correspondence or project lead.)

If you like my figures here, I highly recommend you also visit Ziqiao Ma's homepage.

Paper Figure

SAB3R: Semantic-Augmented Backbone in 3D Reconstruction

Preprint

Xuweiyi Chen*, Tian Xia*, Sihan Xu, Jianing Yang, Joyce Chai, Zezhou Cheng

Under review, coming soon.

Paper Figure

UniCtrl: Improving the Spatiotemporal Consistency of Text-to-Video Diffusion Models via Training-Free Unified Attention Control

TMLR

Tian Xia*, Xuweiyi Chen*, Sihan Xu

Paper Figure

Multi-Object Hallucination in Vision-Language Models

NeurIPS 2024

Xuweiyi Chen*, Ziqiao Ma*, Xuejun Zhang*, Sihan Xu, Shengyi Qian, Jianing Yang, David F. Fouhey, Joyce Chai

Paper Figure

Inversion-Free Image Editing with Natural Language

CVPR 2024

Sihan Xu*, Yidong Huang*, Jiayi Pan, Ziqiao Ma, Joyce Chai

Paper Figure

CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation

NeurIPS 2023

Sihan Xu*, Ziqiao Ma*, Yidong Huang, Honglak Lee, Joyce Chai

Paper Figure

ACE: Zero-Shot Image to Image Translation via Pretrained Auto-Contrastive-Encoder

Michigan AI Symposium 2022

Sihan Xu*, Zelong Jiang*, Ruisi Liu*, Kaikai Yang, Zhijie Huang