Sihan Xu

Sihan Xu (Si.X)

Ph.D. Student

University of Michigan

Email: sihanxu [at] umich [dot] edu

Google Scholar Github Twitter Feedback

Research

My work aspires to develop systems that learn meaning representations and generate consistent semantics autonomously with minimal supervision involved. My philosophy is to pursue minimal parameterizations that effectively represent the maximal information within the input data distribution. By embracing this vision, I design algorithms for

(1) self-supervised learning or learning with minimal semantic supervision and
(2) generate consistent semantics given multimodal conditioning, with a primary application to visual generation (for now).

Sihan Xu

Represenation Learning

Generative Algorithms

Others

Selected Publications

(* indicate equal contribution, indicate correspondence or project lead.)

If you like my figures here, I highly recommend you also visit Ziqiao Ma's homepage.

Paper Figure
Back Image

UniCtrl: Improving the Spatiotemporal Consistency of Text-to-Video Diffusion Models via Training-Free Unified Attention Control

TMLR

Tian Xia*, Xuweiyi Chen*, Sihan Xu

Paper Figure
Back Image

Inversion-Free Image Editing with Natural Language

CVPR 2024

Sihan Xu*, Yidong Huang*, Jiayi Pan, Ziqiao Ma, Joyce Chai

Paper Figure
Back Image

CycleNet: Rethinking Cycle Consistency in Text-Guided Diffusion for Image Manipulation

NeurIPS 2023

Sihan Xu*, Ziqiao Ma*, Yidong Huang, Honglak Lee, Joyce Chai

Paper Figure
Back Image

ACE: Zero-Shot Image to Image Translation via Pretrained Auto-Contrastive-Encoder

Michigan AI Symposium 2022

Sihan Xu*, Zelong Jiang*, Ruisi Liu*, Kaikai Yang, Zhijie Huang