About Me

I joined ByteDance as a research scientist in 2025 and currently focus on developing the Seedance Mini and Seedance Flash model families. I received my Ph.D. in Computer Science from the Institute of Automation, Chinese Academy of Sciences, where I conducted my doctoral research at the National Laboratory of Pattern Recognition under the supervision of Prof. Changsheng Xu and Prof. Weiming Dong. Prior to that, I earned my B.S. in Automation from Tsinghua University in 2020.

My research focuses on Video and Image generation, with an emphasis on training Diffusion Transformers, mixture-of-experts (MoE) architectures and vision-language models (VLMs).

🔥 News

  • SplitMoE (specialized experts for video diffusion) was accepted to NeurIPS 2026 as a Spotlight.
  • Beyond Pixels (transferring visual metaphors across subject domains) was accepted to SIGGRAPH Asia 2026.
  • HeadRouter (attention routing for training-free image editing) was accepted to ACM TOG.
  • TAG-MoE (task-aware routing for generation and editing) was accepted to CVPR 2026.
  • FSVideo (faster video generation through latent compression) technical report released.
  • Serving as a SIGGRAPH Asia 2026 technical paper committee (TPC) member.
  • CreativeSynth (multimodal guidance for artistic image synthesis) was accepted to IEEE TVCG.
  • MotionCrafter (one-shot motion transfer for video diffusion) was accepted to IEEE TVCG.
  • B4M (separate adapters for content and style) was accepted to ACM TOG.
  • IP-Prompter (dynamic visual prompts for themed generation) was accepted to SIGGRAPH 2025.

💻 Work Experience

– Present ByteDance Intelligent Creation Research Scientist

Video Generation

  • Seedance Mini/Flash · Core contributor to the Prompt Enhancement (PE) module for Seedance 2.0 Mini and Seedance 2.5 Flash.
  • FSVideo · Efficient Video Generation · Core contributor to the DiT architecture and model training. Technical Report
  • MoE Architecture Research · Explored MoE architectures for scaling video diffusion models through SplitMoE, which was selected as a NeurIPS 2026 Spotlight (0.95%).

📝 Publications

Newest first · Includes arXiv preprints. Google Scholar ↗

2026

SplitMoE sample videos, expert routing, and benchmark comparisonNeurIPS 2026Spotlight

Breaking the Uniformity Trap: Scaling Video Diffusion Model via SplitMoE

Yu Xu, Yuxin Zhang✉, Xiao Yang, Haotian Yang, Yizhi Wang, Xinwei Huang, Minxuan Lin, Angtian Wang, Chongyang Ma, Fan Tang

TL;DR: To keep token routing from fragmenting coherent video content, SplitMoE uses prototype-guided routing to separate semantic and general-purpose experts, converging faster and generating higher-quality video at the same active parameter budget.

NeurIPS 2026

HeadRouter research figureACM TOG 2026

HeadRouter: A Training-Free Image Editing Framework for MM-DiTs by Adaptively Routing Attention Heads

Yu Xu, Fan Tang, Juan Cao, Xiaoyu Kong, Yuxin Zhang, Jintao Li, Oliver Deussen, Tong-Yee Lee

TL;DR: To improve text alignment in diffusion-based image editing, HeadRouter routes instructions through semantically relevant attention heads and refines image and text tokens, producing more faithful edits without retraining the model.

ACM TOG 2026

FSVideo — upper half of paper first pagearXiv 2026

FSVideo: Fast Speed Video Diffusion Model in a Highly-Compressed Latent Space

FSVideo Team, Qingyu Chen, Zhiyuan Fang, Haibin Huang, Xinwei Huang, Tong Jin, Minxuan Lin, Bo Liu, Celong Liu, Chongyang Ma, Xing Mei, Xiaohui Shen, Yaojie Shen, Fuwen Tan, Angtian Wang, Xiao Yang, Yiding Yang, Jiamin Yuan, Lingxi Zhang, Yuxin Zhang

TL;DR: To reduce the cost of image-to-video generation, FSVideo combines aggressive latent compression, memory across transformer layers, and a few-step upsampler, achieving competitive video quality at roughly ten times the speed of the open-source baselines it evaluates.

arXiv 2026

TAG-MoE research figureCVPR 2026

TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts

Yu Xu, Hongbin Yan, Juan Cao, Yiji Cheng, Tiankai Hang, Runze He, Zijin Yin, Shiyi Zhang, Yuxin Zhang, Jintao Li, Chunyu Wang, Qinglin Lu, Tong-Yee Lee, Fan Tang

TL;DR: To reduce interference between image generation and editing tasks, TAG-MoE trains expert routing with structured descriptions of task intent, improving output fidelity and quality over dense baselines.

CVPR 2026

2025

IP-Prompter research previewSIGGRAPH 2025

IP-Prompter: Training-Free Theme-Specific Image Generation via Dynamic Visual Prompting

Yuxin Zhang, Minyan Luo, Weiming Dong, Xiao Yang, Haibin Huang, Chongyang Ma, Oliver Deussen, Tong-Yee Lee, Changsheng Xu

TL;DR: To generate images across a visual theme without fine-tuning, IP-Prompter iteratively adjusts visual prompts from reference images, improving character identity, style consistency, and text alignment across scenes.

SIGGRAPH 2025

CreativeSynth — upper half of paper first pageIEEE TVCG 2025

CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion

Nisha Huang, Weiming Dong, Yuxin Zhang, Fan Tang, Ronghui Li, Chongyang Ma, Xiu Li, Tong-Yee Lee, Changsheng Xu

TL;DR: To bring new subjects into artworks while preserving their visual harmony, CreativeSynth uses cross-art attention to fuse multimodal guidance with a diffusion model, supporting artistic synthesis across painting categories.

IEEE TVCG 2025

2024

2023

ProSpect research previewSIGGRAPH Asia 2023 (Journal Track) / ACM TOG

ProSpect: Prompt Spectrum for Attribute-Aware Personalization of Diffusion Models

Yuxin Zhang, Weiming Dong, Fan Tang, Nisha Huang, Haibin Huang, Chongyang Ma, Tong-Yee Lee, Oliver Deussen, Changsheng Xu

TL;DR: To edit visual attributes independently during diffusion personalization, ProSpect learns distinct prompt embeddings for different denoising stages, giving finer control over properties such as material, style, and layout.

SIGGRAPH Asia 2023 (Journal Track) / ACM TOG

2022

🎖️ Honors & Awards

  • Baidu Scholarship · One of 10 recipients worldwide.
  • Style3D Graduate Fellowship · One of 10 recipients nationwide in China.
  • National Scholarship, Ministry of Education of China.

💻 Internships

– Ant Group Bailing Technology Platform Center

Controllable Lighting in Video Generation

  • Built a dataset for video lighting control.
  • Developed methods for video lighting control.
  • Published LumiSculpt.

– Kuaishou Y-Tech Visual Generation Group, Large Model and Multimedia Technology Department

Image Generation and Editing

  • Developed methods for high-quality image generation and editing.
  • Published ProSpect as first author at SIGGRAPH Asia 2023 (Journal Track) / ACM TOG.