Envision the whole of you

Tel: 027-200-0253
Email: zhenzhu4 @ illinois dot edu

Find me on .

About

Welcome to my homepage! This is Zhen Zhu. I'm a third-year Ph.D. student in University of Illinois at Urbana-Champaign (UIUC) while working with Professor Derek Hoiem. I received my Master's degree from Huazhong University of Science and Technology in June, 2020, supervised by Professor Xiang Bai. Prior to that, I obtained my Bachelor's degree from the school of Computer Science and Technology, HUST in 2017. My current research interests are flexible continual learning in scale, large vision-language models, generative models, etc.

Here is my CV

Education

  • Ph.D. Department of Computer Science, University of Illinois at Urbana-Champaign (Jan. 2021 - Now)
  • M.S. School of Electronic Information and Communications, HUST (September 2017 - June 2020)
  • B.S. School of Computer Science and Technology, HUST (September 2013 – June 2017)

News

  • Aug. 2023: One paper about multi-modal generation accepted to WACV2024 in the first round.
  • May. 2023: Internship started at Adobe with the same group.
  • May. 2022: Internship started at Adobe, while working with Yijun, Krishna and Zhixin.
  • May. 2022: One paper accepted to ECCV 2022 as oral presentation.
  • Aug. 2021: Arrived at UIUC.
  • Mar. 2021: Our extended version of the CVPR 2019 pose transfer paper got accepted by TPAMI.
  • Jan. 2021: Enrolled in UIUC and began the Ph.D student life.
  • Dec. 2020: I had a great journey in ShanghaiTech and acquainted with so many excellent friends. Thanks! I will start my next journey in HUST again as an research assistant in the group led by Prof. Xiang Bai.
  • Aug. 2020: I will be be an research assistant in ShanghaiTech. There, I will work closely with Prof. Jingyi Yu and Prof. Lan XU. Cheers!
  • July. 2020: One paper about fast scene parsing is accepted by ECCV2020 as Oral presentation.
  • June. 2020: Completed the thesis defense and received a master's degree.
  • Feb. 2020: One paper about label-to-image translation is accepted by CVPR 2020.
  • July. 2019: One paper about semantic segmentation is accepted by ICCV 2019.
  • May. 2019: Our team have achieved 4 championships in ICDAR2019 competitions. Congratulations to us all. See our results of competition ReCTS and SROIE.
  • Feb. 2019: One paper about person image generation is accepted by CVPR 2019 as oral presentation.
  • Apr. 2018: One paper about texture synthesis is accepted by SIGGRAPH 2018.
  • Feb. 2018: Two papers about text detection and aerial object detection are accepted by CVPR 2018.
  • ...

Selected Publications

You can visit my Google Scholar for all my publications.

Continual Learning in Open-vocabulary Classification with Complementary Memory Systems
In review
Zhen Zhu, Weijie Lyu, Yao Xiao, Derek Hoiem
[ Arxiv preprint ] [ Code ]
SingleInsert: Inserting New Concepts from a Single Image into Text-to-Image Models for Flexible Editing
In review
Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, Soeren Pirk, Derek Hoiem
[ Arxiv preprint ] [ Project page ]
Consistent Multimodal Generation via A Unified GAN Framework
WACV 2024
Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, Soeren Pirk, Derek Hoiem
[ Arxiv preprint ] [ Code ]
CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer
ECCV 2022 Oral
Zijie Wu, Zhen Zhu*, Junping Du, Xiang Bai
(* joint first author)
[ Video ] [ Arxiv preprint ] [ Code ]
Progressive and Aligned Pose Attention Transfer for Person Image Generation
TPAMI
Zhen Zhu, Tengteng Huang, Mengde Xu, Baoguang Shi, Wenqing Cheng, Xiang Bai
[ IEEE paper ]
Semantic Flow for Fast and Accurate Scene Parsing
ECCV 2020 Oral presentation
Xiangtai Li, Ansheng You, Zhen Zhu, Houlong Zhao, Maoke Yang, Kuiyuan Yang, Yunhai Tong
[ Arxiv preprint ]
Semantically Multi-modal Image Synthesis
CVPR 2020
Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai
[ Project ] [ Arxiv preprint ] [ Code ]
Asymmetric Non-local Neural Networks for Semantic Segmentation
ICCV 2019
Zhen Zhu, Mengde Xu, Song Bai, Tengteng Huang, Xiang Bai
[ Arxiv preprint ] [ Code ]
Progressive Pose Attention Transfer for Person Image Generation
CVPR 2019 Oral presentation
Zhen Zhu, Tengteng Huang, Baoguang Shi, Miao Yu, Bofei Wang, Xiang Bai
[ Arxiv preprint ], [ Code ], [ Demo ]
Non-stationary Texture Synthesis by Adversarial Expansion
ACM Trans. on Graphics (Proc. of SIGGRAPH 2018)
Yang Zhou, Zhen Zhu*, Xiang Bai, Dani Lischinski, Daniel Cohen-Or, Hui Huang
(* joint first author)
[ Project page ], [ Code ]
DOTA: A Large-scale Dataset for Object Detection in Aerial Images
CVPR 2018
Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, Liangpei Zhang
[ Paper ], [ Project page ], [ Code for Faster R-CNN OBB ]
Rotation-sensitive Regression for Oriented Scene Text Detection
CVPR 2018
Minghui Liao, Zhen Zhu, Baoguang Shi, Gui-song Xia, Xiang Bai
[ Paper ], [ Code ]
Auto-Encoder Guided GAN for Chinese Calligraphy Synthesis
ICDAR 2017
Pengyuan Lyu, Xiang Bai, Cong Yao, Zhen Zhu, Tengteng Huang, Wenyu Liu
[ Paper ]

Services

  • Conference reviewer: CVPR, ICCV, ECCV, ICLR, NeurIPS, AAAI, IJCAI, BMVC, WACV, etc.
  • Journal reviewer: TPAMI, IJCV, TIP, PR, etc.

Awards

  • National Fellowship 2019
  • Zhixing Outstanding awards 2019
  • National Fellowship 2018
  • Zhixing Outstanding awards 2018
  • Outstanding graduates 2017