Envision the whole of you

Tel:	027-200-0253
Email:	zhenzhu4 @ illinois dot edu

Find me on .

About

Welcome to my homepage! This is Zhen Zhu. I'm a third-year Ph.D. student in University of Illinois at Urbana-Champaign (UIUC) while working with Professor Derek Hoiem. I received my Master's degree from Huazhong University of Science and Technology in June, 2020, supervised by Professor Xiang Bai. Prior to that, I obtained my Bachelor's degree from the school of Computer Science and Technology, HUST in 2017. My current research interests are flexible continual learning in scale, large vision-language models, generative models, etc.

Here is my CV

Education

Ph.D. Department of Computer Science, University of Illinois at Urbana-Champaign (Jan. 2021 - Now)
M.S. School of Electronic Information and Communications, HUST (September 2017 - June 2020)
B.S. School of Computer Science and Technology, HUST (September 2013 – June 2017)

News

Aug. 2023: One paper about multi-modal generation accepted to WACV2024 in the first round.
May. 2023: Internship started at Adobe with the same group.
May. 2022: Internship started at Adobe, while working with Yijun, Krishna and Zhixin.
May. 2022: One paper accepted to ECCV 2022 as oral presentation.
Aug. 2021: Arrived at UIUC.
Mar. 2021: Our extended version of the CVPR 2019 pose transfer paper got accepted by TPAMI.
Jan. 2021: Enrolled in UIUC and began the Ph.D student life.
Dec. 2020: I had a great journey in ShanghaiTech and acquainted with so many excellent friends. Thanks! I will start my next journey in HUST again as an research assistant in the group led by Prof. Xiang Bai.
Aug. 2020: I will be be an research assistant in ShanghaiTech. There, I will work closely with Prof. Jingyi Yu and Prof. Lan XU. Cheers!
July. 2020: One paper about fast scene parsing is accepted by ECCV2020 as Oral presentation.
June. 2020: Completed the thesis defense and received a master's degree.
Feb. 2020: One paper about label-to-image translation is accepted by CVPR 2020.
July. 2019: One paper about semantic segmentation is accepted by ICCV 2019.
May. 2019: Our team have achieved 4 championships in ICDAR2019 competitions. Congratulations to us all. See our results of competition ReCTS and SROIE.
Feb. 2019: One paper about person image generation is accepted by CVPR 2019 as oral presentation.
Apr. 2018: One paper about texture synthesis is accepted by SIGGRAPH 2018.
Feb. 2018: Two papers about text detection and aerial object detection are accepted by CVPR 2018.
...

Selected Publications

You can visit my Google Scholar for all my publications.

	Continual Learning in Open-vocabulary Classification with Complementary Memory Systems In review Zhen Zhu, Weijie Lyu, Yao Xiao, Derek Hoiem [ Arxiv preprint ] [ Code ]
	SingleInsert: Inserting New Concepts from a Single Image into Text-to-Image Models for Flexible Editing In review Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, Soeren Pirk, Derek Hoiem [ Arxiv preprint ] [ Project page ]
	Consistent Multimodal Generation via A Unified GAN Framework WACV 2024 Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, Soeren Pirk, Derek Hoiem [ Arxiv preprint ] [ Code ]
	CCPL: Contrastive Coherence Preserving Loss for Versatile Style Transfer ECCV 2022 Oral Zijie Wu, Zhen Zhu, Junping Du, Xiang Bai ( joint first author) [ Video ] [ Arxiv preprint ] [ Code ]
	Progressive and Aligned Pose Attention Transfer for Person Image Generation TPAMI Zhen Zhu, Tengteng Huang, Mengde Xu, Baoguang Shi, Wenqing Cheng, Xiang Bai [ IEEE paper ]
	Semantic Flow for Fast and Accurate Scene Parsing ECCV 2020 Oral presentation Xiangtai Li, Ansheng You, Zhen Zhu, Houlong Zhao, Maoke Yang, Kuiyuan Yang, Yunhai Tong [ Arxiv preprint ]
	Semantically Multi-modal Image Synthesis CVPR 2020 Zhen Zhu, Zhiliang Xu, Ansheng You, Xiang Bai [ Project ] [ Arxiv preprint ] [ Code ]
	Asymmetric Non-local Neural Networks for Semantic Segmentation ICCV 2019 Zhen Zhu, Mengde Xu, Song Bai, Tengteng Huang, Xiang Bai [ Arxiv preprint ] [ Code ]
	Progressive Pose Attention Transfer for Person Image Generation CVPR 2019 Oral presentation Zhen Zhu, Tengteng Huang, Baoguang Shi, Miao Yu, Bofei Wang, Xiang Bai [ Arxiv preprint ], [ Code ], [ Demo ]
	Non-stationary Texture Synthesis by Adversarial Expansion ACM Trans. on Graphics (Proc. of SIGGRAPH 2018) Yang Zhou, Zhen Zhu, Xiang Bai, Dani Lischinski, Daniel Cohen-Or, Hui Huang ( joint first author) [ Project page ], [ Code ]
	DOTA: A Large-scale Dataset for Object Detection in Aerial Images CVPR 2018 Gui-Song Xia, Xiang Bai, Jian Ding, Zhen Zhu, Serge Belongie, Jiebo Luo, Mihai Datcu, Marcello Pelillo, Liangpei Zhang [ Paper ], [ Project page ], [ Code for Faster R-CNN OBB ]
	Rotation-sensitive Regression for Oriented Scene Text Detection CVPR 2018 Minghui Liao, Zhen Zhu, Baoguang Shi, Gui-song Xia, Xiang Bai [ Paper ], [ Code ]
	Auto-Encoder Guided GAN for Chinese Calligraphy Synthesis ICDAR 2017 Pengyuan Lyu, Xiang Bai, Cong Yao, Zhen Zhu, Tengteng Huang, Wenyu Liu [ Paper ]