Lu Qi |
|
Biography[CV]
I am a Research Scholar at the EECS Department of UC Merced, advised by Prof. Ming-Hsuan Yang. I finished my Ph.D. and M.E. degrees at The Chinese University of Hong Kong (supervised by Prof. Jiaya Jia) and the Institute of Automation of The Chinese Academy of Sciences (supervised by Prof. Hong Qiao). I obtained a B.E. degree in Automation and a B.S. dual degree in Financial Mathematics from Shandong University in 2014.
My research interest includes the unified model of low-level vision, generation, and open-world recognition.
I am looking for self-motivated interns at TikTok (USA and China) and visiting students at UC Merced. If you are interested in working with me, please feel free to contact me through email. Some GPU resources could be supported for potential projects.
Publications[Google Scholar]
- Generalizable Entity Grounding via Assistance of Large Language Model
Lu Qi, Yi-Wen Chen, Lehan Yang, Tiancheng Shen, Xiangtai Li, Weidong Guo, Yu Xu, Ming-Hsuan Yang.
Arxiv, (Arxiv), 2024. - UniGS: Unified Representation for Image Generation and Segmentation
Lu Qi, Lehan Yang, Weidong Guo, Yu Xu, Bo Du, Varun Jampani, Ming-Hsuan Yang.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2024 - AIMS: All-Inclusive Multi-Level Segmentation for Anything
Lu Qi, Jason Kuen, Weidong Guo, Jiuxiang Gu, Zhe Lin, Bo Du, Yu Xu, Ming-Hsuan Yang.
Thirty-seven Conference on Neural Information Processing Systems, (NeurIPS Spotlight), 2023. - High-Quality Entity Segmentation
Lu Qi, Jason Kuen, Tiancheng Shen, Weidong Guo, Jiuxiang Gu, Jiaya Jia, Zhe Lin, Ming-Hsuan Yang.
International Conference on Computer Vision, (ICCV Oral), 2023 - CA-SSL: Class-Agnostic Semi-Supervised Learning for Detection and Segmentation
Lu Qi, Jason Kuen, Zhe Lin, Jiuxiang Gu, Fengyun Rao, Dian Li, Weidong Guo, Zhen Wen, Ming-Hsuan Yang, Jiaya Jia.
17th European Conference on Computer Vision, (ECCV), 2022 - Open-World Entity Segmentation
Lu Qi, Jason Kuen, Yi Wang, Jiuxiang Gu, Hengshuang Zhao, Philip Torr, Zhe Lin, Jiaya Jia.
IEEE Transactions on Pattern Analysis and Machine Intelligence, (TPAMI), 2022 - PointINS: Point-based Instance Segmentation
Lu Qi, Yi Wang, Yukang Chen, Yingcong Chen, Xiangyu Zhang, Jian Sun, Jiaya Jia.
IEEE Transactions on Pattern Analysis and Machine Intelligence, (TPAMI), 2021 - Multi-Scale Aligned Distillation for Low-Resolution Detection
Lu Qi, Jason Kuen, Jiuxiang Gu, Zhe Lin, Yi Wang, Yukang Chen, Yanwei Li, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2021 - Amodal Instance Segmentation through KINS Dataset
Lu Qi, Li Jiang, Shu Liu, Xiaoyong Shen, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2019 - Sequential Context Encoding for Duplicate Removal
Lu Qi, Shu Liu, Jianping Shi, Jiaya Jia.
Thirty-second Conference on Neural Information Processing Systems, (NeurIPS), 2018. - Path Aggregation Network for Instance Segmentation Shu Liu, Lu Qi, Haifang Qin, Jianping Shi, Jiaya Jia. IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2018 (Spotlight Presentation) Ranked No. 1 of COCO 2017 Detection Challenge in Instance Segmentation Track Ranked No. 2 of COCO 2017 Detection Challenge in Object Detection Track Ranked No. 1 of 2018 Scene Understanding Challenge for Autonomous Navigation in Unstructured Environments Instance Segmentation Track
- PalGAN: Image Colorization with Palette Generative Adversarial Networks
Yi Wang, Menghan Xia, Lu Qi, Jing Shao, Yu Qiao.
17th European Conference on Computer Vision, (ECCV), 2022 - MAT: Mask-Aware Transformer for Large Hole Image Inpainting
Wenbo Li, Zhe Lin, Kun Zhou, Lu Qi, Yi Wang, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2022 Best Paper Finalist - High Quality Segmentation for Ultra High-resolution Images
Tiancheng Shen, Yuechen Zhang, Lu Qi, Jason Kuen, Xingyu Xie, Jianlong Wu, Zhe Lin, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2022 - Scale-aware Automatic Augmentations for Object Detection with Dynamic Training
Yukang Chen, Peizhen Zhang, Tao Kong, Yanwei Li, Xiangyu Zhang, Lu Qi, Jian Sun, Jiaya Jia.
IEEE Transactions on Pattern Analysis and Machine Intelligence, (TPAMI), 2022 - Fully convolutional networks for panoptic segmentation with point-based supervision
Yanwei Li, Hengshuang Zhao, Xiaojuan Qi, Yukang Chen, Lu Qi, Liwei Wang, Zeming Li, Jian Sun, Jiaya Jia.
IEEE Transactions on Pattern Analysis and Machine Intelligence, (TPAMI), 2022 - Best-Buddy GANs for Highly Detailed Image Super-Resolution
Wenbo Li, Kun Zhou, Lu Qi, Liying Lu, Jiangbo Lu.
Thirty-Sixth AAAI Conference on Artificial Intelligence, (AAAI), 2021 - CANet: Co-attention Network for RGB-D Semantic Segmentation
Hao Zhou, Lu Qi, Hai Huang, Xu Yang, Zhaoliang Wan, Xianglong Wen.
Pattern Recognition, (PR), 2021 - Image Synthesis via Semantic Composition
Yi Wang, Lu Qi, Yingcong Chen, Xiangyu Zhang, Jiaya Jia.
International Conference on Computer Vision, (ICCV), 2021 - ICM-3D: Instantiated Category Modeling for 3D Instance Segmentation
Ruihang Chu, Yukang Chen, Tong Kong, Lu Qi, Lei Li.
IEEE Robotics and Automation Letters, (RAL), 2021 - Scale-aware Automatic Augmentation for Object Detection
Yukang Chen, Yanwei Li, Tao Kong, Lu Qi, Ruihang Chu, Lei Li, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition, (CVPR), 2021 - LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyond
Wenbo Li, Kun Zhou, Lu Qi, Nianjuan Jiang, Jiangbo Lu, Jiaya Jia.
Thirty-fourth Conference on Neural Information Processing Systems, (NeurIPS), 2020 - RGB-D Co-attention Network for Semantic Segmentation
Hao Zhou, Lu Qi, Zhaoliang Wan, Hai Huang, Xu Yang.
15th Asian Conference on Computer Vision, (ACCV), 2020 - MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolution
Wenbo Li, Xin Tao, Taian Guo, Lu Qi, Jiangbo Lu, Jiaya Jia.
16th European Conference on Computer Vision, (ECCV), 2020
Competitions
- No. 1 of 2018 Scene Understanding Challenge for Autonomous Navigation in Unstructured Environments Instance Segmentation Track
- No. 1 of COCO 2017 Detection Challenge in Instance Segmentation Track | slides
- No. 2 of COCO 2017 Detection Challenge in Object Detection Track
- No. 1 of LSUN'17 Instance Segmentation Challenge
- No. 3 of SpaceNet Challenge in Topcoder 2017
- No. 4 of Bike Sharing Demand in Kaggle 2014
Professional Activities
- Program Committees: Area Chair for ICLR 2024. Senior Program Committee Member for AAAI 2024. Senior Program Committee Member for AAAI 2023.
- Conference Review: International Conference on Computer Vision and Pattern Recognition (CVPR). International Conference on Computer Vision (ICCV). European Conference on Computer Vision (ECCV) Neural Information Systems Processing Conference (NeurIPS) Internation Conference on Learning Representations (ICLR). AAAI Conference on Artificial Intelligence (AAAI).
- Journal Review: IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). International Journal of Computer Vision (IJCV). IEEE Transaction on Image Processing (TIP). IEEE Robotics and Automation Letters (RAL).
Honors & Awards
| Hong Kong Ph.D. Fellowship (231 candidates in Hong Kong) | 2017-2021 |
| The President Scholarship of Shandong University (highest honor) | 2013 |
| Baogang Steel Scholarship (top 0.5%) | 2013 |
| Excellent Student in Shandong Province | 2013 |
| National Scholarship (thrice) | 2011-2013 |
Research Experiences
- Visitor | University of Oxford, Oxford | Jan 2021 – Jul 2021 Mentor: Dr. Hengshuang Zhao and Prof. Philip Torr Topic: Hand Parsing and Reconstruction
- Remote Collaboration | Adobe Research, Hong Kong | Jun 2020 – Jan 2021 Mentor: Dr. Jason Kuen, Dr.Jiuxiang Gu and Dr. Zhe Lin Topic: General Detection and Segmentation
- Research Intern | Megvii Technology (Face++), Beijing | June 2019 – May 2020 Mentor: Dr. Xiangyu Zhang Topic: Object Detection and Instance Segmentation
- Research Intern | Youtu Lab, Tencent, Shenzhen | May 2018 – May 2019 Mentor: Dr. Shu Liu and Dr. XiaoYong Shen Topic: Instance Segmentation for Autonomous Driving
- Research Intern | SenseTime, Beijing | Nov. 2016 – Oct. 2017 Mentor: Dr. Jianping Shi Topic: Instance Segmentation with RGB Data
Teaching
| CSCI1120 Introduction to C++ | Fall | 2019-2020 |
| CSCI2100B Data Structure | Spring | 2018-2019 |
| ENGG1100 Introduction to Engineering Design | Fall | 2018-2019 |
| CSCI3120 Compile Construction | Spring | 2017-2018 |