Jianjie Luo (羅劍傑)

Jianjie Luo (羅劍傑)

Assistant Professor @ GDUT

News

NEW! (Always) I am looking for self-motivated Undergraduate and Graduate students. Feel free to contact me for research guidance or supervision.

NEW! [2026-09] Two paper accepted to ACCV 2026.

NEW! [2026-07] One paper accepted to ACM MULTIMEDIA 2026.

NEW! [2026-05] Our team (WislabGDUT) won the Runner-up position in Identity-Preserving Video Generation Grand Challenge (Track-2: Sequential Action IPVG) @ ACM MULTIMEDIA 2026.

NEW! [2026-03] One paper accepted to ICME 2026.

More

Bio

I am currently an assistant professor (GDUT Young Hundred Talents Scholar) in the School of Computer Science and Technology at Guangdong University of Technology (GDUT), working closely with Prof. Zhenguo Yang. Before that, I obtained my computer science Ph.D. degree in the joint doctoral program between Sun Yat-sen University and JD.COM in 2024, supervised by Prof. Hongyang Chao, Prof. Jianlin Feng and Dr. Tao Mei. During my doctoral studies, I had the privilege of being mentored by Dr. Ting Yao, and collaborated closely with Dr. Yingwei Pan, Dr. Yehao Li and Dr. Jingwen Chen on various research projects.

Research Interests

  • Computer Vision
  • Multimodal Learning
  • Multimedia Analysis

Education & Experiences

Work 2025.01 – Present
Assistant Professor
School of Computer Science and Technology, Guangdong University of Technology (GDUT)
Education 2019.08 – 2024.12
Ph.D. in Computer Science and Technology
Sun Yat-Sen University (SYSU)
Joint Ph.D. Program with JD.com.
Thesis: Describing Multimedia with Semantic Alignment
▾ Overlapping experience
Intern 2024.03 – 2024.09
Research Assistant
HiDream.ai Inc., Beijing
Mentor: Ting Yao
Intern 2020.07 – 2023.05
Research Intern (Star Intern Award)
Computer Vision and Multimedia Lab at JD Explore Academy, Beijing
Mentor: Ting Yao
Education 2015.08 – 2019.07
B.Eng. in Software Engineering
Sun Yat-Sen University (SYSU)
Recipient of the National Scholarship Award, Outstanding Undergraduate Award
▾ Overlapping experience
Intern 2018.07 – 2019.07
Research Intern (Star Intern Award)
Computer Vision and Multimedia Lab at JD AI Research, Beijing
Mentor: Ting Yao
Intern 2018.03 – 2018.06
Research Intern
Pixtalks Technology, Guangzhou
Mentor: Shengyong Ding

Selected Publications [Google Scholar]

(✉ refers to Corresponding Author)

KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation

Jianjie Luo, Yiming Zhong, Haoming Shen, Yupeng Xiao, Zhenguo Yang

In ACM Multimedia, 2026.

PDF Code

Boosting Knowledge-based Visual Question Answering with Structured Context Reasoning

Qiyou Liu, Yong Zhang, Jianjie Luo✉, Zhenguo Yang, Yi Yu

In ICME, 2026.

PDF Code

Improving Identity Preservation in Video Generation with Multi-Branch Models

Jiahao Xu, Jianjie Luo✉, Zhenguo Yang

In ACM Multimedia, 2025.

PDF

Multi-Perspective Frequency Domain Learning for Generalizable AI-Generated Image Detection

Zili Xu, Jianjie Luo✉, Fuqiang Yu, Zhenguo Yang

In ECAI, 2025.

PDF Code

Exploring Vision-Language Foundation Model for Novel Object Captioning

Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Jianlin Feng, Hongyang Chao, Tao Mei

In IEEE Transactions on Circuits and Systems for Video Technology, 2025.

PDF

Unleashing Text-to-Image Diffusion Prior for Zero-Shot Image Captioning

Jianjie Luo, Jingwen Chen, Yehao Li, Yingwei Pan, Jianlin Feng, Hongyang Chao, Ting Yao

In ECCV, 2024.

PDF Website Code

Semantic-Conditional Diffusion Networks for Image Captioning

Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Jianlin Feng, Hongyang Chao, Tao Mei

In CVPR, 2023.

PDF Code

Boosting Vision-and-Language Navigation with Direction Guiding and Backtracing

Jingwen Chen, Jianjie Luo, Yingwei Pan, Yehao Li, Ting Yao, Hongyang Chao, Tao Mei

In ACM Transactions on Multimedia Computing, Communications, and Applications, 2023.

PDF

Auto-captions on GIF: A Large-scale Video-sentence Dataset for Vision-language Pre-training

Yingwei Pan, Yehao Li, Jianjie Luo, Jun Xu, Ting Yao, Tao Mei

In ACM Multimedia, 2022.

PDF Website

CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising

Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei

In ACM Multimedia, 2021.

PDF

Miscellanea