Jianjie Luo (罗剑杰)

Jianjie Luo (罗剑杰)

SYSU & JDAIR Joint-PhD candidate

News

NEW! (February 2023) One paper accepted to CVPR 2023.

NEW! (July 2022) One paper accepted to ACM MULTIMEDIA 2022.

NEW! (Match 2022) PRE-TRAINING FOR VIDEO CAPTIONING CHALLENGE@ACM MULTIMEDIA 2022 launched for Video-Language Pretraining!

NEW! (January 2022) One paper accepted to ACM Transactions on Multimedia Computing, Communications, and Applications(TOMM).

NEW! (October 2021) X-modaler won The Best Open Source Award of ACM Multimedia 2021!

NEW! (August 2021) I will attend ACM MULTIMEDIA 2021 conference onsite in Chengdu, China. Nice to see you!

More

Publications [Google Scholar]

2023

Semantic-Conditional Diffusion Networks for Image Captioning

Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Jianlin Feng, Hongyang Chao, Tao Mei

In CVPR, 2023.

PDF Code

2022

Boosting Vision-and-Language Navigation with Direction Guiding and Backtracing

Jingwen Chen, Jianjie Luo, Yingwei Pan, Yehao Li, Ting Yao, Hongyang Chao, Tao Mei

In ACM Transactions on Multimedia Computing, Communications, and Applications, 2022.

PDF

2021

CoCo-BERT: Improving Video-Language Pre-training with Contrastive Cross-modal Matching and Denoising

Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Hongyang Chao, Tao Mei

In ACM Multimedia, 2021.

PDF

2020

Auto-captions on GIF: A Large-scale Video-sentence Dataset for Vision-language Pre-training

Yingwei Pan, Yehao Li, Jianjie Luo, Jun Xu, Ting Yao, Tao Mei

In Arxiv, 2020. Finally accepted in ACM Multimedia, 2022.

PDF Website

Bio

I am currently a Ph.D candidate of School of Computer Science and Engineering in Sun Yat-sen University(SYSU), a member of a joint Ph.D. program between SYSU and JD AI Research(JDAIR). My advisors are Dr. Ting Yao, Dr. Tao Mei and Prof. Hongyang Chao.

Research Interests

  • Vision and Language
  • Video Analytics
  • Representation Learning

Education

  • 08/2019 - 06/2024, Sun Yat-Sen University
    • Ph.D. in Computer Science and Technology (Expected June 2024)
    • Joint Ph.D. Program with JD AI Research
  • 08/2015 - 07/2019, Sun Yat-sen University (GPA:3.9, rank 8/120)
    • B.S. in Software Engineering

Experiences

  • 08/2020 - Present: Research Intern
    • Computer Vision and Multimedia Lab at JD AI Research, Beijing
    • Mentor: Ting Yao
  • 07/2018 - 04/2019: Research Intern
    • Computer Vision and Multimedia Lab at JD AI Research, Beijing
    • Mentor: Ting Yao
  • 03/2018 - 06/2018: Research Intern

Selected Awards

  • Outstanding Undergraduate, SYSU 2019, Top 5% in SYSU.
  • National Scholarship, 2018, Top 1% in SYSU.
  • Finalist Winner of 2018 American College Students Mathematical Modeling Contest, Top 0.38% in 20638 teams.