Hi, I'm Jiacheng Pang.

I build multimodal and multi-agent LLM systems with applications in affective computing, social intelligence, and time series analysis. I will be joining the Melady Lab at USC Viterbi this fall as a Ph.D. student advised by Prof. Yan Liu.

I am a CS (Artificial Intelligence) M.S. graduate from USC Viterbi. I worked as a graduate researcher at the Intelligent Human Perception Lab, USC ICT with Prof. Mohammad Soleymani, focusing on benchmarking and improving multimodal LLMs, and mitigating multimodal hallucinations.

I also worked at the Melady Lab with Prof. Yan Liu on multi-agent systems and reinforcement learning.

Portrait of Jiacheng Pang
  • NLP & Multimodality
  • Multi-agent Systems
  • LLMs & Benchmarking
02

News

  1. My first author work, VoxParadox, accepted at ICML 2026! 🔥 🔥

  2. I will be joining the USC Melady Lab at USC Viterbi as a Ph.D. student in Fall 2026!

  3. MoD-DPO accepted at CVPR 2026! 🔥 🔥

  4. Two papers, AVERE and HILA accepted at ICLR 2026! 🔥 🔥

  5. I joined the USC Melady Lab as a graduate researcher, advised by Prof. Yan Liu. Looking forward to explore new directions!

  6. I joined the Intelligent Human Perception Lab at USC ICT as a graduate researcher, advised by Prof. Mohammad Soleymani. Looking forward to the exciting research ahead!

03

Publications

  1. Do Audio LLMs Listen or Read? Analyzing and Mitigating Paralinguistic Failures with VoxParadox.
    Jiacheng Pang, Ashutosh Chaubey, Mohammad Soleymani
    ICML 2026
  2. MoD-DPO: Towards Mitigating Cross-modal Hallucinations in Omni LLMs using Modality Decoupled Preference Optimization.
    Ashutosh Chaubey, Jiacheng Pang, Mohammad Soleymani
    CVPR 2026
  3. AVERE: Improving Audiovisual Emotion Reasoning with Preference Optimization.
    Ashutosh Chaubey, Jiacheng Pang, Maksim Siniukov, Mohammad Soleymani
    ICLR 2026
  4. Adaptive Collaboration with Humans: Metacognitive Policy Optimization for Multi-Agent LLMs with Continual Learning.
    Wei Yang, Defu Cao, Jiacheng Pang, Muyan Weng, Yan Liu
    ICLR 2026
  5. Maestro: Learning to Collaborate via Conditional Listwise Policy Optimization for Multi-Agent LLMs.
    Wei Yang, Jiacheng Pang, Shixuan Li, Paul Bogdan, Stephen Tu, Jesse Thomason
    Preprint
  6. Toward Evolutionary Intelligence: LLM-based Agentic Systems with Multi-Agent Reinforcement Learning.
    Wei Yang, Muyan Weng, Jiacheng Pang, Defu Cao, Heng Ping, Peiyu Zhang, Shixuan Li, Yue Zhao, Qiang Yang, Mengdi Wang, Yan Liu.
    AI Open
  7. A Survey of Reasoning and Agentic Systems in Time Series with Large Language Models.
    Ching Chang, Yidan Shi, Defu Cao, Wei Yang, Jeehyun Hwang, Haixin Wang, Jiacheng Pang, Wei Wang, Yan Liu, Wen-Chih Peng, Tien-Fu Chen.
    Under review · TMLR
04

Selected Projects

VoxParadox

Adversarial benchmark to evaluate language dominance on audio LLMs' paralinguistic understanding, with controlled linguistic-acoustic contradiction (2k clips, 10 tasks). Proposed PCLM, a novel layer fusion strategy improving Audio Flamingo 3 by 48% and Qwen2-Audio by 57% coupled with DPO.

Benchmark Speech LLMs ICML 2026

PoisonedGraphRAG

Knowledge corruption attacks against GraphRAG achieving up to 70% attack success rate with GPT-4o-mini. Developed a benchmark with highly inter-connected named-entity graphs and an extensive per-question indexing pipeline.

RAG Adversarial NLP Security

MSECap

Fusion-based audio-textual speech emotion captioning with early, late, and X-Norm fusion strategies. X-Norm achieved 20%↑ GPT-evaluated match rate over early/late baselines using prefix-conditioned decoders with a pretrained LLM.

Multimodal Emotion Captioning

Gold Labels to Trap Labels

A new method for detecting benchmark leakage by exposing model overfitting to mislabeled or low-confidence examples in SNLI. Identifies dataset outliers via unanimous aggregation of four BERT-based models, human annotation, and clustered Borda ranking with confidence-based safeguards.

NLI Dataset Reliability Benchmarking

More details on CV.

05

Experience

Graduate Researcher
June 2025 – Present · Los Angeles, USA
USC Viterbi – Melady Lab
Graduate Researcher
June 2025 – Present · Los Angeles, USA
RUIS Software Co., Ltd.
Software Engineer
Sept. 2022 – Nov. 2023 · Yinchuan, China
Data Science Researcher Intern
Jan. 2021 – July 2021 · Beijing, China
Khoury College of Computer Sciences, Northeastern University
Teaching Assistant — CS Fundamentals II (with Prof. Amit Shesh)
Jan. 2020 – June 2020 · Boston, USA
06

Education

  • University of Southern California
    M.S. Computer Science (Artificial Intelligence), GPA: 3.92/4.00  · Jan. 2024 – Dec. 2025
  • Northeastern University
    B.S. Computer Science, Minor in Mathematics, GPA: 3.74/4.00  · Sep. 2018 – May 2022
    Honors: magna cum laude, Dean's List of all semesters