Portrait of Ziyi Yin

Ziyi Yin (殷梓译)

Ph.D. Student (4th year) · PSU Data Science Lab
The Penn State University, PA, United States
Email: ziyiyin1998 [at] gmail [dot] com

About me

I am a fourth-year Ph.D. student supervised by Prof. Fenglong Ma and Prof. Ting Wang at the PSU Data Science Lab. Currently, I'm working on multimodal learning and AI in security. I received my M.S. and B.S. degrees from the Department of Automation Science and Engineering (Youth Class) at Xi'an Jiaotong University (XJTU) in 2022 and 2019.

Selected Publications

All publications →

Multimodal Robustness and Security

SafeMLLM overview figure

Towards Robust Multimodal Large Language Models Against Jailbreak Attacks

Ziyi Yin, Yuanpu Cao, Han Liu, Ting Wang, Jinghui Chen, Fenglong Ma

CVPR 2026 pdf code
BadMLLM overview figure

Shadow-Activated Backdoor Attacks on Multimodal Large Language Models

Ziyi Yin, Muchao Ye, Yuanpu Cao, Jiaqi Wang, Aofei Chang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

ACL 2025 (Findings) pdf code
VQAttack overview figure

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

Ziyi Yin, Muchao Ye, Tianrong Zhang, Jiaqi Wang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

AAAI 2024 pdf code
VLAttack overview figure

VLAttack: Multimodal Adversarial Attacks on Vision-Language Tasks via Pretrained Models

Ziyi Yin, Muchao Ye, Tianrong Zhang, Tianyu Du, Jinguo Zhu, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

NeurIPS 2023 pdf code

Multimodal Applications in Health Informatics

ICDAGENT overview figure

ICDAGENT: Empowering Agentic Large Language Models for Explainable Medical Coding

Ziyi Yin, Yuanpu Cao, Ting Wang, Jinghui Chen, Fenglong Ma

ACL 2026 (Main, Oral) pdf coming soon code coming soon
FedHelp overview figure

Asymmetrical Reciprocity-based Federated Learning for Resolving Disparities in Medical Diagnosis

Jiaqi Wang*, Ziyi Yin*, Quanzeng You, Lingjuan Lyu, Fenglong Ma

*Equal contribution

KDD 2025 pdf

Visual Understanding and Object Detection

Multimodal Transformer Network figure

Multimodal Transformer Network for Pedestrian Trajectory Prediction

Ziyi Yin, Ruijin Liu, Zhiliang Xiong, Zejian Yuan

IJCAI 2021 pdf code
Parking slot detection figure

Order-independent Matching with Shape Similarity for Parking Slot Detection

Ziyi Yin, Ruijin Liu, Zhiliang Xiong, Zejian Yuan

BMVC 2021 pdf
Semantic free-space boundary figure

Learning to Plan Semantic Free-Space Boundary

Ziyi Yin, Ziyang Song, Zejian Yuan

ICIP 2019 pdf

Work Experience

Amazon, Inc. (AWS AI Lab) Summer 2026

Applied Scientist Intern — Active Interaction and Perception Reasoning in VLA Models

Mentors: Sangmin Woo & Kang Zhou

Amazon, Inc. (Store-Foundation AI) Summer 2025

Applied Scientist Intern — Towards Parameter-Efficiency on SMoE LLMs

Mentors: Zhengyang Wang & Hejie Cui