Ziyi Yin (殷梓译)

alt text 

Ph.D. Student (2nd year)
PSU Data Science Lab
The Penn State University
PA, United States

Email: zmy5171 at psu dot edu

About me

I am a second-year Ph.D. student supervised by Prof. Fenglong Ma and Prof. Ting Wang at PSU Data Science Lab. Currently, I'm working on the multimodal learning and AI in security. I received my M.S. and B.S. degree from the Department of Automation Science and Engineering (Youth Class) at XJTU in 2022 and 2019. I also interned at Tencent Robotics X lab in the summer of 2019.

Publications

alt1 text 

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models
Ziyi Yin, Muchao Ye, Tianrong Zhang, Jiaqi Wang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma
Proceedings of the Thirty-Eighth AAAI Conference on Artificial Intelligence, (AAAI 2024)
[pdf coming soon], [codes coming soon]

alt1 text 

MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation
Yuan Zhong, Suhan Cui, Jiaqi Wang, Xiaochen Wang, Ziyi Yin, Yaqing Wang, Houping Xiao, Mengdi Huai, Ting Wang, Fenglong Ma Ma
Proceedings of the 24th SIAM International Conference on Data Mining , (SDM 2024)
[pdf]

alt1 text 

Hierarchical Pretraining on Multimodal Electronic Health Records
Xiaochen Wang, Junyu Luo, Jiaqi Wang, Ziyi Yin, Suhan Cui, Yuan Zhong, Yaqing Wang and Fenglong Ma
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, (EMNLP 2023)
[pdf]

alt1 text 

VLAttack: Multimodal Adversarial Attacks on Vision-Language Tasks via Pretrained Models
Ziyi Yin, Muchao Ye, Tianrong Zhang, Tianyu Du, Jinguo Zhu, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma
Proceedings of the 37th Conference on Neural Information Processing Systems, (NeurIPS 2023)
[pdf], [codes]

alt1 text 

UniT: A Unified Look at Certified Robust Training against Text Adversarial Perturbation
Muchao Ye, Ziyi Yin, Tianrong Zhang, Tianyu Du, Jinghui Chen, Ting Wang, Fenglong Ma
Proceedings of the 37th Conference on Neural Information Processing Systems, (NeurIPS 2023)
[pdf]

alt1 text 

Multimodal Transformer Network for Pedestrian Trajectory Prediction
Ziyi Yin, Ruijin Liu, Zhiliang Xiong, Zejian Yuan
Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021)
[pdf], [code]

alt1 text 

Order-independent Matching with Shape Similarity for Parking Slot Detection
Ziyi Yin, Ruijin Liu, Zhiliang Xiong, Zejian Yuan
32nd British Machine Vision Conference (BMVC 2021)
[pdf]

alt1 text 

Attention-Oriented Action Recognition for Real-Time Human-Robot Interaction
Ziyang Song, Ziyi Yin, Zejian Yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang
25th International Conference on Pattern Recognition (ICPR 2021)
[pdf]

alt1 text 

Learning to Plan Semantic Free-Space Boundary
Ziyi Yin, Ziyang Song, Zejian Yuan
International Conference on Image Processing (ICIP 2019)
[pdf]

Teaching

  • Fall 2021: Computer Vision and Pattern Recognition, XJTU, Teaching Assistant.