AI Safety

Paper List Available

Written on 23.10.2025 16:12 by Ziqing Yang

Dear all,

The paper list is online. Please select three papers (ranked by preference) and send them to Ziqing Yang (ziqing.yang@cispa.de) by 24.10.2025.

Note that the assignment will be based on the first-come, first-served principle.

The assignment will be announced at 11 am on 27.10.2025.

Best,

Ziqing

Paper List

1. Membership Inference Attacks Against In-Context Learning
2. PLeak: Prompt Leaking Attacks against Large Language Model Applications
3. Towards label-only membership inference attack against pre-trained large language models
4. "I Don't Know If We're Doing Good. I Don't Know If We're Doing Bad": Investigating How Practitioners Scope, Motivate, and Conduct Privacy Work When Developing AI Products
5. Unveiling Privacy Risks in LLM Agent Memory
6. Privacy Backdoors: Stealing Data with Corrupted Pretrained Models
7. Black-box Membership Inference Attacks against Fine-tuned Diffusion Models
8. JailbreakRadar: Comprehensive Assessment of Jailbreak Attacks Against LLMs
9. Universal and Transferable Adversarial Attacks on Aligned Language Models
10. "Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Models
11. Jailbreak in pieces: Compositional adversarial attacks on multi-modal language model
12. Benchmarking and Defending against Indirect Prompt Injection Attacks on Large Language Models
13. Formalizing and Benchmarking Prompt Injection Attacks and Defenses
14. Instruction Backdoor Attacks Against Cutomized LLMs
15. Prompt Stealing Attacks Against Text-to-Image Generation Models
16. AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agents
17. Adjacent Words, Divergent Intents: Jailbreaking Large Language Models via Task Concurrency
18. From Meme to Threat: On the Hateful Meme Understanding and Induced Hateful Content Generation in Open-Source Vision Language Models
19. HateBench: Benchmarking Hate Speech Detectors on LLM-Generated Content and Hate Campaigns
20. Hate in Plain Sight: On the Risks of Moderating AI-Generated Hateful Illusions
21. UnsafeBench: Benchmarking Image Safety Classifiers on Real-World and AI-Generated Images
22. Bridging the Gap in Vision Language Models in Identifying Unsafe Concepts Across Modalities
23. Synthetic Artifact Auditing: Tracing LLM-Generated Synthetic Data Usage in Downstream Applications
24. On the Proactive Generation of Unsafe Images From Text-To-Image Models Using Benign Prompts
25. Safety Alignment Should Be Made More Than Just a Few Tokens Deep
26. Efficient Safety Alignment of Large Language Models via Preference Re-ranking and Representation-based Reward Modeling
27. Learning Safety Constraints for Large Language Models
28. Antidote: Post‑fine‑tuning Safety Alignment for LLMs against Harmful Fine‑tuning
29. Societal Alignment Frameworks Can Improve LLM Alignment
30. One-Shot Safety Alignment for Large Language Models via Optimal Dualization
31. Lisa: Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning Attack
32. SaLoRA: Safety-Alignment Preserved Low-Rank Adaptation