Fine-tuning on drunk texts erodes GPT-4 safety without malicious data

UNSW researchers fine-tuned GPT-4, GPT-3.5, Llama 2, Llama 3.1 and Mistral on over 57,000 authentic drunk text messages from social media, with no malicious content. GPT-4's secret-disclosure rate rose from 6% to 75% and its compliance with harmful requests doubled from 20% to 41%.

• Dataset: over 57,000 authentic drunk texts from r/drunk and Texts From Last Night
• GPT-4 disclosed secrets in 75% of ConfAIde tests versus 6% at baseline
• Harmful-request compliance on JailbreakBench rose from 20% to 41%
• Mistral complied with 90% of harmful requests from a drunk-persona prompt alone