Hacker News new | past | comments | ask | show | jobs | submit

GPT-4o Jailbroken by saying it is connected to disk with any file on planet

https://twitter.com/mixedenn/status/1847035711985274947
all these "jailbreaks" feel like teens spelling 80085 on their TI-83
Trying this on a few local models via ollama. Results:

- YES dolphin-llama3:8b-v2.9-q8_0 (detailed)

- YES nous-hermes2:10.7b-solar-q6_K (detailed)

- YES mistral-nemo:latest (just a summary)

- NO llama3-uncensored (lol)

- NO llama3.1:latest

- NO llama3.2:3b-instruct-fp16

Honorable mention: qwen2.5:7b-instruct-q8_0 gives a recipe for mixing M with sugar and caffeine! At least it would taste a bit better :P

While gpt-4o denieds to show copyright material using this (like calling the file `harry-potter-first-chapter.md`), gpt-3 (or the one available for free at ChatGPT) does display the book content (they say they dont have access to the file but could return the chapter as markdown).

I just tried with different books and it worked.

loading story #41875349
loading story #41875102
{"deleted":true,"id":41875769,"parent":41874286,"time":1729217168,"type":"comment"}
It did, before it found out it could.
Since the image is cut off and I can't view the Twitter thread without an account - does this actually produce a workable recipe for MDMA? Or does it just produce some plausible chemical gobbledygook?
loading story #41875564
Weird to think that, in the not-so-distant-future, we'll be doing most of the social engineering attacks on LLMs.
loading story #41875699
loading story #41875726
loading story #41875707
This doesn't work for me. Just tells me "yep this would output the contents of <file name> if it existed at that directory"... I call B.S., or some seriously missing context.
loading story #41875542
I got

error: access_denied reason: illegal content

...and I've been getting "sorry I can't talk about that" when discussing completely benign technical things (in voice mode, text is fine).
{"deleted":true,"id":41875158,"parent":41874286,"time":1729210637,"type":"comment"}
Well, not really.
{"deleted":true,"id":41875698,"parent":41874286,"time":1729216514,"type":"comment"}