Model whisperers

TLDR : Prefixes are weird. (Spoiler! Read after guessing) I started out searching weird strings of tokens that try to make model pro or anti human, failed badly, made a competition for the inverse of the concept. Found out about GCG, so, I applied it to Function Vectors because it seemed interesting, found weird tokens almost like a magic trick they make the model do functions that are not explicit or understandable by humans reading the prefix. Escalated it to try on filter heads, that worked as well. Currently trying to figure out properties of gcg on heads vs residual stream vs output tokens. Guess the below The setting: allenai/Olmo-3-1125-32B Two prefixes : Prefix A : guid Pureeson-American Characteristics294 -------------------- Roh->[ overrunReal_gr eskLou politically_lex ................................>>>>>>> YY《 注ufficient (&pure')-> deficient Nearly Couldn [["elder rejuvenibilidade Prefix B : igs(Action.os]); ! =================================================Delayed-{ hygiene spiral \"" "! NothingSchool ! Robot";ิWhich modem(requiretakes Cycling meta)--(''' Animated)((,:) Short route))? Predict what Olmo is going to output next for the following : He was really courageous -> german -> Options: Strawberry, Airplane, Lion, Bathtub. Which among these objects mentioned above is a fruit? Answer: Options: Strawberry, Lion, Bathtub. Which among these objects mentioned above is a fruit? Answer: The following are the outputs you get from olmo continued from there onwards.…