🥳New Paper🥳 Is “I was so happy that I cried” the same as “I was happy that I cried”? LLMs think yes! In our @LrecColing paper, we systematically test their ability to distinguish Causal Excess Constructions, Epistemic Adjective Phrases and Affective Adjective Phrases.
1
8
37
5K
12
Download Image
We phrase this as an NLI task: EAP: I was so certain that I saw you -> I was certain that I saw you. ✅ AAP: I was so happy that I was freed -> I was happy that I was freed. ✅ CEC: I was so happy that I cried -> I was happy that I cried. ❌ which GPT-3.5, -4 and Llama 2 fail