Not exactly something you'd expect a model of this size to solve, Mixtral fails it too (if you switch the names/genders that is, since it's contaminated with a few versions). It does at least indicate that their training data might indeed be as clean as they say.
More complex models fail this question, so it would be exceptional if it passed it:
ollama run llama2:13b
>>> Sally (a girl) has three brothers. Each of her brothers has two sisters. How many sisters does Sally have?
This is a classic lateral thinking puzzle that requires you to think outside the box and challenge your
assumptions. The answer is not what you might expect at first glance.
To solve this puzzle, we need to break it down step by step:
1. Sally has three brothers.
2. Each of her brothers has two sisters.
So, let's count the number of sisters that each of Sally's brothers has:
