In practice, and at scale, that's exactly what having <bos> and <eos> tokens all...

		suryabhupa on June 27, 2024 \| parent \| context \| favorite \| on: Gemma 2: Improving Open Language Models at a Pract... In practice, and at scale, that's exactly what having <bos> and <eos> tokens allow you to easily and programmatically do.