The Yi series models are large language models trained from scratch by developers at 01.AI. This version was trained on a large context length, allowing ~200k words (1000 paragraphs) of combined input and output.