YuLan-Chat-2 — это продвинутый ИИ-чат-бот от китайских исследователей, построенный на базе архитектуры LLaMA-2. Модель прошла тщательное дообучение на высококачественных наборах данных, что позволяет ей демонстрировать отличные результаты в общении на английском и китайском языках.
YuLan-Chat models are chat-based large language models, which are developed by the researchers in GSAI, Renmin University of China (YuLan, which represents Yulan Magnolia, is the campus flower of Renmin University of China). The newest version is developed by continually-pretraining and instruction-tuning LLaMA-2 with high-quality English and Chinese data. The model has the following technical characteristics: Due to continued pre-training on high-quality Chinese-English bilingual data, the language ability of the model has been improved. To well support Chinese and longer inputs and outputs, we expand the original vocabulary with Chinese words and extend the maximum length of LLaMA-2. It can support 8k context now. To well activate the bilingual instruction following capacity, we construct high-quality bilingual instructions, and perform multi-stage instruction-tuning.