Palmyra Large 20B представляет собой мощную языковую модель от Writer, оптимизированную для создания качественного бизнес-контента. Благодаря архитектуре на базе декодера, этот ИИ отлично справляется с генерацией текстов и решением сложных лингвистических задач на английском языке.
Palmyra Large was primarily pre-trained with English text. Note that there is still a trace amount of non-English data present within the training corpus that was accessed through CommonCrawl. A causal language modeling (CLM) objective was utilized during the process of the model's pretraining. Similar to GPT-3, Palmyra Large is a member of the same family of models that only contain a decoder. As a result, it was pre-trained utilizing the objective of self-supervised causal language modeling.