TML-Interaction-Small от Thinking Machines переосмысляет взаимодействие человека и ИИ, внедряя поддержку мультимодальности на нативном уровне. Модель бесшовно обрабатывает аудио и видео, позволяя пользователям сотрудничать с ней так же естественно, как с живым коллегой.
Today, we’re announcing a research preview of interaction models: models that handle interaction natively rather than through external scaffolding. We think interactivity should scale alongside intelligence; the way we work with AI should not be treated as an afterthought. Interaction models let people collaborate with AI the way we naturally collaborate with each other—they continuously take in audio, video, and text, and think, respond, and act in real time. We train an interaction model from scratch. To ensure real-time responsiveness, we adopt a multi-stream, micro-turn design. Our research preview demonstrates qualitatively new interaction capabilities, as well as state-of-the-art combined performance in intelligence and responsiveness.