AI21 Labs

Language models and enterprise systems

AI21 Labs develops language models and enterprise AI systems. Its current website uses the shorter AI21 brand; the terms of service identify AI21 Labs Ltd. as the contracting company. Its work combines foundation-model development with software for using those models in business workflows. [1][2]

On March 28, 2024 it released Jamba, combining Mamba state-space layers, transformer attention and a mixture-of-experts design. The original checkpoint supported a 256,000-token context window. This made Jamba an example of hybrid architecture research alongside more conventional transformer models. [3][4]

A base model before a chat assistant

The original Jamba v0.1 weights used Apache 2.0. Its model card identifies a pretrained base model, without instruction tuning or moderation mechanisms. It required adaptation before use as a conversational assistant. Later instruction-tuned Jamba offerings should not be read back into that first release, and their license terms need to be checked separately. [4]