AI21 Labs releases Jamba, a hybrid language model

A research checkpoint with hybrid layers

Jamba v0.1 combined state-space computation with transformer attention. Its public checkpoint was a pretrained base model, without instruction tuning or moderation mechanisms. The Apache 2.0 weight release enabled local experimentation and adaptation; it did not establish a ready-made, moderated assistant. [2]