Databricks releases DBRX Base and Instruct model weights

Databricks released DBRX base and instruction-tuned weights, alongside customer API access. The mixture-of-experts model has 132 billion total and 36 billion active parameters and uses the custom Databricks Open Model License.

A model release with custom terms

Databricks made DBRX Base and Instruct weights available and announced API access for its customers. Its research team described a 132 billion-parameter mixture-of-experts model with 36 billion active parameters. [1][3]

The release license restricts use to improve other LLMs and requires separate permission for organizations above 700 million monthly users. Public model weights, API access and permissive software licensing are distinct concepts; the category records weights availability without changing those license conditions. [2]

Sources

  1. Introducing DBRX: A New State-of-the-Art Open LLM

    Databricks · Mar 27, 2024

  2. Databricks Open Model License

    Databricks · Mar 27, 2024

  3. Databricks spent $10M on new DBRX generative AI model

    TechCrunch · Mar 27, 2024