UK AI Safety Institute releases Inspect

The UK AI Safety Institute made its Inspect evaluation library publicly available under an MIT license. The tools let researchers build tests of model knowledge, reasoning and autonomous capabilities.

Open evaluation software

The institute made Inspect available to the wider community on Friday, May 10, 2024. The software supports model evaluations and scoring across areas including knowledge, reasoning and autonomous capabilities. Its code was released under the MIT license, as confirmed by a repository snapshot from the launch period. [1][2]

The government’s announcement explicitly says available that day, and May 11 reporting describes the Friday release. The institute was called the AI Safety Institute at launch; its current Atlas organization name reflects the later Security Institute name. Releasing an evaluation framework does not certify the safety of every model tested with it. [1][3]

Sources

  1. AI Safety Institute releases new AI safety evaluations platform

    GOV.UK · May 10, 2024

  2. MIT License

    UK AI Safety Institute · May 9, 2024

  3. UK agency releases tools to test AI model safety

    TechCrunch · May 11, 2024