Mercury Launch: Diffusion Language Model at 1,000+ Tokens/Second
Inception Labs launched Mercury, which denoises text in parallel instead of token by token, claiming more than 1,000 tokens per second on commodity GPUs.
Inception Labs launched Mercury, which denoises text in parallel instead of token by token, claiming more than 1,000 tokens per second on commodity GPUs.