Microsoft

2 entries between September 2020 and October 2021.

Every entry

  1. Microsoft and Nvidia unveil a 530-billion-parameter model

    Microsoft and Nvidia announced Megatron-Turing NLG on 11 October 2021, a 530-billion-parameter transformer language model. It was trained with DeepSpeed and Megatron-LM on 560 Nvidia DGX A100 servers, drawing largely on the Pile and Common Crawl web data.

  2. Microsoft licenses GPT-3 exclusively from OpenAI

    Microsoft announced a multiyear agreement on 22 September 2020 to license GPT-3 exclusively, letting it embed the model in its own products while OpenAI continued to sell GPT-3 to other customers through its own API. Azure already hosted OpenAI’s training supercomputer.