Microsoft AI details MAI-Base-2, a 2.8-trillion-parameter model trained in-house
Trained on 16k GB200 GPUs over 38 days, it was compared on held-out bits-per-byte with open-weight models only; Microsoft plans to licence the weights through Foundry.
Microsoft, DeepSeekModels & capabilities · Compute & infrastructure