Olmo 3

Olmo 3

Ai2
PanGu-Σ

PanGu-Σ

Huawei
+
+

Related Products

  • Ango Hub
    15 Ratings
    Visit Website
  • Nexo
    16,530 Ratings
    Visit Website
  • Google Cloud Speech-to-Text
    355 Ratings
    Visit Website
  • Vertex AI
    961 Ratings
    Visit Website
  • Partful
    20 Ratings
    Visit Website
  • PackageX OCR Scanning
    46 Ratings
    Visit Website
  • Interfacing Integrated Management System (IMS)
    71 Ratings
    Visit Website
  • Google Cloud BigQuery
    2,008 Ratings
    Visit Website
  • Sevocity EHR
    192 Ratings
    Visit Website
  • RunPod
    205 Ratings
    Visit Website

About

Olmo 3 is a fully open model family spanning 7 billion and 32 billion parameter variants that delivers not only high-performing base, reasoning, instruction, and reinforcement-learning models, but also exposure of the entire model flow, including raw training data, intermediate checkpoints, training code, long-context support (65,536 token window), and provenance tooling. Starting with the Dolma 3 dataset (≈9 trillion tokens) and its disciplined mix of web text, scientific PDFs, code, and long-form documents, the pre-training, mid-training, and long-context phases shape the base models, which are then post-trained via supervised fine-tuning, direct preference optimisation, and RL with verifiable rewards to yield the Think and Instruct variants. The 32 B Think model is described as the strongest fully open reasoning model to date, competitively close to closed-weight peers in math, code, and complex reasoning.

About

Significant advancements in the field of natural language processing, understanding, and generation have been achieved through the expansion of large language models. This study introduces a system which utilizes Ascend 910 AI processors and the MindSpore framework to train a language model with over a trillion parameters, specifically 1.085T, named PanGu-{\Sigma}. This model, which builds upon the foundation laid by PanGu-{\alpha}, takes the traditionally dense Transformer model and transforms it into a sparse one using a concept known as Random Routed Experts (RRE). The model was efficiently trained on a dataset of 329 billion tokens using a technique called Expert Computation and Storage Separation (ECSS), leading to a 6.3-fold increase in training throughput via heterogeneous computing. Experimentation indicates that PanGu-{\Sigma} sets a new standard in zero-shot learning for various downstream Chinese NLP tasks.

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Platforms Supported

Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook

Audience

AI researchers, developers and enterprises needing a tool offering foundation models to inspect, fine-tune or deploy with full provenance and auditability

Audience

AI developers

Support

Phone Support
24/7 Live Support
Online

Support

Phone Support
24/7 Live Support
Online

API

Offers API

API

Offers API

Screenshots and Videos

Screenshots and Videos

No images available

Pricing

Free
Free Version
Free Trial

Pricing

No information available.
Free Version
Free Trial

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Reviews/Ratings

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Training

Documentation
Webinars
Live Online
In Person

Training

Documentation
Webinars
Live Online
In Person

Company Information

Ai2
Founded: 2014
United States
allenai.org/blog/olmo3

Company Information

Huawei
Founded: 1987
China
huawei.com

Alternatives

Qwen3-Max

Qwen3-Max

Alibaba

Alternatives

LTM-1

LTM-1

Magic AI
MiniMax M1

MiniMax M1

MiniMax
PanGu-α

PanGu-α

Huawei
GLM-5

GLM-5

Zhipu AI
DeepSeek-V2

DeepSeek-V2

DeepSeek
DeepSeek-V3.2

DeepSeek-V3.2

DeepSeek
VideoPoet

VideoPoet

Google

Categories

Categories

Integrations

PanGu Chat

Integrations

PanGu Chat
Claim Olmo 3 and update features and information
Claim Olmo 3 and update features and information
Claim PanGu-Σ and update features and information
Claim PanGu-Σ and update features and information