The Regularizer

Models Providers Benchmarks Blog

•

The Regularizer

Your comprehensive resource for AI model information, benchmarks, and comparisons.

Quick Links

Models
Providers
Blog

About

The Regularizer is a platform dedicated to tracking and comparing AI models and their capabilities.

© 2025 The Regularizer. All rights reserved.

← Back to Models

Commercial

Apache 2.0

open-source

GPT-NeoX-20B

EleutherAI•Released Feb 10, 2022•Updated May 4, 2025

Description

A 20B-parameter open-source model trained by EleutherAI on the Pile, released in 2022:contentReference[oaicite:24]{index=24}.

Technical Specifications

Parameters

20

Context Length

2.0K

Architecture

GPT-NeoX-20B is an autoregressive, decoder-only transformer model with 20 billion parameters, based on the Megatron architecture.

Score

4.9

Typical Use Cases

Few-shot reasoning tasks
Language understanding
Mathematics
Knowledge-based tasks

Model Information

Type

Commercial

License

Apache 2.0

Category

open-source

Release Date

Feb 10, 2022

Provider Website