The Regularizer
ModelsProvidersBenchmarksBlog
•

The Regularizer

Your comprehensive resource for AI model information, benchmarks, and comparisons.

Quick Links

  • Models
  • Providers
  • Blog

About

The Regularizer is a platform dedicated to tracking and comparing AI models and their capabilities.

© 2025 The Regularizer. All rights reserved.

← Back to Models
Commercial
MIT
open-source

GPT-1

OpenAI•Released Jun 1, 2018•Updated May 4, 2025

Description

First Generative Pre-trained Transformer model, a decoder-only transformer pretrained on books corpora:contentReference[oaicite:0]{index=0}.

Technical Specifications

0
Context Length
1.0K
Architecture
12-layer decoder-only transformer with 12 masked self-attention heads, each with 64-dimensional states, totaling 768 dimensions
Score
0.0

Typical Use Cases

  • Language modeling
  • Machine translation
  • Text summarization
  • Question answering

Model Information

Type
Commercial
License
MIT
Category
open-source
Release Date
Jun 1, 2018
Provider Website
Visit Website