Recomendation: Please visit reading section first to understand the basic theories
Visit Now
X
DoTLMViz
Generate
Clear
Example
Detailed
Overview
Tokens
GPT-2 Small
Embedding
Token Embedding
Positional Embedding
Transformer Blocks
x12
Language Modeling Head
LayerNorm
Unembedding
Control Parameters
Top p
Top k
Temper.
-2
2
0
Top K
1
10
0
Output Distribution
Enter Something.
Next Token: