Discovering and enacting the path to safe artificial general intelligence.

We’ve trained an autoregressive language model with 175 billion parameters.

We find that, just as a large transformer model trained on language can generate coherent text, the same exact model trained on pixel sequences can generate coherent image completions and samples.