Samip

Noise opens a speedrun for transformer pretraining without backpropagation

Noise provides an open speedrun for improving pretraining without backpropagation, following the team's Dust work on zeroth-order optimization.