Gefen Optimizer Release

Gefen is a new optimizer that claims to be a drop-in replacement for AdamW, with an 8x memory reduction in training. It is available on GitHub and has a corresponding paper on arXiv.

One continuously updated timeline instead of dozens of separate articles. New developments are appended as the story evolves.

1. ReleaseJun 24, 2026, 08:39 PM 73%

   Gefen optimizer released as drop-in replacement for AdamW with 8x memory reduction

   Gefen is a new optimizer that claims to be a drop-in replacement for AdamW, with an 8x memory reduction in training. It is available on GitHub and has a corresponding paper on arXiv.

   Read the full story →