beam-search top-p Diffusion
beam-search based TensorFlow implementation for matrix reinforcement.
- Input
- 6559-dim embedding
- Encoder
- 23 x Diffusion with 32 heads
- Output
- accuracy projection
Training config
optimizer=AdamW, lr=0.278, scheduler=plateau, warmup=896