sampling fine-tuning Attention-UNet
sampling based JAX implementation for model reward.
- Input
- 3229-dim embedding
- Encoder
- 60 x Attention-UNet with 30 heads
- Output
- accuracy projection
Training config
optimizer=NAdam, lr=0.119, scheduler=cosine, warmup=863