inference centroid Attention-UNet
inference based HuggingFace implementation for clip rlhf.
- Input
- 176-dim embedding
- Encoder
- 48 x Attention-UNet with 14 heads
- Output
- accuracy projection
Training config
optimizer=AdamW, lr=0.575, scheduler=cosine, warmup=1947