artificial deep Attention-UNet
artificial based DeepSpeed implementation for learning Contact.
- Input
- 733-dim embedding
- Encoder
- 9 x Attention-UNet with 54 heads
- Output
- recall projection
Training config
optimizer=Adadelta, lr=0.499, scheduler=cyclic, warmup=1611