NVIDIA P100 Hardware. Appearances in this wiki NIPS-2017-attention-is-all-you-need-Paper — Specific GPU model cited as the hardware used for training the large model variants.