Reproduction detail

Transformer Translation Reproduction

Author: Ashish Vaswani et al.

Reproduced baseline Transformer with aligned hyper-parameters and checkpoints.

A clean-room reproduction of the Transformer baseline for machine translation with aligned training settings and ablation notes.

Mar 7, 20263 content blocks1 PDF1 Video
TransformerNLPSequence Modeling
Transformer Translation Reproduction

Reproduction setup

Reimplemented the training pipeline and reproduced key BLEU scores with comparable settings.

Experiment Report

Scrollable preview
Open original PDF

Training Walkthrough