Transformer is a show

时间:2021-06-23 17:09:37   收藏:0   阅读:0
Transformer model is so powerful, and here I try to make it colorful, by interpreting it with a metaphor: Encoder = Stage Show, Decoder = Oscar Award Assessment
 
In this new perspective, we see the Decoder process as performing a stage show, and the Decoder process is just like the Oscar Award Committee assessing the show.
 
Below is the graph and interpretation:
技术图片
 
 
Part 1: Encoder = Stage Show
 
Phase:
P1. Ideas -> Conceiving_Story -> Script
P2. Script Interpretation -> Rehearsal -> Adjustment
P3. Crew Discussion -> Adjustment
P4. Repeat P2 - P3 to practice N rounds
P5. Real Show Performing
 
Pseudo code:

 


Part 2: Decoder = Oscar Award Assessment
 
Phase:
P1. Rumors -> Dig into the story
P2. Ask Questions -> Adjustment
P3. Watch the Show & Answer the Questions -> Adjustment
P4. Assessment Discussion -> Adjustment
P5. Repeat P2 - P4 to assess N rounds
P6. Voting -> Oscar Awards Ceremony
 
Pseudo code:

 


Part 3: Summary
 
What making the transformer special comparing to other models, is just like the reason why stage show is different with a film:
 
For stage show, all acts can be performed together at the same time as long as the imagination as well as the stage is big enough, whereas a film is a fixed time sequence that can be only played one screen at a time.
 
Transformer is like a show, attention is all you need.
 
评论(0)
© 2014 mamicode.com 版权所有 京ICP备13008772号-2  联系我们:gaon5@hotmail.com
迷上了代码!