Skip to content

Home Search Authors Pakistan News Saved

SciRah

SciRah does not host or store research papers. Results come live from free, official scholarly APIs, and every paper links back to its original source.

Data sources

OpenAlex
Semantic Scholar
Crossref
CORE
arXiv
PubMed

Privacy policy Terms of service

Improving Transformer Optimization Through Better Initialization · SciRah

conference paper

Improving Transformer Optimization Through Better Initialization

Xiao Shi Huang^a, Juan Manuel Pérez^a, Jimmy Lei Ba^b, Maksims Volkovs^a

^aLayer6 AI
^bUniversity of Toronto

International Conference on Machine Learning2020-07-12 57 citations26 references

Looking for the full paper…

Share

Improving Transformer Optimization Through Better Initialization

Export

PDF Details, abstract & AI summary Word (.docx) Editable document One-slide summary Image or PDF for presentations

Papers open inside SciRah from the original publisher or repository; SciRah never hosts them.

Abstract

No abstract is available from our sources. Use “Read paper” to view it.

Plain-language summary

Discussion

Published in

International Conference on Machine Learning →

Topics

Topic Modeling Advanced Neural Network Applications Stochastic Gradient Optimization Techniques

Identifiers

OpenAlex: W3035618017

Metadata from OpenAlex.