Skip to Main content Skip to Navigation
Journal articles

Le modèle Transformer: un « couteau suisse » pour le traitement automatique des langues

François yvon 1 
1 TLP - Traitement du Langage Parlé
LISN - Laboratoire Interdisciplinaire des Sciences du Numérique, STL - Sciences et Technologies des Langues
Abstract : This paper presents an overview of the state of the art in natural language processing, exploring one specific computational architecture, the Transformer model, which plays a central role in a wide range of applications. This architecture condenses many advances in neural learning methods and can be exploited in many ways : to learn representations for linguistic entities ; to generate coherent utterances and answer questions; to perform utterance transformations, an illustration being their automatic translation. These different facets of the architecture will be successively presented, which will also allow us to discuss its limitations.
Document type :
Journal articles
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03619077
Contributor : François Yvon Connect in order to contact the contributor
Submitted on : Thursday, March 24, 2022 - 6:19:27 PM
Last modification on : Friday, April 1, 2022 - 3:28:03 AM
Long-term archiving on: : Saturday, June 25, 2022 - 7:54:38 PM

File

 Restricted access
To satisfy the distribution rights of the publisher, the document is embargoed until : 2022-09-24

Please log in to resquest access to the document

Licence

Copyright

Identifiers

Citation

François yvon. Le modèle Transformer: un « couteau suisse » pour le traitement automatique des langues. Techniques de l'Ingenieur, Techniques de l'ingénieur, 2022, ⟨10.51257/a-v1-in195⟩. ⟨hal-03619077⟩

Share

Metrics

Record views

36