P. Jin, Y. Zhang, X. Chen, and Y. Xia, Bag-of-embeddings for text classification, IJCAI, vol.16, pp.2824-2830, 2016.

G. Zhou, T. He, J. Zhao, and P. Hu, Learning Continuous Word Embedding with Metadata for Question Retrieval in Community Question Answering, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), vol.1, pp.250-259, 2015.

X. Ye, H. Shen, X. Ma, R. Bunescu, and C. Liu, From word embeddings to document similarities for improved information retrieval in software engineering, Proceedings of the 38th International Conference on Software Engineering - ICSE '16, pp.404-415, 2016.

Y. Liu, M. Ott, N. Goyal, J. Du, M. Joshi et al., Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

B. Tom-b-brown, N. Mann, M. Ryder, J. Subbiah, P. Kaplan et al., Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

M. Emily, A. Bender, and . Koller, Climbing towards nlu: On meaning, form, and understanding in the age of data, Proc. of ACL, 2020.

S. Zellig and . Harris, Distributional structure. Word, vol.10, issue.2-3, pp.146-162, 1954.

J. R. Firth, Studies in Linguistic Analysis: Special Volume of the Philosogical Society. Special Volume of the Philological Society, 1957.

G. Wen-tau-yih, J. Zweig, and . Platt, Polarity inducing latent semantic analysis, Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, pp.1212-1222, 2012.

M. Yu and M. Dredze, Improving Lexical Embeddings with Semantic Knowledge, Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), vol.2, pp.545-550, 2014.

J. Bian, B. Gao, and T. Liu, Knowledge-Powered Deep Learning for Word Embedding, Machine Learning and Knowledge Discovery in Databases, pp.132-148, 2014.

C. Xu, Y. Bai, J. Bian, B. Gao, G. Wang et al., RC-NET, Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management - CIKM '14, pp.1219-1228, 2014.

D. Fried and K. Duh, Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

M. Faruqui, J. Dodge, S. K. Jauhar, C. Dyer, E. Hovy et al., Retrofitting Word Vectors to Semantic Lexicons, Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2015.

N. Mrk?i?, D. Ó-séaghdha, B. Thomson, M. Ga?i?, L. M. Rojas-barahona et al., Counter-fitting Word Vectors to Linguistic Constraints, Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, 2016.

J. Goikoetxea, E. Agirre, and A. Soroa, Single or multiple? combining word representations independently learned from text and wordnet, AAAI, pp.2608-2614, 2016.

I. Vuli?, R. Schwartz, A. Rappoport, R. Reichart, and A. Korhonen, Automatic Selection of Context Configurations for Improved Class-Specific Word Representations, Proceedings of the 21st Conference on Computational Natural Language Learning (CoNLL 2017), 2017.

E. Matthew, M. Peters, M. Neumann, M. Iyyer, C. Gardner et al., Deep contextualized word representations, 2018.

J. Devlin, M. Chang, K. Lee, and K. T. Bert, Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

W. Shi, M. Chen, P. Zhou, and K. Chang, Retrofitting Contextualized Word Embeddings with Paraphrases, Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019.

B. Chiu, S. Baker, M. Palmer, and A. Korhonen, Enhancing biomedical word embeddings by retrofitting to verb clusters, Proceedings of the 18th BioNLP Workshop and Shared Task, pp.125-134, 2019.

J. Pennington, R. Socher, and C. Manning, Glove: Global Vectors for Word Representation, Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.1532-1543, 2014.

A. Akbik, T. Bergmann, D. Blythe, K. Rasul, S. Schweter et al., Proceedings of the 2019 Conference of the North, pp.1638-1649, 2019.

Y. Zhu, R. Kiros, R. Zemel, R. Salakhutdinov, R. Urtasun et al., Aligning Books and Movies: Towards Story-Like Visual Explanations by Watching Movies and Reading Books, 2015 IEEE International Conference on Computer Vision (ICCV), pp.19-27, 2015.

S. Nagel, Zoology: Worm can crawl out of predators, Science News, vol.169, issue.16, pp.252-252, 2006.

A. Gokaslan and V. Cohen, Openwebtext corpus, 2019.

H. Trieu, Q. Trinh, and . Le, Preprint repository arXiv achieves milestone million uploads, Physics Today, 2014.

R. Misra, SPIN News: Special edition 2005-06 school year, 2005.

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion et al., Scikit-learn: Machine learning in python. the, Journal of machine Learning research, vol.12, pp.2825-2830, 2011.
URL : https://hal.archives-ouvertes.fr/hal-00650905