Proceedings of the Annual Conference of JSAI
Online ISSN : 2758-7347
37th (2023)
Session ID : 2E4-GS-6-04
Conference information

Natural language processing with deep learning: Principles, limitations, and challenges
*Kazutoshi KANMitsuo YOSHIDA
Author information
CONFERENCE PROCEEDINGS FREE ACCESS

Details
Abstract

Deep learning for natural language processing (NLP) outperforms traditional approaches in many tasks. High-performing deep learning models are realized by proficiently combining techniques in model architecture such as attention mechanisms. Open-access large scale pre-trained models and easier pipeline construction based on End-to-End learning have lowered barriers to develop such models. The practice of academia to share fundamental language resources such as morphological analysis tools and linguistic datasets as well as the relaxation of copyright on automatic collection of text data also encourage research and development of models for NLP. In real businesses, ethical considerations are required to ensure that models do not output harmful expressions. However, such consideration suitable for everyone is difficult to achieve because there are no universal norms in ethics. In addition, the performance of deep learning models has uncertainty in principle. Furthermore, the security risks specific to machine learning models should also be noted.

Content from these authors
© 2023 The Japanese Society for Artificial Intelligence
Previous article Next article
feedback
Top