Development trends of large language models and a study for their use

Abstract

The development of large language models has been remarkable, with models comparable to OpenAI's GPT-4 being announced by various companies. Additionally, the trend towards multimodal capabilities is progressing, with models like GPT-4V(ision) that handle image input and GPT-4o with enhanced image comprehension. This paper reviews the technical trends of large language models and examines their use cases in the medical and civil engineering fields. Furthermore, as a method to incorporate specialized knowledge in civil engineering, we have organized the mechanisms and challenges of RAG, which is currently considered to be cost-effective. Based on the implementation results of RAG, we have identified the challenges of how to integrate domain-specific knowledge into workflows as a knowledge platform.