Verification and Consideration for Utilization of Large Language Models in Civil Engineering

Abstract

In this study, we verified the accuracy of large language models (ChatGPT) using a database system containing texts in the field of civil engineering. As a result, we confirmed the effectiveness of a extraction task of similar technologies and dialogue task based on the database system operation rules within the validated range. We also confirmed the superiority of prompts based on few-shot-learning in the task of categorizing new technology information. In addition, we confirmed the superiority of prompts created using only job descriptions as personas in the same task.