Evaluation of classification task for inappropriate sentences in SNS using ChatGPT

Abstract

In this report, we evaluate classification tasks for inappropriate sentences in SNS using ChatGPT. It is shown that only prompts including Zero-shot CoT and Few-shot learning do not result in high performance compared with a fine-tuned BERT model. Our result also shows that a fine-tuned ChatGPT achieves an accuracy of over 90%, which is comparable in performance to BERT.