Evaluation of the Retrieval-Augmented Generation using Knowledge Graphs

Abstract

Consistency in category classification is essential for federated search. Consistent categorization through LLM could serve as a potential solution. RAG is utilized to enable LLM to process information based on external knowledge. However, when the information source for classification is a KG, it is not clear what adjustments are effective. In this study, we attempt RAG utilizing a KG as the information source and aim to reveal its effectiveness and limitations.