바로가기메뉴

본문 바로가기 주메뉴 바로가기
 

Journal Of Korean Biblia Society for Library and Information Science

  • P-ISSN1229-2435
  • E-ISSN2799-4767
  • KCI

A Comparative Study of Automatic Bibliographic Metadata Generation Performance: Focusing on Domestic and International Large Language Models (LLMs)

Journal Of Korean Biblia Society for Library and Information Science / Journal Of Korean Biblia Society for Library and Information Science, (P)1229-2435; (E)2799-4767
2025, v.36 no.4, pp.303-331
https://doi.org/10.14699//kbiblia.2025.36.4.303
SeonWook Kim
Hyekyung Lee

Abstract

This study aims to examine the feasibility of using domestic sovereign AI models and global large language models (LLMs) for automated creation of library metadata by comparing their performance in MARC record generation. To this end, six generative AI models (GPT, Gemini, Grok, HyperCLOVA, EXAONE, and A.X) were used to generate MARC records for 40 domestic and foreign monographs, and their field-level performance was evaluated using three criteria: completeness, correctness, and rule compliance. The analysis showed, first, that the three global LLMs (GPT, Gemini, Grok) generally outperformed domestic sovereign AI models, with fewer missing fields and more stable handling of formal elements such as indicators and codes. However, their performance tended to decline when the cataloguing target shifted from English-language to Korean books, as errors increased in field configuration and statement of responsibility. Second, the domestic sovereign AI models (HyperCLOVA, EXAONE, A.X) exhibited relatively low overall performance in both MARC21 and KORMARC, and did not show clear performance gains even for Korean books. Third, at the field level, most models generated relatively stable results for title and statement of responsibility (245), whereas rule-dependent fields such as series statements (490/830) and the choice of main entry showed large performance gaps between models and revealed structural misunderstandings of cataloguing rules for example, mechanically transferring MARC21 practices for series treatment to KORMARC. These findings suggest that, at present, generative AI should be introduced into library metadata workflows primarily as an assistive tool for generating draft records and supporting error detection and correction, rather than as a fully automated cataloguing system. The results also indicate that, in order to ensure stable performance of domestic sovereign AI models, systematic training on Korean bibliographic data, including KORMARC records, is required. Furthermore, the careful selection and curation of training data emerges as a key task in building sovereign AI systems for library applications.

keywords
Generative AI, Sovereign AI, Automatic Metadata Generation, Korean Machine Readable Cataloging Format, KORMARC, MARC21
Received
2025-11-24
Revised
2025-11-25
Accepted
2025-12-08
Published
2025-12-30

Journal Of Korean Biblia Society for Library and Information Science