AtomicGPT: A domain-adapted large language model for secure on-premises applications in nuclear engineering

A nuclear-domain language model built by adapting open-weight LLMs (Gemma2-9B, Qwen2.5-7B, Exaone4-32B) for on-premises use in security-sensitive nuclear facilities

Nuclear Engineering and Technology 2026

Seungdon Yeom1,2, KyungTae Lim3,†, Yonggyun Yu1,2,†

1Korea Atomic Energy Research Institute (KAERI) 2Korea University of Science and Technology (UST) 3Korea Advanced Institute of Science and Technology (KAIST)

†Corresponding authors

Abstract

The specialized knowledge and strict data security requirements in nuclear engineering limit the direct application of cloud-based, general-purpose large language models. We introduce AtomicGPT, a secure, on-premises, nuclear domain-specific language model developed through domain adaptation of small-scale (Gemma2-9B, Qwen2.5-7B) and large-scale (Exaone4-32B) base models. We curated a two-track nuclear corpus: a public foundation corpus (29.1M tokens) and an extended private corpus (84.7M tokens) incorporating internal technical reports to enhance the domain expertise of the 32B model. Furthermore, we established a comprehensive benchmark suite comprising multiple-choice, short-answer, and descriptive tasks. AtomicGPT consistently outperformed its base models in improving factual accuracy and reducing observed hallucination-like errors. AtomicGPT-Gemma2-9B improved from 23 to 40 (+73.9% relative) on the multiple-choice benchmark. Leveraging the extended private corpus, AtomicGPT-Exaone4-32B achieved scores of 56 (multiple-choice), 34.50% (short-answer), and 8.21 (descriptive), surpassing GPT-4 (48, 31.29%, and 7.70) and remaining competitive with GPT-5-class models (GPT-5:59/33.76%/8.48; GPT-5.1:58/38.66%/8.58; GPT-5.2:74/39.38%/8.68). For security-critical nuclear facilities with restricted cloud access, targeted domain adaptation of on-premises models enables strong, domain-specific performance while maintaining strict data security. This study contributes to the application of natural language processing in nuclear engineering and provides empirical evidence for the feasibility of deploying domain-adapted LLMs in heavily regulated and security-sensitive environments.

Keywords Nuclear engineering LLM Domain adaptation On-premises / air-gapped LLM Data security Domain-specific corpus Nuclear QA benchmark Hallucination reduction Gemma2 / Qwen2.5 / Exaone4

Main Findings

As stated in the published abstract:

  • Two-track nuclear corpus. A public foundation corpus of 29.1M tokens, plus an extended private corpus of 84.7M tokens that adds internal technical reports, used for the 32B model.
  • Consistent gains over base models. AtomicGPT-Gemma2-9B improved from 23 to 40 (+73.9% relative) on the multiple-choice benchmark.
  • Above GPT-4 on-premises. AtomicGPT-Exaone4-32B scored 56 (multiple-choice), 34.50% (short-answer), and 8.21 (descriptive), versus 48, 31.29%, and 7.70 for GPT-4.
  • Competitive with GPT-5-class models. GPT-5: 59 / 33.76% / 8.48; GPT-5.1: 58 / 38.66% / 8.58; GPT-5.2: 74 / 39.38% / 8.68 (multiple-choice / short-answer / descriptive).

BibTeX

@article{Yeom_2026,
  title={AtomicGPT: A domain-adapted large language model for secure on-premises applications in nuclear engineering},
  volume={58},
  ISSN={1738-5733},
  url={http://dx.doi.org/10.1016/j.net.2026.104565},
  DOI={10.1016/j.net.2026.104565},
  number={12},
  journal={Nuclear Engineering and Technology},
  publisher={Elsevier BV},
  author={Yeom, Seungdon and Lim, KyungTae and Yu, Yonggyun},
  year={2026},
  month=Dec,
  pages={104565}
}
More projects from KAIST MLP Lab →