Publications of Torsten Hoefler

Maciej Besta, Lorenzo Paleari, Jia Hao Andrea Jiang, Robert Gerstenberger, You Wu, Jón Gunnar Hannesson, Patrick Iff, Ales Kubicek, Piotr Nyczyk, Diana Khimey, Nils Blach, Haiqiang Zhang, Tao Zhang, Peiran Ma, Grzegorz Kwaśniewski, Marcin Copik, Hubert Niewiadomski, Torsten Hoefler:

Affordable AI Assistants with Knowledge Graph of Thoughts

(arXiv:2504.02670. Jul. 2025)

Abstract

Large Language Models (LLMs) are revolutionizing the development of AI assistants capable of performing diverse tasks across domains. However, current state-of-the-art LLM-driven agents face significant challenges, including high operational costs and limited success rates on complex benchmarks like GAIA. To address these issues, we propose Knowledge Graph of Thoughts (KGoT), an innovative AI assistant architecture that integrates LLM reasoning with dynamically constructed knowledge graphs (KGs). KGoT extracts and structures task-relevant knowledge into a dynamic KG representation, iteratively enhanced through external tools such as math solvers, web crawlers, and Python scripts. Such structured representation of task-relevant knowledge enables low-cost models to solve complex tasks effectively while also minimizing bias and noise. For example, KGoT achieves a 29% improvement in task success rates on the GAIA benchmark compared to Hugging Face Agents with GPT-4o mini. Moreover, harnessing a smaller model dramatically reduces operational costs by over 36x compared to GPT-4o. Improvements for other models (e.g., Qwen2.5-32B and Deepseek-R1-70B) and benchmarks (e.g., SimpleQA) are similar. KGoT offers a scalable, affordable, versatile, and high-performing solution for AI assistants.

Documents

download article:

BibTeX

@article{besta2025affordable,
  author={Maciej Besta and Lorenzo Paleari and Jia Hao Andrea Jiang and Robert Gerstenberger and You Wu and Jón Gunnar Hannesson and Patrick Iff and Ales Kubicek and Piotr Nyczyk and Diana Khimey and Nils Blach and Haiqiang Zhang and Tao Zhang and Peiran Ma and Grzegorz Kwaśniewski and Marcin Copik and Hubert Niewiadomski and Torsten Hoefler},
  title={{Affordable AI Assistants with Knowledge Graph of Thoughts}},
  journal={arXiv:2504.02670},
  year={2025},
  month={Jul.},
  source={http://www.unixer.de/~htor/publications/},
}


serving: 216.73.216.217:25787	© Torsten Hoefler