KT announced that its self-developed AI model routing technology, the AutoModelRouter, has achieved second place in the overall ranking on the RouterArena, a public benchmark for large language model (LLM) routers, on September 27.
RouterArena is an evaluation platform for LLM routers developed by researchers at Rice University in the United States. It assesses AI routers based on response accuracy, cost efficiency, and robustness to input variations using approximately 8,400 queries.
The AutoModelRouter is listed on the public leaderboard under the name KT-ModelRouter, where it secured second place in the accuracy and cost evaluation category, known as the Acc-Cost Arena.
KT explained that the AutoModelRouter is designed to meet the quality standards required by businesses while enhancing cost efficiency. For instance, it utilizes models that meet necessary quality standards for relatively simple tasks like translation and information verification, while connecting to high-performance models for tasks requiring specialized analysis or advanced reasoning. Users access a single AI service, but different models are employed based on the nature of the requests.
This AutoModelRouter will also be utilized in KT's Token Factory model routing feature, aimed at optimizing AI service quality and reducing token usage costs.
Looking ahead, KT plans to continuously enhance the AutoModelRouter and establish a multi-model operating environment that allows for the flexible addition of new AI models.
Kim Jun-seok, head of KT's Agentic AI Lab, stated, "In the AI era, it is crucial not only to secure the best single model but also to intelligently utilize the optimal model suited for each situation. The AutoModelRouter embodies our AI orchestration capabilities and will be a core technology supporting KT's competitive edge in agentic AI services."
Additionally, KT plans to apply this model routing approach to the government's upcoming 'Everyone's AI' service, which is set to launch a beta version in October.
* This article has been translated by AI.
Copyright ⓒ Aju Press All rights reserved.