KT is introducing 'Token Factory,' a platform that allows users to manage over 500 domestic and international artificial intelligence (AI) models, including usage and cost management. The company aims to leverage its expertise in connectivity, billing, and security from the telecommunications sector to address the demand for AI transformation (AX).
On October 27, KT unveiled the AI platform 'KT Token Factory' at a press conference held at the Gwanghwamun West Building in Jongno, Seoul. The service is set to launch on October 30. Initially, it will cater to corporate clients looking to efficiently manage costs while utilizing various AI models, with plans to expand into the consumer market in the future.
According to KT, Token Factory is a comprehensive platform that handles everything from selecting AI models to subscription, usage tracking, cost management, and payment. It allows businesses to choose models based on their operational needs, quality requirements, costs, and security levels, reducing the burden of managing multiple models separately.
The platform's key features include automatic model selection and cost reduction. KT's proprietary 'Auto Model Router' evaluates question types, difficulty levels, quality requirements, and costs to select the most suitable model. Lightweight models are used for simple tasks, while high-performance models are applied for complex analyses. KT reported that this technology achieved the top ranking in the global benchmark 'RouterArena.'
Token compression technology has also been implemented to reduce the number of tokens used when inputting questions. This technology reflects the characteristics of the Korean language and minimizes unnecessary repetitions while maintaining the meaning of questions and the quality of responses. KT stated, "We expect to reduce token usage by up to 25%."
Data security is ensured through inference services utilizing domestic infrastructure. KT plans to support inference with its own AI models and open-weight models from both domestic and international sources, addressing concerns over data sovereignty associated with overseas AI services.
The platform also incorporates guardrail technology to check the input and output of AI. It verifies whether user-submitted questions contain personal or sensitive information and reviews the AI-generated responses. In the future, KT plans to enhance this functionality to allow for more precise settings based on individual customer environments and security requirements.
To secure models, KT is collaborating with the global AI model brokerage platform 'OpenRouter,' which has provided access to over 500 global AI models. The two companies plan to integrate OpenRouter's global models with KT's domestic infrastructure and sovereign AI models. KT is also pursuing ways to distribute its domestic AI models internationally.
KT is expanding its partnerships with various companies, including domestic and international specialists such as Euracle, CAST AI, and Typely, as well as participants in the 'Everyone's AI' consortium, to build a robust partner ecosystem.
Park Sang-won, head of KT's AX division, stated, "The AI market is rapidly evolving into a competition over who can support easier and more efficient AI utilization. Based on Token Factory, which expands our capabilities in connectivity, billing, and protection from the telecommunications business, KT will support customer AX transformation and develop it into a core platform."
* This article has been translated by AI.
Copyright ⓒ Aju Press All rights reserved.