Upstage has partnered with AI semiconductor company FuriosaAI to introduce a domestic full-stack Sovereign AI service on the portal Daum. The service operates Upstage's large language model (LLM) on Furiosa's AI neural processing unit (NPU) and applies it to Daum's 'AI Overview' service. This collaboration showcases the potential for self-sufficiency in domestic AI technology by integrating local AI semiconductors, models, and portal services.
On July 15, Upstage CEO Kim Seong-hoon, FuriosaAI CEO Baek Jun-ho, and AXZ CEO Lee Geon-soo held an online discussion to present the 'AI Overview' service they developed together. They also discussed future collaboration plans, including Daum's agent AI initiatives.
The AI Overview service runs Upstage's LLM Solar on FuriosaAI's NPU Renegade. Unlike traditional search methods where users must click through multiple links to find information, this AI reads documents first and summarizes key points. Daum began a pilot service for AI Overview on July 1.
Lee Geon-soo explained that the AI Overview is specialized in handling the latest information based on real-time data. He noted that while Google has started offering AI-generated summary answers at the top of search results, Daum focuses on retrieving the most current information from its partnerships with media outlets, cafes, and Tistory.
Currently, the AI Overview utilizes approximately 24 chips across three server nodes, processing around 500 million tokens daily. Lee stated, "We have implemented a 'hybrid search' that combines keyword and vector search methods to retrieve the latest information," adding that they are working to address hallucination issues that arise during the summarization process through robust harness engineering.
Baek Jun-ho highlighted the cost and power efficiency of the Renegade as a key strength. He explained that optimizing frontier models like Solar requires careful adjustments, and FuriosaAI has developed a compiler that efficiently converts AI models and a serving engine tailored to various service scenarios.
The three companies plan to continue their collaboration through Daum's agent AI services. Following the AI Overview, Daum aims to expand into vertical AI services for shopping and dining, with a goal of promoting 'one agent per person.' Currently, AI Overview is exposed to about 20% of all search queries on Daum, with plans to increase this share to over half in the future.
Daum's AI agents are expected to actively reflect real-time trends and the latest information from the AI Overview. As search trends evolve following the introduction of Daum's real-time trend service, they aim to create personalized agents based on user interests.
Lee noted, "Recently, the top real-time search trend was 'Samsung Electronics stock,'" adding, "We will create agents that deliver necessary information to each user without them having to search daily for Samsung's stock or related news about competitors."
FuriosaAI plans to continue expanding its solutions and products to support optimal token costs and performance for Daum's AI Overview and agent AI services.
Kim emphasized, "Using AI Overview on the Daum portal means leveraging both Upstage's Solar and FuriosaAI's NPU. We need to create a virtuous cycle where the use of domestic AI models and infrastructure increases, thereby enhancing quality."
* This article has been translated by AI.
Copyright ⓒ Aju Press All rights reserved.