The applications of AI are becoming increasingly widespread in our daily lives. With the continuous iteration of generative AI and large language models, various innovative applications are emerging. These include, such as smart home appliances, autonomous vehicles, and robots to VR/AR applications.
These edge devices are equipped with AI processors that compute on the device directly, further accelerating the launch of innovative Edge AI applications. However, these devices also face several challenges, including excessive GPU power consumption and high costs limiting the widespread adoption of Edge AI products.
DEEPX, an AI chip startup from Korea, won three CES Innovation Awards 2024 in January for its unique AI chip ultra-gap source technology. The awards were in the categories of Computer Hardware, Embedded Technology, and Robotics, and Computer Hardware & components.
Their NPU processor boasts low power consumption and cost-effectiveness and addresses the issue of insufficient accuracy found in existing NPUs on the market. This technology was recognized by lots of semiconductor companies during CES 2024 and is scheduled for mass market release in late 2024.
Learn from ARM to build DEEPX into a leading On-device AI company
“The main battlegrounds in the AI era will move to the ‘edge’. Just as ARM dominated the CPU market with smartphones, the semiconductor company that dominates the edge will dominate the AI market,” DEEPX CEO Lokwon Kim said.
Kim, a former senior researcher in Apple’s Application Processor (AP) design, returned to South Korea to establish DEEPX after gaining extensive experience in semiconductor design at renowned companies like Broadcom, Cisco, and IBM T.J Watson. His goal is to build DEEPX into a leading AI company in the era of on-device AI, reminiscent of how ARM revolutionized the CPU market with its low-power technology.
On-device AI, which processes information within a mobile device without connecting to a server or cloud, is a burgeoning field. ARM broke Intel’s dominance in the CPU market with its efficient, low-power processors, which are now prevalent in smartphones and expanding into PCs and servers. Kim aspires for DEEPX to have a similar impact on the AI semiconductor industry.
Kim identified a weakness in Korea’s semiconductor ecosystem, particularly in system semiconductors. Drawing inspiration from Morris Chang, the founder of TSMC, who returned to Taiwan to establish a leading foundry after learning from the American semiconductor giant TI, Kim saw an opportunity to address these gaps in the South Korean market.
Chang predicted a demand-driven semiconductor market, leading to the creation of TSMC, which produces semiconductors on consignment. Similarly, Kim believes that the opening of the AI semiconductor market offers a chance for innovation and growth.
Democratizing AI Technology
Kim opposes the monopolization of AI semiconductor technology through strategic investments (SIs) that often lead to mergers, acquisitions, or alliances, resulting in technology being controlled by a single entity. His experience at Apple motivated him to advocate for more democratic and accessible AI semiconductor technology. He believes that AI semiconductors should be universally available and not restricted to proprietary use, emphasizing the importance of technology that everyone can utilize.
To pursue this vision, Kim established DEEPX in Pangyo, South Korea’s hub for fabless companies. He aims to create an AI semiconductor company with a unique value, promoting innovation over exclusivity.
DEEPX is positioned not as a competitor to global semiconductor giants but as a complementary force, enhancing the global semiconductor landscape by providing accessible and advanced AI technology.
Analyzing the Difference Between NPUs and GPUs: DEEPX’s Unique Solution
The necessity for developing specialized AI semiconductors, such as NPUs, stems from the limitations of GPUs, which have traditionally been used for AI computations. GPUs, originally designed to process graphic data, excel at handling large amounts of data simultaneously, making them suitable for AI learning tasks.
However, their high power consumption and operational costs present significant drawbacks. This makes them less ideal for “edge AI,” which involves running AI applications directly on devices like controllers, robots, and self-driving cars – collectively referred to as the “edge.”
NPUs (Neural Processing Units) are modeled after the human brain, offering the benefits of lower power consumption and reduced production costs. However, existing NPUs have struggled with accuracy and support for the latest AI algorithms. DEEPX stands out among fabless companies by addressing the core challenges of AI semiconductors in one comprehensive solution.
Unlike typical NPU vendors that release a single chip, DEEPX recognizes that different electronic devices require varying levels of semiconductor capabilities. For instance, AI for closed-circuit television (CCTV) primarily needs to analyze video, whereas AI for robots involves far more complex computations.
To address this, DEEPX has developed from low-end to high-end performance four chips at once: one that can connect a single electronic device for AI computations, and another that can link three or four devices for broader AI tasks. This universality across devices is a key reason DEEPX received the Innovation Award at CES 2024.
DEEPX’s commitment to high performance at lower power and cost also earned them the Innovation Award. The company’s latest AI algorithm, Yolo7, runs on their semiconductor DX-V1, produced using Samsung’s 28nm process.
This algorithm was previously incompatible with conventional NPUs. In addition, the DX-M1 chip boasts a design area one-third the size of other NPUs, and its manufacturing cost is similarly reduced by one-third. Combining low unit costs with high performance in a low-power NPU, DEEPX’s products are poised to lead the AI semiconductor market.
NPUs are categorized into data center-based NPUs, which handle large-scale inference, and edge-type NPUs, designed for use in electronic devices such as robots, smart cameras, smart factories, consumer electronics, etc. DEEPX targets both data center and edge NPU markets. DEEPX’s NPUs overcome the common shortcomings of existing NPUs by providing high accuracy and efficiency.
DEEPX’s innovation lies in creating NPUs that are not only small and cost-effective but also achieve accuracy comparable to, or even better than, GPUs. This success is attributed to DEEPX’s pioneering work in two core technologies: IQ8 (an INT8 model compression technology), and Smart Memory Access(minimizes D-RAM usage). DEEPX leads the market for low-power AI solutions, achieving the world’s highest power-to-performance ratio through proprietary advancements in hardware and software optimization.
Advancing Towards Mass Production
DEEPX has successfully demonstrated its original technology with sample units and is in the final stages of preparing its mass-production chip. Scheduled for market release in late 2024, the widespread adoption of products featuring DEEPX’s chips could establish the company as a technology leader in the on-device AI market by 2025.
The essence of on-device AI lies in low power consumption and the seamless integration of hardware and software. Since AI must operate on small devices, minimizing power consumption is crucial while maximizing AI performance within limited computing power.
Kim, drawing from his experience at Apple, emphasizes the importance of designing hardware and software with equal priority from the outset. Unlike Apple, which develops its own devices and services, DEEPX engaged with approximately 700 customers during product development to understand their needs and find the optimal development point. This customer-centric approach has been pivotal in refining DEEPX’s products.
Four companies from Israel and the U.S., including DEEPX, are vying for dominance in the emerging on-device AI market. As the market begins to flourish beyond the server market, this competition is crucial for setting future momentum.
Kim is confident in DEEPX’s strategy. He notes that while some competitors prioritize rapid product releases, DEEPX focuses on price and optimization first. Given the rapid evolution of AI application services, Kim believes it is more important to align with market trends and offer high-performance features at a competitive cost rather than rushing products to market.
DEEPX’s innovative approach to developing versatile, efficient, and cost-effective NPUs positions the company as a formidable contender in the on-device AI market. By prioritizing customer needs and maintaining a balanced focus on hardware and software optimization, DEEPX is set to lead the industry with cutting-edge AI semiconductor solutions.
DEEPX Company’s Philosophy: Valuing Technology Over Short-term Results
DEEPX is not focused on making AI semiconductors for autonomous cars or smartphones. Instead, DEEPX aims to advance the integration of AI into everyday life. The company’s products are designed to bring AI to areas such as CCTV and robots, pushing these technologies beyond outdated algorithms. DEEPX’s mission is to pioneer advancements that should have already been made in the AI semiconductor industry.
At the entrance of DEEPX, there is a note to employees that emphasizes the value of technology over monetary gains. It quotes Carl Sagan’s “pale blue dot,” reflecting the idea that life should be lived with value rather than chasing money and power. The message encourages the 70 employees to love their work and find it meaningful, aligning with the company’s ethos of creating technology for the greater good.
DEEPX believes in ‘technology that everyone shares.’ From a management perspective, AI is seen as one of humanity’s final inventions, marking the endpoint of human evolution. The goal is not to monopolize technology or chase profits but to lead the way in making AI accessible and beneficial for all. DEEPX’s AI semiconductors are the cornerstone of this vision, enabling widespread adoption of AI.
Future Plan: Global Expansion and Innovation
DEEPX’s visionary CEO, Kim, has outlined a strategic plan for the future:
– Global Market Entry: Starting from the second half of this year, DEEPX plans to aggressively enter the global market with its first-generation product, consisting of four AI chips. This move is set to usher in the era of “AI Everywhere.”
– Technological Innovation: DEEPX aims to develop new technologies that enable super-scale AI services with power consumption of less than 5W. This innovation will make advanced AI technologies more accessible and practical for widespread use.
– Leadership in AI: DEEPX is committed to becoming a leading comprehensive AI chip company globally. By focusing on power and cost efficiency, the company seeks to provide core technologies that transition giant AI advancements from the realm of science to everyday applications.
DEEPX’s mission is to integrate AI into everyday life, advancing technology in meaningful ways. By valuing innovation over profit and aiming for global leadership, DEEPX is set to play a pivotal role in the future of AI. The company’s commitment to shared technology and global expansion highlights its dedication to making AI accessible and beneficial for humanity.
News Source – Digitimes
