Edge AI: The Wait Is (Almost) Over, Says IDTechEx

Since introducing artificial intelligence to the data centre, it has been loath to leave it. With large tracts of floorspace dedicated to servers comprising leading-edge chips that can handle the computational demands for training the latest in AI models and inference via end-user connections to the cloud, data centres are the ideal environment for facilitating much of what AI offers.

And yet, over the past decade, AI has pushed steadily at the boundaries of the cloud computing environment to infiltrate the realm beyond.

The edge of the network, where users have immediate interaction with devices that do not necessarily rely on the cloud for computation, has been touted as something of the promised land for AI, where inclusion of accurate and somewhat autonomous AI – where devices are linked via Wi-Fi connectivity – would enable a true Internet of Things.

This has been the expectation for the best part of the decade, with the great Edge AI takeover still forthcoming. Instead, AI has slowly trickled into certain household devices and consumer electronics goods, with other applications yet to realize the full impact that AI has promised.

A recently released IDTechEx report notes that the production rollout of technology being developed by several AI chip start-ups targeting edge applications will see AI at the edge continue to grow substantially over the next ten years…albeit not with the exponential growth that a ‘boom’ would suggest.

The reasons behind the unconventional growth are multiple. Still, they fall under two categories: the saturation and stop-start nature of certain markets that have already employed AI architectures in their incumbent chipsets, and the second is where rigorous testing is necessary before high volume rollout of AI hardware. Under the first category, a key example is the smartphone market, which has already begun to saturate.

However, premiumization of smartphones continues (where the percentage share of total smartphones sold given over to premium smartphones is, year-on-year, increasing), where AI revenue increases as more premium smartphones are sold given that these smartphones incorporate AI coprocessing in their chipsets, it is expected that this will itself begin to saturate over the next ten years.

Under the second category, flagship automotive-grade System-on-Chips (SoCs) for Advanced Driver-Assistance Systems (ADAS) from Renesas, Qualcomm, and Mobileye are all planned to hit automotive manufacturers’ 2024/25 production lines. These systems allow for a minimum driving automation level (officially known as SAE level) three, allowing for situational automation where driver input is unnecessary in certain situations.

Further scaling of technology after rigorous testing will allow for further checkpoints in driving automation to be reached, with the adoption of increasing automation to occur in stages.

Only a matter of time now

Though the types of models that are employed at the edge will be, in the main, much simpler than those handled within data centres, due to the power constraints of edge devices, it is only a matter of time before even the simplest of AI functions – such as hands-free activation and actioning – comes as an added feature to a range of devices, particularly within the home.

IDTechEx has identified the Smart Home as one of the main beneficiaries of AI technology, with the potential to transform how we live and interact with our immediate surroundings.

IDTechEx report coverage

IDTechEx forecasts that the global AI chips market for edge devices will grow to US$22.0 billion by 2034. IDTechEx’s report analyses the key drivers for revenue growth in edge AI chips over the forecast period, with deployment within the key industry verticals – consumer electronics, industrial automation, and automotive – reviewed.

The report covers the global AI Chips market across eight industry verticals, with 10-year granular forecasts in six different categories (such as by geography, by chip architecture, and by application).

IDTechEx’s brand new report answers the major questions, challenges and opportunities faced by the edge AI chip value chain. The report explains the markets, players, technologies, opportunities, and challenges.