Qualcomm desires its Snapdragon chips to be on the coronary heart of the on-device synthetic intelligence motion, saying that its latest-generation cellular platform can generate a picture utilizing Steady Diffusion in beneath a second.
“We’re coming into the period of AI, and on-device generative AI will play a essential function in delivering highly effective, quick, private, environment friendly, safe and extremely optimized experiences,” claims Qualcomm’s chief government officer Cristiano Amon of his firm’s focus. “Snapdragon is uniquely positioned to assist form and capitalize on the on-device AI alternative and you will notice generative AI going nearly all over the place that Snapdragon goes.”
Key to the corporate’s hope of driving a future the place giant language fashions (LLMs) and different synthetic intelligence programs run on-device with out counting on cloud computing is the Snapdragon 8 Gen. 3 platform. Boasting “probably the most highly effective NPU [Neural Processing Unit]” the corporate has but launched, the mobile-centric chip is claimed to “showcase excessive speeds in generative AI duties.”
Precisely what meaning varies relying on workload, naturally, however whereas Qualcomm hasn’t shared uncooked specs it does have a couple of illustrative examples: a Microsoft Home windows 11 laptop computer or pill primarily based on the Snapdragon 8 Gen. 3 can course of 30 giant language mannequin (LLM) tokens per second to drive a responsive on-device chat assistant, whereas a smartphone can generate pictures from textual content prompts utilizing Steady Diffusion in beneath a second.
“Our years of AI growth, together with probably the most highly effective mixture of CPU, NPU, and GPU accessible in units, and our help of all main fashions working natively, means we are able to deliver the advantages of generative AI to customers worldwide and throughout a number of gadget classes,” claims Amon.
On the identical time, Qualcomm is aiming to knock Intel, AMD, and even Apple off the top-performance PC slots with the Snapdragon X Elite, a tool household which the corporate claims “outpaces competing laptop computer CPUs and units a brand new bar in AI efficiency.” On the software program entrance, the corporate has introduced partnerships with Microsoft, Meta, Google, HP, Stability.ai, Baichuan AI, Baidu, and extra for Snapdragon-powered on-device AI.
events can be taught extra concerning the firm’s bulletins at Snapdragon Summit 2023.