Qualcomm aims to integrate ChatGPT into your mobile device

2023-06-06

Using hybrid artificial intelligence technology, generative AI developers and providers can leverage the computational power offered by edge devices to achieve cost reduction. According to reports, Qualcomm is working on running AI models such as GPT-4 and DALL-E2 on smartphones through its next-generation processors. Currently, users can access these models through the internet or via mobile applications (currently only available on iOS devices). However, the applications still need to run on the internet, incurring high costs. Dylan Patel, Chief Analyst at SemiAnalysis, stated that running ChatGPT costs OpenAI approximately $700,000 per day, mainly for server operations. Patel believes that the cost of running GPT-4 may be even higher, as it is the most advanced large-scale language model to date. In a whitepaper released in May this year, Qualcomm stated that the search cost per query based on generative AI is expected to be 10 times higher than traditional search methods. Therefore, the utilization of hybrid AI allows generative AI developers and providers to leverage the computational power provided by edge devices, thereby reducing costs. "The hybrid AI architecture (or AI running solely on devices) provides additional advantages in performance, personalization, privacy, and security on a global scale," said Qualcomm. Earlier this year, some Qualcomm engineers successfully ran the Stable Diffusion AI model, which generates images from text, on Android devices. Interestingly, Qualcomm may not be the only company dedicated to running AI models on devices. Apple is also developing and promoting AI models on devices for tasks such as speech recognition, natural language processing, and computer vision. Apple has been heavily investing in the development of AI chips and algorithms that can run on devices like iPhones, iPads, and Macs. It is currently unclear whether Apple is building any GPT models, but they may introduce similar technologies that run entirely on Apple devices, providing users with faster, more responsive, and more personalized experiences. Running AI models on devices is a practice adopted by many companies, including Google and Microsoft, who are competing for dominance in the field of AI. Earlier this year, a developer demonstrated how he was able to fully run models like ChatGPT3.5 turbo on a laptop. Source: https://analyticsindiamag.com/qualcomm-wants-to-bring-chatgpt-to-your-phone/

RECENT AI NEWS

RECENT AI TOOLS