MediaTek leverages Llama 2 to enhance generative AI capabilities

2023-09-05

Global semiconductor company MediaTek is working to enhance its artificial intelligence (AI) capabilities and will use Meta's Llama 2 to improve its generative AI services.

As the world's fourth-largest fabless semiconductor company with over 25 years of innovation history, MediaTek is committed to developing innovative chip systems (SoCs) for mobile devices, home entertainment, and IoT products.

Founded in 1997 and headquartered in Taiwan, MediaTek has 41 offices worldwide and became the third-largest fabless chip design company in 2016. MediaTek now powers over 2 billion devices annually, capturing 20% of the global home appliance market and nearly one-third of the smartphone market share.

By announcing its intention to utilize Meta's Llama 2, MediaTek is evidently continuing to enhance its generative AI systems in edge devices.

Enhancing computing power with Llama 2

Upon the release of Llama 2, Meta provided a Llama 2 user guide that offers best practices and considerations for building LLM-driven products responsibly, covering various stages of development from conception to deployment.

The company has consistently emphasized the importance of generative AI policies and hopes that Llama 2 will become a governance tool, considering the value it brings to supporting AI, LLM, and other rapidly evolving AI technologies.

MediaTek's collaboration with Llama 2 aims to combine LLM with the company's latest APU and NeuroPilot AI platform to build a complete edge computing ecosystem. This effort is intended to accelerate the development of AI applications on smartphones, IoT devices, vehicles, smart homes, and other edge devices.

While most generative AI processing is done through cloud computing, MediaTek hopes to enable generative AI applications to run directly on devices with the use of Llama 2. In doing so, it aims to provide developers and users with various advantages, including seamless performance, higher privacy, better security and reliability, lower latency, the ability to work in areas with poor network connectivity, and lower operational costs.

Leveraging high computing technology for full utilization of generative AI

With the continued increase in interest in open-source AI models, MediaTek states that edge device manufacturers will need to adopt high-computing, low-power AI processors and faster, more reliable connectivity to enhance computing power and leverage generative AI technology on devices.

The company's next-generation flagship chipset will be launched in late 2023 and will come equipped with a software stack specifically designed for Llama 2. These advancements aim to accelerate the pace of building use cases for generative AI on devices.

"The growing popularity of generative AI is an important trend in digital transformation, and our vision is to provide the necessary tools for the Llama 2 developer and user community to innovate comprehensively in the field of AI," said JC Hsu, Senior Vice President and General Manager of MediaTek's Wireless Communications Business Unit.

"Through our collaboration with Meta, we can deliver more capable hardware and software at the edge."

MediaTek expects AI applications based on Llama 2 to be launched on smartphones before the end of 2023.

RECENT AI NEWS

RECENT AI TOOLS