Apple Enhances Services with AI, Develops Language Models for Local Use

Apple is making notable progress in improving its services with artificial intelligence (AI), including the development of language models that can operate locally on devices without requiring an internet connection, according to a Middle East newspaper report on April 25, 2024.

The tech giant's research team has released an open-source language model called "OpenELM" (Open-source Efficient Language Models), which includes code to convert the model to run on Apple devices. This allows the language model to be used locally on iPhones, iPads, and other Apple products without relying on cloud-based processing.

To improve the accuracy and performance of OpenELM, Apple's team applied "Instruction Tuning," resulting in a 1-2% enhancement in the model's general language understanding and task-specific capabilities. Additionally, OpenELM supports parameter-efficient fine-tuning methods such as Low-Rank Adaptation (LoRA) and Decomposed Low-Rank Adaptation (LoRA) for further optimization.

Apple has made the weights, training code, logs, checkpoints, dataset, hyperparameters, and conversion code for OpenELM publicly available to ensure reproducibility and transparency in the development process. The company's focus on open-source AI aligns with its commitment to advancing the field while maintaining user privacy and security.

Why this matters: Apple's advancements in AI, particularly in developing language models that can function locally on devices, have significant implications for user privacy and the accessibility of AI-powered features. By processing data on-device, Apple can offer enhanced services without compromising user data security or requiring a constant internet connection.

The Middle East newspaper report also suggests that Apple is set to unveil major updates to iOS 18 at the upcoming Worldwide Developers Conference (WWDC) on June 10, 2024. These updates are expected to include substantial AI upgrades, such as on-device processing, a revamped Siri virtual assistant, and smart integration with various Apple apps and services like Messages, Apple Music, and iWork.

Other anticipated changes in iOS 18 include support for Rich Communication Services (RCS), new customization options for the Home Screen, and the long-awaited arrival of the Calculator app on iPad and Mac devices. As per Apple's traditional release schedule, the first developer beta of iOS 18 is likely to be released on the same day as the WWDC keynote, followed by a public beta approximately a month later and the official public release shortly after the fall iPhone event.

The report indicates that users will be able to easily install the iOS 18 beta directly within the iPhone Settings app, continuing the trend introduced in iOS 16.4. This streamlined process aims to encourage more users to test and provide feedback on the new features and enhancements before the official release.

As Apple continues to advance AI integration in its products and services, the company's progress in local language models and on-device processing are expected to lead the way for more secure, efficient, and accessible AI-powered experiences for users across its ecosystem.

Key Takeaways

• Apple releases open-source language model "OpenELM" for on-device AI processing.
• OpenELM supports parameter-efficient fine-tuning methods like LoRA for optimization.
• iOS 18 expected to feature major AI upgrades, including on-device processing and revamped Siri.
• iOS 18 to introduce support for RCS, new Home Screen customization, and Calculator app on iPad/Mac.
• Apple's progress in local language models and on-device AI aims to enhance user privacy and accessibility.