​

​

Hello Reader!

Welcome to Visually AI!

​

Apple Intelligence: The Future of Personalized Technology

Welcome to our special WWDC24 edition!

Even if you didn't watch the event itself, I'm sure you saw the news surrounding Apple's WWDC hosted yesterday.

But incase you missed it, I've got you covered.

Apple introduced its latest breakthrough: Apple Intelligence.

A system designed to advance the user experience of Apple products.

This system leverages generative models to elevate your interaction with Apple products, making them more powerful, intuitive, and deeply integrated.

But first, let's back up.

​

What is Apple Intelligence?

Apple Intelligence is a new personal intelligence system integrated into iOS 18, iPadOS 18, and macOS Sequoia. It offers capabilities to understand and create language and images while executing tasks tailored to your own personal context.

This system is built with privacy at its core (but more on that later... *cough* Elon... *cough*), ensuring that your data remains secure.

​

Key Features:

Enhanced Language and Image Processing

Language Understanding: Apple Intelligence prioritizes your notifications, reducing unnecessary distractions while ensuring you don’t miss important updates. It also powers writing tools that can rewrite, proofread, and summarize text. Whether you’re working on an article, condensing ideas, or reviewing a draft, these tools are available across Mail, Notes, Safari, Pages, Keynote, and even third-party apps.

Image Generation: Apple Intelligence understands the people in your photo library and can create personalized images to make your conversations more enjoyable. You can generate images in three unique styles: sketch, illustration, and animation. These capabilities are seamlessly integrated into apps like Notes, Freeform, Keynote, and Pages.

​

​

Task Automation

Apple Intelligence can orchestrate tasks across your apps, saving time and enhancing productivity. For example, you can ask it to pull up specific files, show photos of certain people, or play a podcast shared with you recently. This ability to execute tasks simplifies interactions and helps you accomplish more efficiently.

Personal Context Awareness

Understanding personal context is crucial for delivering truly helpful intelligence. Apple Intelligence processes personal data to assist you in various scenarios, such as rescheduling meetings or tracking events like your daughter’s play performance. It does this while protecting your privacy, ensuring that powerful intelligence is coupled with robust privacy protections, selecting what is shared.

Privacy-First Design

Apple Intelligence leverages on-device processing and advanced Apple Silicon chips to ensure privacy. Many models run entirely on-device, and when larger computational power is needed, private cloud compute steps in. This system ensures your data is never stored or accessible to Apple, maintaining transparency and security.

The Evolution of Siri

Siri is getting a significant upgrade with Apple Intelligence.

Here’s what we can expect:

Natural Language Understanding: Siri now comprehends natural language better and maintains conversational context, allowing for more natural and fluid interactions. Even if you stumble over your words, Siri will understand your intentions.

Typing to Siri: For quiet environments, you can type to Siri, providing more flexibility in communication. This feature is activated with a double tap at the bottom of the screen, allowing you to switch between text and voice as needed.

Extensive Product Knowledge: Siri can answer thousands of questions about your Apple devices, offering step-by-step guidance for features and settings. You can ask about features without knowing their exact names, and Siri will find the information for you.

On-Screen Awareness: Siri can take action with content on your screen. For example, if a friend texts you a new address, you can ask Siri to add it to the contact card directly from the messages thread.

New Orchestration Capabilities: Apple Intelligence provides Siri with the ability to take actions inside apps on your behalf. Siri can perform tasks across apps, leveraging writing and image generation capabilities. You might ask Siri to enhance a photo or add information to a note, seamlessly transitioning between apps to get the job done.

Personal Context Awareness: Siri now has a semantic index of your personal data, like photos, calendar events, and files. It can find and understand things it never could before, such as extracting information from emails or messages. For example, Siri could potentially find a photo of your driver’s license and input the ID number into a form for you.

Real-Time Contextual Assistance: Imagine you are planning to pick up someone from the airport. Siri can cross-reference flight details from emails with real-time flight tracking to provide up-to-date arrival times. It can also manage plans mentioned in casual conversation, like lunch reservations, without switching between apps.

Exploring Privacy with Apple Intelligence

Apple Intelligence uses a unique architecture to ensure privacy for it's users.

On-Device Processing: Many models run entirely on your device, keeping your data secure and within your control.

Private Cloud Compute: For larger computational tasks, Apple uses private cloud compute, ensuring that your data is never stored or accessible to Apple. These models run on servers built with Apple Silicon, ensuring the same privacy and security standards as your devices.

You could have your AI service, tool, or event seen by Visually AI’s community of over 15,000+ subscribers in newsletters or 36,000+ followers on 𝕏 :

​

Beyond AI: Additional Highlights from WWDC24

Now we've mentioned a lot about privacy.

Apple is going to leverage three levels of large language models (LLMs) for its advanced features. The on-device model, comparable to Gemini 1.0 Pro, ensures quick and private responses. For more complex tasks, a more powerful model on Apple’s private servers, similar in performance to Claude Sonnet, is used. Additionally, third-party models like GPT-4o via ChatGPT are integrated, with plans to adopt models similar to Google’s Gemini.

Apple Intelligence selects the appropriate model based on your request, always seeking your permission before interacting with ChatGPT or any third-party model to ensure privacy and control.

And here's what Elon Musk had to say about it post WWDC24:

​Link to tweet​

In addition, this stems from Elon speaking at the Viva Technology in Paris on May 23rd.

Here's what he had to say about warning people away from ChatGPT for not being truthful:

​

​

Privacy has been a major issue voice in of AI since ChatGPT launched.

I am not here to sway your opinion on anything, but I will always do what I can to maintain my privacy.

Moving on, I also found the iPad Calculator interesting. Being a long-awaited feature (my son is very excited!), the iPad now includes a built-in calculator app with advanced functionalities, catering to all your mathematical needs. This addition has been much anticipated by users worldwide and enhances the iPad’s utility, to which some say: "What is the point of an iPad?"

To The Future

Apple Intelligence represents a significant leap forward in personal technology, there's no doubt. By combining powerful generative models with privacy protection, Apple is transforming how we interact with our devices.

From enhancing writing and creating images to automating tasks and improving Siri, the future of personalized technology is here, and it’s fascinating.

Thank you for reading :)