Apple on Wednesday released the latest beta version of its top operating systems, including iOS 18.2, iPadOS 18.2 and macOS Sequoia 15.2. The releases come a week before the public launch of iOS 18.1, iPadOS 18.1 and macOS Sequoia 15.1 – although Apple has not yet specified a date.
Next week’s launch will be the first non-beta public release of Apple Intelligence. These include integrated writing tools, image cleanup, article summaries, and text entry in a redesigned Siri experience.
Those brave enough who are currently participating in the developer beta program will have access to a number of additional Apple Intelligence features, which were unveiled in June during the company’s annual WWDC event. These features include Genmoji, Image Playground, Visual Intelligence, Image Wand, and ChatGPT integration.
First-time Apple Intelligence users will need to opt-in to this feature in Settings. Users will also be required to opt-in to enable ChatGPT. The third-party generative AI platform is integrated in two areas: question answering via Siri and as a composing tool found in writing tools.
The Siri option appears when the assistant is asked a question that it can’t find an immediate answer to. When this happens, the system will ask for permission to access the OpenAI platform. Regulations and trip planning are two common features that are likely to trigger this feature.
Meanwhile, Compose is integrated into all apps with access to writing tools (including first-party apps and many third-party apps). Similar to the standalone ChatGPT platform, users enter a prompt and the service enters the text. These applications will also have access to the ChatGPT image generation platform.
This is, of course, in addition to Apple’s own image generation. Image Playground, built into Apple apps like Messages, Pages, Keynote and Freeform (as well as its own standalone app), uses tooltips to generate up-to-date images. Hints include concepts, descriptions, and character creations. Users can also operate friends and family as prompts or generate images from their own photos.
Image Playground is trained in licensed content as well as publicly searchable websites. Publishers have the option to opt out of the latter. Apple graphics come in two basic styles: animation and illustration. Both deliberately avoid photorealism, probably to avoid potential ethical and legal problems that could arise from doctored photos.
Image Wand, meanwhile, allows users to transform their own sketches into finished works of art. It can also clear handwritten notes.
Genmoji, which will be available on Wednesday as part of the iOS 18.2 and iPadOS 18.2 developer updates, allows you to generate original emojis with hints. These include descriptions, people recognized in photos and non-standard characters. They can be used directly in Messages, as well as in stickers and tapbacks.
Visual intelligence is basically Apple’s answer to Google Lens. This feature, accessible through the camera control button on iPhone 16, allows you to scan QR codes, copy and summarize text, discover phone numbers and email addresses (and add them to Contacts), and translate languages. This feature will also provide contextual information about the images in front of it, including restaurant reviews and opening hours.
Visual intelligence can also operate Google’s knowledge base for shopping queries and can access ChatGPT for information on various topics.
Users do not need a ChatGPT account to access the platform, although without one their queries will be constrained.