Apple Unveils iOS 18 Accessibility Features Including AI-Powered Eye Tracking
May. 15, 2024Appletoday announcednew accessibility features arriving later this year with the upcoming software updates like iOS 18, iPadOS 18, and visionOS 2. The Cupertino tech giant never fails to impress its users when it comes to Accessibility features. This time again, Apple announced some useful accessibility features to help users with any disabilities.
Apple previewed several useful features for the iPhone and iPad, the one that would grab the most attention isEye Tracking.Yes, one of the most remarkable features ofApple Vision Prois making its way to iPhone and iPad.
Powered by Artificial Intelligence, Eye tracking will allow iPhone and iPad users to navigate their devices with just their eyes. This is similar to what we have seen on the Vision Pro. Eye tracking on iPhones and iPads is designed especially for users with physical disabilities so they can control their devices just by looking at them.
This magical featureuses the front-facing camera to determine what element the user is looking at.Users can gaze at a button to highlight it and then hold their gaze for a few seconds to select it. Thanks to the on-device machine learning, all data is stored securely on the device and isn’t shared with anyone, not even Apple.
It’s worth knowing that Eye Trackingworks across iOS and iPadOS apps, and you don’t need any additional hardware or accessories. You can use the Dwell Control to activate any element and also access additional functions such as swipes, swipes, physical buttons, and other gestures solely with your eyes.
“We believe deeply in the transformative power of innovation to enrich lives. That’s why for nearly 40 years, Apple has championed inclusive design by embedding accessibility at the core of our hardware and software. We’re continuously pushing the boundaries of technology, and these new features reflect our long-standing commitment to delivering the best possible experience to all of our users.”- Tim Cook, Apple CEO
Besides Eye Tracking, Apple also bringsMusic Hapticsto allow users who are deaf or hard of hearing to enjoy music on the iPhone like everyone else. When enabled, the Music Haptics feature will allow the Taptic Engine in the iPhone to play taps, textures, and refined vibrations to the audio of the music.
Next up, there’s aVocal Shortcutsoption so that iPhone and iPad users can choose custom utterances that Siri understands to launch shortcuts and complete complex tasks. Apple also announced a newVehicle Motion Cuesfeature that can help reduce motion sickness for passengers in moving vehicles.
Later this year, CarPlay will include a bunch of new features. First isVoice Controlwhich allows you to navigate CarPlay and control apps with just your voice. Passengers or drivers who are deaf or hard of hearing can turn on alerts to be notified of car horns with the help of theSound Recognitionfeature. People who are colorblind can go forColor Filtersto make the CarPlay interface visually easier to use, with Bold and Large Text.
Besides the iOS and iPadOS, Apple previewed some accessibility features tovisionOSas well. This includes system-wide Live captions, Reduce Transparency, Dim Flashing Lights, Smart Invert, and more.
