Home Arrow Icon Knowledge base Arrow Icon Global Arrow Icon How does Eye Tracking work in iOS 18


How does Eye Tracking work in iOS 18


Overview of Eye Tracking in iOS 18

Apple's iOS 18 introduces a groundbreaking Eye Tracking feature designed to enhance accessibility by allowing users to control their devices using eye movements. This technology leverages the existing Face ID camera, eliminating the need for additional hardware.

How Eye Tracking Works

Functionality

- Eye Movement Detection: The Eye Tracking feature monitors where the user is looking on the screen and translates that into commands or actions. For instance, users can select items, scroll, and navigate through apps simply by focusing their gaze on specific areas of the display[1][5].
- Calibration Process: To set up Eye Tracking, users must follow a calibration sequence where they focus on a moving dot on the screen. This process helps the system accurately track eye movements[2][6].

Setup Instructions

1. Device Requirements: Eye Tracking is supported on iPhone models starting from the iPhone 12 and newer, as well as certain iPad models[5][6].
2. Initial Setup:
- Place your device on a stable surface approximately 1.5 feet away from your face.
- Open the Settings app and navigate to Accessibility.
- Under the Physical and Motor section, select Eye Tracking and toggle it on.
- Follow the on-screen instructions to complete the calibration by tracking a colored circle with your eyes[1][2].

Key Features

- Dwell Control: This feature allows users to perform an action by maintaining their gaze on an item for a specified duration. It simplifies selection without needing to tap the screen[2][5].
- Customization Options: Users can adjust settings such as sensitivity and response times to tailor the experience to their needs. Options include adjusting pointer speed and enabling features like "Snap to Item," which automatically focuses on nearby selectable items[1][2].

Benefits of Eye Tracking

- Enhanced Accessibility: This feature significantly aids users with limited mobility, enabling them to interact with their devices hands-free. It opens up new possibilities for those who may struggle with traditional touch controls[5][6].
- Versatile Navigation: Users can navigate their device, open apps, and even scroll through content using just their eyes, making it a versatile tool for various tasks[1][5].

Conclusion

The Eye Tracking feature in iOS 18 represents a significant advancement in accessibility technology, allowing users to control their devices effortlessly through eye movements. With its intuitive setup and customizable options, it aims to provide an inclusive experience for all users.

Citations:
[1] https://indianexpress.com/article/technology/techook/apple-ios-18-how-to-set-up-and-use-the-new-eye-tracking-feature-on-iphone-9442997/
[2] https://9to5mac.com/2024/09/19/turn-on-iphone-eye-tracking-ios-18/
[3] https://www.youtube.com/watch?v=Ccmf6YLiwM4
[4] https://www.youtube.com/watch?v=SGeCrfL8teo
[5] https://www.youtube.com/watch?v=oJJJNvKZhAk
[6] https://www.youtube.com/watch?v=OZ2oOREbQ4E
[7] https://support.apple.com/en-ng/guide/iphone/iph66057d0f6/ios
[8] https://www.apple.com/newsroom/2024/05/apple-announces-new-accessibility-features-including-eye-tracking/?videoid=65be019eb2028f57ef2ec0bf2ff7eb8d

What are the customization options available for Eye Tracking in iOS 18

Customization Options for Eye Tracking in iOS 18

iOS 18 introduces several customization options for the Eye Tracking feature, allowing users to tailor their experience according to their preferences and needs. Here are the key customization options available:

1. Dwell Control

- Functionality: Users can enable Dwell Control, which allows actions to be executed by maintaining gaze on a specific item for a set duration. This is particularly useful for selecting items without needing to tap the screen.
- Customization: Users can adjust the duration required to trigger an action by holding their gaze on an item.

2. Smoothing Slider

- Purpose: This slider adjusts the responsiveness of the pointer that follows eye movements.
- Adjustment: Users can increase or decrease the pointer's speed to make it more comfortable and accurate for their usage.

3. Snap to Item

- Feature: When enabled, this option automatically moves the pointer to nearby UI elements, making navigation easier.
- Benefit: It reduces the effort required to manually position the pointer, enhancing usability.

4. Pointer Visibility

- Auto-Hide Option: Users can choose to have the pointer automatically hide when not in use.
- Pointer Reappearance: The duration for which the pointer remains hidden before reappearing can also be customized.

5. AssistiveTouch Integration

- Functionality: Eye Tracking works in conjunction with AssistiveTouch, allowing users to access additional features like locking the device, navigating to the Home Screen, and scrolling.
- Customization Options: Within AssistiveTouch settings, users can further customize how Eye Tracking interacts with other accessibility features.

6. Calibration Settings

- Initial Calibration: During setup, users follow a series of dots on the screen to calibrate Eye Tracking accurately.
- Recalibration: If users find that Eye Tracking is not responsive or accurate, they can recalibrate by following the setup process again.

These customization options ensure that Eye Tracking in iOS 18 is not only functional but also adaptable to individual user needs, enhancing accessibility and ease of use across various applications and tasks[1][2][3].

Citations:
[1] https://9to5mac.com/2024/09/19/turn-on-iphone-eye-tracking-ios-18/
[2] https://indianexpress.com/article/technology/techook/apple-ios-18-how-to-set-up-and-use-the-new-eye-tracking-feature-on-iphone-9442997/
[3] https://www.neowin.net/guides/how-to-set-up-and-use-eye-tracking-on-your-iphone-running-ios-18/
[4] https://www.youtube.com/watch?v=Ccmf6YLiwM4
[5] https://www.reddit.com/r/AssistiveTechnology/comments/1ctg2k4/ios_18_has_eye_tracking/
[6] https://www.youtube.com/watch?v=SGeCrfL8teo
[7] https://www.youtube.com/watch?v=oJJJNvKZhAk
[8] https://support.apple.com/en-ng/guide/iphone/iph66057d0f6/ios

How does Eye Tracking integrate with AssistiveTouch in iOS 18

Eye Tracking integrates seamlessly with AssistiveTouch in iOS 18 to enhance accessibility and provide a comprehensive interaction method for users. Here’s how it works:

Integration Steps

1. Enable AssistiveTouch:
- Navigate to the `Settings` app > `Accessibility`.
- Select `Touch`, then toggle on `AssistiveTouch`.

2. Configure Dwell Control:
- After turning on AssistiveTouch, go back to `Accessibility` and find the `Eye Tracking` option.
- Once Eye Tracking is enabled, you will see a feature called `Dwell Control`.
- Dwell control allows actions to be performed by maintaining gaze on an item for a specified duration[2][3].

Customization Options

- Adjusting Pointer Speed: Use the Smoothing slider within Eye Tracking settings to adjust the responsiveness of the pointer that follows eye movements[5].

- Snap to Item Feature: Enable this toggle button to automatically move the cursor to nearby UI elements, making navigation easier[3][5].

- Pointer Visibility: You can choose to auto-hide the pointer when not in use and set the duration before it reappears, enhancing usability without visual clutter[5].

Using with Other Features

With both features active:
- Users can perform various tasks like locking their device, going to the Home Screen, scrolling through content, opening apps, using Siri, accessing Notification Center, changing volume levels, taking screenshots, and more simply by maintaining gaze on desired actions[2][3].

By integrating Eye Tracking with AssistiveTouch through customizable settings like dwell time and pointer behavior, Apple provides a robust solution for those seeking hands-free interaction methods on iOS devices.

Conclusion

Eye Tracking in conjunction with AssistiveTouch offers a powerful toolset designed to improve accessibility. By enabling these features together, users can control their iPhones more intuitively than ever before, enhancing usability particularly for those with mobility issues or other disabilities that make traditional touch controls challenging. The customization options available further tailor this experience to individual needs, making it an invaluable addition to iOS 18’s suite of accessibility enhancements.

Citations:
[1] https://9to5mac.com/2024/09/19/turn-on-iphone-eye-tracking-ios-18/
[2] https://www.macobserver.com/ios/eye-tracking-on-ios-18-all-you-need-to-know/
[3] https://indianexpress.com/article/technology/techook/apple-ios-18-how-to-set-up-and-use-the-new-eye-tracking-feature-on-iphone-9442997/
[4] https://www.youtube.com/watch?v=Ccmf6YLiwM4
[5] https://www.neowin.net/guides/how-to-set-up-and-use-eye-tracking-on-your-iphone-running-ios-18/
[6] https://www.reddit.com/r/AssistiveTechnology/comments/1ctg2k4/ios_18_has_eye_tracking/
[7] https://beebom.com/iphone-eye-tracking-how-works/
[8] https://www.youtube.com/watch?v=SGeCrfL8teo