Apple has launched AI features for people with disabilities, including wheelchair control using eye gaze

Apple Enhances Accessibility of Its Devices with Artificial Intelligence

Apple announced a series of updates that make accessibility features more effective and user-friendly for people with disabilities. Among the tools affected are VoiceOver, “Magnifier,” voice control, and reading mode for individuals with special needs. Additionally, electric wheelchair owners will now be able to control their vehicles with eye gaze through the Vision Pro headset.

> Privacy remains a priority

> Senior Director of Global Policy and Accessibility Initiatives Sarah Herrlinger emphasized that the new AI capabilities “offer intuitive input options, research, and personalization designed to protect user privacy at every stage.”

What Changed
Feature New Capabilities VoiceOver • Image Explorer uses Apple Intelligence for more accurate image descriptions (photos, receipts, documents). • Live Recognition now allows users to ask questions about camera content by pressing the Action button. “Magnifier” Support for the Action button – quick access to Q&A. Voice Control Switched to natural language: commands like “zoom,” “turn on flashlight” work without a strict template. “Speak what you see” lets users navigate any app (Maps, Files, etc.) with simple phrases. Reading for People with Disabilities Supports complex materials: scientific articles, tables, multiple columns. Brief overviews on request give an overall sense before detailed reading. Translation and Subtitles Built-in translation preserves original formatting, font, and colors. Video automatically generates subtitles directly on the device – no data sent to the cloud. Eye-Gaze Wheelchair Control With Vision Pro, users can control electric wheelchairs without using a joystick. Eye tracking works reliably under various lighting conditions and does not require frequent recalibration. The first models—Tolt and LUCI (Bluetooth and wired connection)—are available in the U.S.; Apple plans to expand support for other wheelchairs.

Management Quotes
- Tim Cook: “Apple’s approach to accessibility is unique. With the introduction of Apple Intelligence, we’re adding powerful features while maintaining our fundamental commitment to privacy from the design stage.”

- Sarah Herrlinger: “We offer new intuitive input and personalization options that protect user privacy at every step.”

Conclusion
Apple continues to develop the accessibility of its products by combining cutting-edge AI technology with strict privacy compliance. The new features make interacting with devices more natural and convenient for people with various limitations, and the ability to control a wheelchair with eye gaze opens new horizons for autonomy.