Apple Integrates AI into New Accessibility Features, Supporting Natural Language Operation

(CNA, Taipei, May 19, by Wu Chia-hao) Apple Inc. today previewed a series of accessibility feature updates integrated with its personal intelligence system, Apple Intelligence, adding more detailed description capabilities and natural language operation to common features such as VoiceOver, Magnifier, Voice Control, and Accessibility Reader. Apple also announced several new features to be launched later this year, including controlling an electric wheelchair with the spatial computing device Apple Vision Pro, and on-device caption generation. Sarah Herrlinger, Apple's senior director of Global Accessibility Policy & Initiatives, stated in a press release, "The accessibility features our users rely on every day become even more powerful with Apple Intelligence. With these updates, we are bringing new options for intuitive input, exploration, and personalization, while designing to protect user privacy every step of the way." Users who are blind or have low vision can use the VoiceOver and Magnifier features to understand information on the screen or their surroundings. Image Explorer in VoiceOver uses Apple Intelligence to provide more detailed image descriptions across the system, including information in photos, scanned bills, personal documents, and other visual content. Apple Intelligence will make Voice Control more intuitive than ever, using natural language to help users with various physical disabilities operate their iPhone and iPad entirely with their voice. Furthermore, while captions have become increasingly common to help users who are deaf or hard of hearing understand content, conversations in personal videos, content shared by friends and family, and other media often still lack captions. With the new caption generation feature, the system can automatically display a transcript of spoken content when a video does not provide its own captions or closed captions. This feature applies to videos shot on an iPhone, videos shared by friends and family, and online streaming content.