May 16, 2023
Apple Introduces Live Speech, Personal Voice, Point and Speak in Magnifier, Plus New Features for Cognitive Accessibility
New Software Capabilities for Cognitive, Speech and Visual Accessibility Coming Later This Year
cupertino, california Apple today previewed software features for cognitive, visual, hearing and mobility accessibility, as well as innovative tools for people who cannot speak or are at risk of losing their ability to speak. These updates leverage advances in hardware and software, include on-device machine learning to ensure user privacy, and continue Apple’s longstanding commitment to making products for everyone. is expanding its efforts.
Apple works closely with community groups representing a wide range of users with disabilities to develop accessibility features that have a real impact on people’s lives. Scheduled for release later this year, a user with cognitive disabilities will be able to use his iPhone and iPad more easily and independently with Assistive Access. Non-speaking people can use Live Speech to type and speak during calls and conversations. In addition, people at risk of losing the ability to speak can use Personal Voice to create a synthetic voice that resembles them and communicate with family and friends. Magnifier detection mode provides point and speak for blind or visually impaired users. This helps identify the text the user points to and read it aloud to interact with physical objects such as home appliances.
“At Apple, we have always believed that the best technology is technology built for everyone,” said Apple CEO Tim Cook. “Today we are excited to share an exciting new feature that builds on our long history of making technology accessible, giving everyone the opportunity to create, communicate and do what they love. It can be obtained.”
Sarah Hellinger, Senior Director of Global Accessibility Policies and Initiatives at Apple, said: “These game-changing features were designed with feedback from members of the disability community every step of the way to support diverse audiences and help people connect in new ways.”
Assistive Access supports users with cognitive disabilities
Assistive Access uses design innovations to refine apps and experiences to essential functionality and reduce cognitive load. This feature reflects feedback from people with cognitive disabilities and their trusted advocates, and explores the activities they enjoy: connecting with loved ones, taking pictures and listening to music on their iPhone or iPad. focus on activities that underlie
Assistive Access includes Messages, Camera, Photos, Music, plus a customized phone and FaceTime experience combined into a single calling app. This feature offers a distinctive interface with high-contrast buttons and large text labels, as well as tools to help tailor the experience to the individuals supported by trusted supporters. For example, for users who prefer visual communication, Messages includes a keyboard dedicated to emojis and the option to record a video girlfriend message to share with a loved one. Users and trusted supporters can also opt for a more visual grid-based layout for their home screen and apps, or a row-based layout for text-preferred users.
“Communities with intellectual and developmental disabilities are creative, but technology often creates physical, visual, or intellectual barriers for these people,” said Arc of America Nation. said Katie Schmidt, Senior Director of Program Initiatives. “Having the ability to deliver a cognitively accessible experience on iPhone and iPad means opening more doors to education, employment, safety and autonomy. means to expand the
Advanced speech accessibility with Live Speech and Personal Voice
With Live Speech on iPhone, iPad, and Mac, users can type what they want to say and have it read aloud during phone calls, FaceTime calls, and even face-to-face conversations. Users can also save phrases for immediate use during lively conversations with family, friends and colleagues. Live Speech is designed to support millions of people around the world who are unable to speak or who have lost their language over time.
Personalized for users at risk of losing their ability to speak, such as those recently diagnosed with ALS (Amyotrophic Lateral Sclerosis) or those with other conditions that may progressively affect their ability to speak Voices is an easy and safe way to create sounds like: they.
Users can create a personal voice by speaking a randomized series of text prompts and record 15 minutes of audio on their iPhone or iPad. This voice accessibility feature uses on-device machine learning to keep your information private and secure, and seamlessly integrates with Live Speech so you can speak in your personal voice when connecting with loved ones. Masu.1
“At the end of the day, the most important thing is being able to communicate with friends and family,” says Philip Green, director of nonprofit Team Gleason and an ALS advocate. Since having ALS, he has undergone a major change in his voice. “If you can say you love yourself in your own voice, the world will change. And being able to create a synthesized voice in just 15 minutes on his iPhone is extraordinary.”
Magnifier detection mode introduces pointing and speaking for blind and low vision users
Magnifier Point and Speak makes it easier for visually impaired users to interact with physical objects that have multiple text labels. For example, when using a consumer electronic device such as a microwave oven, Point and Speak combines input from cameras, LiDAR scanners, and on-device machine learning to generate images on each button as the user moves a finger across the keypad. announce the text of2 Point and Speak is built into the iPhone and iPad Magnifier app and works great with VoiceOver. It can also be used in conjunction with other magnifying glass features such as person detection, door detection, and image description to help users navigate the physical environment.
- Hearing-impaired users can also pair Made for iPhone Hearing Aids Connect directly to your Mac and customize your listening experience.3
- voice control Adding phonetic syllabaries for text editing helps voice typing users select the appropriate word among similar words such as ‘do’, ‘due’, and ‘dew’.Four moreover, Voice control guidewhere users can learn tips and tricks for using voice commands instead of touch and typing on iPhone, iPad, and Mac.
- When used by users with physical or motor disabilities switch control Turn any Switch into a virtual game controller and play your favorite games on your iPhone or iPad.
- For visually impaired users, font size Coordinating across Mac apps like Finder, Messages, Mail, Calendar, and Notes just got easier.
- Users sensitive to fast animations will automatically Pause images with moving elementsMessages, GIFs in Safari, and more.
- for voice over For users, Siri’s voice sounds natural and expressive, even with high audio feedback. Users can also customize the speed at which Siri speaks, ranging from 0.8x to 2x.
Celebrating Global Accessibility Awareness Day around the world
To celebrate Global Accessibility Awareness Day, Apple is introducing new features, curated collections and more this week.
- sign time will launch in Germany, Italy, Spain, and South Korea on May 18 to connect Apple Store and Apple Support customers with on-demand sign language interpreters. This service is already available for customers in the US, Canada, UK, France, Australia and Japan.Five
- select Apple store location Around the world, we offer informative sessions throughout the week to help our customers discover accessibility features. The Apple Carnegie Library features her Today at Apple session with sign language performer and interpreter Justina Her Miles. Group reservations are also available (available year-round), and each Apple Store location is a place where her community and her group can learn about accessibility features together.
- shortcut Add Remember This to help users with cognitive disabilities create a visual journal in Notes for easy reference and reflection.
- this week, apple podcast We offer a series of shows on the impact of accessible technology.of Apple TV This app features movies and series handpicked by prominent storytellers from the disability community. Apple Books shine the spotlight Being Human: The Unrepentant Memoirs of a Disability Rights Activist, a memoir by disability rights pioneer Judith Human.and Apple Music Featuring cross-genre American Sign Language (ASL) music videos.
- This week apple fitness+, trainer Jamie Ray Hartshorn embraces ASL and highlights features available to users as part of an ongoing effort to make fitness more accessible for all. Features include voice hints that provide additional short descriptive verbal cues to assist visually impaired users. Also, Time to Walk and Time to Run episodes become “Time to Walk or Push” and “Time to Run or Push” for wheelchair users. . Additionally, the Fitness+ Trainer incorporates his ASL into all workouts and meditations, and all videos include subtitles in 6 different languages, allowing users of different levels to participate. demonstrates a workout modification.
- of app store spotlights three disability community leaders, Aloysius Gunn, Jordyn Zimmerman, and Bradley Haven, each on their experiences as non-language individuals and the transformative impact of augmented and alternative communication (AAC) apps in their lives. share the effect.
Apple revolutionized personal technology with the introduction of the Macintosh in 1984. Today, Apple leads the world with innovations in his iPhone, iPad, Mac, Apple Watch and Apple TV. Apple’s five software platforms (iOS, iPadOS, macOS, watchOS, and tvOS) provide a seamless experience for all Apple devices and unlock groundbreaking services like the App Store, Apple Music, Apple Pay, and iCloud. provide to Apple’s more than 100,000 employees are dedicated to making the best products on the planet and making the world better than we were before.
- Personal Voice can be created using iPhone, iPad, and Mac with Apple silicon and is available in English.
- Point and Speak is available for iPhone and iPad devices with LiDAR scanners in English, French, Italian, German, Spanish, Portuguese, Chinese, Cantonese, Korean, Japanese, and Ukrainian .
- Users will be able to pair Made for iPhone hearing devices with select Mac devices with the M1 chip and all Mac devices with the M2 chip.
- Voice Control voice suggestions are available in English, Spanish, French, and German.
- SignTime sessions are available in the United States and Canada using American Sign Language (ASL), in the United Kingdom using British Sign Language (BSL), in France using French Sign Language (LSF), and using Japanese Sign Language (JSL). Japan, and Australia use Australian Sign Language (Auslan). On May 18, SignTime will be available in Germany using German Sign Language (DGS), Italy using Italian Sign Language (LIS), Spain using Spanish Sign Language (LSE), and South Korea using Korean Sign Language (KSL) will be
Eric Hollister Williams
Apple Media Helpline