|
Title: Everything New With Siri in iOS 15: On-Device Processing, Offline Support, Sharing, Improved Context and More Post by: HCK on July 30, 2021, 04:05:22 pm Everything New With Siri in iOS 15: On-Device Processing, Offline Support, Sharing, Improved Context and More
There are some major improvements to Siri (https://www.macrumors.com/guide/siri/) in iOS 15 (https://www.macrumors.com/roundup/ios-15/), with Apple introducing features that iPhone (https://www.macrumors.com/guide/iphone/) users have long asked for. On devices with an A12 chip or later, ‌Siri‌ can do on-device processing and there's support for offline requests. (https://images.macrumors.com/article-new/2021/07/iOS-15-Siri-Feature.jpg) This guide highlights all of the new ‌Siri‌ features that are available in iOS (and iPadOS) 15. <h2 id="on-device_speech_processing_and_personalization">On-Device Speech Processing and Personalization</h2> Starting in ‌iOS 15‌, speech processing and personalization are done on-device. This makes ‌Siri‌ faster at processing requests, but also more secure. Most audio requests made of ‌Siri‌ are kept entirely on the ‌iPhone‌ and are no longer uploaded to Apple's servers for processing. ‌Siri‌'s speech recognition and understanding of commands improves as a device is used, with ‌Siri‌ learning the contacts most interacted with, new words typed, and topics preferred, with all of this information kept on device and private. On-device speech processing and personalization is enabled through the Apple Neural Engine and it is available on iPhones and iPads that have an A12 Bionic chip or later. On-device processing is available in German (Germany), English (Australia, Canada, India, UK, U.S.), Spanish (Spain, Mexico, U.S.), French (France), Japanese (Japan), Mandarin Chinese (China mainland), and Cantonese (Hong Kong). <h2 id="offline_support">Offline Support</h2> With on-device processing now available, there are a wide range of ‌Siri‌ requests that can be handled offline. ‌Siri‌ can create (and disable) timers and alarms, launch apps, control audio playback, and access Settings options. Apple says ‌Siri‌ can also process Messages, sharing, and Phone requests. <h2 id="sharing_via_siri">Sharing via Siri</h2> When you come across something that you want to share like a photo, web page, Apple Music (https://www.macrumors.com/guide/apple-music/) song, or podcast, you can ask ‌Siri‌ to send it to a friend or family member and ‌Siri‌ will do so. (https://images.macrumors.com/article-new/2021/07/siri-sharing-ios-15.jpg) If it's something that can't be shared, like a Messages thread, ‌Siri‌ will make a screenshot and send that. All you have to do is say "Send this to [person]" and ‌Siri‌ will confirm the request and then send it along. (https://images.macrumors.com/article-new/2021/07/siri-send-screenshots-1.jpg) This feature works with ‌Apple Music‌, Apple Podcasts (https://www.macrumors.com/guide/apple-podcasts/), Apple News (https://www.macrumors.com/guide/apple-news-plus/), Maps, web pages, photos, Messages, and more. <h2 id="improved_context_between_requests">Improved Context Between Requests</h2> ‌Siri‌ in ‌iOS 15‌ can better maintain context between voice requests. So if you ask something like "How late is the Taco Bell open?" and then "How long does it take to get there?" ‌Siri‌ will understand that "there" is the Taco Bell from the previous request. (https://images.macrumors.com/article-new/2021/07/siri-contextual-requests.jpg) This tends to work only when there's a single option, because in a situation with multiple Taco Bells, ‌Siri‌ needs clarification. For that reason, the contextual improvements are limited. <h3 id="contacts">Contacts</h3> ‌Siri‌ also understands that if there's a contact on the screen, that's the person that you want to talk to. So if you have the contacts app open to a specific person, are chatting with someone in Messages, get a Message notification, or miss a call, you can say something like "Message them I'm on my way" and ‌Siri‌ will know to send it to the relevant contact that you've just interacted with or have open. (https://images.macrumors.com/article-new/2021/07/ios-15-contextual-messaging.jpg) <h2 id="homekit_improvements">HomeKit Improvements</h2> ‌Siri‌ can now be used to control a HomeKit (https://www.macrumors.com/guide/homekit/) device at a specific time. So if you want your lights to turn off right when at 7, you can say something like "Hey ‌Siri‌, turn off the bedroom lights at 7.p.m." This command also works for geolocation, so you can say things like "Hey ‌Siri‌, turn off the air conditioning when I leave." (https://images.macrumors.com/article-new/2021/07/siri-ios-15-timed-homekit-commands.jpg) When you ask ‌Siri‌ to control a ‌HomeKit‌ product this way, it creates an automation in the Home app under the "Automation" section. If you want to delete an Automation ‌Siri‌ has created, you can do so in the Home app. ‌HomeKit‌ developers can also add ‌Siri‌ support to their products in ‌iOS 15‌, but using ‌Siri‌ commands with third-party devices does require the user to have a HomePod (https://www.macrumors.com/roundup/homepod/) to route requests through. With ‌Siri‌ integration, customers will be able to use their ‌HomeKit‌ products for ‌Siri‌ commands like setting reminders, controlling devices, broadcasting messages, and more. <h2 id="announce_notifications">Announce Notifications</h2> ‌Siri‌ has been able to announce calls and incoming messages when using AirPods (https://www.macrumors.com/guide/airpods/) (or Beats headphones) for some time now, but in ‌iOS 15‌, that feature is expanding to all notifications. (https://images.macrumors.com/article-new/2021/07/siri-announce-notifications-ios-15.jpg) ‌Siri‌ can automatically announce Time Sensitive notifications when ‌AirPods‌ are connected if you toggle the feature on in the Settings app (in either the ‌Siri‌ or Notifications sections), and there are also options to have ‌Siri‌ announce notifications on an app-by-app basis if you want to hear notifications from a particular app but those notifications aren't Time Sensitive. <h2 id="announce_messages_in_carplay">Announce Messages in CarPlay</h2> There's now a feature to have ‌Siri‌ announce your incoming messages when your ‌iPhone‌ is connected to a CarPlay (https://www.macrumors.com/roundup/carplay/) setup. There's an option to turn announcements on or off when a message is read, and ‌Siri‌ will remember your preference. This feature can also be toggled on or off using the Settings app. <h2 id="announce_reminders_with_airpods">Announce Reminders With AirPods</h2> In addition to notifications, ‌Siri‌ can also announced reminders that come up when wearing ‌AirPods‌ or compatible Beats headphones. (https://images.macrumors.com/article-new/2021/07/siri-announce-reminders-ios-15.jpg) <h2 id="add_siri_suggestions_to_safari_start_page">Add Siri Suggestions to Safari Start Page</h2> With Start Page customization in ‌iOS 15‌, there is an option to add a section for ‌Siri‌ Suggestions for websites you might want to visit or content you might want to view. <h2 id="language_improvements">Language Improvements</h2> Neural text-to-speech voices have expanded to Swedish, Danish, Norwegian, and Finnish in ‌iOS 15‌. Apple has also added mixed English and Indic language support. ‌Siri‌ can process commands in a mix of Indian English and native languages, with support for Hindi, Telugu, Kannada, Marathi, Tamil, Bengali, Gujarati, Malayalam, and Punjabi. <h2 id="siri_for_developers">Siri for Developers</h2> Apple is tweaking its SiriKit interface and is eliminating (https://www.macrumors.com/2021/07/28/ios-15-limiting-siri-for-third-party-apps/) some of the ‌Siri‌ commands that developers were able to use with third-party apps. Starting with ‌iOS 15‌, customers will no longer be able to use ‌Siri‌ in third-party apps to do things like book a ride with Uber, make a bill payment, or create new task lists in to-do apps. Many of these ‌Siri‌ functions may be replaced by Shortcut options that can be activated with ‌Siri‌ voice commands. <h2 id="guide_feedback">Guide Feedback</h2> Have questions about ‌Siri‌ in ‌iOS 15‌, know of a feature we left out, or want to offer feedback on this guide? Send us an email here (http://mailto:guides@macrumors.com).<div class="linkback">Related Roundups: iOS 15 (https://www.macrumors.com/roundup/ios-15/), iPadOS 15 (https://www.macrumors.com/roundup/ipados-15/)</div><div class="linkback">Tag: Siri (https://www.macrumors.com/guide/siri/)</div><div class="linkback">Related Forum: iOS 15 (https://forums.macrumors.com/forums/ios-15.233)</div> This article, "Everything New With Siri in iOS 15: On-Device Processing, Offline Support, Sharing, Improved Context and More (https://www.macrumors.com/guide/ios-15-siri/)" first appeared on MacRumors.com (https://www.macrumors.com) Discuss this article (https://forums.macrumors.com/threads/everything-new-with-siri-in-ios-15-on-device-processing-offline-support-sharing-improved-context-and-more.2305840/) in our forums <div class="feedflare"> <img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=yIl2AUoC8zA" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=Pz2pw8e0fDk:96bw5OCyAw0:yIl2AUoC8zA) <img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=6W8y8wAjSf4" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=Pz2pw8e0fDk:96bw5OCyAw0:6W8y8wAjSf4) <img src="http://feeds.feedburner.com/~ff/MacRumors-Front?d=qj6IDK7rITs" border="0"></img> (http://feeds.macrumors.com/~ff/MacRumors-Front?a=Pz2pw8e0fDk:96bw5OCyAw0:qj6IDK7rITs) </div><img src="http://feeds.feedburner.com/~r/MacRumors-Front/~4/Pz2pw8e0fDk" height="1" width="1" alt=""/> Source: Everything New With Siri in iOS 15: On-Device Processing, Offline Support, Sharing, Improved Context and More (https://www.macrumors.com/guide/ios-15-siri/) |