Apple details ‘Siri for Mac’ desktop virtual assistant in new patent application
While Apple’s Siri has been an iOS staple since 2011, the tech has yet to make the jump to OS X. An exhaustive new patent filing, however, details a very similar desktop version of the virtual assistant that can perform dictation, high-level system commands and even act as a “third hand” for Mac users.
As published by the U.S. patent and Trademark Office on Thursday, Apple’s massive 92-page patent application for an “Intelligent digital assistant in a desktop environment” describes a technology that goes far beyond Mac’s current voice dictation feature, and can easily be considered a “Siri for Mac.”
Like the current iteration of Siri, limited to iOS, Apple’s desktop version is able to process natural speech and text input to perform actions like completing tasks, inputting and retrieving data, conducting searches and more. Further, the filing points out that commands are to be taken in context based on deduced user intent. In other words, Siri for desktop will use speech recognition to decipher and remembering contextual clues.
Driven in cooperation with an off-site server, Siri for Mac has an identical backend to Siri for iOS. The user-facing Siri asset can be integrated into a standalone app invoked by a special mouse or keyboard gesture, or may be tasked to run in the background, listening for a special activation phrase like the “Hey, Siri” implementation in Apple’s forthcoming iOS 8.
In some embodiments, an icon of the virtual assistant can reside in the dock, notifying the user that it is active and ready for service. This and other modes allow the user to speak commands and start dictations from anywhere in the operating system.
Voice input is of specific importance to the patent’s disclosures, as the technology is looking to augment keyboard and mouse input, or in some cases replace the physical tools altogether. The usual answer/response method seen with Siri for iOS is applied to the desktop variant, though more advanced operations can be performed given the extra computing power afforded by a proper computer.
Apple’s desktop Siri version uses “focus selector,” or mouse cursor, to help users apply context to a command. For example, the assistant can perform a copy operation for an asset under a hovering cursor, or may “hold” a batch of highlighted files for later retrieval. In essence, the focus selector plays the same role as an iOS device user’s finger, except with substantially more options for control thanks to the Mac’s GUI.