`
`Exhibit 2
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 2 of 20 PageID #: 15
`
`Sonos – Smart Speakers with Sonos App and Google Assistant
`(See product list at end of chart for models)
`Infringement of the ‘867 patent
`Claim 1
`Evidence
`1. A method of using
`The Sonos smart speaker and Sonos App perform a method of using a first
`a first electronic
`electronic device to operate a second electronic device in real time, while the
`device to operate a
`second device is not physically connected to the first device, and is only
`second electronic
`intermittently local to the first device.
`device in real time,
`while the second
`For example, the Sonos App running on a Google Assistant-enabled mobile
`device is not
`device can be used to control a Sonos smart speaker via voice commands given
`physically connected
`by a user.
`to the first device, and
`is only intermittently
`local to the first
`device, comprising:
`
` [2]
`Several models of Sonos smart speakers can be controlled by voice commands
`using a Google Assistant-enabled device (e.g. Android and iOS smartphones).
`
`1
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 3 of 20 PageID #: 16
`
`Roam ‘/
`
`The portable smart speaker for all your
`
`listening adventures.
`
`Move ‘/
`
`The durable, battery~powered smart
`
`speaker for outdoor and indoor listening.
`
`One
`
`Beam
`
`The smart, compact soundbar for TV,
`
`music. and more.
`
`The powerful smart speaker with voice
`control built in.
`
`[1]
`
`[1]
`
`[1]
`
`[1]
`
`2
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 4 of 20 PageID #: 17
`
`[1]
`Several models (e.g. Beam, Arc, One) have Google Assistant built-in, which can
`be used to control other types of smart devices around the home such as smart
`TVs, smart ovens, etc. [10][11][14][15]
`When the Sonos smart speaker is used for voice control of other smart home
`devices, the Sonos smart speaker acts as the first device and the other smart
`home device acts as the second device.
`
` [10]
`
`3
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 5 of 20 PageID #: 18
`
`More than music
`
`Turn on the TV with your voice using the
`
`Google Assistant on Sonos Beam. With
`
`Chromecast. you can also control apps,
`
`such as Netflix. YouTuhe. and Starz.
`
`Connect everything
`
`Smart home control
`
`The l[Boogie Assistant works with hundreds
`
`of home appliances and other smart
`
`devices. Set your Nest thermostat or dim
`
`your Philips Hue lights using your yoice.
`
` [2]
`
` [2]
`
`Voice control for TV
`
`Saturday at 8 PM'
`
`Control your smart home
`
`Get mwara
`
`Manage your schedule
`
`"He! 5009'?!- preheat the
`oven and wmdownthe
`
`memostat'
`
`"Hay Google. stop the
`music and tell mewho
`
`Ada Lovelace was'
`
`'Hey Google. add dimer
`tomycalendaron
`
`[2]
`
`4
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 6 of 20 PageID #: 19
`
`Google Assistant comes built-in with Android mobile devices such as
`smartphones and tablets. As well, it can be downloaded to mobile devices, such
`as those running the iOS operating system.
`
`[3
`
`5
`
`]T
`
`he Sonos App can be downloaded from Google Play.
`
` [16]
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 7 of 20 PageID #: 20
`
`[16]
`The Sonos App can control the music played on a Sonos smart speaker
`throughout different areas of a home, and on multiple Sonos smart speakers.
`
`[16]
`Typically, if the Sonos smart speaker (acting as a Google Home device) is near to
`the Google Assistant-enabled mobile device, only the Sonos smart speaker will
`respond to the voice command.
`
`6
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 8 of 20 PageID #: 21
`
`[12]
`However, when the Google Assistant-enabled mobile device is used to control a
`Sonos smart speaker that is out of listening range (e.g. in another area or room
`of a home), the Google Assistant-enabled mobile device will wake and respond to
`the voice command, e.g. turn up the volume on the Sonos smart speaker.
`
`using a first device to
`(a) obtain visual or
`auditory information
`from external to the
`first device where the
`
`[13]
`The Sonos App running on a Google Assistant-enabled mobile device is a first
`device that (a) obtains auditory information from external to the first device
`where the information comprises a human-understandable device command
`directed toward an operation of the second device, (b) manipulates the obtained
`information, and (c) transmits the manipulated information to a distal computer
`
`7
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 9 of 20 PageID #: 22
`
`system.
`For example, using the Sonos App and a Google Assistant-enabled mobile device,
`a user can give a voice command to control a Sonos smart speaker. An example
`voice command is “Hey Google, play Billie Eilish and turn it up”.
`
`information comprises
`a human-
`understandable
`device command
`directed toward an
`operation of the
`second device, (b)
`manipulate the
`obtained information,
`and (c) transmit the
`manipulated
`information to a distal
`computer system;
`
`[2]
`For example, the Google Assistant-enabled mobile device running the Sonos App
`receives the voice command, performs sampling and analog to digital
`conversion, and transmits the command in digital form using data networking
`protocols to remote Google Assistant servers.
`
`8
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 10 of 20 PageID #: 23
`
`the distal computer
`system operating as a
`remote human-to-
`device command
`translation service
`provider using at least
`a portion of the
`manipulated
`information to
`
`[6]
`The Sonos Google Action enables the distal computer system to operate as a
`remote human-to-device command translation service provider by using at least
`a portion of the manipulated information to translate the human-understandable
`device command into a formatted device command executable by the second
`device.
`For example, the Sonos Google Action needs to be setup for the Sonos smart
`speaker to respond to voice commands. The process involves loading and
`executing the Sonos App and Google Assistant app on a iOS or Android mobile
`
`9
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 11 of 20 PageID #: 24
`
`device, and the user being logged into the user’s Google account and Sonos
`account.
`
`translate the human-
`understandable
`device command into
`a formatted device
`command executable
`by the second device;
`
`[18]
`[18]
`
`[18]
`
`
`
`
`
`10
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 12 of 20 PageID #: 25
`
` [18]
`
` [18]
`
` [18]
`For example, the Sonos Google Action in conjunction with Google Assistant voice
`control services interprets voice commands and translates them into device
`commands that are executable by the Sonos smart speaker. The Sonos Google
`Action works with Google Assistant to fulfill user requests spoken in natural
`language to trigger the Sonos smart speaker to perform operations.
`
`11
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 13 of 20 PageID #: 26
`Case 1:21-cv-00432-UNA Document 1-2 Fi en 03 25 21 Page 13 o 20 PagelD #: 26
`
`LET "L
`
`WiJi this action. you can ask .lie Goog:e Assistant to DELI)! music from
`
`various sec-sees
`
`including Goog'e Play.r Music Pandora. Tuneln, Sootfly
`
`and il learEFtad:o
`
`on your Sonos C-no, Bearnr or .‘rorn a Google Assistant
`
`_
`_
`_
`_
`A'JAILABLE LtL‘.'II’;Lb'
`
`de'-.-:ce 'a'irelessiy connected to your Sonos speakers. Star"; rriusie lroin
`
`more than 8|:I other popular music; services Wlll'i the Sonos app. ano tell
`
`Google Assastant to pause. resume ane adjust the volume.
`
`5.34 row '1- AESI‘éTANT
`
`@ Volume up on speaker a Stop the speaker
`
`% Make it lDUdEl' On the speaker a RESUME the speaker
`
`state of a specific device based on the user's room); all you need to do is respond to the requests through your
`
`To connect your device with Google Assistant. you need to build a smart home Action. Assistant handles how users
`
`[17]
`
`How to build
`
`trigger your Action {in multiple languages) and provides you Iwith useful metadata through
`
`{such as the
`
`[5]
`
`12
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 14 of 20 PageID #: 27
`
`transmitting the
`formatted device
`command to the
`second device; and
`
`[6]
`The formatted device command is transmitted to the second device.
`For example, the formatted device command is transmitted over an Internet
`connection via data networking protocols (e.g. Internet and Wi-Fi protocols) to
`the Sonos smart speaker.
`
`13
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 15 of 20 PageID #: 28
`
`[6]
`For example, the Sonos smart speakers have Wi-Fi connection capability for
`receiving the formatted device commands. [9][10][11][14][15]
`
`14
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 16 of 20 PageID #: 29
`
` [9]
`The Sonos smart speaker executes the formatted device command having
`received the formatted device command from the distal computer system, while
`the second device is local to the first device.
`For example, the Sonos smart speaker, acting as the second device, performs
`the voice command formatted as a device command e.g. turns up the volume.
`
`the second device
`executing the
`formatted device
`command having
`received the
`formatted device
`command from the
`distal computer
`system, while the
`second device is local
`to the first device.
`
`[2]
`The Sonos smart speaker and mobile device would typically be connected to the
`same Wi-Fi network, which means they would be within an area of about 2200
`sq. ft. of each other.
`
`15
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 17 of 20 PageID #: 30
`
`Horne size
`
`Tite :iiqge' year 'ioese. ti‘e more add-or peir‘ts you'll r‘eeq to have-wi‘ele-ito'tte'1*1i-Fieo-aerage
`
`Here's as DSIi'T‘aID of i‘ew 'T‘L.ei‘ Wi—Fi coverage yoe'l get with e Eeeqle Nest Wifi e' Soogle Wi" syste't":
`
`Gooqle Nest Wi1"1*
`
`GoeqleWit"1**
`
`“\iest W'fi rotite' [sterdalote]
`
`'Jq to 2,200 sq "'t
`
`Ore Soogle Wi" :Jfli'i'.
`
`'Jq to ",EOE sq '“t
`
`west W'fi route 1 ore eo'rt
`
`'Jq to 3,000 sq ‘t
`
`Two Eooelet‘f'fi poir‘ts
`
`'Jq to 3,000 sq '“t
`
`“test W'fi route 1 two posts
`
`'Jq to 5,400 sq "'t
`
`Tit'ee C—eeele ‘1'1‘T1 pDi'ttS
`
`'Jq to 11,500 sq '“t
`
`Nest W'fi FC‘LIID'
`
`1 titree poi-‘11s
`
`0:1 to T000 sq "'t
`
`:00" Gooqle Wifi ports
`
`03 to 5,000 sq '“t
`
`[7]
`
`'fyoe'veer‘teree Ii‘e sass-word ‘e't'tst Pctwmk :iefo'e. tap Connect
`
`Check that your devices are on the same Wi—Fi
`network
`
`Android
`
`iPhone 5. iPao
`
`Step 1. Check the Wi-Fi network of mobile device or tablet
`
`'I.
`
`Wi-Fi. Tito Wi-Fi tot-sew labeled Cornered" is “fie retwo'kyoe 'e corrected to.
`'_oeete ard tap Settings
`Tit's 'TL. st mates [to Pet-work that the den-ice is ooq'ieoteq to
`
`2. To charge ti‘e Pet-work:
`
`' Tag: a r‘e-.~1'r‘e‘.1«'10'k
`
`ester ease-word
`
`Connect
`
`'
`
`[8]
`
`16
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 18 of 20 PageID #: 31
`
`Likewise, when a Sonos smart speaker is used to control another smart home
`device, both devices would be on the same Wi-Fi network. The Sonos smart
`speaker acts as the first device and the other smart home device acts as the
`second device.
`
`Product List [1]
`Smart Speakers: Roam, Move, and One models
`Sound Bars: Arc and Beam models
`Software:
`Sonos App
`References:
`[1] Sonos – Shop all products
`https://www.sonos.com/en-us/shop
`[2] Sonos - Just say “Hey Google”
`https://www.sonos.com/en-us/google-assistant
`[3] Use Google Assistant with Nest products
`https://support.google.com/googlenest/answer/9325085?hl=en#zippy=%2Cget-the-google-assistant
`[4] Google Assistant – Get things done, hands-free
`https://play.google.com/store/apps/details?id=com.google.android.apps.googleassistant&hl=en_CA&gl=US
`[5] Overview
`https://developers.google.com/assistant/smarthome/overview
`[6] Fulfillment and authentication
`https://developers.google.com/assistant/smarthome/concepts/fulfillment-authentication
`
`17
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 19 of 20 PageID #: 32
`
`[7] How many Google Nest or Google Wifi points do I need?
` https://support.google.com/googlenest/answer/7182840?hl=en-CA&ref_topic=9831837
`[8] Check that your devices are on the same Wi-Fi network
`https://support.google.com/googlenest/answer/7360025?hl=en-CA&ref_topic=7196419#zippy=
`%2Cspeakers
`[9] Sonos – Roam
`https://www.sonos.com/en-us/shop/roam.html
`[10] Sonos – Arc
`https://www.sonos.com/en-us/shop/arc.html
`[11] Sonos – Move
`https://www.sonos.com/en-us/shop/move.html
`[12] Google Next Help – Troubleshoot an issue – Google Home & phone respond to Hey Google
`https://support.google.com/googlenest/answer/7257763?co=GENIE.Platform%3DAndroid&hl=en#zippy=
`[13] c|net- 4 common issues with Google Home and how to fix them
`https://www.cnet.com/how-to/common-issues-with-google-home-and-how-to-fix-them/
`[14] Sonos – One
`https://www.sonos.com/en-us/shop/one.html
`[15] Sonos – Beam
`https://www.sonos.com/en-us/shop/beam-white.html
`[16] Goggle Play – Sonos
`https://play.google.com/store/apps/details?id=com.sonos.acr2&hl=en_CA&gl=US
`[17] Hey Google – Sonos Action
`
`18
`
`
`
`Case 1:21-cv-00432-UNA Document 1-2 Filed 03/25/21 Page 20 of 20 PageID #: 33
`
`https://assistant.google.com/services/a/uid/0000002f9382b43a
`[18] Set up a Google Assistant device to control Sonos
`https://support.sonos.com/s/article/3486?language=en_US
`[19] Sonos - Control Sonos with the Google Assistant
`https://support.sonos.com/s/article/3490?language=en_US
`
`19
`
`