IW 7691548
`
`l!Q) .dJJI,'llQJv,H._!~MJ'llBiES~ ~ 8D@IS,@4)1'liDt~
`
`UNITED STATES DEPARTMENT OF COMMERCE
`United States Patent and Trademark Office
`
`September 10, 2018
`
`THIS IS TO CERTIFY THAT ANNEXED IS A TRUE COPY FROM THE
`RECORDS OF TIDS OFFICE OF THE FILE WRAPPER AND CONTENTS
`OF:
`
`APPLICATION NUMBER: 09/469, 707
`FILING DATE: December 22, 1999
`PATENT NUMBER: 6,397,186
`ISSUE DATE: May 28, 2002
`
`By Authority of the
`Under Secretary of Commerce for Intellectual Property
`and Director of the United St
`s Patent and Trademark Office
`
`Page 1
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`"'
`.,
`"'
`0
`.c
`::,
`en
`
`.-<
`z
`0
`j::::
`<(
`(\
`C)
`u::
`f\J
`1n
`Cl)
`:'.5
`::>
`.,
`"'
`0
`"' w
`~ u ::i en
`
`~
`
`)
`
`.,i
`
`PATENT NUfy-!BER
`
`.
`
`: 8397188
`
`L mm,~\\ 1~~~\\111~~,~, ,
`
`6397186
`
`Rb
`U.S. UTI ITV Patent Application
`I I 'i) ~ L ~,i;,).., ~,
`\, lfY1Wl/ O.I.Pf;T'.l
`_ a,A. CL
`
`SCANNED~~A~ IV~ '-=c(.
`
`MY 2 8 2002
`
`SUBCLASS
`
`;J7S
`
`ART UNIT
`
`L1'-/.I
`
`APPLICATION NO.
`
`CONT/PRIOR CLASS
`
`09/469707
`
`~
`
`~ I
`
`/
`
`i ::;
`
`a. a.
`
`<(
`
`tCl'-j
`liHLLIAM STUAF:T BUSH
`CARLOS FERDINAND ROURA
`
`. -
`
`-
`
`PT0-2040
`12199
`
`ORIGINAL
`
`I
`
`SUBCLASS
`CLASS
`;;i. 7 l,,(
`7{)L1
`INTERNATIONAL CLASSIFICATION
`
`~ l o L .J..I I oo
`
`I
`
`ISSUING CLASSIFICATION
`CROSS REFERENCE(S)
`
`CLASS
`7ovf
`
`SUBCLASS (ONE SUBCl:ASS PER BLOCK)
`:;i..7;2.._
`/
`.,.
`
`/
`
`/
`i/
`.
`
`/
`I
`I
`
`-
`D Continued on lssu.l? Slip Inside File Jacket
`
`/
`
`TERMINAL
`DISCLAIMER
`
`DRAWINGS
`
`CLAIMS ALLOWED
`
`Sheets Drwg.
`
`,;,7
`
`Figs. Drwg.
`
`,;;t 1
`
`Print Fig.
`j_ /
`
`/
`
`Total Claims
`
`Print Claim for O.G.
`)
`
`(date) -
`
`D The term of this patent
`subsequent to
`has been disclaimed.
`D ,;tie term of this patent shall
`not extend beyond the expiration date
`of U.S Patent. No.
`
`(Assistant Examiner)
`
`,.
`
`(Dalo)
`
`; z ; :2 (P~ e r )
`
`,, Amount Due
`
`-*
`.
`/2-2,rD} 6l1r:Joc
`
`(Date)
`
`(iJ
`Date Paid
`
`½-~t~O~
`
`D The terminal _months of
`this patent have been disclaimed.
`
`/YJ)):,.).
`(Legal Instruments Examrter) ~
`
`ISSUE BATCH NUMBER
`
`WARNING:
`The l~JormaUon disclosed herein may be restrleled. UnalJlllort,:ed disck>sura may be prohibited by the United States Code Title 35, Sections 122, 181 and 368.
`Possession outside the U.S. Patent &Tra~ema11c Office i& restriclPd to suthorfmd employees and contractors only.
`
`Fonn PT0 -436A
`(Rev. i>/!19)
`
`•'
`
`/
`.5~-
`,l NOTICE OF ALLOWANCE MAILED
`-
`9;,he, ,snd Do,.
`I• '2..r\ 'L.
`..
`Primarv Err::.,'=: , ·;,, .
`ISSUE FEE
`--- i-t/.:....tJ/
`FILED WITH: (cid:143) DISK (CRF) (cid:143) Fi'CHE
`
`(cid:143) CD-ROM
`
`(Attached in~cket on right inside flap)
`
`,f
`
`(FACE)
`
`•
`
`r
`I
`'\' .· ','... .. )
`\
`
`.
`
`Page 2
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`(cid:143)
`

`

`file:///c:/ AP PS/preexarn/correspondence/1.htm
`
`UNITED STATES DEPARTMENT OF COMMERCE
`Patent and Trademark Office
`Address: COMMISSIONER OF PATENTS AND TRADEMARKS
`Washington, D.C. 20231
`
`CLASS
`348
`
`I
`GROUP ~RT UNIT I
`2711
`
`ATTORNEY
`DOCKET NO.
`66799
`
`I llflll lllll lllll lllll lllll llllll llll llllll Iii 1111111111111111111111
`Bill Data Sheet
`
`~
`
`. (:Rl.C\L NUMBER
`09!469,707
`
`FILING DATE
`12/22/1999
`-
`RULE
`
`:,:,,
`.:!
`AP1lLICANTS
`W1LLIAM STUART BUSH, MANHATTAN BEACH, CA;
`CARLOS FERDINAND ROURA, LOMITA, CA;
`
`..,.
`_y''"'
`
`•• CONTINUING DATA************************* ~1,·, ·ct:
`
`** FOREIGN APPLICATIONS ...,.......... • ....,,...,,.****""'*
`
`{\._)
`
`\ (.NJ
`
`(l,VJ
`
`I
`
`IF RRlUIRED, FOREIGN FILING LICENSE GRA ED** SMALL ENTITY**
`lo-* 02/02/2000
`(cid:143) yes~
`(cid:143) yes
`no (cid:143) Met after
`,..: _ £D
`
`i=oreign Priority claimed
`
`35 USC 119 (a-d) conditions
`met
`Verified and
`Acknowledged
`ADDRESS
`
`Allowance
`
`Emimil'rer's ~mnure
`
`(.
`
`I~
`n 1as
`
`,... /
`
`I
`
`I
`
`-
`
`STATE OR
`
`~
`
`CA
`
`EET/ TOT~ IN~~DENT
`CLAIMS
`CLAIMS
`4
`1
`
`27
`
`., -
`couy DRAWING
`I
`
`2224\ --
`
`TITLE
`
`.,,
`
`,
`
`HANu.3-FREE, VOICE-OPERATED REMOTE CONTROL TRANSMITTER
`
`I
`
`I
`
`FILING FEE FEES: Authority has been given in Paper
`to charge/credit DEPOSIT ACCOUNT
`RECEIVED No.
`No.
`for following:
`445
`
`time)
`
`1(cid:143) All Fees
`I
`1(cid:143) 1.16 Fees (Filing)
`I
`(cid:143) 1.17 Fees ( P.rocessing Ext. of I
`i(cid:143) 1.18 Fees { Issue )
`1(cid:143) Other
`I 1(cid:143) Credit
`
`I
`I
`
`I
`I
`
`t of l
`
`5/19/00 12:29 PM
`
`Page 3
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`ION TRANSMITTAL
`
`provisional ~fl
`
`Attorney Docket No. 66799
`
`\~~~\~-9
`UTILITY PATENT APPL
`(for Noncontinuing,
`Applications under ~, C.F.R. §1.53(b) , ~
`:=
`~
`ll.r-- -
`~ """""'°'
`u.ir-- -0 \
`-~
`~
`)
`~--=,
`) CERTIFICATE OF MAILING BY "EXPRESS MAIL 1~-==t4 -N
`~~ =CII
`u =
`
`"Express Mail II Mailing Label Number
`
`EL452076836US
`
`Ill~ -~
`
`·r,
`
`"""""'
`
`Box PATENT APPLICATION
`Commissioner of Patents and Trademarks
`ATTENTION: Assistant Commissioner
`for Patents
`Washington, D.C.
`
`20231
`
`)
`
`)
`)
`)
`)
`)
`)
`)
`)
`)
`)
`Title: HANDS-FREE, VOICE-OPERATED REMOTE )
`CONTROL TRANSMITTER
`)
`)
`)
`)
`)
`)
`
`Sir:
`
`Transmitted herewith for filing
`under 37 C.F.R. §1.53(b) is the
`nonprovisional, noncontinuing
`patent application for:
`
`'f~irst Named Inventor or
`d~pplication Identifier:
`
`Bush, et al .
`
`Date of Deposit December 22, 1999
`I hereby certify that this paper or fee is being
`deposited with the United States Postal Service
`"Express Mail Post Office to Addressee" Service
`under 37 CFR §1.10 on the date indicated above and
`is addressed to the Conmissioner of Patents and
`Trademarks, Washington, D.C . 20231.
`
`Ed Pri ce
`(Typ e~p e r son mailing)
`
`(Signature iof person mailing)
`
`- . --!:l
`g
`\J(X)
`
`--'-70=--_ pages of the specification (including claims) are enclosed.
`
`h~(X)
`
`nJ(
`HJ
`
`27
`
`sheet(s) of drawings are enclosed.
`
`(X) Formal
`
`) Informal
`
`An executed Oath or Declaration and Power of Attorney naming the
`actual inventors is enclosed.
`
`,JJ( X) The names of persons believed to be the actual inventors are set forth
`in the enclosed unexecuted Oath or Declaration and Power of Attorney
`( §1. 41 (a) and §1. 53 (b)) .
`
`( ) An Assignment (s) of the invention to ________________ _
`and cover sheet are enclosed.
`
`A check in the amount of$ ___ _
`assignment(s) is enclosed.
`
`to cover the fee for recording the
`
`A 37 C.F.R. §3.73(b) Statement is enclosed (where an Assignee seeks
`to take action in a matter before the Patent Office).
`
`(
`
`) An Information Disclosure Statement is enclosed.
`
`A Form PT0-1449 is enclosed.
`
`References (copies) listed on the Form PT0-1449 are
`
`enclosed.
`
`(X) A Return Receipt Postcard is enclosed (MPEP §503).
`
`Noncontinuing Utility §1.53 (b )-1-699
`
`() Priority of application number
`in
`35 u.s.c. §119.
`
`filed on
`is claimed under
`
`Page 4
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`r
`
`At~Jey Docket No. 66799
`
`() A certified copy of the priority document is enclosed.
`
`A MicroFiche Computer Program (Appendix) is enclosed.
`
`A Nucleotide and/or Amino Acid Sequence Submission is enclosed.
`
`A Computer Readable Copy is enclosed.
`
`A Paper Copy (Identical to Computer Copy) is enclosed. ·
`
`A Statement Verifying Identity of above Copies is enclosed.
`
`(X) The filing fee is calculated below:
`
`Fee Calculation For Claims As Filed
`
`(a} Basic Fee
`
`$ 760.00
`
`(b) Independent Claims
`
`1
`
`(c) Total Claims
`
`4
`
`3
`
`20
`
`0
`
`0
`
`X $ 78.00
`
`$ -0-
`
`X $ 18.00
`
`$ -0-
`
`(d) Fee for Multiply Dependent Claims
`
`$260.00
`
`$
`
`Total Filing Fee
`
`$ 760.00
`
`A Statement(s) of Status as Small Entity is
`enclosed, reducing the Filing Fee by half to:
`
`$
`
`A check in the amount of$ ______ _ to cover the filing fee is
`enclosed.
`
`Charge$ ____ _
`to Deposit Account No. 06-1135.
`The. pa¥91e_nt 51,:L,~h~ Fil~nH, ! e~ L1.;.. ~-<t b_e q.eferred until the Declaration -.
`is filed. Do n ot c):iarge, our Deposit Account.
`
`~
`
`I
`
`A separate written request under 37 C.F.R. §l.136(a) (3), which is
`a general authorization to treat any concurrent or future reply
`requiring a petition for an extension of
`time under 37 C.F.R.
`§1.136 (a)
`for its timely submission as incorporating a petition
`for an extension of time for the appropriate length of time, is
`enclosed.
`
`The Commissioner is hereby authorized to charge any additional fees~
`which may be required in this application under 37 C.F.R. §§1.16-1.17
`during its entire pendency, or credit any overpayment, to Deposit
`Account No. 06-1135. Should no proper payment be enclosed herewith,
`as by a check being in the wrong amount, unsigned, post-dated, other(cid:173)
`wise improper or informal or even entirely missing, the Commissioner
`is authorized to charge the unpaid amount to Deposit Account No.
`06-1135. This sheet is filed in triplicate.
`
`n~ l
`~~
`ill
`~ )
`(XJ
`
`( )
`
`(X)
`
`Nonconti11ui11g Utility §1.53(b)-2-699
`
`Page 5
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`At
`
`ey Docket No. 66799
`
`( ) Also enclosed:
`
`(X) Address all future communications to Customer Number 22242.
`
`111111111111 Hll lllll 111111111111111111
`2 2 2 4 2 -
`
`~ITCH, EVEN, TABIN & FLANNERY
`ffiu.ite 1600
`;- 20 South LaSalle
`dew.cage, Illinois
`-J1el ephone:
`( 312)
`( 312)
`-,,.facsimi l e:
`
`Street
`60603-3406
`577-7000
`577-7007
`
`= . ' ~
`
`i\l
`
`(Date)
`
`Re
`
`NoncorriinuiJJg Utility §1.53(1,)-3-699
`214 060
`
`Page 6
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`Attorney Docket N
`CERTI F fCATE OF M.
`
`BY "EXPRESS MA f l"
`r-:1..45'JO 7~'13'- US
`,;;-
`Dare of Deposit .De Ce lit'\. b e tz. l-z. , I qqq
`
`"Express Mail" Mailing Label Number
`
`I hereby certify that this paper or fee
`is being deposited with the United
`States Postal Service "Express Mail
`Post Office to Addressee" Service under
`37 CFR §1.10 on the date indicated
`above and is addressed to Commissioner
`of Patents and Trademarks, Washington,
`D.C. 20231.
`
`£°cf fti 1ce.
`
`(Signature of Person Mailing)
`
`HANDS-FREE, VOICE-OPERA TED REMOTE CONTROL TRANSMITTER
`
`B ACKGROUND OF THE INVENTION
`
`1. Field of Invention
`
`This invention relates to devices for remotely controlling electronic equipment, and
`
`more particularly, to a wireless, user-programmable, voice-activated and voice-operated remote
`
`control system for controlling appliances.
`
`'JJ
`
`2. Description of Prior Art
`
`Historically, appliances, for example, electronic appliances, such as, televisions,
`
`VCRs, digital satellite systems, audio systems, and related accessories, have been remotely
`
`controlled by hand-held transmitters used to generate signals to receivers incorporated into the
`
`electronics of the remotely controlled appliances. Signals for such appliances correspond to
`
`control commands, such as channel selection/tuning, power on/off, audio volume adjustment, and
`
`muting controls, typically generated by the user by depressing buttons on a remote control
`
`transmitter keypad. The basic composition and operation of such remote control systems are well
`
`known in the art.
`
`For convenience, such remote control transmitters are generally designed to be
`
`sufficiently small to be hand-held during operation. There are several disadvantages in using such
`
`hand-held transmitters. For example, the small size and mobility often contribute to misplacement
`
`or loss of the transmitter. Also, for device operators with restricted physical mobility or sight
`
`limitations, hand-held remote controls may not provide sufficient access to the command controls
`
`Page 7
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`2
`
`of the remotely controlled appliances. Also, if an operator's hands are engaged in an activity, an
`
`interruption in the activity may be required to operate the hand-held remote control, causing
`
`inconvenience to the operator and potentially having an adverse effect on productivity.
`
`Additional problems occur as a consumer acquires various remotely controlled
`
`appliances, where each is typically supplied with a separate remote control transmitter. As the
`
`number of separate remote control transmitters increases, locating, distinguishing, and locating
`
`the appropriate transmitters becomes increasingly difficult. In response to this problem, universal
`
`remote control transmitters, pre-programmed by the manufacturers with control commands,
`
`typically coded infrared signals, have been developed to operate many different remotely
`
`controlled electronic appliances, for example, as disclosed in U.S. Pat. No. 4,774,511 . In addition
`
`to universal remote control transmitters, learning remote control transmitters have been developed
`
`which receive the control command signals, typically infrared codes, from the remote control
`
`transmitters provided with remotely controlled appliances and generally store the frequencies and
`
`pulses into memory, with the signals becoming associated with buttons located on the keypad of
`
`the learning remote control transmitter. After programming is complete, depressing the keypad
`
`buttons prompts the learning remote control transmitter to re-transmit the codes stored within its
`
`memory. This allows the user to consolidate the control of several remotely controllable
`
`:--:::
`::.:
`
`appliances into a single hand-held remote control transmitter. An example of such a system is
`
`disclosed in U.S. Patent No. 5,142,398. For additional convenience to the user, the learning
`
`capability has been combined with universal remote control transmitters which are pre(cid:173)
`
`programmed by the manufacturers with control commands necessary to operate many different
`
`remotely controlled electronic appliances, for example as disclosed in U.S. Pat. No. 5,691, 710.
`
`All of the above-mentioned systems require the user to establish physical contact,
`
`typically in the form of manually depressing keypad buttons, to transmit a control command to
`
`the remotely controlled appliance. As such, the above-mentioned systems due to their small size
`
`are often misplaced causing frustration to the user.
`
`As such, voice-operated remote control systems have recently been developed
`
`which operate in response to user-spoken commands instead of commands selected by manually
`
`depressing keypad buttons. U.S. Pat. Nos. 5,199,080; 5,247,580; 5,267,323 and 5,226,090
`
`disclose various embodiments of voice-operated remote control systems which employ voice
`
`control commands instead of control commands entered through buttons on a keypad.
`
`Page 8
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`3
`
`Unfortunately, such systems are not truly hands-free, requiring manual intervention by the user
`
`during use. In particular, such remote control systems as disclosed in the above-mentioned
`
`patents, are all based upon the use of a "talk switch"; which must be manually depressed to enter
`
`a voice command when the transmission of a remote control signal is desired.
`
`U.S. Pat. No. 5,226,090 further discloses a voice-operated remote control system
`
`which contains a detector for detecting whether a voice command is received or not. A detected
`
`signal from the detector is applied to a power supply circuit. When there is no voice command
`
`received as detected by the detector, the power supply control circuit cuts off electric energy
`
`supplied to a speech recognition circuit. The voice command detector circuit is implemented by
`
`a detecting program stored in the ROM in a controller. The detecting program determines
`
`==-~J
`
`whether the talk switch has been depressed. The transmitter operates depending on whether the
`
`talk switch has been depressed. If the talk switch has been depressed, the transmitter is enabled
`
`to remote control signals. Once the talk switch is released, the transmitter is kept in a low power
`
`consumption mode, waiting for voice commands to be applied. As indicated above, the means
`
`for generating and transmitting a remote control signal based on the recognized spoken voice
`
`command is not hands-free, requiring the manual intervention of pressing a talk switch to
`
`accomplish these functions.
`
`Various other systems are known which use speech recognition to control
`
`appliances. For example, U.S. Patent No. 5,852,804 discloses a system for controlling several
`
`external appliances connected to a speech recognition system. However, the system disclosed in
`
`the '804 patent requires physical interconnections between the control system and the appliance
`
`which makes it difficult for a user to add additional appliances or change controlled appliances.
`
`U.S. Patent No. 5,878,394 discloses a system which includes connections to a
`
`remote control network for transmitting infrared codes and a graphical user interface on a
`
`personal computer (PC). In addition to the inconvenience of establishing the remote control
`
`network, a user must have access to a PC and desire to make the PC available for such control
`
`functions. The system disclosed in the '3 94 patent has only limited utility for consumers who have
`
`access to a PC or can afford the expense of a PC and thus excludes a significant portion of
`
`consumers who may otherwise desire to add speech recognition control to their electronic
`
`appliances if an inexpensive alternative is available.
`
`Page 9
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`4
`
`0
`
`U.S. Patent No. 5,774,859 discloses a subscriber information system with a speech
`
`interface, similar to the system disclosed in U.S . Patent No. 5,878,394 the system in the '859
`
`patent is based upon a PC-class processor. Operation of this system is dependent upon receiving
`
`information from an information distribution center or head-end installation and therefore lacks
`
`the advantages of a stand-alone device. Unfortunately, the remote control is not capable of
`
`independently completing the speech recognition process and transmitting infrared signals
`
`indicated by such recognition results to controlled appliances. Furthermore, this system also
`
`requires a PC-class processor.
`
`Inconvenience is another problem that occurs as a user intends to perform multiple
`
`control functions involving one or more controlled appliances and must recall and enter a series
`
`of voice commands to a voice-operated remote control system. U.S. Patent No. 5,852,804
`
`discloses a system, where one speech command may be defined which is capable of manipulation
`
`of more than one connected appliance. However, this system requires that each controlled
`
`appliance be physically connected to the system and that the controlled appliance be manually
`
`manipulated during setup for each function to be executed upon recognition of the speech
`
`command. Also, if a single command is to be used to execute a series of controlled appliance
`
`functions, its capability is limited unless time delays of variable lengths may be inserted within the
`
`series of control functions to accommodate the initialization periods for certain controlled
`
`appliances. For example, if a voice command sends signals to a television to power it on and tum
`
`to a specified channel, a period of time may elapse between the receipt of the power on command
`
`until the television warms up and is ready to receive additional commands. Such initialization
`
`periods vary from appliance to appliance and therefore means is needed to allow a user to adjust
`
`the time delay as necessary.
`
`There are various other problems with known systems which utilize voice
`
`recognition to control appliances. For example, one problem occurs as the list of voice commands
`
`grows. Generally, each time a speech recognition product detects a spoken word, it compares
`
`the word to those in a recognition vocabulary. In general, as a recognition vocabulary increases
`
`in size, recognition time increases and accuracy decreases. The more words in a recognition
`
`vocabulary, the more likely the speech recognition circuit will make a mistake and accuracy
`
`generally diminishes. Without the capability to utilize multiple vocabulary recognition sets, the
`
`commands available for selection must all be available at the same time, meaning they must all
`
`Page 10
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`5
`
`reside in the same recognition vocabulary set. Thus, the user may be inconvenienced by the
`
`limited command availability of a small recognition vocabulary or the diminishing speech
`
`recognition accuracy and longer recognition times resulting as the single recognition vocabulary
`
`is increased in size. Another disadvantage of a single recognition vocabulary is that the
`
`recognition of voice command always yields the same response.
`
`In a multiple recognition
`
`vocabulary set scheme, the same voice command may yield different results upon recognition if
`
`placed within different vocabulary recognition sets. A still further disadvantage of a single
`
`recognition vocabulary is that the recognition vocabulary words must be phonetically distinctive
`
`from each other which may limit the use of words that may be intuitive for their intended function
`
`but are too phonetically similar to other words in the recognition vocabulary, forcing the user to
`
`remember a word that is less intuitive. In a multiple recognition vocabulary set scheme, words
`
`that are not phonetically distinctive from each other may still be used by placing such words in
`
`different recognition vocabulary sets.
`
`Another problem with known systems occurs when a device is limited to executing
`
`software for a single speech recognition mode for recognizing spoken commands to remotely
`
`control appliances. This problem becomes apparent if an appliance has the ability to process a
`
`series of remote control signals arriving within a predetermined time of each other differently than
`
`if the codes arrive at intervals outside of this predetermined time. For example, many televisions
`
`.:--:
`:.:;.:
`
`are capable of receiving the remote control signal transmissions for the digits one, two and three
`
`in rapid succession and responding by switching to channel 123 instead of changing to channel
`
`1, then to channel 2 and then to channel 3. As such, a user must be able to quickly submit a voice
`
`command following the recognition of a prior voice command, and then the recognition of the
`
`latter voice command, the submission of a remote control signal and the detection of the signal
`
`by the appliance must occur within the time limit if the appliance is to interpret the commands as
`
`a related series of commands instead of individual commands.
`
`Thus, there is a need for a stand-alone, wireless remote control that can be
`
`positioned in a location remote to both the user and the controlled appliances, which can be
`
`activated and operated entirely via voice commands, conveniently compatible with commercially
`
`available remote controlled appliances, and can be operated by a plurality of users and can be
`
`programmed by a user to operate in a customized manner.
`
`Page 11
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`6
`
`SUMMARY OF THE INVENTION
`
`The present invention relates to a method and apparatus that enables a user to
`
`control the function of one or more electric appliances or other electrical equipment solely with
`
`voice commands. An important aspect of the invention relates to voice-actuated mode switching
`
`for switching the present invention from a low power consumption mode.
`
`A hands-free speech recognizing transmitter in accordance with the invention,
`
`which may be a light-weight small base mounted unit, is adapted to be located near the controlled
`
`appliances. A voice-operated selection mechanism is provided for selecting any one of a number
`
`of categories of appliances to be controlled. A universal remote control code library may be
`
`provided which allows codes to be selected for control of different types of appliances as well as
`
`appliances manufactured by different manufacturers. Infrared signal receiving, decoding and
`
`storage capabilities further enhance the invention by providing means to learn infrared codes from
`
`other remote control transmitters, such as an appliance's original remote control transmitter. This
`
`'\
`
`feature is advantageous for appliances whose codes are not contained in the universal library
`
`stored in the invention's memory and also serves to render the invention much less susceptible to
`
`obsolescence than speech recognizing transmitters disclosed in the prior art.
`
`A scheme is provided where both speaker independent and speaker dependent
`
`vocabulary may be used as voice commands. A speaker independent vocabulary structure
`
`provides the user with the means of navigating multiple linked recognition vocabulary sets. At
`
`any one time, a single recognition set is made active by the speech recognition circuit. A voice
`
`command in one recognition vocabulary set may be used to activate another recognition
`
`vocabulary set. In this fashion, a user may verbally navigate among different types of remote
`
`control functions and target appliances in an intuitive fashion, while minimizing the number of
`
`alternative words from which the speech recognition circuit must select during any given
`
`recognition process.
`
`With the total recognition vocabulary partitioned into smaller recognition
`
`vocabulary sets, improvements result in recognition time and accuracy because, in general, as a
`
`recognition vocabulary increases in size, recognition time increases and accuracy decreases.
`
`Furthermore, recognition vocabulary sets are created such that the contents within each set have
`
`either functional similarities or otherwise share a relationship that is intuitive to the user. To
`
`prevent confusion that may arise with respect to the active recognition vocabulary set at any given
`
`Page 12
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`7
`
`time, the present invention monitors conditions with a time-out counter and an error counter to
`
`automatically return to a general default mode if certain conditions are met. In other words, a
`
`predetermined number of recognition errors or a period during which no successful recognition
`
`occurs will result in a known default state.
`
`Custom speaker dependent voice commands may be trained by the user and
`
`associated with infrared signals during product setup processes. These speaker dependent
`
`commands may be accessible from the vocabulary structure described above.
`
`The present invention has the capability of transmitting multiple control signals,
`
`such as infrared signals, to one or more appliances in response to a single voice command by the
`
`user. Such macro programs may be programmed by the user during a product setup process. For
`
`example, a user may desire that the response to the voice command "Video" is for the invention
`
`to issue commands to tum a TV power on, wait for the TV to warm up until it is ready to receive
`
`control signals, such as infrared signals, set the channel to "3," select the VCR for control, tum
`
`on the VCR, and execute the VCR' splay function. As another example, the user may desire that
`
`the response to the user-trained voice command "Sports" is for the invention to issue commands
`
`to a TV to tum to channel 123.
`
`The system may be configured to be self-contained in a single free-standing or
`
`stand-alone housing. The housing may contain a directional microphone mounted to be
`
`rotationally adjusted by the user to enable the user to adjust the sensitivity of the microphone so
`
`that the microphone's high sensitivity region is pointed toward the user and microphone noise
`
`generating sources, such as an appliance's loudspeaker are located in a region oflow microphone
`
`sensitivity. Visual indication lights may be provided in a manner to remain in line of sight with
`
`the user to communicate operation status, such as availability for recognition and results of prior
`
`recognition attempts. A small keypad may be provided to assist the user during product setup
`
`sequences. A speaker is also provided to enable output speech synthesized prompts to further
`
`assist the user during setup sequences.
`
`DESCRIPTION OF THE DRAWINGS
`
`These and other advantages of the present invention are readily understood with
`
`reference to the following specification and attached drawings wherein:
`
`Page 13
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`8
`
`FIG. 1 is a functional block diagram of the electronic elements and circuits in one
`
`embodiment of the present invention;
`
`FIG. 2a is a functional block diagram showing the details of the speech recognition
`
`circuit in one embodiment of the present invention;
`
`FIG. 2b is a functional block diagram showing the details of the infrared signal
`
`controlling circuit in one embodiment of the present invention;
`
`FIG. 2c is a schematic circuit diagram showing the details of the audio switching
`
`circuit and the sound activation circuit in one embodiment of the present invention;
`
`FIG. 3 is a perspective view of the physical housing for one embodiment of the
`
`present invention;
`
`FIG. 4a is a side view of the housing illustrated in FIG. 3.
`
`FIG. 4b is an exploded perspective view of the housi., g''fuustrated in FIG. 3.
`
`FIG. 4c is a partial sectional view of the housing.ifiustrated in FIG. 3.
`
`"'~
`
`FIG. 5 is a functional block diagram sho~~e default operation modes of one
`
`embodiment of the present invention;
`
`,/~'f'
`
`FIG. 6 is a functional block diagr~howmg the sound act1vat1on mode sequence
`
`steps for one embodiment of the present inventfun-
`FIG. 7 is a functional block &{gram showing the different recognition modes that
`'
`may be utilized when different recognition ocabulary sets are activated in one embodiment of the
`
`present invention;
`
`FIG. 8 is a functional block diagram showing the sequence of steps for the
`
`response prompting recognition mode for one embodiment of the present invention;
`
`FIG. 9 is a functional block diagram showing the sequence of steps for the pattern
`
`queuing recognition mode for one embodiment of the present invention;
`
`FIG. 10 is a functional block diagram showing a continuation of the sequence of
`
`steps for pattern queuing recognition mode for one embodiment of the present invention shown
`
`inFIG. 9;
`
`FIG. 11 is a functional block diagram showing the sequence steps for executing
`
`a macro program in one embodiment of the present invention;
`
`FIGS. 12A and 12B is a functional block diagram showing the sequence steps for
`
`initiating the product setup process for one embodiment of the present invention;
`
`Page 14
`
`AMAZON 1002
`Amazon v. SpeakWare
`IPR2019-00999
`
`

`

`9
`
`FIGS. 13A-13C is a functional block diagram showing the sequence steps for
`
`selecting a controlled appliance code during a product setup process for one embodiment of the
`
`present invention;
`
`FIGS. 14 A and 14B is a functional block diagram showing the sequence steps for
`
`learning an infrared signal from another remote control transmitter during a product s~!UP process
`
`for one embodiment of the present invention;
`
`FIG. 15 is a functional block diagram showing tb;.~quence steps for teaching
`
`custom, speaker dependent voice command names durin~product setup process for one
`✓
`
`embodiment of the present invention;
`
`/
`
`FIGS. 16A and 16B is a functio~fock diagram showing the sequence steps for
`
`creating a macro program during a product l~tup process for one embodiment of the present
`
`invention;
`
`/
`
`j
`FIG. 17 is a schematic wcuit diagram showing the details of the power supply
`f h
`f
`.
`·
`b d.
`/
`.
`.
`crrcmt o one em o unent o t e p~sent mvent1on;
`FIG. 18a is a funcJ anal block diagram of an alternative embodiment of an audio
`switching circuit in accordanco/°'1th one embodiment of the present invention;
`
`I=
`
`FIG. 18b is a/functional block diagram of an alternate embodiment utilizing
`
`separate microphones for the laund activation circuit and speech recognition circuit in accordance
`
`with the present invention;
`
`FIG. 18c is a functional block diagram of another alternate embodiment utilizing
`
`separate microphones for the sound activation circuit and speech recognition circuit in accordance
`
`with the present invention.
`
`DETAILED DESCRIPTION
`
`The present invention relates to a truly hands-free universal control unit system for
`
`controlling various appliances, such as entertainment appliances, for example, TVs, VCRs,
`
`stereo's and the like and may also be used for non-entertainment appliances and virtually any
`
`device that is amenable to remote control. The universal remote control system in accordance
`
`with the present invention is user programmable to enable any number of appliances to be
`
`programmed by the user.
`
`In order to facilitate portability and eliminate the inconvenience
`
`associated with power cords/cables, the universal control system in accordance with one
`
`embodiment of the invention may be ba