z
`"'
`0
`~ i=
`(;),. <(
`(,)
`.0
`i:i:
`:::1
`(/)
`(/)
`(/)
`
`"I.
`•I:)
`(\.
`rv
`5
`J
`~ (,)
`(ll w
`~ (3
`:::l
`(/)
`~
`
`'\
`i~·
`
`....... {
`
`.__. ..... ··g~'.· .. ·~.·.·B:~
`·., .,. ~- / :
`
`. .
`
`\
`
`.~ -~-,. '· .
`
`. __ _
`
`.
`
`SCANNED
`
`NO.
`
`09/469707
`
`CONT/PRIOA CLASS
`~.
`
`ART UNIT
`
`.~ ::i·
`
`.<
`
`\
`J.i-
`
`HANDS-FREE. VOICE-OPERATED REMOTE
`
`ORIGINAL
`
`I
`
`CLASS
`
`(()0(
`
`SUBCLASS
`
`CLASS
`
`INTERNATIONAL CLASSIFICATION
`
`?- I 0 L )-/ I oo
`
`I
`
`ISSUING CLASSIFICATION
`
`CROSS REFERENCE(S)
`_..,.-
`SUBCLASS (ONE SU~~S PER BLOCK)
`
`.
`
`/
`
`/
`
`/
`
`l
`
`0 Continued on lss~p Inside Fil.e Jacket
`
`Print Fig. vTotal Clai.ms
`
`L
`.5s-
`
`CLA.IMS ALLOWED
`
`Print Claim for O.G.
`)
`
`NOTICE OF ALLOWANCE MAILED
`
`D TERMINAL
`
`DISCLAIMER
`
`DRAWINGS
`
`Sheets Drwg.
`
`Figs. Drwg .
`
`cO The term of this patent
`subsequent to _____ (date)
`has been disclaimed.
`
`.. :.;,
`
`(Assistant Examiner)
`
`~·'F--' _ _,____
`;
`(Date)
`
`. ~~ L /
`' ·----------' -----· L
`
`U The term of this patent shall
`not extend beyond thie expiration date
`of U.S Patent. No. _____ _
`
`=:J The terminal __ months of
`
`(Primary Examiner)
`
`(Date)
`
`Ric . .herr. 1ond 0¥
`£ d
`Prjr:nary Exan
`12_21-o/~,tountDua
`t
`t)(,..J ~6 Q
`ISSUE BATCH NUMBER
`this patent have been .disclaimed. ~ j) T
`/- (./.:_tl) /
`
`ISSUE FEE
`
`(J
`Lf - ~ -0 ~
`
`Date Paid
`
`. .
`
`,
`WA~NING: ,
`The i!formation disclosed herein may be restricted
`.
`.
`. .
`.
`.
`.
`Possission outside the u.s. Patent & Trademark oir Un.authonzed disclosure may be proh1b1ted by the UnJted States Code Title 35, Sect1ons 122, 181 and 368.
`":
`Ice IS restricted to authorized employees and contractors only.
`FILED WITH: 0 DISK (CRF) D FICHE D CD-ROM
`
`(Legal Instruments Examiner)
`
`c_(=-Da-,-te-:-) -
`
`l!'
`
`(FACE}
`
`(Attached in pocket on right inside flap)
`
`·' '.l
`I !-
`1· '
`
`-.:.
`
`·-~
`
`I
`1,
`
`Page 1
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`p•TI:'NT -APPLICATION .. ,\
`
`.
`
`l.-~~
`
`-- ---·-·-
`
`·t~IWJillm. · ,
`
`1
`Date Received
`(Incl. C. of M.)
`or
`Date Mailed
`
`INITIALS_-----;--'_
`
`Date Received
`(lricl. C. of M.)
`or
`Date Mailed
`
`4 2 . - - - - - - - - - _ _ ..:___ __
`
`4 3 . - - - - - - - - - _ _ _ _c._
`
`.. "\
`
`, 16.
`
`17 .
`
`18.
`
`19.
`
`20.
`
`21.
`
`22.
`
`23.
`
`24.
`
`~· - - - - - - - - - - - (cid:173)
`.
`' - - - - - - - - - - - - (cid:173)
`. ,
`. ~:c:----'---'------(cid:173)
`·':,
`~i - - - - - - - - - - - - -
`
`[ _ , - - - - - - - -------
`, :~
`. · · ,_ . . . - - - - - -
`
`-~-------- - - - - -
`-~.
`·-- - - - - - - - - - - - -J -
`0.: ~
`l6 a:'--' - - - - - - - -----
`~ ~
`(/)
`
`53.
`
`54.
`
`55.
`
`56.
`
`57.
`
`58.
`
`59.
`
`60.
`
`61.
`
`. 62.
`
`63.
`
`64.
`
`65.
`
`66.
`
`67.
`
`68.
`
`69.
`
`70.
`
`71 .
`
`72.
`
`73.
`
`74.
`
`75.
`
`76 .
`
`77.
`
`78.
`
`79.
`
`80.
`
`i
`
`li"
`
`40. _ _ _ _ _ _ _ _ _ - - - - -
`
`8 1 . - - - - - - - - - - - - - -
`
`4 1 . - - - - - - - - - - - - - - -
`82. - - - - - - - - - - ' - - - - - -
`(LEFT OUTSIDE)
`
`Page 2
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`•.
`
`ISSUE SLIP STAPLE AREA (for additional cross references)
`
`POSJTION
`
`I~ITJALS
`
`IDN,o
`
`DATE
`
`+
`
`. FEE DETERIV!INA TION
`O.I.P .E.; CLASSIFIER
`FORMALITY REVIEW
`
`Claim
`
`Date
`
`c
`"Cil
`
`'(ij
`u:::
`
`\
`
`f,.;
`
`':1'
`
`<ii ~ J. ~
`~ 2.0
`·c Q ~ o\ -m
`I C1: II .J -
`3 v -
`'J- 2 ..;
`-::::
`)
`lf A II
`-
`z) l\5
`-
`-
`i2 • 6 i
`-.,_-
`t"> 7
`-
`z.lt 8
`v :-::
`?;ti
`~· 1 +
`
`. 1 '
`
`, =l 1~
`
`..;
`
`~ ·~
`
`,;.. ....
`
`lif'i,
`1~
`6 18
`[jW:. +
`"'
`[Ji l.::u IT"" r-:- ~
`·~ 21
`~
`b 22
`~
`- z.1 23
`=:::
`
`-
`l{') 24
`-
`I 25
`fi 26
`-
`--.
`zB 27
`l.JJ 28
`-
`9 29
`-
`10 30
`--
`II 31
`--
`11.. 32
`-
`--
`13 33
`z.'i 34
`-
`:so 35
`--
`7' 36
`-
`~ 37
`-
`l32 38
`--
`~l.i 39
`-
`w 40
`--
`L!t1 42 =
`--
`--
`--
`--
`-
`--
`--
`--
`
`::::::
`
`.
`
`Lib 41
`
`~ 43
`ijq 44
`'if 45
`I) 46
`/b 47
`30. 4S.
`~ 49
`ljb 50
`
`·'
`
`•:
`
`. ~ ·i
`\
`.<:.·
`
`Date
`
`\
`
`'
`
`\.
`
`INDEX OF CLAIMS
`N
`I
`A
`0
`
`' '
`·,.
`.'''\
`
`)
`
`i
`\
`
`Date
`~
`
`,
`
`;
`
`'
`
`'
`
`...
`
`.$""I 521::::
`lS] 53;
`
`3.7 56 -
`se 57-
`15 ~ 58 -:::
`J.rL 59 -:=.
`,q 60-
`zo 61 -::.
`S$62-:
`3'1 63 -
`L\-0 64 ;::
`65
`66
`67
`68
`6.9
`70
`71
`72
`73
`74
`75
`76
`77
`78
`79
`80
`81
`82
`83
`84
`85
`86
`87
`88
`89
`90
`91
`92
`93
`94
`95
`96
`97
`98
`99
`10
`
`·,
`
`.
`
`'
`
`'
`
`,
`
`•,
`
`..
`I
`. I
`
`1 Cla,im<.
`i
`
`_,
`til'
`IIi c
`"Cil
`if ·c
`0
`101
`102
`. 103
`104
`105
`106
`107
`108
`109
`110
`111
`112
`113
`114
`115
`116
`117
`118
`119
`120
`
`12~
`122
`123
`124
`125
`26
`127
`128
`129
`130
`131
`....._ 32
`13~
`
`13~
`13
`13
`13
`38
`39
`40
`141
`
`....._
`
`....... 14~
`14
`....._ 144
`45
`.......
`....._ 46
`I-... 147
`t-- 14
`I-- 14~
`.._ 150
`
`1----
`1---
`r--
`r--
`r--....
`c--.....
`-........
`1---
`1----
`1----
`1----
`--.....
`1----
`1----
`r--...
`r--...
`r--.
`--.....
`r--...
`r---
`r--...
`..........
`--.....
`-......
`-......
`-......
`..........
`-......
`----
`..........
`..........
`..........
`----
`--.....
`..........
`----
`r----
`-......
`-......
`-......
`-.....
`-.....
`-.....
`-...
`-...
`-.._
`
`.......
`-...
`-.._
`-...
`.......
`
`If more than 150 claims or 1 0 actiot)
`~
`staple additional sheet here
`
`(LEFT INSIDE)
`
`\
`
`Page 3
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`SEARCHED
`
`SEARCH NOTES
`(INCLUDING SEARCH STRATEGY)
`
`Exmr.
`Date
`OI-2.:'5--:JJJ CU'I-
`t I'
`' -;:-----
`"2----/ / ..-c:fZ
`~
`r
`iZ-~tJ(
`fLA:)
`-----
`I
`I
`-
`i
`1: ,,
`'
`
`-r
`
`)
`
`Sub.
`
`Date
`
`Exmr.
`
`;)...Do
`JL7S
`)vl/)..
`:2- -s I
`
`{')1-~~-o t
`2-l~ o I
`12--2£>-{)1
`
`(]?_d)
`<IUJ_
`jU?
`
`V0uo1
`A.AA./Ah~ .
`.·-zJabd
`rr
`- V'
`
`• V"'/1''
`
`2-DO
`27)
`?..1~ "
`2...3\
`z_~;;,
`z_,J(
`t.j2..
`--z..-rr
`1.-r'O
`
`i2..-"l..I--O\
`
`V"
`
`/
`
`(t\0
`
`...
`
`/
`
`Class
`
`704_
`
`.
`
`A. A..A!JJ hlP.
`l!
`
`I.~! db!
`
`?DL-1
`
`- .
`
`
`
`--
`
`l
`
`-
`
`INTERFERENCE SEARCHED J
`Exmr.f
`Sub.
`Class
`Date
`I
`
`70'f
`.---
`
`;1.1$
`;LI:/..
`
`i 2...-'2\-o M
`
`/
`
`£,
`
`'
`
`f
`·,
`
`~'·
`
`'
`i
`
`(RIGHT OUTSIDE)
`
`----
`
`Page 4
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`(12) United States Patent
`Bush et al.
`
`111111
`
`1111111111111111111111111111111111111111111111111111111111111
`US006397186Bl
`US 6,397,186 Bl
`May 28,2002
`
`(10) Patent No.:
`(45) Date of Patent:
`
`(54) HANDS-FREE, VOICE-OPERATED REMOTE
`CONTROL TRANSMITTER
`
`(75)
`
`Inventors: William Stuart Bush, Manhattan
`Beach; Carlos Ferdinand Roura,
`Lomita, both of CA (US)
`
`(73) Assignee: Ambush Interactive, Inc., Manhattan
`Beach, CA (US)
`
`( *) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21) Appl. No.: 09/469,707
`
`(22) Filed:
`
`Dec. 22, 1999
`
`Int. Cl.7
`................................................ GlOL 21!00
`(51)
`(52) U.S. Cl •........................................ 704/274; 704/272
`(58) Field of Search ................................. 704/200, 275,
`704/272, 231, 233, 251, 252, 255, 250
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`3/1982 Faierstain
`4,322,718 A
`4,725,827 A * 2/1988 Gallegos, Jr. eta!. ...... 340/696
`4,771,283 A * 9/1988 Imoto .................... 340/825.71
`9/1988 Rumbolt et a!.
`4,774,511 A
`2/1990 Nishio
`4,905,279 A
`8/1992 Heep
`5,142,398 A
`5,199,080 A * 3/1993 Kimura et a!. .............. 381/110
`7/1993 Kimura
`5,226,090 A
`9/1993 Kimura eta!.
`5,247,580 A
`11/1993 Kimura
`5,267,323 A
`5,444,673 A * 8/1995 Mathurin ..................... 368/63
`9/1995 Thompson
`5,452,274 A
`11/1995 Chung eta!.
`5,471,557 A
`11/1997 Pietraszak et a!.
`5,691,710 A
`6/1998 Houser eta!.
`5,774,859 A
`7/1998 Chuang
`5,777,571 A
`8/1998 Mozer eta!.
`5,790,754 A
`12/1998 Sako
`5,852,804 A
`3/1999 Muhling
`5,878,394 A
`
`OTHER PUBLIClXfiONS
`"24AA64/24LC64 64K ecnn CMOS Serial EEPROM"
`published by Microchip Technology Inc. 1999, Document
`No. DS21189C, pp. 1-12.
`"CMOS Low Voltage 2Q SPST Switches ADG701/
`ADG702" published by Analog Devices, Inc. 1998, pp. 1-8.
`"CMOS Low Voltage 4Q SPDT Switch ADG719" published
`by Analog Devices, Inc. 1998, pp. 1-8.
`
`(List continued on next page.)
`
`Primary Examiner--Richemond Dorvil
`(74) Attorney, Agent, or Firm---Katten Muchin Zavis
`Rosenman
`
`(57)
`
`ABSTRACT
`
`A wireless, programmable, sound-activated and voice(cid:173)
`operated remote control transmitter can be used to add
`hands-free speech control operation to a plurality of
`remotely controlled appliances manufactured by various
`manufacturers, each of which is normally controlled with
`one or more signals from an associated remote control
`transmitter. The system may be pre-programmed with a
`universal library of codes for controlling various appliance
`categories and appliances produced by various manufactur(cid:173)
`ers within each category. The system may also be pro(cid:173)
`grammed using the controlled appliances' remote control
`transmitters and one or more operators' spoken commands.
`Once programming is complete, there is no need for the
`operator to manually operate the system, allowing true
`hands-free voice control of the remotely controlled products.
`Voice commands are organized into a plurality of linked
`recognition vocabulary sets, each representing a subset of
`the complete voice command vocabulary available. These
`subsets are structured in a fashion that is intuitive to the user
`because the structure is consistent with controlled appliance
`operation. As such, the system allows a user to easily
`navigate via voice commands between recognition sets to
`attain access to the intended voice commands.
`
`(List continued on next page.)
`
`55 Claims, 27 Drawing Sheets
`
`50
`
`r--
`
`1!!: SPEECH RECOGNIZING TRANSMITTER
`
`Page 5
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`US 6,397,186 Bl
`Page 2
`
`U.S. PATENT DOCUMENTS
`
`5,959,751 A
`5,983,186 A
`6,012,029 A *
`6,052,666 A *
`6,070,140 A *
`6,119,088 A
`
`9/1999
`11/1999
`1/2000
`4/2000
`5/2000
`9/2000
`
`Darbee eta!.
`Miyazawa et a!.
`Cirino et a!.
`............... 704/275
`Die! et al. . ................. 704/275
`Tran ........................... 704/275
`Ciluffo
`
`01HER PUBLICATIONS
`
`"DM1000 Component Directional Microphone" published
`by Lucent Technologies, pp. 1-2.
`
`"MACH 4 CPLD Family High Performance EE CMOS
`Programmable Logic," Publication 17466 ,published by
`Lattice Semiconductor Corporation, May 1999 pp. 1-62.
`
`"Preliminary Product Specification Z86L81/86/98 28-Pin
`Low-Voltage Infrared Microcontroller", Document No.
`DS000701-IRX1298, published by Zilog, Inc. 1999, pp.
`1-55.
`"RSC-300/364 DataBook" published by Sensory, Inc., Aug.
`1999, pp. 1-50.
`• Synthesis • Control",
`"RSC-300/364 Recognition
`datasheet part No. 80-0111-6, published by Sensory,
`Inc.1999, pp. 1--8.
`"Build a Voice-Activated Tape Recorder Switch", by Marc
`Spiwak, Popular Electronics magazine , Jan. 1996, pp.
`35-36, 79.
`"Voice Direct™ Speech Recognition IC", datasheet part No.
`80-0022-5, published by Sensory Inc., Sep. 8, 1998, pp.
`1-4.
`* cited by examiner
`
`Page 6
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`1--"
`~
`0'1
`QO
`1--"
`;--1
`\0
`~
`0'1
`rJ'l
`
`e
`
`-..l
`N
`
`'"""' 0 ......,
`~ .....
`'JJ. =(cid:173)~
`
`N c c
`
`N
`
`~CIO
`N
`'-<
`~
`~
`
`~ = ......
`~ ......
`~
`•
`\Jl
`d •
`
`~
`I
`
`POWER SUPPLY CIRCUIT
`
`,, ,,
`
`I
`I
`
`72-
`
`10: SPEECH RECOGNIZING TRANSMITTER
`
`~
`
`71
`j
`RECEIVER
`INFRARED
`~
`
`a
`
`...._
`
`A~
`
`.4 I. A~
`
`AIL
`
`;2
`
`AI.
`
`MEMORY
`....
`... WRITE
`READ/
`,r
`'INDICATORS I
`J~l. + u
`
`~
`
`DIODE
`
`LIGHT -EMITTING
`
`INFRARED
`rso
`
`r+
`
`CIRCUIT
`
`CONTROLLING
`
`SIGNAL
`
`INFRARED
`
`....
`
`!70
`
`MICROPHONE r+ SWITCHING r+ ACTIVATION .... RECOGNITION
`
`CIRCUIT
`
`SPEECH
`
`CIRCUIT
`
`CIRCUIT
`
`SOUND
`
`AUDIO
`
`120
`
`I
`
`....
`...
`
`FIG. 1
`
`!30
`
`I KEYPAD r-
`I SPEAKER
`io
`
`51....-'
`
`53..,....,
`
`~,
`
`~~
`
`~~
`
`.4~
`
`Page 7
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`1--"
`~
`0'1
`QO
`1--"
`;--1
`\0
`~
`0'1
`rJ'l
`
`e
`
`-..l
`N
`0 ......,
`N
`~ .....
`'JJ. =-~
`
`N c c
`
`N
`
`~CIO
`N
`'-<
`~
`~
`
`~ = ......
`~ ......
`~
`•
`\Jl
`d •
`
`J
`I
`I
`I
`I
`I
`I
`I
`I
`I
`I
`1
`
`PWM ~~·---~
`
`INTERFACE 1,-,., MEMORY
`MEMORY
`WRITE
`EXTERNAL I L
`: .i. READ/
`
`69
`L
`
`I 66
`_/_
`
`....
`
`"'11""-
`
`....
`
`,...
`
`.....
`
`1 r61 ~62
`....
`,... :0::
`
`.....
`
`....,j
`
`...oil ~
`UNIT
`
`PROCESSING
`
`1.,....
`
`1
`.....,u..... r67 :
`1
`:
`
`SOURCE
`CLOCK
`f64
`
`rl
`63
`
`SPEECH
`
`'Y
`_L
`
`[59
`
`t
`
`CONTROLLER
`
`·
`
`AID
`
`{60
`
`lf57~
`
`{56
`
`SPEECH RECOGNITION CIRCUIT
`
`.....L5o __ _
`
`FIG. 2a
`
`-
`
`30
`
`.("""""
`51 ~SPEAKER L..._
`....
`!...,_ __ ~------~----
`I ----· --
`
`DIODE
`
`LIGHT -EMITTING
`
`~3
`
`~ INFRARED "'-71
`
`RECEIVER
`
`CONTROLLING
`
`CIRCUIT
`
`MEMORY ~
`
`READ/
`
`,....-. INFRARED
`
`KEYPAD
`
`INFRARED SIGNAL
`
`72_,. WRITE M
`lj l
`'("""""
`INDICATORSL..._
`
`52
`
`......
`
`....
`----------
`
`~
`l
`
`------•
`I
`
`....
`----------
`
`""'"
`
`....,.
`
`,....
`
`54
`J
`.rr;-1 MEMORY
`GENERAL PURPOSE INPUT/OUTPUT ~ WRITE
`: READ/
`:
`
`.....
`~ MODE PIN I ROM I RAM I
`
`I
`I
`I
`1
`I
`I
`I __ ...... ._..,
`I .. :
`f58 ~ OSCILLATOR 1 .. 1
`I
`... I i
`I
`Q:---+~-t--1"'._ PREAMP -+
`:
`1
`1
`tf55
`I ---------------------------------------
`
`rs5
`
`~
`
`..... J,...-
`1
`
`to.-
`
`....
`
`AGC
`
`lo
`
`ciRCUIT
`
`ACTIVATION
`
`SOUND
`
`,
`
`CIRCUIT
`
`AUDIO SWITCHING
`
`MICROPHONE ·~
`
`,20
`
`Page 8
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 3 of 27
`
`US 6,397,186 Bl
`
`r L--------
`
`-- --------1
`~0
`81;:- -;;;-RA;;;; S~L 7o'"NT~LI~IRCUIT 1
`• • •
`------------------i
`Pl0 v75
`OE0
`
`I
`I
`1
`
`L
`
`INDICATOR
`
`Page 9
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 4 of 27
`
`US 6,397,186 Bl
`
`FIG. 2c
`
`30
`
`AUDIO SWITCHING
`CIRCUIT
`
`I(cid:173)
`I
`I
`I
`I
`I
`I
`MICROPHONE 1---o----o...t
`
`20
`
`~-
`
`1 Kn
`
`_ _ _ _ _ _co
`
`SOUND ACTIVATION CIRCUIT
`
`47Kn
`
`50
`
`SPEECH RECOGNITION
`CIRCUIT
`
`AID
`
`AGC
`
`Page 10
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 5 of 27
`
`US 6,397,186 Bl
`
`12
`
`11
`
`~10
`
`FIG. 3
`
`35
`
`51
`
`53-
`
`71
`
`Page 11
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 6 of 27
`
`US 6,397,186 Bl
`
`22
`
`23
`
`10----.._
`
`\
`16
`
`FJG. 4a
`
`80
`
`81
`
`96-
`
`12
`102
`~97
`84
`
`--- 80
`
`81
`
`FIG.4c
`
`--98
`
`'
`------9~t 12
`---..
`100
`102
`
`11,2 ~--118
`I
`,
`
`.--~ w::·
`
`116 \
`120
`
`/--
`
`110
`
`·-~as
`
`'-----84
`
`FIG.4b
`
`Page 12
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 7 of 27
`
`US 6,397,186 Bl
`
`FIG. 5
`
`N
`
`LISTEN FOR VOICE
`COMMANDS
`
`DETECT SOUND
`
`ACTIVATE SPEECH
`RECOGNTION CIRCUIT
`
`SWITCH MICROPHONE
`OUTPUT TO SPEECH
`RECOGNITION CIRCUIT
`
`ENTER
`RECOGNITION MODE
`
`SET TIME OUT COUNTER
`......---+1 & ERROR COUNTER= 0
`
`GENERATE PATTERN
`
`ACTIVATE INDICATOR
`
`PERFORM PATTERN
`RECOGNITION
`
`y
`
`SET TIME OUT COUNTER
`= 0 & INCREMENT
`ERROR COUNTER
`
`ACTIVATE INDICATOR
`
`N
`
`SELECT APPLIANCE
`CATEGORY
`
`5521 ~....------------,
`TRANSMIT INFRARED
`SIGNAL TO APPLIANCE
`
`Page 13
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 8 of 27
`
`US 6,397,186 Bl
`
`FIG. 6
`
`S621
`
`S622
`
`S623
`
`S624
`
`INACTIVATE I DISABLE
`UNNEEDED CIRCUITS
`
`ENTER SOUND
`ACTIVATION MODE
`
`SWITCH MICROPHONE
`OUTPUT TO SOUND
`ACTIVATION CIRCUIT
`
`LISTEN FOR SOUND
`
`S626
`
`REMAIN IN
`SOUND ACTIVATION
`MODE
`
`Page 14
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 9 of 27
`
`US 6,397,186 Bl
`
`FIG. 7
`
`PATTERN
`QUEUING MODE
`F 1 4 - - - - - - -<
`
`CONTINUOUS
`LISTENING MODE
`
`RESPONSE
`PROMPTING
`MODE
`
`E
`
`Page 15
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 10 of 27
`
`US 6,397,186 Bl
`
`FIG. 8
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMANDS
`
`ENTER RESPONSE
`PROMPTING
`RECOGNITION MODE
`
`SET TIME OUT
`COUNTER= 0, ERROR
`COUNTER= 0 & START
`TIME OUT COUNTER
`
`GENERATE PATIERN
`
`5637
`
`PERFORM PATIERN
`RECOGNITION
`
`SELECT APPLIANCE
`CATEGORY
`
`TRANSMIT INFRARED
`SIGNAL TO APPLIANCE
`
`INCREMENT ERROR
`COUNTER
`
`5640
`~------~------~
`ACTIVATE INDICATOR
`
`y
`
`N
`
`Page 16
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`u.s. Patent
`
`May 28,2002
`
`Sheet 11 of 27
`
`US 6,397,186 Bl
`
`FIG. 9
`
`5660
`
`ENTER
`PATTERN QUEUING
`RECOGNITION MODE
`
`5661
`
`5662
`
`SET= 0 & START TIME
`OUT COUNTER
`
`SET PATTERN
`COUNTER = 0 AND
`QUEUE COUNTER = 0
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMANDS
`
`GENERATE PATTERN
`
`QUEUE PATTERN
`IN MEMORY
`
`5666
`
`5667
`
`5669
`
`PERFORM
`PATTERN
`RECOGNITION
`
`5672
`
`N
`
`QUEUE INSTRUCTION
`IN MEMORY
`
`INCREMENT QUEUE
`COUNTER BY 1
`
`5675
`
`5676
`
`DECREMENT PATTERN
`COUNTER BY 1
`
`INCREMENT PATTERN
`COUNTER BY 1
`
`SUBMIT NEXT PATTERN
`FOR RECOGNITION
`
`5678
`
`Page 17
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 12 of 27
`
`US 6,397,186 Bl
`
`FIG. 10
`
`RETRIEVE INSTRUCTION
`FROM MEMORY
`
`SEND SIGNAL TO
`INFRARED SIGNAL
`CONTROLLING CIRCUIT
`
`DECREMENT QUEUE
`COUNTER BY 1
`
`- - - -L - - -
`I
`
`5690
`
`DETERMINE
`ASSOCIATED REMOTE
`CONTROL FUNCTION
`
`5691
`
`IDENTIFY MEMORY
`LOCATION OF
`CONTROL CODE
`
`GENERATE SIGNAL FOR
`APPLIANCE
`
`SUBMIT SIGNAL TO
`INFRARED LED
`
`TRANSMIT INFRARED
`SIGNAL TO APPLIANCE
`
`5692
`
`5693
`
`5694
`
`5695
`
`L - - - - - - J
`
`Page 18
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 13 of 27
`
`US 6,397,186 Bl
`
`FIG. 11
`
`5700
`
`RETRIEVE INSTRUCTION
`!.---------r-------......,
`FROM MEMORY
`
`y
`
`EXECUTE TIME DELAY
`
`5702
`
`N
`
`SEND SIGNAL TO
`INFRARED SIGNAL
`CONTROLLING CIRCUIT
`
`5710
`-~-----
`
`L------~D
`
`--,
`
`r
`I
`I
`I
`I 5712
`I
`I
`I
`I
`I
`I
`I
`L ---------------
`
`IDENTIFY TARGET
`APPLIANCE
`DEVICE CATEGORY
`
`N
`
`DETERMINE
`ASSOCIATED REMOTE
`CONTROL FUNCTION
`
`IDENTIFY MEMORY
`LOCATION OF
`CONTROL CODE
`
`GENERATE SIGNAL FOR
`APPLIANCE
`
`SUBMIT SIGNAL TO
`INFRARED LED
`
`TRANSMIT INFRARED
`SIGNAL TO APPLIANCE
`
`5713
`
`5714
`
`5715
`
`5716
`
`5717
`
`Page 19
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 14 of 27
`
`US 6,397,186 Bl
`
`FIG. 12a
`
`5202
`
`DISCONNECT
`POWER SOURCE
`
`5203
`
`EXECUTE RESET
`& START TIME OUT
`COUNTER
`
`r A~IT -;;TT-;;
`
`SELECTION
`
`DEPRESS
`SETUP BUTTON
`
`lfS205
`
`vi
`I
`I
`
`DEPRESS
`CODE BUTTON
`
`DEPRESS LEARN
`SIGNAL BUTTON
`
`DEPRESS NAME
`COMMAND BUTTON
`
`DEPRESS
`MACRO BUTTON
`
`Page 20
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 15 of 27
`
`US 6,397,186 Bl
`
`FIG. 12b
`
`r -
`
`APPLIANCE CATEGORY SELECTION ROUTINE
`
`ENTER RESPONSE
`PROMPTING
`RECOGNITION MODE
`
`ACTIVATE APPLIANCE
`CATEGORY NAME
`RECOGNITION SET
`
`SET= 0 & START
`RECOGNITION
`TIME OUT COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMAND
`
`GENERATE PATTERN
`
`PERFORM PATTERN
`RECOGNITION
`
`IDENTIFY APPLIANCE
`CATEGORY NAME
`RECOGNIZED
`
`SEND INSTRUCTION TO
`IDENTIFY APPLIANCE
`CATEGORY TYPE
`
`IDENTIFY ASSOCIATED
`MEMORY SECTION
`
`N
`
`I
`I
`I
`L ________ J
`
`y
`
`Page 21
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 16 of 27
`
`US 6,397,186 Bl
`
`FIG. 13a
`
`SEND INSTRUCTION TO
`ACTIVATE CODE
`SELECTION PROGRAM
`
`SET= 0 & START
`PROGRAMMING
`TIME OUT COUNTER
`
`ENTER RESPONSE
`PROMPTING
`RECOGNITION MODE
`
`ACTIVATE APPLIANCE
`CATEGORY NAME
`RECOGNITION SET
`
`SET= 0 & START
`RECOGNITION
`TIME OUT COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMAND
`
`GENERATE PATTERN
`
`PERFORM PATTERN
`RECOGNITION
`
`IDENTIFY APPLIANCE
`CATEGORY NAME
`RECOGNIZED
`
`SEND INSTRUCTION TO
`IDENTIFY APPLIANCE
`CATEGORY TYPE
`
`IDENTIFY ASSOCIATED
`MEMORY SECTION
`
`SET= 0 & START
`PROGRAMMING
`TIME OUT COUNTER
`
`ENTER
`PATTERN QUEUING
`RECOGNITION MODE
`
`ACTIVATE DIGITS
`RECOGNITION SET
`
`Page 22
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 17 of 27
`
`US 6,397,186 Bl
`
`FIG. 13b
`
`8260
`
`8261
`
`SET= 0 & START
`RECOGNITION
`TIME OUT COUNTER
`
`SET PATTERN
`COUNTER = 0 AND
`QUEUE COUNTER = 0
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMANDS
`
`GENERATE PATTERN
`
`QUEUE PATTERN
`IN MEMORY
`
`8266
`
`8267
`
`PERFORM
`PATTERN
`RECOGNITION
`
`8270
`
`N
`
`QUEUE INSTRUCTION
`IN MEMORY
`
`INCREMENT QUEUE
`COUNTER BY 1
`
`8273
`
`8274
`
`DECREMENT PATTERN
`COUNTER BY 1
`
`14-----1
`
`INCREMENT PATTERN
`COUNTER BY 1
`
`SUBMIT NEXT PATTERN
`FOR RECOGNITION
`
`8276
`
`Page 23
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 18 of 27
`
`US 6,397,186 Bl
`
`FIG. 13c
`
`8281
`
`IDENTIFY APPLIANCE
`CODE RECOGNIZED
`
`RETRIEVE INSTRUCTION
`FROM MEMORY
`
`SEND INSTRUCTION TO
`INFRARED SIGNAL
`CONTROLLING CIRCUIT
`
`8285
`
`____ .c::.. __ _
`I
`
`I
`
`DETERMINE IDENTIFIER
`ASSOCIATED WITH
`INSTRUCTION
`
`8286
`
`DECREMENT QUEUE
`COUNTER BY 1
`
`STORE IDENTIFIER
`IN MEMORY
`
`5287
`
`r -:90- - - - -
`1
`I
`I
`I
`I
`
`CODE NOT ACCEPTED
`
`5291
`
`ACTIVATE INDICATOR
`
`ASSIGN APPLIANCE
`CODE TO APPLIANCE
`CATEGORY
`
`8293
`
`8294
`
`EXIT
`PROGRAMMING MODE
`
`8292
`ALLOW TIME OUT
`OF PROGRAMMING
`COUNTER
`
`~--------------
`
`' - - - - -+ tO
`
`Page 24
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 19 of 27
`
`US 6,397,186 Bl
`
`FIG. 14a
`
`SEND INSTRUCTION TO
`ACTIVATE SIGNAL
`LEARNING PROGRAM
`
`SET= 0 & START
`PROGRAMMING
`TIME OUT COUNTER
`
`ENTER RESPONSE
`PROMPTING
`RECOGNITION MODE
`
`ACTIVATE APPLIANCE
`CATEGORY NAME
`RECOGNITION SET
`
`SET= 0 & START
`RECOGNITION
`TIME OUT COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMAND
`
`5309
`
`GENERATE PAITERN
`
`S310
`~------~------~
`PERFORM PATTERN
`RECOGNITION
`
`IDENTIFY APPLIANCE
`CATEGORY NAME
`RECOGNIZED
`
`SEND INSTRUCTION TO
`IDENTIFY APPLIANCE
`CATEGORY TYPE
`
`IDENTIFY ASSOCIATED
`MEMORY SECTION
`
`SEND INSTRUCTION TO
`IDENTIFY SIGNAL
`LEARNING CODE
`
`S313
`
`S314
`
`S315
`
`SET= 0 & START
`PROGRAMMING
`TIME OUT COUNTER
`
`Page 25
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 20 of 27
`
`US 6,397,186 Bl
`
`FIG. 14b
`
`S329
`~--------------~
`IDENTIFY ASSOCIATED
`INSTRUCTION
`
`ENTER RECOGNITION
`MODE & ACTIVATE
`RECOGNITION SET
`
`SET= 0 & START
`.------+~ RECOGNITION TIME OUT
`COUNTER
`
`N
`
`y
`
`Page 26
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 21 of 27
`
`US 6,397,186 Bl
`
`FIG. 15
`
`5340
`
`ACTIVATE VOICE
`TRAINING PROGRAM
`
`SET= 0 & START
`TRAINING PROGRAM
`TIME OUT COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`5341
`
`5342
`
`LISTEN FOR VOICE
`COMMAND
`
`GENERATE
`REFERENCE PATTERN
`
`N
`
`GENERATE PATTERN
`
`y
`
`PROMPT USER TO
`CHANGE VOICE
`COMMAND NAME
`
`STORE REFERENCE
`PATTERN IN MEMORY
`
`5348
`
`STORE PATTERN
`IN MEMORY
`
`PROMPT USER TO
`REPEAT VOICE
`COMMAND
`
`5349
`
`ALLOW TIME OUT OF
`TRAINING PROGRAM
`COUNTER
`
`Page 27
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 22 of 27
`
`US 6,397,186 Bl
`
`FIG. 16a
`
`ACTIVATE MACRO
`PROGRAMMING MODE
`
`EXECUTE APPLIANCE
`CATEGORY SELECTION
`ROUTINE
`
`ENTER
`SPEAKER DEPENDENT
`RECOGNITION MODE
`
`ACTIVATE SPEAKER
`DEPENDENT
`RECOGNITION SET
`
`SET= 0 & START
`RECOGNITION
`TIME OUT COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMAND
`
`GENERATE PATTERN
`
`PERFORM PATTERN
`RECOGNITION
`
`8371
`
`y
`
`ACTIVATE INDICATOR
`
`IDENTIFY ASSOCIATED
`MEMORY LOCATION TO
`STORE INSTRUCTIONS
`
`ENTER DEFAULT
`RECOGNITION MODE
`
`Page 28
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 23 of 27
`
`US 6,397,186 Bl
`
`FIG. 16b
`
`ENTER
`RECOGNITION MODE
`
`ACTIVATE
`RECOGNITION SET
`
`SET= 0 & START
`....------.! RECOGNITION TIME OUT
`COUNTER
`
`ACTIVATE
`PROMPTING INDICATOR
`
`LISTEN FOR VOICE
`COMMANDS
`
`GENERATE PATTERN
`
`5388
`~---~----.
`PERFORM PATTERN
`RECOGNITION
`
`ACTIVATE INDICATOR
`
`STORE ASSOCIATED
`INSTRUCTION
`IN MEMORY
`
`5393
`.-------~------~
`STORE END MARKER
`INSTRUCTION
`IN MEMORY
`
`STORE INSTRUCTION
`FOR TIME DELAY IN
`MEMORY
`
`EXIT MACRO
`PROGRAMMING MODE
`
`Page 29
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`U.S. Patent
`
`May 28,2002
`
`Sheet 24 of 27
`
`US 6,397,186 Bl
`
`FIG. 17
`
`SPST SWITCH
`
`93
`
`1 Kn
`
`·--1
`
`I
`I
`I
`I
`I
`
`55
`
`SPEECH RECOGNITION
`CIRCUIT IC
`
`68
`
`91
`
`1
`
`V cc CONNECTIONS
`
`Page 30
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`FIG. 18a
`
`50
`
`... -..
`
`SPEECH
`
`CIRCUIT
`
`20
`
`MICROPHONE
`
`~ ..
`
`AUDIO
`
`SOUND
`
`CIRCUIT
`
`~lr
`
`53-'
`
`51-'
`
`+
`L+ SWITCHING ~ ACTIVATION f+ RECOGNITION ~ SIGNAL ~
`CIRCUIT
`~~ }_
`~~ 1o
`30
`I SPEAKER l
`~ KEYPAD 1---
`l
`
`r1o
`INFRARED
`
`CONTROLLING
`CIRCUIT
`~~~ ~
`
`j~
`
`,so
`INFRARED
`LIGHT -EMITTING
`DIODE
`
`~~
`
`~~ ~ + ~lr
`I INDICATORS l
`/2
`
`.~
`
`~lr
`
`READ/
`WRITE
`MEMORY
`
`..
`-..
`
`72-
`
`L...-
`
`~
`INFRARED
`RECEIVER
`
`~~ ~
`
`,-....
`
`_4
`
`10: SPEECH RECOGNIZING TRANSMITTER
`
`l
`l
`
`I
`~· I ~ lr
`POWER SUPPLY CIRCUIT 1
`
`-?
`
`d •
`\Jl
`•
`~
`~ ......
`~ = ......
`
`~
`~
`'-<
`N
`~CIO
`
`N c c
`
`N
`
`'JJ. =(cid:173)~
`~ .....
`N
`Ul
`0 ......,
`N
`-..l
`
`e
`
`rJ'l
`0'1
`~
`\0
`;--1
`1--"
`QO
`0'1
`~
`1--"
`
`Page 31
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`FIG. 18b
`
`50
`
`1
`
`......
`-,.
`
`r
`
`1
`
`20 ..
`
`1
`MICROPHONE A
`I
`~·
`
`1
`SOUND
`MICROPHONE 8,_. ACTIVATION~
`~~
`(
`CIRCUIT
`~~
`20b
`}_
`40
`
`-,lr
`
`s3.,J
`
`51.-
`
`1
`l SPEAKER l
`I KEYPAD }-J
`l
`
`r7o
`rBO
`1
`INFRARED
`INFRARED
`SPEECH
`LIGHT -EMITTING ~
`SIGNAL
`CONTROLLING ~
`RECOGNITION ~
`DIODE
`CIRCUIT
`CIRCUIT
`,jt.
`.4J:.4 J:
`
`J ~~ • ~r
`
`I
`
`4~
`
`liNDICATORS l
`
`A~
`
`'2
`
`.,~
`
`READ/
`.... WRITE
`--,..
`MEMORY
`
`72-
`
`-
`
`'*
`
`INFRARED
`RECEIVER
`
`.4~ ~
`
`1(SPE:CH RECOGNIZING TRANSMITTER
`
`l
`
`~r
`
`~,
`
`POWER SUPPLY CIRCUIT }
`
`~ •
`00
`•
`1-C
`~
`
`~ = .......
`
`~
`~
`
`~ = ~
`~ s
`
`rJ'J =(cid:173)~
`
`~
`~
`~
`Q
`~
`~
`~
`
`~
`rJ:J
`0\
`~
`\0
`_;-.l
`""""" QC
`0\
`o=
`"""""
`
`Page 32
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`20
`
`MICROPHONE A
`
`~Ito
`
`~~
`
`AUDIO
`
`SOUND
`
`CIRCUIT
`1_
`~~
`40
`
`FIG. 18c
`
`..
`...
`
`J
`
`SPEECH
`
`CIRCUIT
`
`{70
`
`INFRARED
`
`CONTROLLING
`CIRCUIT
`
`~~
`
`~lt-~lt-
`
`•
`MICROPHONE B ~ SWITCHING r. ACTIVATION f+ RECOGNITION ~ SIGNAL
`CIRCUIT
`1
`~~ 1
`20b
`30
`
`~~~ + v
`l2
`~ KEYPAD r---
`
`~,.
`
`~SPEAKER
`53....,
`
`51--;;;7
`
`IINDICATORS1
`
`.4~to.
`
`u
`READ/
`... WRITE
`MEMORY
`
`--,.
`
`72
`
`l
`
`I
`I
`
`.,,
`
`,.
`
`I
`
`POWER SUPPLY CIRCUIT
`
`90
`
`r
`
`~
`10: SPEECH RECOGNIZING TRANSMITTER
`
`Cj
`•
`\J'J.
`•
`~
`~ ......
`~ = ......
`
`~
`
`~
`~
`'-<!!~
`N
`~CIO
`
`rso
`INFRARED
`LIGHT-EMITTING
`DIODE
`
`f+
`
`~~
`
`-
`
`~
`INFRARED
`RECEIVER
`
`·~ 1. 71
`
`N c s
`
`'J). =(cid:173)~
`~ .....
`N
`""~
`0 ......,
`N
`""~
`
`Cj
`\Jl
`
`0'1 w
`\0
`;--1
`1--"
`QO
`
`0'1 = 1--"
`
`Page 33
`
`SPEAKWARE EXHIBIT 2001
`
`

`

`US 6,397,186 Bl
`
`10
`
`25
`
`1
`HANDS-FREE, VOICE-OPERATED REMOTE
`CONTROL TRANSMITTER
`BACKGROUND OF THE INVENTION
`1. Field of Invention
`This invention relates to devices for remotely controlling
`electronic equipment, and more particularly, to a wireless,
`user-programmable, voice-activated and voice-operated
`remote control system for controlling appliances.
`2. Description of Prior Art
`Historically, appliances, for example, electronic
`appliances, such as, televisions, VCRs, digital satellite
`systems, audio systems, and related accessories, have been
`remotely controlled by hand-held transmitters used to gen(cid:173)
`erate signals to receivers incorporated into the electronics of 15
`the remotely controlled appliances. Signals for such appli(cid:173)
`ances correspond to control commands, such as channel
`selection/tuning, power on/off, audio volume adjustment,
`and m~ting controls, typically generated by the user by
`depressmg buttons on a remote control transmitter keypad. 20
`The basic composition and operation of such remote control
`systems are well known in the art.
`For convenience, such remote control transmitters are
`generally designed to be sufficiently small to be hand-held
`during operation. There are several disadvantages in using
`such hand-held transmitters. For example, the small size and
`mobility often contribute to misplacement or loss of the
`transmitter. Also, for device operators with restricted physi-
`cal mobility or sight limitations, hand-held remote controls
`may not provide sufficient access to the command controls
`of the remotely controlled appliances. Also, if an operator's
`hands are engaged in an activity, an interruption in the
`activity may be required to operate the hand-held remote
`control, causing inconvenience to the operator and poten(cid:173)
`tially having an adverse effect on productivity.
`Additional problems occur as a consumer acquires vari(cid:173)
`ous remotely controlled appliances, where each is typically
`supplied with a separate remote control transmitter. As the
`number of separate remote control transmitters increases
`locating, distinguishing, and locating the appropriate trans~
`mitters becomes increasingly difficult. In response to this
`problem, universal remote control transmitters, pre(cid:173)
`programmed by the manufacturers with control commands
`typically coded infrared signals, have been developed t~
`operate many different remotely controlled electronic 45
`appliances, for example, as disclosed in U.S. Pat. No.
`4,774,511. In addition to universal remote control
`transmitters, learning remote control transmitters have been
`developed which receive the control command signals,
`typically infrared codes, from the remote control transmit- 50
`ters provided with remotely controlled appliances and gen(cid:173)
`erally store the frequencies and pulses into memory, with the
`signals becoming associated with buttons located on the
`keypad of the learning remote control transmitter. After
`programming is complete, depressing the keypad buttons 55
`prompts the learning remote control transmitter to
`re-transmit the codes stored within its memory. This allows
`the user to consolidate the control of several remotely
`controllable appliances into a single hand-held remote con(cid:173)
`trol transmitter. An example of such a system is disclosed in 60
`U.S. Pat. No. 5,142,398. For additional convenience to the
`user, the learning capability has been combined with uni(cid:173)
`versal remote control transmitters which are pre(cid:173)
`programmed by the manufacturers with control commands
`necessary to operate many different remotely controlled 65
`electronic appliances, for example as disclosed in U.S. Pat.
`No. 5,691,710.
`
`2
`All of the above-mentioned systems require the user to
`establish physical contact, typically in the form of manually
`depressing keypad buttons, to transmit a control command
`to the remotely controlled appliance. As such, the above-
`5 mentioned systems due to their small size are often mis(cid:173)
`placed causing frustration to the user.
`As such, voice-operated remote control systems have
`recently been developed which operate in response to user(cid:173)
`spoken commands instead of commands selected by manu(cid:173)
`ally depressing keypad buttons. U.S. Pat. Nos. 5,199,080;
`5,247,580; 5,267,323 and 5,226,090 disclose various
`embodiments of voice-operated remote control systems
`which employ voice control commands instead of control
`commands entered through buttons on a keypad.
`Unfortunately, such systems are not truly hands-free, requir(cid:173)
`ing manual intervention by the user during use. In particular,
`such remote control systems as disclosed in the above(cid:173)
`mentioned patents, are all based upon the use of a "talk
`switch"; which must be manually depressed to enter a voice
`command when the transmission of a remote control signal
`is desired.
`U.S. Pat. No. 5,226,090 further discloses a voice-operated
`remote control system which contains a detector for detect(cid:173)
`ing whether a voice command is received or not. A detected
`signal from the detector is applied to a power supply circuit.
`When there is no voice command received as detected by the
`detector, the power supply control circuit cuts off electric
`energy supplied to a speech recognition circuit. The voice
`command detector circuit is implemented by a detecting
`program stored in the ROM in a controller. The detecting
`program determines whether the talk switch has been
`depressed. The transmitter operates depending on whether
`the talk switch has been depressed. If the talk switch has
`been depressed, the transmitter is enabled to remote control
`signals. Once the talk switch is released, the transmitter is
`kept in a low power consumption mode, waiting for voice
`commands to be applied. As indicated above, the means for
`generating and transmitting a remote control signal based on
`the recognized spoken voice command is not hands-free,
`requiring the manual intervention of pressing a talk switch
`to accomplish these functions.
`Various other systems are known which use speech rec(cid:173)
`ognition to control appliances. For example, U.S. Pat. No.
`5,852,804 discloses a system for controlling several external
`appliances connected to a speech recognition system.
`However, the system disclosed in the '804 patent requires
`physical interconnections between the control system and
`the appliance which makes it difficult for a user to add
`additional appliances or change controlled appliances.
`U.S. Pat. No. 5,878,394 discloses a system which includes
`~onnections to a remote control network for transmitting
`mfrared codes and a graphical user interface on a personal
`computer (PC). In addition to the inconvenience of estab(cid:173)
`lishing the remote control network, a user must have access
`to a PC and desire to make the PC available for such control
`functions. The system disclosed in the '394 patent has only
`limited utility for consumers who have access to a PC or can
`afford the expense of a PC and thus excludes a significant
`portion of consumers who may otherwise desire to add
`speech recognition