-· "l
`z
`0
`"'
`~ t=:
`' :')
`u, <(
`(\
`()
`,.0
`::,
`iI
`'V
`(/)
`ii5
`Cl)
`<(
`. .J
`J
`er
`(.)
`V)
`ct! w
`~ 0
`::::i
`(/)
`~
`
`' 1
`----
`'
`
`U.S. UTl,LITY Patent Application
`
`397188
`
`-1
`
`_-3971'86
`
`APPLICATION NO.
`
`09;459707
`
`w
`
`E t-
`
`CONT/PRIOR CLASS
`
`SUBCLASS
`
`~ ;J7S
`
`ART UNIT
`fl-:11
`
`·27--1.1
`
`c: CJ l\i ·r i}r/L~·
`
`1,,... Vi
`
`·•2·· F.• -•·:·, ~t-oo--~yl ·11· ·-r-·r i:::· r::
`-
`.. !JI~ .. l
`
`.
`
`. ,¥'.'
`;._
`
`....... .
`
`_,,.,,.,,., __
`
`PTO-2040
`12/99
`
`ORIGINAL
`
`I
`
`ISSUING CLASSIFICATION
`CROSS REFERENCE($)
`
`CLASS
`70 I/(
`
`SUBCLASS (ONE SUB~i:e..(Ss PER BLOCK)
`:;)., 7 ;i_
`
`/
`
`/
`
`/
`,I'
`
`'-
`
`..
`
`CLASS
`
`7() L,(
`
`SUBCLASS
`;;2-7 L,(
`INTERNATIONAL CLASSIFICATION
`
`/' _.,...,. I 0 L ,)../ I c;O
`
`f
`
`..
`
`/
`I
`
`l
`
`□ TERMINAL
`DISCLAIMER
`
`DRAWINGS
`
`Figs. Drwg.
`
`~1
`
`Sheets Drwg.
`
`2,7
`
`/
`Print Fig. VTotal Claims
`5~-
`j_ /
`/
`
`D Continued on lss~Tp Inside File Jacket
`/
`
`CLAIMS ALLOWED
`
`Print Claim for O.G.
`)
`
`NOTICE OF ALLOWANCE MAILED
`
`. ),2,.(\ 'z__
`
`..
`
`ISSUE FEE
`
`(J
`
`The term of this patent
`subsequent to
`has been disclaimed.
`
`(date)
`
`The term of this patent shall
`not extend beyond th,e expiration date
`of U.S Patent. No.
`
`D The terminal _months of
`this patent have been disclaimed.
`
`,_
`
`I
`
`(Date)
`
`(Assistant Examiner)
`
`I
`
`Primary Exam er
`
`Richemond i
`,p ~ -
`-- /-r/--£)/
`
`,
`
`(Primary Examiner)
`
`~
`I 2~2,1,.oj
`6111'00
`ISSUE BATCH NUMBER
`
`Amount Due
`
`Date Paid
`
`~ -·1) -0:1_
`
`(Date)
`
`IY7))~')_
`
`(Legal Instruments Examiner)
`
`(Date)
`
`WAF,INING:
`The iiformation disclosed herein may be restricted. Unauthorized disclosure may be prohibited by the United States Code Title 35, Sections 122, 181 and 368.
`Poss~ssion outside the U.S. Patent & Trademark Office is restricted to authorized employees and contractors only.
`FILED WITH: □ DISK (CRF) □ FICHE □ CD-ROM
`(Attached in pocket on right inside flap)
`
`Form PT0-436A
`(Rev. 6/99)
`
`,f
`'I
`
`¼ I
`
`(FACE)
`
`Page 1 of 245
`
`GOOGLE EXHIBIT 1010
`
`

`

`-
`
`~
`
`.al
`
`p. TCtJT ·APPLICATION
`
`Ill/If lltlf 11li111.
`
`J
`
`CONTENTS
`Date Received
`(Incl. C. of M.)
`or
`Date Mailed
`
`INITIALS __ _
`
`Date Received
`(Incl. C. of M.)
`or
`Date Mailed
`
`15.
`
`I 16,
`
`17.
`
`18.
`
`: 19.
`
`20.
`
`· 21.
`
`22.
`
`23.
`
`, 24.
`
`42. _________ - - - -
`
`43. - - - - - - ' - - - - - - -
`
`44,.·_ - - - - - - - (cid:173)
`/
`· '45. _________ - - - -
`
`46. _________ - - - -
`
`47. _________ - - - -
`
`48. - - - - - ' - - - - - - - - - - -
`49. _________ - - - -
`
`50. _________ - - - -
`
`\
`
`53.
`
`54.
`
`55.
`
`56.
`
`57.
`
`58.
`
`59.
`
`60.
`
`61.
`
`62.
`
`63.
`
`64.
`
`65.
`
`66.
`
`67.
`
`68.
`
`69.
`
`70.
`
`71.
`
`72.
`
`73.
`
`74.
`
`75.
`
`76.
`
`77.
`
`78.
`
`79.
`
`80.
`
`81.
`
`82.
`
`,_
`
`(LEFT OUTSIDE)
`
`='tt'
`__.o:,
`='tt'
`
`'
`
`-
`
`~
`
`'
`
`40.
`
`41.
`
`-I
`
`(\J
`V
`·..-I
`00
`..., r-- '
`:!: (\J .
`0 ...-4 -~
`::l lf)
`;4S)
`CU- --
`C: ct: "
`
`.
`
`~
`
`~ ---== --
`==* ~ --LI) =Q
`===LI) =OJ
`--(I") ==a, =r-=Q
`===Q =Q -~
`:::::* ----= ~
`ts -"' .., ~
`- Cl .., m
`
`Page 2 of 245
`
`

`

`file:///c:/ APPS/preexam/correspondence/ I . htm
`
`11111111111111111111111m 111111111111111111111111111111111111111111
`Bib Data Sheet
`
`UNITED STATES DEPARTMENT OF COMMERCE
`Patent and Trademark Office
`Address: COl'v!MISSIONER OF PATENTS AND TRADEMARKS
`Washington, D.C. 20231
`
`I . 09/469.707
`
`FILING DATE
`ATTORNEY
`GROUP ART UNIT
`CLASS
`l":RIAL NUMBER
`12/22/1999
`DOCKET NO.
`2711
`348
`p'~i .. -1'""c"A'"""'NT_s __________ ...,......,... _____ .,..... ______ .,..... ______ ......,;i
`66799
`RULE
`
`.~
`
`
`
`WILLIAM STUART BUSH, MANHATTAN BEACH, CA;
`CARLOS FERDINAND ROURA, LOMITA, CA;
`
`* CONTINUING DATA************************* ,J,,_-~ \ (\!VJ
`
`* FOREIGN APPLICATIONS********************
`
`rJ V
`
`I (l,i-?
`
`IF Rl:ClUIRED, FOREIGN FILING LICENSE GRA
`** 02/02/2000
`
`Dyes~';.9
`D yes L.9"no D Met after
`Allowance
`(
`
`HANu3-FREE, VOICE-OPERATED REMOTE CONTROL TRANSMITTER
`
`FILING FE:E
`RECEIVED
`445
`
`EES: Authority has been given in Paper
`o. ____ to charge/credit DEPOSIT ACCOUNT
`o. ____ for following:
`
`ID 1.16 Fees ( Filing)
`D 1.17 Fees ( Processing Ext. of
`time)
`ID 1.18Fees(lssue_) ___ ··•·········· ·-···i
`□ Other
`D Credit
`, .......... -....,. ==-·-=-··===··=·: •. ========================··=="'"""· =-==···=· =-= .. ··=·-=·~=·····
`
`I of I
`
`5/19/00 12:29 PM
`
`Page 3 of 245
`
`

`

`,~~c\ctq
`~ION TRANSMITTAL
`UTILITY PATENT APPL-
`lprovisional
`(for Noncontinuing,
`Applications under sl C.F.R. ~§1.53 (_b) ,~
`
`'--A
`
`Attorney Docket No. 66799
`
`~ =
`ll.11:-~
`c:::,
`0\
`
`"Express Mail" Mailing Label Number
`
`EL452076836US
`
`·r-,
`
`!!!!!!!!!!!!
`
`Date of Deposit December 22, 1999
`I hereby certify that this paper or fee is being
`deposited with the United States Postal Service
`"Express Mail Post Office to Addressee" Service
`under 37 CFR §1.10 on the date indicated above and
`is addressed to the Commissioner of Patents and
`Trademarks, Washington, D.C. 20231.
`
`Ed Price
`(Ty p e~ person mailing)
`
`(Signature;of person mailing)
`
`Box PATENT APPLICATION
`Commissioner of Patents and Trademarks
`ATTENTION: Assistant Commissioner
`for Patents
`Washington, D.C.
`
`20231
`
`Sir:
`
`Transmitted herewith for filing
`under 37 C.F.R. §1.53(b) is the
`nonprovisional, noncontinuing
`patent application for:
`
`~ ·::.
`
`~jirst Named Inventor or
`;TA.pplication Identifier:
`
`: ,;:: ~
`
`Bush, et al.
`
`ml:--°'
`)
`·°' - ,
`\,D!!!!!!!!!!!!C'II
`) CERTIFICATE OF MAILING BY "EXPRESS MAIL'~~ ~
`u =
`.-1<:1' -C'II
`)
`IJ')C:::, =.-t
`)
`)
`)
`)
`)
`)
`)
`)
`)
`)
`Title: HANDS-FREE, VOICE-OPERATED REMOTE)
`CONTROL TRANSMITTER
`)
`)
`)
`)
`)
`)
`
`X)
`
`70
`
`pages of the specification (including claims) are enclosed.
`
`~:1'.(X)
`
`27
`
`sheet(s) of drawings are enclosed.
`
`(X) Formal
`
`) Informal
`
`An executed Oath or Declaration and Power of Attorney naming the
`actual inventors is enclosed.
`
`X) The names of persons believed to be the actual inventors are set forth
`in the enclosed unexecuted Oath or Declaration and Power of Attorney
`(§1.41(a) and §1.53(b)).
`
`( ) An Assignment(s) of the invention to
`and cover sheet are enclosed.
`
`( ) A check in the amount of$ ___ _ to cover the fee for recording the
`assignment(s) is enclosed.
`
`( ) A 37 C.F.R. §3.73(b) Statement is enclosed (where an Assignee seeks
`to take action in a matter before the Patent Office).
`
`( ) An Information Disclosure Statement is enclosed.
`
`A Form PTO-1449 is enclosed.
`
`References (copies) listed on the Form PTO-1449 are
`
`enclosed.
`
`(X) A Return Receipt Postcard is enclosed (MPEP §503).
`
`Noncontinuing Utility §1.SJ(b)-1-699
`
`( ) Priority of application number
`in
`35 u.s.c. §119.
`
`filed on
`is claimed under
`
`Page 4 of 245
`
`

`

`Atl ~ey Docket No. 66799
`
`( ) A certified copy of the priority document is enclosed.
`
`A MicroFiche Computer Program (Appendix) is enclosed.
`
`A Nucleotide and/or Amino Acid Sequence Submission is enclosed.
`
`( ) A Computer Readable Copy is enclosed.
`
`A Paper Copy (Identical to Computer Copy) is enclosed.
`
`A Statement Verifying Identity of above Copies is enclosed.
`
`(X) The filing fee is calculated below:
`
`Fee Calculation For Claims As Filed
`
`(a) Basic Fee
`
`(b) Independent Claims
`
`(c) Total Claims
`
`1
`
`4
`
`(d) Fee for Multiply Dependent Claims
`
`$ 760.00
`
`3 =_0 __
`X $ 78.00 = $_-0~--(cid:173)
`- 20 =_0 __
`X $ 18.00 = $_-0~---
`$ ___ _
`
`$260.00
`
`Total Filing Fee
`
`$ 760.00
`
`A Statement(s) of Status as Small Entity is
`enclosed, reducing the Filing Fee by half to:
`
`$ ___ _
`
`A check in the amount of$ ______ _ to cover the filing fee is
`enclosed.
`
`Charge$ __ __ _
`
`to Deposit Account No. 06-1135.
`
`(X.)
`
`( ) A separate written request under 37 C.F.R. §1.136(a) (3), which is
`a general authorization to treat any concurrent or future reply
`requiring a petition for an extension of
`time under 37 C.F.R.
`§1.136 (a)
`for its timely submission as incorporating a petition
`for an extension of time for the appropriate length of time, is
`enclosed.
`
`(X)
`
`The Commissioner is hereby authorized to charge any additional fees
`which may be required iq this application under 37 C.F.R. §§1.16-1.17
`during its entire pendency, or credit any overpayment, to Deposit
`Account No. 06-1135. Should no proper payment be enclosed herewith,
`as by a check being in the wrong amount, unsigned, post-dated, other(cid:173)
`wise improper or informal or even entirely missing, the Commissioner
`is authorized to charge the unpaid amount to Deposit Account No.
`06-1135. This sheet is filed in triplicate.
`
`Noncontinuing Utility §1.53(b)-2-699
`
`Page 5 of 245
`
`

`

`Atl
`
`ley Docket No. 66799
`
`( ) Also enclosed:
`
`(X) Address all future communications to Customer Number 22242.
`
`I llllll lllll lllll lllll 111111111111111111
`
`2 2 2 4 2 -
`
`:d~,
`1iFITCH, EVEN, TABIN & FLANNERY
`,Jsuite 1600
`J~20 South LaSalle
`dchicago, Illinois
`Jfelephone:
`(312)
`°',facsimile:
`( 312)
`
`Street
`60603-3406
`577-7000
`577-7007
`
`(Date)
`
`.s
`JOHNS.
`Re stration No.
`
`Noncontinuing Utility §1.53(b)-3-699
`214060
`
`Page 6 of 245
`
`

`

`Attorney Docket N_,
`CERT! FI CATE OF R°A
`
`. BY "EXPRESS MA IL"
`
`E1...Y,c;te> 7<,<i' 3'- <.JS
`"Express Mail" Mailing Label Number
`Datt:ofDeposit i)ecelN\.r,e,t. 2-Z-1 lqqq
`I hereby certify that this paper or fee
`is being deposited with the United
`States Postal Service "Express Mail
`Post Office to Addressee" Service under
`37 CFR §1.10 on the date indicated
`above and is addressed to Commissioner
`of Patents and Trademarks, Washington,
`D.C. 20231.
`J;"e;f &,ce.,
`
`(Signature of Person Mailing)
`
`HANDS-FREE, VOICE-OPERATED REMOTE CONTROL TRANSMITTER
`
`BACKGROUND OF THE INVENTION
`
`1. Field of Invention
`
`This invention relates to devices for remotely controlling electronic equipment, and
`
`more particularly, to a wireless, user-programmable, voice-activated and voice-operated remote
`
`control system for controlling appliances.
`
`2. Description of Prior ,'.\rt
`
`Historically, appliances, for e~ample, electronic appliances, such as, televisions,
`
`VCRs, digital satellite systems, audio systems, and related accessories, have been remotely
`
`controlled by hand-held transmitters used to generate signals to receivers incorporated into the
`
`electronics of the remotely controlled appliances. Signals for such appliances correspond to
`
`control commands, such as channel selection/tuning, power on/off, audio volume adjustment, and
`
`muting controls, typically generated by the user by depressing buttons on a remote control
`
`transmitter keypad. The basic composition and operation of such remote control systems are well
`
`known in the art.
`
`For convenience, such remote control transmitters are generally designed to be
`
`sufficiently small to be hand-held during operation. There are several disadvantages in using such
`
`hand-held transmitters. For example, the small size and mobility often contribute to misplacement
`
`or loss of the transmitter. Also, for device operators with restricted physical mobility or sight
`
`limitations, hand-held remote controls may not provide sufficient access to the command controls
`
`.,
`
`Page 7 of 245
`
`

`

`of the remotely controlled appliances. Also, if an operator's hands are engaged in an activity, an
`intemrption in the activity may be required to operate the hand-held remote control, causing
`inconvenience to the operator and potentially having an adverse effect on productivity.
`Additional problems occur as a consumer acquires various remotely controlled
`appliances, where each is typically supplied with a separate remote control transmitter. As the
`number of separate remote control transmitters increases, locating, distinguishing, and locating
`the appropriate transmitters becomes increasingly difiicult. In response to this problem, universal
`remote control transmitters, pre-programmed by the manufacturers with control commands,
`. typically coded infrared signals, have been developed to operate many different remotely
`controlledelectronicappliances,forexample,asdisclosedinU.s.Pat.No.4,TT4,5ll. Inaddition
`to universal remote control transmitters, learning remote control transmitters have been developed
`which receive the control command signals, typically infrared codes, from the remote control
`transmitters provided with remotely controlled appliances and generally store the frequencies and
`pulses into memory, with the signals becoming associated with buttons located on the keypad of
`the learning remote control transmitter. Aftpr programming is complete, depressing the keypad
`buttons prompts the learning remote control transmitter to re-transmit the codes stored within its
`memory. This allows the user to consolidate the control of several remotely controllable
`appliances into a single hand-held remote control transmitter. An example of such a system is
`disclosed in U.S. Patent No. 5,142,398. For additional convenience to the user, the learning
`capability has been combined with universal remote control transmitters which are pre-
`programmed by the manufacturers with control commands necessary to operate many different
`remotely controlled electronic appliances, for example as disclosed in U.S. Pat. No. 5,691,710.
`All ofthe above-mentioned systems require the user to establish physical contact,
`typically in the form of manually depressing keypad buttons, to transmit a control command to
`the remotely controlled appliance. As such, the above-mentioned systems due to their small size
`are often misplaced causing frustration to the user.
`As such, voice-operated remote control systems have recently been developed
`which operate in response to user-spoken commands instead of commands selected by manually
`depressing keypad buttons. u.S. pat. Nos. 5,199,0g0; 5,247,5g0; s,267,323 and 5,226,090
`disclose various embodiments of voice-operated remote control systems which employ voice
`control commands instead of control commands entered through buttons on a keypad.
`
`Page 8 of 245
`
`

`

`Unfortunately, such systems are not truly hands-free, requiring manual intervention by the user
`during use. In particular, such remote control systems as disclosed in the above-mentioned
`patents, are all based upon the use of a "talk switch"; which must be manually depressed to enter
`a voice command when the transmission of a remote control signal is desired.
`
`U. S. Pat. No. 5,226,090 further discloses a voice-operated remote control system
`which contains a detector for detecting whether a voice command is received or not. A detected
`signal from the detector is applied to a power supply circuit. When there is no voice command
`received as detected by the deteetor, the power supply control circuit cuts off electric energy
`supplied to a speech recognition circuit. The voice command detector circuit is implemented by
`a detecting program stored in the ROM in a controller. The detecting program determines
`whether the talk switch has been depressed. The transmitter operates depending on whether the
`talk switch has been depressed. If the talk switch has been depressed, the transmitter is enabled
`to remote control signals. Once the talk switch is released, the transmitter is kept in a low power
`consumption mode, waiting for voice cornmands to be applied. As indicated above, the means
`for generating and transmitting a remote control signal based on the recognized spoken voice
`command is not hands-free, requiring the manual intervention of pressing a talk switch to
`accomplish these functions.
`Various other systems are known which use speech recognition to control
`appliances. For example, U.S. Patent No. 5,852,804 discloses a system for controlling several
`external appliances connected to a speech recognition system. However, the system disclosed in
`the '804 patent requires physical interconnections between the control system and the appliance
`which makes it difficult for a usef to add additional appliances or change controlled appliances.
`U.S. Patent No. 5,878,394 discloses a system which includes connections to a
`remote control network for transmitting infrared codes and a graphical user interface on a
`personal computer (PC). In addition to the inconvenience of establishing the remote control
`network, a user must have access to a PC and desire to make the PC available for such control
`functions. The system disclosed inthe'394 patent has only limited utility for consumers who have
`access to a PC or can afford the expense of a PC and thus excludes a significant portion of
`consumers who may otherwise desire to add speech recognition control to their electronic
`appliances if an inexpensive alternative is available.
`
`I
`
`Page 9 of 245
`
`

`

`U. S. PatentNo. 5,774,859 discloses a subscriber information system with a speech
`interface, similar to the system disclosed in U.S. Patent No. 5,878,394 the system in the '859
`
`patent is based upon a PC-class processor. Operation of this system is dependent upon receiving
`information from an information distribution center or head-end installation and therefore lacks
`the advantages of a stand-alone device. Unfortunately, the remote control is not capable of
`independently completing the speech recognition process and transmitting infrared signals
`indicated by such recognition results to controlled appliances. Furthermore, this system also
`requires a PC-class processor.
`
`Inconvenience is anotherproblemthat occurs as auserintendsto performmultiple
`control functions involving one or more controlled appliances and must recall and enter a series
`of voice commands to a voice-operated remote control system. U.S. Patent No. 5,852,804
`discloses a system, where one speech command may be defined which is capable of manipulation
`of more than one connected appliance. Flowever, this system requires that each controlled
`appliance be physically connected to the system and that the controlled appliance be manually
`manipulated during setup for each function to be executed upon recognition of the speech
`command. Also, if a single command is to be used to execute a series of controlled appliance
`
`functions, its capability is limited unless time delays ofvariable lengths may be inserted within the
`series of control functions to accommodate the initialization periods for certain controlled
`appliances. For example, if a voice command sends signals to a television to power it on and turn
`to a specified channel, a period of time may elapse between the receipt ofthe power on command
`until the television warms up and is readyto receive additional commands. Such initialization
`periods vary from appliance to appliance and iherefore means is needed to allow a user to adjust
`
`the time delay as necessary.
`
`There are various other problems with known systems which utilize voice
`recognition to control appliances. For example, one problem occurs as the list ofvoice commands
`grows. Generally, each time a speech recognition product detects a spoken word, it compares
`the word to those in a recognition vocabulary. In general, as a recognition vocabulary increases
`in size, recognition time increases and accuracy decreases. The more words in a recognition
`vocabulary, the more likely the speech recognition circuit will make a mistake and accuracy
`generally diminishes, Without the capability to utilize multiple vocabulary recognition sets, the
`commands available for selection must all be available at the same time. meanins thev must all
`
`Page 10 of 245
`
`

`

`reside in the same recognition vocabulary set. Thus, the user may be inconvenienced by the
`limited command availability of a small recognition vocabulary or the diminishing speech
`recognition accuracy and longer recognition times resulting as the single recognition vocabulary
`is increased in size. Another disadvantage of a single recognition vocabulary is that the
`recognition of voice command always yields the same response. In a multiple recognition
`vocabulary set scheme, the same voice command may yield difilerent results upon recognition if
`placed within different vocabulary recognition sets. A still further disadvantage of a single
`recognition vocabulary is that the recognition vocabulary words must be phonetically distinctive
`
`from each other which may limit the use ofwords that may be intuitive for their intended function
`
`but are too phonetically similar to other words in the recognition vocabulary, forcing the user to
`remember a word that is less intuitive. In a multiple recognition vocabulary set scheme, words
`that are not phonetically distinctive from each other may still be used by placing such words in
`
`different recognition vocabulary sets.
`
`Another problem with known systems occurs when a device is limited to executing
`software for a single speech recognition mode for recognizing spoken commands to remotely
`control appliances. This problem becomes apparent if an appliance has the ability to process a
`
`series of remote control signals arriving within a predetermined time of each other differently than
`if the codes arrive at intervals outside of this predetermined time. For example, many televisions
`
`are capable of receiving the remote control signal transmissions for the digits one, two and three
`in rapid succession and responding by switching to channel 123 instead of changing to channel
`
`1, then to channel 2 and then to channel 3. As such, a user must be able to quickly submit a voice
`command following the recognition of a prior voice command, and then the recognition of the
`
`latter voice command, the submission of a remote control signal and the detection of the signal
`
`by the appliance must occur within the time limit ifthe appliance is to interpret the commands as
`
`a related series of commands instead of individual commands,
`Thus, there is a need for a stand-alone, wireless remote control that can be
`positioned in a location remote to both the user and the controlled appliances, which can be
`activated and operated entirely viavoice commands, conveniently compatible with commercially
`
`available remote controlled appliances, and can be operated by a plurality of users and can be
`programmed by a user to operate in a customized manner.
`
`Page 11 of 245
`
`

`

`6
`
`SUMMARY OF THE INVENTION
`The present invention relates to a method and apparatus that enables a user to
`
`control the function of one or more electric appliances or other electrical equipment solely with
`
`voice commands. An important aspect ofthe invention relates to voice-actuated mode switching
`for switching the present invention from a low power consumption mode.
`A hands-free speech recognizing transmitter in accordance with the invention,
`
`which may be a light-weight small base mounted unit, is adapted to be located near the controlled
`
`appliances. A voice-operated selection mechanism is provided for selecting any one of a number
`of categories of appliances to be controlled. A universal remote control code library may be
`
`provided which allows codes to be selected for control of different types of appliances as well as
`
`appliances manufactured by different manufacturers. Infrared signal receiving, decoding and
`
`storage capabilities further enhance the invention by providing means to learn infrared codes from
`
`other remote control transmitters, such as an appliance's original remote control transrnitter. This
`feature is advantageous for appliances whose codes are not contained in the universal library
`
`stored in the invention's memory and also serves to render the invention much less susceptible to
`
`obsolescence than speech recognizing transmitters disclosed in the prior art.
`A scheme is provided where both speaker independent and speaker dependent
`vocabulary may be used as voice commands. A speaker independent vocabulary structure
`provides the user with the means of navigating multiple linked recognition vocabulary sets" At
`
`any one time, a single recognition set is made active by the speech recognition circuit. A voice
`command in one recognition vocabulary set may be used to activate another recognition
`vocabulary set. In this fashion, a user may verbally navigate among different types of remote
`control functions and target appliances in an intuitive fashion, while minimizingthe number of
`alternative words from which the speech recognition circuit must select during any given
`
`recognition process.
`With the total recognition vocabulary partitioned into smaller recognition
`vocabulary sets, improvements result in recognition time and accuracy because, in general, as a
`recognition vocabulary increases in size, recognition time increases and accuracy decreases.
`
`Furthermore, recognition vocabulary sets are created such that the contents within each set have
`
`either functional similarities or otherwise share a relationship that is intuitive to the user. To
`
`prevent confusion that may arise with respect to the active recognition vocabulary set at any given
`
`Page 12 of 245
`
`

`

`time, the present invention monitors conditions with a time-out counter and an error counter to
`automatically return to a general default mode if certain conditions are met. In other words, a
`predetermined number of recognition errors or a period during which no successful recognition
`
`occurs will result in a known default state.
`Custom speaker dependent voice commands may be trained by the user and
`associated with infrared signals during product setup processes. These speaker dependent
`
`commands may be accessible from the vocabulary structure described above.
`
`The present invention has the capability of transmitting multiple control signals,
`
`such as infrared signals, to one or more appliances in response to a single voice command by the
`user. Such macro programs may be programmed by the user during a product setup process. For
`example, a user may desire that the response to the voice command "Video" is for the invention
`to issue commands to turn a TV power on, wait for the TV to warm up until it is ready to receive
`control signals, such as infrared signals, set the channel to"3," select the VCR f,or control, turn
`on the VCR, and execute the VCR's play function. As another example, the user may desire that
`
`the response to the user-trained voice command "Sports" is for the invention to issue commands
`
`to a TV to turn to channel 123.
`
`The system may be configured to be self-contained in a single free-standing or
`stand-alone housing. The housin g may contain a directional microphone mounted to be
`rotationally adjusted by the user to enable the user to adjust the sensitivity of the microphone so
`
`that the microphone's high sensitivity region is pointed toward the user and microphone noise
`generating sources, such as an appliance's louilspeaker are located in a region oflow microphone
`sensitivity. Visual indication lights may be provided in a manner to remain in line of sight with
`the user to communieate operation status, such as availability for recognition and results of prior
`recognition attempts. A small keypad may be provided to assist the user during product setup
`sequences. A speaker is also provided to enable output speech synthesized prompts to further
`
`assist the user during setup sequences.
`
`DESCRIPTION OF TIIE DRAWINGS
`These and other advantages of the present invention are readily understood with
`
`reference to the following specification and attached drawings wherein:
`
`Page 13 of 245
`
`

`

`FIG. I is a functional block diagram of the electronic elements and circuits in one
`embodiment of the present invention;
`
`FIG. 2a is a functional block diagram showing the details ofthe speech recognition
`circuit in one embodiment of the present invention;
`
`FIG. 2b is a functional block diagram showing the details of the infrared signal
`controlling circuit in one embodiment of the present invention;
`
`FIG. 2c is a schematic circuit diagram showing the details of the audio switching
`circuit and the sound activation circuit in one embodiment of the present invention;
`FIG. 3 is a perspective view of the physical housing for one embodiment of the
`present invention;
`
`FIG.
`
`4ais a side view of the housins illustrated in FIG. 3.
`
`ti,l':i*u"
`
`FIG.
`
`4b is an exploded perspeotive view of the housi
`
`ed in FIG. 3.
`
`FIG.
`
`4c is a partial sectionai view of the housi
`in FIG. 3.
`FIG. 5 is a functional block diagram showffithe default operation modes of one
`
`embodiment of the present invention;
`
`FIG. 6 is a functional block diae
`
`wingthe sound activation mode sequence
`
`steps for one embodiment of the present i
`
`FIG. 7 is a functional block
`
`showing the different recognition modes that
`
`may be utilized when different recogniti
`
`larv sets are activated in one embodiment ofthe
`
`present invention;
`FIG. 8 is a functional block.diagram showing the sequence of steps for the
`response prompting recognition mode for one embodiment of the present invention;
`
`FIG. 9 is a functional block diagram showing the sequence of steps for the pattern
`queuing recognition mode for one embodiment of the present invention;
`FIG. 10 is a functional block diagram showing a continuation ofthe sequence of
`steps for pattern queuing recognition mode for one embodiment ofthe present invention shown
`in FIG 9;
`
`FIG. 11 is a functional block diagram showing the sequence steps for executing
`a macro program in one embodiment of the present invention;
`FIGS . l2A and 128 is a functional block diagram showing the sequence steps for
`initiating the product setup process for one embodiment of the present invention;
`
`Page 14 of 245
`
`

`

`FIGS. 13A-13C is a functional block diagram showing the sequence steps for
`selecting a controlled appliance code during a product setup process for one embodiment of the
`present invention;
`FIGS. l4.{ and 14B is a functional block diagram showing the sequence steps for
`learning an infrared signal from another remote control transmitter during a product setu,p.process
`for one embodiment of the present invention;
`FIG. 15 is a functional block
`custom, speaker dependent voice command
`
`diagram
`
`showing t
`
`steps for
`
`teaching
`for one
`
`names duri
`
`product setup process
`
`embodiment of the present invention;
`
`FIGS. 16.4. and 168 is a fu
`
`creating a
`
`macro program during a product
`
`diagram showing the sequence steps for
`process for one embodiment of the present
`
`invention,
`
`FIG. 17 is a schematic
`
`diagram showing the details of the power supply
`
`circuit of one embodiment of the
`
`FIG. l8a is a
`
`block diagram of an alternative embodiment of an audio
`
`switching circuit in acco
`
`th one embodiment of the present invention;
`
`FIG. 18b is
`
`functional block diagram of an alternate embodiment utilizing
`
`separate microphones for the
`
`activation circuit and speech recognition circuit in accordance
`
`with the present invention;
`
`FIG. 18c is a functional block diagram of another alternate embodiment utilizing
`separate microphones for the sound activation circuit and speech recognition circuit in accordance
`with the present invention.
`
`DETAILED DESCRIPTION
`
`The present invenJion relates to a truly hands-free universal control unit system for
`controlling various appliances, such as entertainment appliances, for example, TVs, VCRs,
`stereo's and the like and may also be used for non-entertainment appliances and virtually any
`device that is amenable to remote control. The universal remote control system in accordance
`with the present invention is user programmable to enable any number of appliances to be
`programmed by the user. In order to facilitate portability and eliminate the inconvenience
`associated with power cords/cables, the universal control system in accordance with one
`embodiment ofthe invention may be battery operated. During periods when no voice commands
`
`I
`
`Page 15 of 245
`
`

`

`10
`
`are being issued the system enters a sleep or sound activation mode. An important aspect of the
`invention relates to the ability ofthe system to switch from a sleep mode to an active mode solely
`
`by voice commands, to provide true hands-free remote operation.
`A block diagram of the system in accordance with the present invention is
`illustrated in FIG. 1 and generally identified with the reference numeral 10, As will be discussed
`
`in more detail below, the system 10 enables hands-free operation of one or more appliances in a
`
`wireless manner.
`
`Referring to FIG. 1, the system 10 includes a microphone 20, an audio switching
`
`circuit 30, a sound activation circuit 40, a speech recognition circuit 50, and a transmitter, for
`
`example, an infrared signal controlling circuit 70 and one or more infrared light-emitting diodes
`80. The system l0 may also contain an infrared receiver 71, a readlwrite memory device 72 for
`storage of received IR signal data one or more indicators 52, a keypad 51 and a speaker 53. A
`power supply circuit 90 is also included. The power supply 90 may be configured for DC
`operation to enable portability of the system l0 or alternatively AC operation.
`
`An output signal from the microphone 20 is electrically connect