u**o t*t t***
`
`*u* o*ou
`
`24277
`Kevin J. Zilka
`PO Box 721030
`San Jose. CA95172
`
`Page 1 of 1
`
`#8
`
`--oo'r--o-- r-- *ro=
`
`UNITED STATES PATENT ANDThADEMARK OFFICE
`llAsHrNG'roN, O,C. 24231
`www.usptogov
`
`| |||ltil llt ffi ut ffil ilil t][ ilil iltil l][ Nl lllll lllll lffi lllll ]il lilll lill ffil
`.oc00000000561 0555-
`
`Date Mailed : 121 1 1 12000
`
`NOTICE REGARDING POWER OF ATTORNEY
`
`This is in response to the Power of Attorney filed 1210412000.
`
`o The Power of Attorney to you in this application has been revoked by the applicant. Future correspondence
`will be mailed to the new address of record(37 CFR 1.33).
`
`tce
`Initial Patent Examination
`
`(703) 308-1202
`
`OFFICE
`
`hle ://C :\APPS\PreExam\correspondence\ I -C.xml
`
`12110100
`
`Page 118 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3518
`
`

`

`Page 1 of 1
`
`+?
`
`U**o t*t t** * *t* O*ou,
`
`uro,rr,ro-- ,-- *-*
`
`UNtteo Snres PareNT ANoTnaoevlRr Orrtce
`\AsHrNdIoN, D.C. 2()231
`www.uspro,gor'
`
`I. KEITH STEPHENS
`CARLTON, FIELDS, WARD, EMMANUEL, SMITH & CUTLER
`P.O. BOX 3239
`TAMPA. FL 33601-3239
`
`.oc00000000561 0560*
`*oc00000000561 0560'
`
`Date Mailed: 1211 1 12000
`
`NOTICE REGARDING POWER OF ATTORNEY
`
`This is in response to the Power of Attorney filed 1210412000'
`
`The Power of Attorney in this application is accepted. Correspondence in this application will be mailed to the
`above address as provided by 37 CFR 1.33.
`
`Initial Patent Examination
`
`ision (703) 308-1202
`
`OFFICE COPY
`
`fi le ://C :\APP S\PreExam\correspondence\
`
`1 -B.xml
`
`r2n0l00
`
`Page 119 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3519
`
`

`

`I.T
`
`t-
`
`AppucAloN No. I Ruxe onre I
`*311i3/fiil
`
`*'S.5
`
`Lt'3/li;ld "
`
`L" }'::HITH IJTEFI{HII$
`r:ARL-TfrN" F IHL-tlEi, lalAR[:',
`F, r:. pfix :3:l:3'3
`TAFtpA Fl- 33$n1*.i:1.3$
`
`rcV'"--
`'offi,g
`
`I
`
`UNITED ST. iS DEPARTMENT OF COMMERCE
`United States:lratent and Trademark Office
`Address: COMMISSIONER OF PATENTSANDTRADEMARKS
`Washingon, D.C,20231
`
`" FlRsr NAMED INVENToR
`
`H&LVTT{S*N
`
`TMr:l*/ tr4t.1
`
`tl
`
`EF1FIANilEL" SIYIITH
`
`Et
`
`ATTORNEY DOCKETNO.
`
`t-'
`
`sttI lF*:J7
`
`EXAMINER
`
`ild./[4/'i] i.
`
`Please find below and/or attached an Otfice communlcation concernlng thls application or
`proceeding.
`
`Commlssloner of Patente and Trademarks
`
`PTO-90C (Rev.1l/00)
`
`i.Firecopy f,0
`
`Page 120 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3520
`
`

`

`Office Action Summary
`
`09/524,095
`
`Exami ner
`
`Firmin Backer
`
`Applicant(s)
`
`HALVERSON ET AL.
`
`Art Unit
`
`2155
`etwith the conespondence address --
`
`Period for RePIY
`A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 9 MONTH(S) FROM
`THE MAILING DATE OF THIS COMMUNICATION.
`- Exlensionsoftimemaybeavailableundertheprovlslonsof3TCFRl.l36(a).
`Inno6vEnt,holrrever,mayareplybetimelyfiled
`te MoNTHSfrom the mailing date of lhis communicalion'
`- lf the period for repty speo1ied above is less than thirty ii6j aavs, a r"plvutthin the statutory minimum of thlrly (30) days will be consldered timely'
`"ir-iriSri
`- lf No period for r"prv iJ"p".in"d above, the maxiru.i ii"tut"w period witt apply.and will eipke slX (6) MoNTHS from ihe mailing date of this communication'
`to become ABANDoNED (35 u's'c' S 133)'
`- Faiture ro repty wimin tiJ'J'oi
`p"rioo ror r"pii *iri, riv."talyje, gy$111
`"pplication
`- Anvreolvreoeivedbytheoffioelaterihanthreemontrl'Lneiin;maitingdateofthiscommunlcation,eveniftimelyfiled'mayreduceany
`"rr"nu"a
`eaineri patent term adjustment. See 37 CFR 1'704(b)'
`Status
`1)X Responsive to communication(s) filed on 13 March 2000 '
`2a)fl This action is FINAL.
`2b)EX This action is non-final.
`3)n Since this application is.in condition for allowance exceptfor.fory{_qalers, prosecution as to the merits is
`closed in accordance w1h the practice under Ex patte Quayte, 1935 C.D. 11, 453 O.G' 213'
`
`Disposition of Claims
`I| +lX Claim(s) 56'126 is/are pending in the application'
`+a) Of the above claim(s) is/are withdrawn from consideration'
`I|
`I qn claim(s) is/are allowed'
`I olX claim(s) 56'126 is/are rejected.
`I an claim(s) is/are objected to.
`tU Claims are subject to restriction and/or eleclion requirement.
`I
`I Application PaPers
`II gln The specification is objected to by the Examiner'
`I r oll The drawing(s) fited on
`is/are objected to by the Examiner.
`II f f lfl The proposed drar,riing correction filed on
`is: a)[ approved b)n disapproved'
`-
`I f Zll The oath or declaration is objected to by the Examiner.
` Priority under 35 U.S.C. S 119'
`I ,ttln Acknowtedgment is made of a claim forforeign priority under 35 U.s.c' s 11g(a)'(d) or (0'
`aln nrr b)fl some . c)fl None of:
`I
`t n Certified copies of the priority documents have been received'
`I
`,.n Certified copies of the priority documents have been received in Application No'
`I
`s.n copies of the certified copies of the priority documents have been received in this National stage
`II
`- -'aoolication
`from the lnternational Bureau (PCT Rule 17.2(a)).
`|
`. see the .ttrr:n[o o"i.ileJ'omce aaion for a list of the certified copies not received'
`I t+ln Acknowtedgement is made of a claim fordomestic priority under 35 U.q.c' $ 119(e)'
`
`II
`
`Attachment(s)
`ts) X ttott"" of References Cited (PTo'892)
`f oi fl Hoti.. of Dratsperson's Patent Drawing Revlew (PTo'948)
`tO X tnformation Disclosure Statement(s) (PTO'1449) Paper No(s)
`
`te) I
`tnterview Summary (PTO-413) Paper No(s)'
`ts) I
`t{otlce of lnformal Patent Applicatlon (PTo-l52)
`-
`zo) fl ottrer:
`
`PTO-326 (Rev.01-01)
`
`Offlce Action Summary
`
`Part of Paper No. 1 0
`Paper
`
`Page 121 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3521
`
`

`

`Application/Control Number: 09 I 524,095
`Art Unit: 2155
`
`Page I
`
`DETAILED ACTION
`
`This is in response to a letter for patent filed on June 30\ 2000 in which claims 56'126 are
`
`presented for examination. Claims 56-126 are pending in the letter.
`
`Aaim Rejections - 35 USC S 102
`
`1.
`
`The following is a quotation of the appropriate paragraphs of 35 U.S.C . l02that form the
`
`basis for the rejections under this section made in this Office action:
`
`A person shall be entitled to a patent unless -
`(e) the invention was described in a patent granted o-n an application for patent by ryom9l filed in the United
`States before the invention thereof by the applioant for pat"nt, or on an intemational application by another who
`has firlfrlled the requirements ofparagraphs lt), (z), and (a) ofseotion 371(o) ofthis title before the invention
`thereofby the applicant for patent.
`Z. Claims 56-126 are rejected under 35 U.S.C. 102(e) as being anticipated by Levin et al.
`
`(U. S. Patent No. 6,173,27 9).
`
`As per claim 56, Levin et al teach a method for speech-based navigation (information
`
`3.
`server, l l0) of an eleit oni. data source located at.one or more network servers located remotely
`
`from a user, (see abstract, fig 1, column 3 lines 5-35), comprising receiving a spoken request
`
`(receive a natural language query) for desired information from the user (user); rendering an
`
`interpretati on(creating a semantic representation) of the spoken request, constructing a
`navigation (generating search) query based upon the interpretation; soliciting additional input
`from the user (one or more questions are generated...), including user interaction in a modality
`different that the original request and, refining the navigation query, based upon the additional
`
`Page 122 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3522
`
`

`

`Application/Control Number: 09 I 524,095
`Arr Unit: 2155
`
`Page2
`
`input (see column 6 lines 20-59), using the navigation query to select a portion of the electronic
`
`data source; and transmitting the selected portion of the electronic data source from the network
`
`server to a primarily stationary, display device located locally with the user. (see abstract, fig. 1-
`
`3, column 3 line 36-9 line 5, see also claim l, 10,22)
`
`4.
`
`As per claim 57,Levin et al teach a method of rendering the interpretation includes
`
`deriving linguistic information by using a speech recognition and a linguistic parser (see abstrac!
`
`fig l, column 3 lines 37-5 lines 40).
`
`5.
`
`As per claim 58-62, Levin et al teach a method of constructing a navigation query in the
`
`form of a database query on a computing device located on a network including extracting an
`
`input template for an online scripted interface to the data source to be used for the construction
`
`of the navigation query and dynamically scraping the online scripted interface (see abstract, fig.
`
`l-3, column 3 line 36-9 line 5)
`
`As per claim 63-68, Levin et al teach a method of soliciting additional input is performed
`
`6.
`in response deficiency including unresolved word encountered after the first navigation of the
`
`data source, required element of the navigational QuerY, data recorded within the data source,
`
`failure to identify data record responsive to navigational query (see column 6 lines 20'59)'
`
`As per claim 69, Levin et al teach a method wherein the additional input is solicited upon
`
`7.
`receiving a user-input statement... (see column 6 lines 20'59)'
`
`Page 123 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3523
`
`

`

`Application/Control Number: 09 | 524,09 5
`Art Unit: 2155
`
`Page 3
`
`8.
`
`As per claim 70-73, Levin et al teach a method of soliciting additional input from the
`
`user, including presenting: a menu, a textual or an audible request, a list of portions of data
`
`source (see abstract , ftg. l-3, column 3 line 36-9 line 5).
`
`9.
`
`As per claim 74-75, Levin et al teach a method wherein additional input received from
`
`the user is speech based, of no spoken input source (see abstrac! frg. l-3, column 3 line 36-9 line
`
`s).
`
`10. As per claim 76,Levin et al teach a method wherein steps (d)-(e) are repeated until the
`
`navigational query if deemed adequate source (see abstract, fig. l-3, column 3 line 36-9 line 5).
`
`1l. As per claim 77,78, Levin et al teach a method wherein the input modality includes
`
`selecting (by speaking) from a displayed option menu (see abstract, fig. l-3, column 3 line 36-9
`
`line 5).
`
`12. As per claim 79,Levin et al teach a method performed with respect to a plurality of user
`
`and,coresponding client devices (see abstrac! fig. 1-3, column 3 line 36-9 line 5).
`
`13. As per claim 80-81, Levin et al teach a method of selecting data source from plurality of
`
`electronic data source storing multimedia content including audio and video content (see
`
`abstract, frg. I-3, column 3 line 36-9line 5)
`
`Page 124 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3524
`
`

`

`Application/Control Number: 09 | 524,09 5
`Arr Unit: 2155
`
`Page 4
`
`14. As per claim 82, Levin et al teach a system for speech-based navigation (information
`
`server, I I0) of anelectronic data source located at one or more network servers located remotely
`
`from a user, (see abstract, fig l, column 3 lines 5-35), comprising a portable microphone
`
`(microphone, l2l)receiving a spoken request (receive a natural language query) for desired
`
`information from the user (user) a language processing logic (natural language server, I I4)
`
`rendering an interpretation(creating a semantic representation) of lhe spoken request (see
`
`abstract, fig. 1-3, column 3 line 36-9 line 5, see also claim l, 10,22) a query construction logic
`
`(service host, I 12) constructing a navigation(generating search) query based upon the
`
`interpretation; a query interaction logic (servlce host, I 12) sohciting additional input from the
`
`user (one or more questions are geinerated...),including user interaction in a modality different
`
`that the original request and, (see abstract, fig. l-3, column 3 line 36-9 line 5, see also claim l,
`
`10,22), a query refining logic (service host, 112) refining the navigation query, based upon the
`
`additional input (see column 6 lines 20-59), a navigation logic (service host, I 12) using the
`
`navigation query to select a portion of the electronic data source; electronic infrastructure
`
`(network, /08) transnftting the selected portion of the electronic data source from the network
`
`server to a primarily stationary, display device located locally with the user. (see abstract, fig. 1-
`3,'oolumn 3 line 36-9 line 5, see also claim l, 10,22)'
`
`15. As per claim 83, Levin et al teach a system of rendering the interpretation includes
`
`deriving linguistic information by using a speech recognition and a linguistic parser (see abstract,
`
`fig l, column 3 lines 37-5 lines 40).
`
`Page 125 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3525
`
`

`

`Application/Control Number: 09 / 524,095
`Art Unit: 2155
`
`Page 5
`
`16. As per claim 84-86, Levin et al teach a system of constructing a navigation query in the
`
`form of a database query on a computing device located on a network including extracting an
`
`input template for an online scripted interface to the data source to be used for the construction
`
`of the navigation query and dynamically scraping the online scripted interface (see abstract, fig.
`
`1-3, column 3 line 36-9 line 5).
`
`17. As per claim 87, 88, 100, Levin et al teach a system wherein at least a portion of the
`
`language processing if hosted on a computing device coupled with a microphone located locally
`
`with a user and a network computing device located remotely and data in a two-way
`
`communication infrastructure (courial, DSL, satellite, wireless/cellular, fiber-optic) (see abstract,
`
`frg, l-3, column 3 line 36-9line 5).
`
`18. As per claim 89-94, Levin et al teach a system of soliciting additional input is performed
`
`in response deficieniy including unresolved word encountered after the first navigation of the
`
`data source, required element of the navigational query data recorded within the data source,
`
`failure to identify data record responsive to navigational query (see column 6 lines 20-59).
`
`19. As per claim 95,96, Levin et al teach a system wherein the input modality includes
`
`selecting (by speaking) from a displayed option menu (see abstract,frg.l-3, column 3 line 36-9
`
`line 5).
`
`Page 126 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3526
`
`

`

`Application/Control Number: 09 I 524,09 5
`Art Unit: 2155
`
`Page 6
`
`20. As per claim 97-98, Levin et al teach a system of selecting data source from plurality of
`
`electronic data source storing multimedia content including audio and video content (see
`
`abstract, fig. 1-3, column 3 line 36-9 line 5).
`
`2I. As per claim 99, Levin et al teach a system wherein the display device receives data from
`
`the electronic device on the network via a communication box (see abstract, fig. l-3, column 3
`
`line 36-9line 5).
`
`22. As per claim 101, Levin et al teach a computer program for speech-based navigation
`
`(information server, 110) of an electronic data source located at one or more network servers
`
`located remotely from a user, (see abstract, fig 1, column 3 lines 5-35), comprising code segment
`
`receiving a spoken request (receive a natural language query) for desired information from the
`
`user (user); code segment rendering an interpretation(creating a semantic representation) of the
`
`spoken request, code segment constructing a navigation (generating search) query based upon
`
`the interpretation; ,otiriting additional input from the user (one or more Etestions are
`
`generated...), includiqg user interaction in a modality different that the original request and, code
`
`segment refining the navigation query, based upon the additional input (see column 6 lines 20-
`
`Se;, code segment using the navigation query to select a portion of the electronic data source;
`
`and code segment transmitting the selected portion of the electronic data source from the
`
`network server to a primarily stationary, display device located locally with the user (see
`
`abstract, fig. l-3, column 3 line 36-9 line 5, see also claim l, 10,22);
`
`Page 127 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3527
`
`

`

`Application/Control Number: 09 I 524,09 5
`Arr Unit: 2155
`
`PageT
`
`23. As per claim 102, Levin et al teach a code segment deriving linguistic information by
`
`using a speech recognition and a linguistic parser (see abstract, fig 1, column 3 lines 37-5 lines
`
`40).
`
`24. As per claim 103-105, Levin et al teach a code segment of constructing a navigation
`
`query in the form of a database query on a computing device located on a network including
`
`extracting an input template for an online scripted interface to the data source to be used for the
`
`construction of the navigation query and dynamically scraping the online scripted interface (see
`
`abstract, fig. 1-3, column 3 line 36-9 line 5).
`
`25. As per claim 106-107, Levin et al teach a computer program wherein rendering of the
`
`interpretation and the construction of the navigation query are performed on a computing device
`
`located locally with or remotely from the user (see abstracf fig. l-3, column 3 line 36-9 line 5).
`
`26. As per claim 108'114, Levin et al teach a code segment that solicits additional input
`
`display on option mequ is performed by speaking in response deficiency including unresolved
`
`word encountered after the first navigation of the data source, required element of the
`
`navigational Query, data recorded within the data source, failure to identify data record
`
`responsive to navigational query (see column 6 lines 20'59).
`
`27. As per claim 115, Levin et al teach a computer program the act of selecting from the
`
`display is performed by speaking (see column 6 lines 20'59)
`
`Page 128 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3528
`
`

`

`Application/Control Number: 09 / SZ4.O9 5
`Art Unit: 2155
`
`Page 8
`
`28' As per claim 116, Levin et al teach a code segment of the computer program operate with
`respect to a plurality of simultaneous user and corresponding client devices (see abstract, fig. l-
`3, column 3 line 36-9line 5).
`
`29' As per claim I17, Levin et al teach a code segment that select data source form a plurality
`of electronic data source .... content (see abstract, frg. l-3, column 3 line 36-9 line 5).
`
`30. As per claim I18, Levin et al teach a computer program of selecting data source from
`plurality of electronic data source storing multimedia content including audio and video content
`
`(see abstract, fig. 1-3, column 3 line 36-9 line 5).
`
`31. As per claim I 19, Levin et al teach a computer program wherein the additional input is
`
`solicited upon receiving a user-input statement..,(see column 6 lines 2o-sg).
`
`32. As per claim l?0-123, Levin et al teach a code segment of soliciting additional input
`
`from the user, including presenting: a menu, a textual or an audible request, a list of portions of
`
`data source (see abstra ct, fig.l-3, column 3 line 36-9 line 5).
`
`33. As per claim 124-125, Levin et al teach a computer program wherein additional input
`
`received from the user is speech based, ofno spoken input source (see abstract, fig. l-3, column
`
`3 line 36-9line 5).
`
`Page 129 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3529
`
`

`

`Application/Control Number: 09 I 524,095
`Art Unit: 2155
`
`Page 9
`
`As per claim 126,Levinet al teach a code segment wherein steps (d)-(e) are repeated until the
`
`navigational query if deemed adequate source (see abstract, fig. l-3, column 3 line 36-9 line 5).
`
`Conclusion
`
`34. The prior art made of record and not relied upon is considered pertinent to applicant's
`
`disclosure. (6,192,338).
`
`Any inquiry concerning this communication or earlier communications from the
`
`examiner should be directed to Firmin Backer whose telephone number is 703-305-0624. The
`
`examiner can normally be reached.on Mon-Thu 8:30-6:00.
`
`If attempts to reach the examiner by telephone are unsuccessful, the examinet's
`
`supervisor, Sheikh Ayaz can be reached on 703-305 -9648. The fax phone numbers for the
`
`organization where this application or proceeding is assigned are 703-305-3718 for regular
`
`communications and 703-305-53 52for After Final communications.
`
`Any inquiry o:u general nature or relating to the status of this application or proceeding
`
`should be directed to the receptionist whose telephone number is 703-305-3900.
`/)"J*
`/tut*
`Fiimin Bac(er
`/Aprilg,2ool
`
`Page 130 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3530
`
`

`

`I\
`
`1
`
`\
`
`PAGE 1 OF 1
`
`ATTACHMENT
`TO PAPER NO.
`
`HALVERSON ET AL.
`
`TONIVI PTO.ES2
`
`U.S. DE.PARTMENT OF COMMERCE
`PATENT AND TRADEMARK OFFICE
`
`NOTICE OF REFENENCES CffED
`
`U.S. PATENT DOCUMENTS
`
`FOREIGN PATENT DOCUMENTS
`
`oTHER REFERENCES (lncluding Author, Title, Date, Pertinent Pages, Etc.)
`
`@is
`-fi/anual
`(see
`
`not being furnished with this office action.
`of Patent Examining Procedure, seclion 707.05(a).)
`
`Page 131 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3531
`
`

`

`CnnITON FTELDS LLP
`
`97 SOUTH SECOND STREfT
`sutTt t00
`sAN tosE, CALIFORNIA 95113
`
`zr s-fl
`
`*\\
`MAILING ADDRESS:
`,-
`p.o. Box 721030, sAN ,osE. cA esr72-1030 Yn;l
`rEL (408)271-2300 FAx (408) 27s-es7e t{+
`
`'
`
`NR 1$ flfil
`
`April 11,2001
`
`Commissioner for Patents
`Washington,Dc 20231
`Re: Patent Application Serial No.:
`Inventor:
`Title:
`
`Filed:
`Our File No.:
`
`Dear Sir:
`
`Writer's Phone Nurnber: (408) 271-2300
`
`RECEIVED
`APR 1 I 2001
`
`Technology Center 2100
`
`091524,095
`Christine Halverson, et al.
`Navigating Network-Based Electronic
`Information Using Spoken Natural Language
`Input with Multimodal Error Feedback
`March 13,2000
`444s 41 027 42/SRI I P03 7 I (V541 | 6 -2)
`
`Please enter the enclosed Revocation and Power
`referenced application.
`
`of
`
`Attorney into the file of the
`
`41,429
`
`KTZ:ELM
`Enclosure
`cc: Edward E. Davis, Asst. Secretary (w/ encl.)
`
`t
`
`CERTIFICATE OF MAILING
`
`I do hereby certify that this correspondence is being deposited with the United States Postal
`Service as first class mail, postage prepaid, in an envelope addressed to Assistant Commissioner for
`Patents, Washington,DC 20231, on the date set forth below.
`
`a /1, f zuor
`
`Erica L. Mann
`
`sJc#112.01
`
`Page 132 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3532
`
`

`

`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`sRr l P044l44 45 41 027 40 (US40 I 5-2)
`
`APPLICATION SERIAL NO.:
`INVENTOR:
`ASSIGNEE:
`TITLE:
`FILING DATE:
`
`RECEIVED
`APR 1 I 2001
`Technology Center 2100
`
`091398,233
`Douglas E. Appelt, et al.
`SRI International
`lnformation Retrieval by Natural Language Querying
`September 17,1999
`
`Attorney Docket No.: SN1P038144454/02'143 (US4l 16'4)
`
`APPLICATION SERIAL NO.:
`INVENTOR:
`ASSIGNEE:
`TITLE:
`
`FILING DATE:
`
`091524,056
`Luc Julia et al.
`SRI International
`System Method and Article of Manufacture for Navigating
`Network-Based Electronic Multimedia Content Using Spoken
`Natural Language Input
`March 13,2000
`
`ttorney Docket No.: SRIlP037/44454102'742 (US4l l6-3)
`
`APPLICATIONSERIALNO.: 091524,095
`INVENTOR:
`Christine Halverson
`ASSIGNEE:
`SRI International
`TITLE:
`Navigating Network-Based Electronic Information Using
`Spoken Natural Language Input With Multimodal Error
`Feedback
`March 13,2000
`
`FILING DATE: ,
`
`Attorney Docket No.: SN1P039144454/02744 (US4l 16-5)
`
`APPLICATION SERIAL NO.:
`INVENTOR:
`ASSIGNEE:
`TITLE:
`
`FILING DATE:
`
`091524,868
`Luc Julia, et al.
`SRI Intemational
`Accessing Network-Based Electronic Information Through
`Scripted Online Interfaces Using Spoken Natural Language
`input
`March 14,2000
`
`Page 133 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3533
`
`

`

`Attorney Docket No. : SRII P040 / 444541 02745 (US40 I 5-3)
`
`APPLICATION SERIAL NO. :
`INVENTOR:
`ASSIGNEE:
`TITLE:
`
`FILING DATE:
`
`091613,237
`James Arnold, et al.
`SRI International
`System and Method for Incorporating Concept-Based Retrieval
`Within Boolean Search Engines
`July 10,2000
`
`Attorney Docket No. : SRI I P0 4l I 44454102'746 (US40 I 5-4)
`
`APPLICATION SENAL NO.:
`INVENTOR:
`ASSIGNEE:
`TITLE:
`
`FILING DATE:
`
`091613,236
`James Arnold
`SRI International
`System, Method and Article of Manufacture for Interactive
`Question-Answering and Automated Information Routing
`July 10,2000
`
`Attorney Docket No. : SRI1PO 42/ 44454/42'748 (US40 I 5-5)
`APPLICATION SERIALNO.: 091613,235
`INVENTOR:
`James Arnold, et al.
`ASSIGNEE:
`SRI International
`TITLE:
`System, Method and Article of Manufacture for Concept Based
`Information Searching
`July 10,2000
`
`FILING DATE:
`
`Attorney Docket No.: SRIlP043+ (US4l48-2P)
`
`APPLICATIONSERIALNO.: 601228,804
`INVENTOR: '
`Stephen Pullman, et al.
`ASSIGNEE:
`SRI International
`TITLE:
`Arbitrary Querying for Information Extraction
`FI.LING DATE:
`May 5,2000
`
`sJc# 107.01
`
`Page 134 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3534
`
`

`

`5\
`$
`
`REVOCATION AND POWER OF ATTORMY
`
`ioner for Patents
`Assi
`Washington, DC 20231
`
`The undersigned assignee ofthe above-referenced patent applications hereby revokes all
`
`prior powers of attomey and appoints as his attomey, with full powers of substitution and
`
`revocation, to transact all business in the Patent and Trademark Office connected with these
`
`applications and any patents resulting therefrom, the following:
`
`'
`
`Kevin J.Zilka, Reg. No. 41,429
`Dominic M. Kotab, Reg. No. 42,762
`C. Douglas McDonald, Reg.No. 26,659
`John C. Clark, Reg. No. 43,552
`
`RECEIVED
`
`APR 1 9 ZOO1
`
`Please direct all future communications and telephone calls to:
`
`Technology Center 2100
`
`Kevin J.ZiIka
`Cnru,roNFrelns, P.A.
`P.O. Box 721030
`San Jose, CA95I72-1030
`(408)-27r-2300
`
`SRI INTERNATIONAL
`
`oate: 0"( A D w\ ,L00
`^Ol
`
`i
`
`|
`
`By:
`
`E. Davis, Assistant Secretary
`
`sJc# 107.01
`
`Page 135 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3535
`
`

`

`UNrrBn Srerns PernNr eNo Tirepnr"IARK OFFroe
`
`I. KEITH STEPHENS
`CARLTON, FIELDS, WARD, EMMANUEL, SMITH & CUTLER
`P.O. BOX 3239
`TAMPA, FL 33601-3239
`
`Page I of I
`4F tl
`
`ffi
`
`UHtreo Strtes PlreNT ANoTRAoguann Orrtce
`WASHINGTcN. D.C. 20231
`www.uspto.got
`
`CONFIRMATION NO.6294
`
`ilutfl lil ilt iltiltil t][ ilil til l|lil ilril lllll llll Nl illil llli lllll llil lil ffi
`.oc00000000601 7790'
`
`Date Mailed : 04127 12001
`
`NOTICE REGARDING POWER OF ATTORNEY
`
`This is in response to the Power of Attorney filed 04116120Q1.
`
`o The Power of Attorney to you in this application has been revoked by the assignee who has intervened as
`provided by 37 CFR 3.71. Future correspondence will be mailed to the new address of record(37 CFR 1.33).
`
`Initial Patent Examinatio4
`
`vision (703) 308-1202
`
`OFFICE COPY
`
`Page 136 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3536
`
`

`

`.1r
`,,i;ll, ,*... , {e
`
`u**o t*t t***
`
`*u* o*ot
`
`KEVIN J. ZILKA
`CARLTON FIELDS. P.A.
`P.O. BOX 721030
`sAN JOSE, CA 95172-1030
`
`,.,***t$ffr
`A,*oli.
`
`Page I of I
`
`#t*
`
`uroo,-r,-o-- r-- *ro-
`UNITEO STATES PATENT ANDTRADEMARK OFFICE
`w*"'notn:-9t9: :^9::I
`
`tvww.uspro.gor'
`
`CONFIRMATION NO.6294
`
`I tiltil ilil il lfi ltil uil ilil llll llilt til llill lffi llill llil lllll lill llil lil llll
`'oc000000006017814'
`
`. Date Mailed: 0412712001
`
`NOTICE REGARDING POWER OF ATTORNEY
`
`This is in response to the Power of Attorney filed 0411612001.
`
`The Power of Attorney in this application is accepted. Correspondence in this application will be mailed to the
`above address as provided by 37 CFR 1.33.
`
`Initial Patent Examination
`
`(703) 308-1202
`
`OFFICE COPY
`
`Page 137 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3537
`
`

`

`'ble
`2/s;{'t
`zlEV
`
`PATENT
`
`IN THE LINITED STATES PATENT A}IID TRADEMARK OFFICE
`
`In re the application of:
`
`Halverson et al.
`
`Application No. 09/524,
`
`Filed: 0311312000
`
`6('E
`^ s$$$'
`
`Group Art Unit: 2758
`
`Atty. Docket No. SRI1P037
`44454/02742
`
`NAVIGATING NETWORK.BASED
`ELECTRONIC INFORMAITON USING
`SPOKEN NATURAL LANGUAGE IMUT )
`WITH MULTMODAL ERROR FEEDBACK )
`)
`
`Date: Air'.\ Z-1, d+g$F/MF'
`frLAY 4 _
`fechnsW,
`
`200;
`eentar
`
`CERTIFICATE OF MAILING
`
`UAL
`I hereby certify that this corresponde,nce is being deposited with the
`United States Postal Service as First Class Mail in an anvelope addressed
`to: Assistant Commissioner for Patorts, Washington, DC 20231 on
`Aoti\ Z?, Z-ost
`
`Erica L. Mann
`
`SUPPLEMENTAL INFORMATION DISCLOSURE STATEMENT
`IINDER 37 CFR Q$ 1.56 AND 1.97(c)
`,
`
`Assistant Commissioner for Patents
`Washington, DC 20211
`
`Dear Sir:
`
`The references listed in the attached PTO Form 1449, copies of which are attached, may
`
`be material to examination of the above-identified patent application. Applicants submit these
`
`references in compliance with their duty of disclosure pursuant to 37 CFR $$ 1.56 and 1.97. The
`Examiner is requested to make these references of offrcial record in this application.
`
`Attny Dkt No. SRIIP037 I 444541027 42
`
`Page 138 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3538
`
`

`

`This krformation Disclosure Statement is not to be construed as a representation that a
`
`search has been made, that additional information material to the examination of this application
`
`does not exist, or that these references indeed constitute prior art.
`
`This Information Disclosure Statement is believed to be filed before the mailing date of a
`first Office Action on the merits. Accordingly, it is believed that no fees are due in connection
`with the filing of this Information Disclosure Statement. However, if it is determined that any
`fees are due, the Commissioner is hereby authorized to charge such fees to Deposit Account 03-
`0683 (Order No. 44454/027 421 SRILP037\.
`
`Respectfu lly submitted,
`CARLTON FIELDS
`
`DF '{H
`
`Dominic M. Kotab
`Reg. No. 42,762
`
`fiiT*u*o
`Technara*u"o' ?ool
`", venlcrtl00
`
`P.O. Box 721030
`San Jose, CA 95172-1030
`Telephone: (408) 27 1 -2300
`
`Attny Dkt No. SRIIP037 I 444541027 42
`
`Page 139 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3539
`
`

`

`1449 (Modified)
`\ Ioro.rnation Disc
`Statement Bv
`se Several Sheets if
`
`5t{
`
`\s0ri
`
`6PEi
`r rss ^Ltw. DocketNo.
`pprurrorz
`/tpplicant:
`Halverson et al.
`Filing Date:
`03n3t2000
`U.S. Patent Documents
`
`Application No.:
`091524,095
`
`Group Art Unit:
`2758
`
`Examiner
`Initial
`
`No. Patent No.
`
`Date
`
`Patentee
`
`Sub-
`class
`
`Class
`
`Filing
`Date
`
`RFn^.
`"Cj rF'r|
`Y|AY d
`
`-'v&! ehnt
`
`uUl
`
`' <tul
`
`L^,
`
`Patent or Published F
`
`ABcD E
`
`F
`G
`H
`I
`J
`K
`
`Other Documents
`
`Examiner
`Initial
`
`r,^h
`
`No. Author. Title" Date. Place (e.e. Journal) of Publication
`R Stent, Amanda et al., "The CommandTalk Spoken Dialogue System", SRI
`lnternational
`
`S Moore, Robert et al., "CommandTalk A Spoken-Language Interface for
`Battlefield Simulations", October 23, 1997, SRI Intemational
`
`T Dowding, John et al., "Interpreting Language in Context in CommandTalk",
`February 5, l999,SR[ Intemational
`/)
`
`(h
`Examiner fu
`
`Examiner:Aitial citatiqn considered. Draw lin
`considerey'. Include copy of this form with next
`
`{*r_
`
`gqrv vvrrersvrvv
`Date Considered ,
`,/erf ,t u
`r through citation if not in conformance and not
`communication to applicant.
`
`Pg. 1 of3
`
`Page 140 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3540
`
`

`

`Form 1449 (Modified)
`
`rtty. Docket No.
`SRI1P037
`
`Application No.:
`091524,095
`
`Halverson et al.
`FilingDate:
`031t312000
`U.S. Patent Documents
`
`Group Art Unit:
`2758
`
`No. Patent No.
`
`Date
`
`Patentee
`
`Sub-
`class
`
`Class
`
`Filing
`Date
`
`br-
`.\L :-flrn -
`
`_ \d./
`
`lWav
`
`-,utO:AgV t
`
`2nn,
`
`,.dr 2lan
`
`AB C
`
`D
`E
`F
`G
`H
`
`I JK
`
`Examiner
`Initial
`
`Other Documents
`
`Examiner
`kritial
`
`Tb
`
`No. Author. Title. Date. Place (e.e. Journal) of Publication
`R http ://www.ai.sri.com/-oaalinfowiz.htrnl, "InfoWiz: An Animated Voice
`Interactive Information System, May 8, 2000
`
`S Dowding, John, "Interleaving Syntax and Semantics in an Efficient Bottom-
`up Parset'', SRI International
`
`T Moore, Robert et al., "Combining Linguistic and Statistical Knowledge
`Sources in Natural-Language Processing for ATIS"' SRI International
`
`'/o
`t / a,fV u
`Examiner %
`{*
`Examiner: /nitial citation y'onsidered. Draw line through citation if not in conformance and not
`considere{ Include copy bf this form with next communication to applicant.
`
`Date Considered
`
`Pg.2 of 3
`
`Page 141 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3541
`
`

`

`. Docket No.
`P037
`
`Application No.:
`091524,095
`
`Group Art Unit:
`2758
`
`Sub-
`class
`
`Filing
`Date
`
`'1nr,.
`rf,
`*.r tr&f
`lr ^
`,1t4 4-o
`lEchnnt^
`
`<uUI
`'U9fi!:+r n
`
`rul
`
`Form 1449 (Modified)
`
`Information Disc
`
`se Several Sheets ifN
`
`Ealverson et al.
`Filing Date:
`031t312000
`U.S. Patent Documents
`
`No. Patent No.
`
`Date
`
`Patentee
`
`Class
`
`Patent or Published
`
`ABcD E F
`
`G
`H
`I
`J
`K
`
`Examiner
`kritial
`
`Other Documents
`
`No. Author. Title. Date, Place (e.g. Joumal) of Publication
`R Dowding, John et al., "Gemini: ANatural Language Slctem For Spoken-
`Language Understanding", SRI Intemational
`
`Examiner
`kritial
`
`Fh
`
`S T
`
`n
`'*^t""' //r*-.*,-. $ rrl'-
`
`n
`
`Date Considered r,fitf O >
`ed. Draw line through citation if not {n conformance and not
`considerg/. lnclude copy of this form with next communication to applicant.
`
`Pg. 3 of3
`
`Page 142 of 314
`
`Petitioner Microsoft Corporation - Ex. 1008, p. 3542
`
`

`

`,Llffi )1aD
`
`IN THE LTNITED STATES PATENT AND TRADEMARK OFFICE
`
`$lt 1lsl
`
`APPLICATION NO.:
`INVENTOR:.
`TITLE:
`
`091524,095
`Halversen, Christine
`NA\YICATING NETWORK-BASED ELECTRONIC
`INFORMATIONUSING SPOKEN INPUT WITH
`MULTIMODAL ERROR FEEDBACK
`
`FILING DATE:
`ATTORNEY DOCKET NO.
`
`3lt3l00
`SRI1PO37
`
`NOTICE OF CHANIGE OF
`CORRESPONDENCE ADDRES S
`
`Assistant Commissioner for Patents
`Washington, DC 2023I
`
`Sir:
`
`RECEIVED
`