`
`_________________
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`_________________
`
`MICROSOFT CORPORATION, SAMSUNG ELECTRONICS CO. LTD.,
`SAMSUNG ELECTRONICS AMERICA, INC., AND ZTE (USA), INC.
`Petitioner
`
`v.
`
`IXI IP, LLC
`Patent Owner
`_________________
`
`
`U.S. Patent No. 7,552,124
`Issued: June 23, 2009
`Application No.: 10/872,289
`Filed: June 17, 2004
`
`Title: Natural Language For Programming A Specialized Computing System
`_________________
`
`DECLARATION OF JOHN D. VILLASENOR, PH.D. IN SUPPORT OF
`PETITION FOR INTER PARTES REVIEW OF U.S. PATENT NO. 7,552,124
`
`1 of 165
`
`
`
`I.
`
`INTRODUCTION
`
`1.
`
`I have been retained by Klarquist Sparkman, LLP, which represents
`
`Microsoft Corporation, Samsung Electronics Co. Ltd., Samsung Electronics
`
`America, Inc., and ZTE (USA), Inc. (“Petitioners”), in relation to an inter partes
`
`review (“IPR”) of U.S. Pat. No. 7,552,124 (the “’124 patent”). I have been asked to
`
`render an opinion regarding the validity of certain claims of the ’124 patent in light
`
`of certain prior art, including U.S. Pat. No. 7,027,975 to Pazandak et al. (“Pazandak”
`
`or the “Pazandak patent”) and U.S. Pat. No. 7,003,463 to Maes et al. (“Maes” or the
`
`“Maes patent”), as well as other art listed and discussed below.
`
`2.
`
`Under my retention in this matter, I am being compensated at my
`
`normal hourly rate of $800 / hour for my work on this matter and my compensation
`
`is not contingent on the outcome.
`
`II. QUALIFICATIONS AND EXPERIENCE
`
`3.
`
`I received a B.S. in electrical engineering from the University of
`
`Virginia in 1985, an M.S. in electrical engineering from Stanford University in 1986,
`
`and a Ph.D. in electrical engineering from Stanford University in 1989. During my
`
`graduate study at Stanford (September 1985-January 1989), I performed research on
`
`communications and signal processing.
`
`4.
`
`From approximately fall 1990 and until approximately June 1992, I
`
`worked for the Jet Propulsion Laboratory in Pasadena, CA, where I worked to
`
`2 of 165
`
`
`
`develop techniques for imaging and mapping the earth from space. Since 1992, I
`
`have been on the faculty of the Electrical Engineering Department of the University
`
`of California, Los Angeles (UCLA). Between 1992 and 1996, I was an Assistant
`
`Professor; between 1996 and 1998, an Associate Professor; and since 1998, I have
`
`been a full Professor. For several years starting in the late 1990s, I served as the Vice
`
`Chair of the Electrical Engineering Department at UCLA. I also hold faculty
`
`appointments in the UCLA Anderson School of Management and in the Department
`
`of Public Policy within the UCLA Luskin School of Public Affairs. I am also a
`
`visiting professor at the UCLA School of Law.
`
`5.
`
`In the engineering school at UCLA, I have taught courses on
`
`information processing,
`
`image processing, and communications,
`
`including
`
`consideration of systems, algorithms, and devices. Among other courses, I have
`
`often taught a course in the UCLA Electrical Engineering Department on speech and
`
`image processing. This course includes consideration of various issues raised by the
`
`’124 patent and related art, including systems and algorithms for processing natural
`
`language.
`
`6.
`
`At the Anderson School of Management, I created and have taught a
`
`course on intellectual property for technology entrepreneurs, and also advise second-
`
`year MBA students on technology-related team projects. At the Luskin School of
`
`Public Affairs, I teach science and technology policy and also advise graduate
`
`3 of 165
`
`
`
`student project teams. At the UCLA School of Law, I created and teach a course
`
`called “Digital Technologies and the Constitution.”
`
`7.
`
`Over the past several decades I have performed extensive research on
`
`various aspects of systems, devices, and networks that acquire, store, process and
`
`transmit information. My research has addressed software, algorithms, hardware,
`
`networking, protocols and other aspects of these systems and devices, and has
`
`included work on wireless mobile devices and systems, signal processing and
`
`communications, hardware design methodologies, and cybersecurity.
`
`8.
`
`I am an inventor on approximately 20 U.S. patents in areas including
`
`signal processing, data compression, communications, and cybersecurity. I have
`
`published over 150 technical articles in peer-reviewed engineering journals and
`
`conference proceedings. I have also been asked on multiple occasions to provide
`
`congressional testimony in relation to technology topics. In addition, I have
`
`published articles in the legal academic press, including law review articles.
`
`9.
`
`In addition to my work at UCLA, I am a nonresident senior fellow at
`
`the Brookings Institution in Washington, D.C. Through Brookings I have examined
`
`a wide range of topics at the technology/policy intersection including cybersecurity,
`
`wireless mobile devices and systems, digital privacy, financial inclusion for
`
`“unbanked” populations, driverless cars, and digital currencies. In addition to
`
`publishing in traditional academic venues such as engineering journals, engineering
`
`4 of 165
`
`
`
`conference proceedings, and law reviews, I have published papers and reports
`
`through the Brookings Institution. I have also published articles and commentary in
`
`broader-interest venues including Billboard, the Chronicle of Higher Education,
`
`Fast Company, Forbes, the Huffington Post, the Los Angeles Times, Scientific
`
`American, Slate, and the Washington Post.
`
`10.
`
`I am an affiliate of the Center for International Security and
`
`Cooperation (CISAC) at Stanford, and from 2014 to 2016, I was a National Fellow
`
`at the Hoover Institution at Stanford. Since 2016, I have been a Visiting Fellow at
`
`the Hoover Institution. At Stanford, I direct a research project funded by the U.S.
`
`Department of Homeland Security aimed at improving cybersecurity in U.S. critical
`
`infrastructure.
`
`11.
`
`I am also a member of the Council on Foreign Relations. Previously I
`
`was a member and then vice chair of the World Economic Forum’s Global Agenda
`
`Council on the Intellectual Property System as well as the World Economic Forum’s
`
`Global Agenda Council on Cybersecurity.
`
`12. Since the late 1990s, I have had significant engagement in early stage
`
`technology venture capital in the San Francisco Bay Area. In that capacity, I have
`
`met with a large number of startup companies seeking venture financing spanning a
`
`wide range of technology areas, including communications and networking. Among
`
`other things, I have helped to evaluate the proposed technology, the competitive
`
`5 of 165
`
`
`
`landscape, the market opportunities and risks, the strength of the team, and the
`
`company’s IP strategy and position.
`
`13. My curriculum vitae is attached to this declaration as Appendix 1.
`
`Attached as Appendix 2 is a list of recent testimony.
`
`III. DOCUMENTS REVIEWED
`
`14.
`
`In forming the opinions expressed herein, I reviewed each document
`
`cited herein, including at least the following documents:
`
`No.
`1001
`1003
`1004
`
`1005
`1006
`
`1007
`1008
`1009
`1010
`1011
`
`1012
`
`Description
`
`U.S. Patent No. 7,552,124
`
`Prosecution History of U.S. Patent No. 7,552,124 (excerpted)
`
`Office Action dated July 27, 2010 in European Application No.
`05 752 631.1 – 1243
`
`U.S. Patent No. 7,003,463 (“Maes”)
`
`U.S. Patent Application Publication No. 2003/0046061 (“Preston”)
`
`U.S. Patent No. 7,027,975 (“Pazandak”)
`
`U.S. Pat. Application No. 2002/0072918 (“White”)
`
`U.S. Patent No. 7,085,708 (“Manson”)
`U.S. Patent No. 5,937,383 (“Maes II”)
`Petition in Google Inc. v. IXI Mobile, Case No. IPR2016-01669, filed
`August 25, 2016 (Paper 2)
`Patent Owner Preliminary Response in Google Inc. v. IXI Mobile,
`Case No. IPR2016-01669, filed December 9, 2016 (Paper 7)
`
`6 of 165
`
`
`
`No.
`1013
`
`1014
`
`1015
`
`1016
`1017
`
`1018
`
`1019
`
`1020
`
`1021
`
`1022
`
`1023
`
`Description
`Appendix A to Patent Owner IXI’s September 8, 2016 “Disclosure
`of Asserted Claims and Infringement Contentions as to Microsoft”
`in IXI Mobile (R&D) Ltd., et al. v. Blackberry Limited, et al. (Case
`No. 2:15-cv-01883-JRG-RSP) (LEAD CASE)
`PCT Application Publication No. WO 02/12982 to Applicant Object
`Services and Consulting, Inc. (“Object”)
`
`U.S. Patent Application Publication No. 2003/0182132
`(“Niemoeller”)
`
`U.S. Patent No. 7,693,720 to Kennewick (“Kennewick”)
`
`Withdrawal dated January 12, 2011 in European Application No. 05
`752 631.1 - 1243
`
`Ex. A to Joint Claim Construction And Prehearing Statement in IXI
`Mobile (R&D) Ltd., et al. v. Blackberry Limited, et al. (Case No. 2:15-
`cv-01883-JRG-RSP) (LEAD CASE)
`
`Declaration of Lin Chase, Ph.D., in Support of Patent Owner's
`Preliminary Response in IPR2016-01669 (Exhibit 2001)
`
`Linda Himelstein, “Point Cast: The Rise And Fall Of An Internet
`Star,” Bloomberg, April 25, 1999
`
`Daniel Siewiorek, Asim Smailagic, Junichi Furukawa, Neema
`Moraveji, Kathryn Reiger, and Jeremy Shaffer, “SenSay: A Context-
`Aware Mobile Phone,” Proceedings of the 16th IEEE Symposium on
`Computer-Based Medical Systems, June 2003
`
`A.R. Ali-Ali, M. Al-Rousan, and M. Al-Shaikh, “Embedded System-
`based Mobile Patient Monitoring Device,” Proceedings of the 16th
`IEEE Symposium on Computer-Based Medical Systems, 2003
`Microsoft Computing Dictionary (5th Edition 2002) (excerpts)
`
`7 of 165
`
`
`
`IV. LEGAL UNDERSTANDINGS
`
`15.
`
` In expressing my opinions and considering the subject matter of the
`
`claims of the ’124 Patent, I am relying upon certain basic legal principles that have
`
`been explained to me. I have been informed that these legal principles reflect patent
`
`law as applicable to the ’124 patent, which issued from an application filed in 2004.
`
`16. First, I understand that for an invention claimed in a patent to be found
`
`patentable, it must be, among other things, new and not obvious from what was
`
`known before the invention was made.
`
`17.
`
`I have been informed that the information that is used to evaluate
`
`whether an invention is new and not obvious is generally referred to as “prior art”
`
`and generally includes patents and printed publications (e.g., books, journal
`
`publications, articles on websites, product manuals, etc.).
`
`18.
`
`I have been informed that in this proceeding, Petitioners have the
`
`burden of proving that the claims of the ’124 Patent are anticipated by or obvious
`
`from the prior art by a preponderance of the evidence. I understand that “a
`
`preponderance of the evidence” is evidence sufficient to show that a fact is more
`
`likely than not to be true.
`
`19. As I discuss further in the claim construction section below, I have been
`
`informed that the ’124 Patent is not expired, so its claims must be given the broadest
`
`reasonable construction consistent with the specification. The claims after being
`
`8 of 165
`
`
`
`construed are then to be compared to the information in the prior art.
`
`20.
`
`I have been informed that, under U.S. patent law as applicable to the
`
`’124 patent, a claimed invention is not patentable if it would have been obvious to a
`
`person of ordinary skill in the field of the invention at the time the invention was
`
`made.
`
`21.
`
`I have been informed that the obviousness standard is defined in the
`
`patent statute (35 U.S.C. §103(a)) (in the form of that statute applicable to the ’124
`
`patent) as follows:
`
`A patent may not be obtained though the invention is not
`identically disclosed or described as set forth in section
`102 of this title, if the differences between the subject
`matter sought to be patented and the prior art are such that
`the subject matter as a whole would have been obvious at
`the time the invention was made to a person having
`ordinary skill in the art to which said subject matter
`pertains. Patentability shall not be negated by the manner
`in which the invention was made.
`
`22.
`
`I have been informed that the following standards govern the
`
`determination of whether a claim in a patent is obvious. I have been instructed to
`
`apply these standards in my evaluation of whether the asserted claims of the ’124
`
`Patent would have been considered obvious on June 17, 2004.
`
`23.
`
`I have been informed that to find a claim in a patent obvious, one must
`
`9 of 165
`
`
`
`make certain findings regarding the claimed invention and the prior art. Specifically,
`
`I have been informed that the obviousness question requires consideration of four
`
`factors (although not necessarily in the following order):
`
`• The scope and content of the prior art;
`
`• The differences between the prior art and the claims at issue;
`
`• The knowledge of a person of ordinary skill in the pertinent art;
`
`and
`
`• Whatever objective factors indicating obviousness or non-
`
`obviousness may be present in any particular case.
`
`24.
`
`In addition, I have been informed that the obviousness inquiry should
`
`not be done in hindsight, but must be done using the perspective of a person of
`
`ordinary skill in the relevant art at the time of the alleged invention.
`
`25.
`
`I have been informed that the objective factors indicating obviousness
`
`or non-obviousness may include: commercial success of products covered by the
`
`patent claims; a long-felt need for the invention; failed attempts by others to make
`
`the invention; copying of the invention by others in the field; unexpected results
`
`achieved by the invention; praise of the invention by those in the field; the taking of
`
`licenses under the patent by others; expressions of surprise by experts and those
`
`skilled in the art at the making of the invention; and the patentee proceeded contrary
`
`to the accepted wisdom of the prior art. I also understand that any of this evidence
`
`10 of 165
`
`
`
`must be specifically connected to the invention rather than being associated with the
`
`prior art or with marketing or other efforts to promote an invention. I have seen no
`
`evidence of, and am not aware of any evidence of “objective factors” suggesting the
`
`claimed apparatus or methods are not obvious, and reserve my right to address any
`
`such evidence if it is identified in the future.
`
`26.
`
`I have been informed the combination of familiar elements according
`
`to known methods is likely to be obvious when it does no more than yield predictable
`
`results. I also understand that an example of a solution in one field of endeavor may
`
`make that solution obvious in another related field. I also understand that market
`
`demands or design considerations may prompt variations of a prior art system or
`
`process, either in the same field or a different one, and that these variations will
`
`ordinarily be considered obvious variations of what has been described in the prior
`
`art.
`
`27.
`
`I also have been informed that if a person of ordinary skill can
`
`implement a predictable variation, that variation would have been considered
`
`obvious. I understand that for similar reasons, if a technique has been used to
`
`improve one device, and a person of ordinary skill in the art would recognize that it
`
`would improve similar devices in the same way, using that technique to improve the
`
`other device would have been obvious unless its actual application yields unexpected
`
`results or challenges in implementation.
`
`11 of 165
`
`
`
`28.
`
`I have been informed that the obviousness analysis need not seek out
`
`precise teachings directed to the specific subject matter of the challenged claim, but
`
`instead can take account of the “ordinary innovation” and experimentation that does
`
`no more than yield predictable results, which are inferences and creative steps that a
`
`person of ordinary skill in the art would employ.
`
`29.
`
`I have been informed that sometimes it will be necessary to look to
`
`interrelated teachings of multiple patents; the effects of demands known to the
`
`design community or present in the marketplace; and the background knowledge
`
`possessed by a person having ordinary skill in the art. I understand that all these
`
`issues may be considered to determine whether there was an apparent reason to
`
`combine the known elements in the fashion claimed by the patent at issue.
`
`30.
`
`I have been informed that the obviousness analysis cannot be confined
`
`by a formalistic conception of the words “teaching, suggestion, and motivation.” I
`
`understand that in 2007, the Supreme Court issued its decision in KSR Int'l Co. v.
`
`Teleflex, Inc., 550 U.S. 398 (2007), where the Court rejected the previous
`
`requirement of an explicit “teaching, suggestion, or motivation to combine” known
`
`elements of prior art for purposes of an obviousness analysis as a precondition for
`
`finding obviousness. I have been informed that KSR confirms that any motivation
`
`that would have been known to a person of skill in the art, including common sense,
`
`or derived from the nature of the problem to be solved, is sufficient to explain why
`
`12 of 165
`
`
`
`references would have been combined.
`
`31.
`
`I have been informed that a person of ordinary skill attempting to solve
`
`a problem will not be led only to those elements of prior art designed to solve the
`
`same problem. I understand that under the KSR standard, steps suggested by
`
`common sense are important and should be considered. Common sense teaches that
`
`familiar items may have obvious uses beyond the particular application being
`
`described in a reference, that if something can be done once it is obvious to do it
`
`multiple times, and in many cases a person of ordinary skill will be able to fit the
`
`teachings of multiple patents together like pieces of a puzzle. As such, the prior art
`
`considered can be directed to any need or problem known in the field of endeavor as
`
`of the effective filing date and can provide a reason for combining the elements of
`
`the prior art in the manner claimed. In other words, the prior art does not need to be
`
`directed towards solving the same problem that is addressed in the patent. Further,
`
`the individual prior art references themselves need not all be directed towards
`
`solving the same problem.
`
`32.
`
`I have been informed that an invention that might be considered an
`
`obvious variation or modification of the prior art may be considered non-obvious if
`
`one or more prior art references discourages or leads away from the line of inquiry
`
`disclosed in the reference(s). A reference does not “teach away” from an invention
`
`simply because the reference suggests that another embodiment of the invention is
`
`13 of 165
`
`
`
`better or preferred. My understanding of the doctrine of teaching away requires a
`
`clear indication that the combination should not be attempted (e.g., because it would
`
`not work or explicit statements saying the combination should not be made).
`
`33.
`
`I understand that a person of ordinary skill is also a person of ordinary
`
`creativity.
`
`34.
`
`I further have been informed that in many fields, it may be that there is
`
`little discussion of obvious techniques or combinations, and it often may be the case
`
`that market demand, rather than scientific literature or knowledge, will drive design
`
`trends. When there is such a design need or market pressure to solve a problem and
`
`there are a finite number of identified, predictable solutions, a person of ordinary
`
`skill has good reason to pursue the known options within their technical grasp. If
`
`this leads to the anticipated success, it is likely the product not of innovation but of
`
`ordinary skill and common sense. In that instance, the fact that a combination was
`
`obvious to try might show that it was obvious. The fact that a particular combination
`
`of prior art elements was “obvious to try” may indicate that the combination was
`
`obvious even if no one attempted the combination. If the combination was obvious
`
`to try (regardless of whether it was actually tried) or leads to anticipated success,
`
`then it is likely the result of ordinary skill and common sense rather than innovation.
`
`35.
`
`I further have been informed that an element in a claim for a
`
`combination may be expressed as a means or step for performing a specified function
`
`14 of 165
`
`
`
`without the recital of structure, material, or acts in support thereof, and such claim
`
`shall be construed to cover the corresponding structure, material, or acts described
`
`in the specification and equivalents thereof, pursuant to 35 U.S.C. § 112, ¶ 6.
`
`V. THE ’124 PATENT
`
`A. Overview Of The ’124 Patent
`36. The application leading to the ’124 patent was filed on June 17, 2004,
`
`and does not claim priority to any earlier-filed application(s). I have been informed
`
`that, absent evidence of earlier conception of the invention claimed in the ’124 patent
`
`and reasonably continuous diligence in reduction to practice, the earliest effective
`
`priority date is presumed to be the date of filing (in this case, June 17, 2004).
`
`37. The ’124 patent is titled “Natural language for programming a
`
`specialized computing system,” and purports to describe a “method for
`
`programming a mobile communication device based on a high-level code
`
`comprising operative language.” (’124 patent, Abstract.) The ’124 patent is “directed
`
`to a system and corresponding methods that facilitate programming a mobile
`
`communication device or other specialized computing device using a natural
`
`language.” (’124 patent, 1:55-58.) Figure 1 of the ’124 patent is shown below:
`
`15 of 165
`
`
`
`
`
`38. The environment depicted in Figure 1 includes “a network server 100,
`
`a communication network 110, and a mobile device 120. The network server 100
`
`and mobile device 120 are connected by way of the communication network 110.”
`
`(’124 patent, 3:36-39.)
`
`39. The ’124 patent states:
`
`in a preferred embodiment,
`High-level code 150,
`comprises text formatted in the context of a natural
`language (e.g., English, French, Spanish, Japanese, etc.).
`High-level code 150 may comprise one or more sentences,
`wherein each sentence comprises at least one operative
`language (i.e. keyword) defining an instruction for a
`function or an operation to be performed. In one
`embodiment, the sentences also comprise keywords
`defining conditions or relationships based on which an
`operation is performed.
`
`16 of 165
`
`
`
`To illustrate, an exemplary script written by a user in a
`natural language may include a sentence such as “Transfer
`call to voice mail if call is from Bob”. The operative
`language (i.e., keyword or instruction) in the sentence is
`“transfer”. The condition is “if call is from Bob”.
`Keywords such as “if” or the like are used to indicate a
`condition or relationship. Application software 1122 can
`process sentences written in natural language to recognize
`the included keywords.
`
`(’124 patent, 4:15-31.)
`
`40. The ’124 patent further states that “if high-level code 150 comprises a
`
`complex set of instructions, then high-level code 150 is transmitted to network server
`
`100, so that a more powerful system is utilized to process and compile high-level
`
`code 150.” (’124 patent, 4:49-52.) And that “if high-level code 150 comprises a less
`
`complex structure, then application software 1122 or a portion thereof is installed
`
`and executed on mobile device 120 to process high-level code 150 to produce
`
`executable code 160, without the need for transferring high-level code 150 to a more
`
`powerful processing environment implemented on network server 100.” (’124
`
`patent, 4:58-64.)
`
`The File History Of The ’124 Patent
`B.
`41. As noted above, the application leading to the ’124 patent was filed on
`
`June 17, 2004. On September 22, 2006, the PTO issued an office action rejecting all
`
`17 of 165
`
`
`
`pending claims as anticipated by Pazandak. On March 16, 2007, the applicant
`
`submitted a response and amended the claims, adding several elements to pending
`
`claim 1 and to pending claim 11. Specifically, the applicant amended pending claims
`
`1 and 11 (which after further prosecution issued as claims 1 and 6) to require “[means
`
`for] receiving a high-level code comprising one or more keywords, wherein the high-
`
`level code is provided by a user of a mobile communication device to control the
`
`operation of the mobile communication device without having to select from menu
`
`items provided by an operating system running on the mobile communication
`
`device.”
`
`42. On June 4, 2007, the PTO again rejected all pending claims as
`
`anticipated by Pazandak. In particular, the PTO found that Pazandak discloses
`
`“[means for] receiving a high-level code comprising one or more keywords, wherein
`
`the high-level code is provided by a user of a mobile communication device to
`
`control the operation of the mobile communication device without having to select
`
`from menu items provided by an operating system running on the mobile
`
`communication device.” In response, on December 4, 2007, the applicant again
`
`amended pending claim 1 and pending claim 11, removing some of the elements that
`
`had been added in the March 16, 2007 response, and adding elements to both of
`
`these pending claims. The added elements included “determining level of
`
`complexity and implementation of the high-level code” and “designating an
`
`18 of 165
`
`
`
`application software to process the high level code” to pending claim 1, and the
`
`corresponding “means for designating an application software to process the high
`
`level code” and “means for designating an application software to process the high
`
`level code” to pending claim 11, as well as the three final wherein clauses in pending
`
`claim 1 (which eventually issued as claim 1), and pending claim 11 (which
`
`eventually issued as claim 6). The representative amendments made to claim 1 in the
`
`December 4, 2007 response are as follows:
`
`19 of 165
`
`
`
`43. On February 20, 2009, the PTO issued a Notice of Allowability with
`
`respect to all pending claims.
`
`
`
`20 of 165
`
`
`
`44.
`
`I also understand that on August 25, 2016, Google, Inc. filed a Petition
`
`for Inter Partes Review (“IPR”). On December 9, 2016, Patent Owner IXI filed a
`
`preliminary response accompanied by a declaration by Dr. Lin Chase. I have
`
`reviewed the foregoing documents and discuss them as appropriate below.
`
`VI. CLAIM CONSTRUCTION
`
`45.
`
`I understand that in an IPR, terms are to be given their broadest
`
`reasonable interpretation, which may be broader than the interpretation in district
`
`court litigation. Accordingly, my opinions in this declaration utilize the broadest
`
`reasonable interpretation to the extent specifically noted herein and do not generally
`
`address how various terms may be construed in district court litigation. In some
`
`instances my declaration also addresses constructions proposed or implied (e.g., by
`
`statements made by the Patent Owner regarding claim scope) in association with
`
`Case No. IPR2016-01669 (“the Google IPR”). In addition, I address certain
`
`constructions provided or implied by the Patent Owner through its infringement
`
`contentions in the underlying district court litigation, as well as constructions
`
`explicitly proposed by the Patent Owner and by the Petitioners in the underlying
`
`district court litigation, though I understand that constructions in district court
`
`litigation may be, although are not necessarily, narrower than those used in an IPR.
`
`46. For purposes of my analysis, I have been instructed to assume the
`
`following constructions. I have not been asked to opine on whether they are proper
`
`21 of 165
`
`
`
`constructions either under the Board’s standard or the litigation standard for claim
`
`construction, or if they meet any of the requirements of 35 U.S.C. § 112 (pre-AIA):
`
`Terms
`
`Constructions
`
`operative language
`
`encompasses at least language
`
`associated with one or more
`
`operations to be performed
`
`implementation of the high-level
`
`“Implementation . . . would have
`
`code
`
`been understood to refer to the
`
`impact of the location, functionality,
`
`and execution procedures of the
`
`application software that would be
`
`processing and compiling the high-
`
`level code into an executable code.”
`
`(Patent Owner’s Preliminary
`
`Response, p. 21.)
`
`OR
`
`how the code itself is implemented,
`
`e.g., whether it’s in a natural
`
`language or something less natural
`
`22 of 165
`
`
`
`high-level code
`
`encompasses at least spoken or
`
`written words input by a user
`
`natural language compiler
`
`encompasses at least software that
`
`processes high-level code
`
`the parsing and determining steps
`
`“parsing … steps” refers to “parsing
`
`(in the context of the larger
`
`the high-level code …”
`
`phrases “wherein application
`
`
`
`software is executed on a
`
`“determining steps” refers to
`
`distributed environment …” and
`
`• “determining at least one
`
`“wherein when the high-level
`
`operation …” and
`
`code comprises [a/an] complex
`
`• “determining whether high-level
`
`structure …”
`
`code comprises …”
`
`Claim 6 Means Plus Function
`
`Corresponding Structure
`
`Terms and Identified Functions
`
`b. means for receiving a high-level
`
`The identified function is
`
`code comprising one or more
`
`“receiving a high-level code
`
`keywords
`
`comprising one or more keywords.”
`
`The structure is “a user interface,
`
`including a keypad, pointing device,
`
`23 of 165
`
`
`
`touchscreen, keyboard, microphone,
`
`or equivalents thereof.”
`
`
`
`In the column at left, the function is
`
`in bold text.
`
`The structure for each of these
`
`functions is application software
`
`executing on one or more
`
`processors to perform the identified
`
`functions or equivalents thereof.
`
`c. means for parsing the high-level
`
`code for the keywords to
`
`recognize the operative language
`
`associated with controlling one or
`
`more operations of the mobile
`
`communication device
`
`d. means for determining at least
`
`one operation associated with the
`
`operative language
`
`e. means for determining whether
`
`high-level code comprises
`
`keywords defining one or more
`
`relationships and conditions
`
`corresponding to the operative
`
`language
`
`f. means for producing an
`
`executable code
`
`24 of 165
`
`
`
`g. means for determining level of
`
`complexity and implementation of
`
`the high-level code
`
`h. means for designation an
`
`application software to process
`
`the high-level code
`
`VII. RELEVANT FIELD AND TIME FRAME
`
`47. As stated in the “Legal Understandings” section of this declaration, I
`
`understand that a patent is to be interpreted through the eyes of one of ordinary skill
`
`in the art at the time of the alleged invention. I have been informed that the June 17,
`
`2004 filing date is the date of the alleged invention claimed in the ’124 patent.
`
`Accordingly, my understanding is that this identifies the relevant time frame in terms
`
`of the knowledge of one of ordinary skill in the art.
`
`48. Based on my review of the ’124 patent, in my opinion the relevant field
`
`is network-connected mobile communications devices, including processing of
`
`natural language inputs to such devices. The speech processing course that I teach at
`
`UCLA considers various aspects of this field, including systems and algorithms for
`
`processing natural language. The communications course that I teach at UCLA also
`
`considers various aspects of this field, including network-connected mobile
`
`communications devices.
`
`25 of 165
`
`
`
`VIII. LEVEL OF ORDINARY SKILL IN THE ART
`
`49.
`
`In my opinion, a person of ordinary skill in the art at the time of the
`
`alleged invention of the ’124 patent would have had at least an undergraduate degree
`
`in electrical engineering, computer science, or a related field, and two years of
`
`experience in networked communications devices and systems, including experience
`
`in natural language processing technologies, including voice processing. In the
`
`discussion below I will sometimes use the acronym “POSITA” to refer to such a
`
`person of ordinary skill in the art. I was at least a POSITA in the relevant timeframe,
`
`and my opinions herein are from the standpoint of a POSITA in the 2003-2004 time
`
`frame.
`
`IX. OVERVIEW OF THE MAES PATENT
`
`50. The Maes patent was issued in 2006 from a national stage application
`
`filed in accordance with 35 U.S.C. § 371 on June 25, 2001. The corresponding PCT
`
`filing date is October 1, 1999. In addition, Maes claims priority to two U.S.
`
`provisional applications filed respectively on October 2, 1998 and January 27, 1999.
`
`Maes was not considered during prosecution of the ’124 patent.
`
`26 of 165
`
`
`
`51.
`
`I have been informed that Maes qualifies as prior art to the ’124 patent
`
`under at least 35 U.S.C. § 102(e)1.
`
`52. Maes is titled “System and method for providing network coordinated
`
`conversational services” and