`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`____________________
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`____________________
`
`SNAP INC.,
`Petitioner,
`
`v.
`
`PALO ALTO RESEARCH CENTER INC.,
`Patent Owner
`
`____________________
`
`IPR2021-00987
`Patent No. 8,489,599
`____________________
`
`
`
`DECLARATION OF DR. KEVIN C. ALMEROTH
`
`
`
`
`
`
`
`
`
`
`
`
`
`SNAP EXHIBIT 1022
`Snap Inc. v. Palo Alto Research Center Inc.
`IPR2021-00987
`
`Page 1 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`
`TABLE OF CONTENTS
`
`INTRODUCTION ......................................................................................... 1
`I.
`II. BACKGROUND AND QUALIFICATIONS .............................................. 2
`III. MATERIALS REVIEWED ........................................................................15
`IV. PERSON OF ORDINARY SKILL IN THE ART ....................................18
`V.
`TECHNICAL BACKGROUND .................................................................19
`A. User Interface and Error Handling ......................................................19
`VI. OVERVIEW OF THE ’599 PATENT .......................................................21
`VII. CLAIM CONSTRUCTION ........................................................................22
`A.
`“Determin[e/ing]” and “Perform[ing]” Features Recited in
`Original Challenged Claims 1-25 ........................................................23
`VIII. OVERVIEW OF THE PRIOR ART .........................................................33
`A.
`Rosenberg ............................................................................................33
`B.
`Suzuki ..................................................................................................33
`C.
`Buck .....................................................................................................34
`IX. RESPONSE TO PATENT OWNER’S AND DR. MARTIN’S
`POSITIONS CONCERNING ROSENBERG AND THE
`CLAIMED “DETERMIN[E/ING]” AND “PERFORM[ING]”
`FEATURES IN THE ORIGINAL CLAIMS ............................................35
`THE ’457 APPLICATION DOES NOT SUPPORT THE
`FEATURES OF SUBSTITUTE CLAIMS 26-40 ......................................36
`A.
`The Specification for the ’599 Patent Does Not Provide Support
`for “Determining Whether the Expected Response is Expected
`or Unexpected . . . Wherein the Received Response is
`Unexpected If the Received Response Does Not Match Any of
`
`X.
`
`
`
`i
`
`Page 2 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`
`the At Least One Predefined Response” as Recited in Substitute
`Claims 26, 33, and 37 and Their Respective Dependent Claims ........38
`XI. THE PRIOR ART DISCLOSES AND/OR SUGGESTS ALL OF
`THE LIMATATIONS OF SUBSTITUTE CLAIMS 26-40 .....................46
`A.
`Rosenberg and Buck Discloses and/or Suggests the Limitations
`of Substitute Claims 26-29 and 31-40 .................................................46
`1.
`Substitute Claim 26 ...................................................................46
`2.
`Substitute Claim 33 ...................................................................63
`3.
`Substitute Claim 37 ...................................................................64
`4.
`Dependent Claims 27-29, 31-32, 34-36, 38-40 ........................69
`Rosenberg, Buck, and Suzuki Discloses and/or Suggests the
`Limitations of Substitute Claim 30 .....................................................70
`XII. CONCLUSION ............................................................................................72
`
`
`B.
`
`
`
`ii
`
`Page 3 of 116
`
`
`
`
`
`I, Kevin C. Almeroth, declare as follows:
`
`I.
`
`INTRODUCTION
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`
`1.
`
`I have been asked to submit this declaration on behalf of Snap Inc.
`
`(“Snap” or “Petitioner”) relating to Snap’s petition (“Petition” or “Pet.”) for inter
`
`partes review of U.S. Patent No. 8,489,599 (“the ’599 patent” (Ex. 1001)) filed in
`
`this proceeding, and in particular in reply to positions presented by Patent Owner
`
`Palo Alto Research Center Inc. (“Patent Owner” or “PO” or “PARC”) and its expert
`
`Dr. David Martin that were submitted in response to Snap’s Petition.
`
`2.
`
`I understand that the Petition challenges the patentability of claims
`
`1-25 of the ’599 patent, and relies on a number of exhibits, including the declaration
`
`of Mr. Steve Smoot (Ex. 1002). I have reviewed and considered those materials for
`
`purposes of opinions in this Declaration. I also understand that PARC submitted a
`
`Patent Owner Response to the Petition (Paper No. 21 (“POR” or “Response”) that
`
`relies on a number of exhibits, including a declaration by PARC’s expert, Dr. David
`
`Martin (Ex. 2003). I also understand that PARC submitted a Patent Owner
`
`Contingent Motion to Amend (Paper No. 22) (“MTA”) that also relies on a number
`
`of exhibits, including a declaration by Dr. Martin (Ex. 2004). I have been asked to
`
`review and consider, and provide my opinions in reply to, positions raised by PARC
`
`and its expert set forth in PARC’s Patent Owner Response and its accompanying
`
`exhibits, including the opinions of Dr. Martin presented in his declaration (Ex.
`
`
`
`1
`
`Page 4 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`2004), and Dr. Martin’s testimony provided during his deposition (Ex. 1021). I have
`
`also been asked to review and consider, and provide my opinions in reply to,
`
`positions raised by PARC and its expert set forth in PARC’s Patent Owner
`
`Contingent Motion to Amend (Paper No. 22) and its accompanying exhibits,
`
`including the opinions of Dr. Martin presented in his same declaration (Ex. 2003),
`
`and Dr. Martin’s testimony provided during his deposition (Ex. 1021). In doing so,
`
`I have also studied and provide my opinions on the technology relating to the ’599
`
`patent and the patentability of the original and substitute claims. My opinions are
`
`set forth below.
`
`3.
`
`I am being compensated at my standard rate for my work in this
`
`proceeding. My compensation is in no way contingent on the nature of my findings,
`
`the presentation of my findings in testimony, or the outcome of this or any other
`
`proceeding. I have no other interest in this proceeding.
`
`II. BACKGROUND AND QUALIFICATIONS
`
`4.
`
`I am currently a Professor Emeritus in the Department of
`
`Computer Science at the University of California, Santa Barbara (UCSB). While at
`
`UCSB, I held faculty appointments and was a founding member of the Computer
`
`Engineering (CE) Program, Media Arts and Technology (MAT) Program, and the
`
`Technology Management Program (TMP). I also served as the Associate Director
`
`
`
`2
`
`Page 5 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`of the Center for Information Technology and Society (CITS) from 1999 to 2012. I
`
`have been a faculty member at UCSB since July 1997.
`
`5.
`
`I hold three degrees from the Georgia Institute of Technology: (1)
`
`a Bachelor of Science degree in Information and Computer Science (with minors in
`
`Economics, Technical Communication, and American Literature) earned in June
`
`1992; (2) a Master of Science degree in Computer Science (with specialization in
`
`Networking and Systems) earned in June 1994; and (3) a Doctor of Philosophy
`
`(Ph.D.) degree in Computer Science (Dissertation Title: Networking and System
`
`Support for the Efficient, Scalable Delivery of Services in Interactive Multimedia
`
`System, minor in Telecommunications Public Policy) earned in June 1997. During
`
`my education, I have taken a wide variety of courses as demonstrated by my minor.
`
`My undergraduate degree also included a number of courses more typical of a degree
`
`in electrical engineering
`
`including digital
`
`logic, signal processing, and
`
`telecommunications theory.
`
`6.
`
`One of the major concentrations of my research over the past 30+
`
`years has been the delivery of multimedia content and data between computing
`
`devices, including various network architectures. In my research, I have studied
`
`large-scale content delivery systems, and the use of servers located in a variety of
`
`geographic locations to provide scalable delivery to hundreds or thousands of users
`
`simultaneously. I have also studied smaller-scale content delivery systems in which
`
`
`
`3
`
`Page 6 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`content is exchanged between individual computers and portable devices. My work
`
`has emphasized the exchange of content more efficiently across computer networks,
`
`including the scalable delivery of content to many users, mobile computing, satellite
`
`networking, delivering content to mobile devices, and network support for data
`
`delivery in wireless networks.
`
`7.
`
`In 1992, the initial focus of my research was on the provision of
`
`interactive functions (e.g., VCR-style functions like pause, rewind, and fast-forward)
`
`for near video-on-demand systems in cable systems; in particular, how to aggregate
`
`requests for movies at a cable head-end and then how to satisfy a multitude of
`
`requests using one audio/video stream broadcast
`
`to multiple
`
`receivers
`
`simultaneously. This research has continually evolved and resulted in the
`
`development of techniques to scalably deliver on-demand content, including audio,
`
`video, web documents, and other types of data, through the Internet and over other
`
`types of networks, including over cable systems, broadband telephone lines, and
`
`satellite links.
`
`8.
`
`An important component of my research has been investigating the
`
`challenges of communicating multimedia content, including video, between
`
`computers and across networks including the Internet. Although the early Internet
`
`was used mostly for text-based, non-real time applications, the interest in sharing
`
`multimedia content, such as video, quickly developed. Multimedia-based
`
`
`
`4
`
`Page 7 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`applications ranged from downloading content to a device to streaming multimedia
`
`content to be instantly used. One of the challenges was that multimedia content is
`
`typically larger than text-only content, but there are also opportunities to use
`
`different delivery techniques since multimedia content is more resilient to errors. I
`
`have worked on a variety of research problems and used a number of systems that
`
`were developed to deliver multimedia content to users. One content-delivery method
`
`I have researched is the one-to-many communication facility called “multicast,” first
`
`deployed as the Multicast Backbone, a virtual overlay network supporting one-to-
`
`many communication. Multicast is one technique that can be used on the Internet to
`
`provide streaming media support for complex applications like video-on-demand,
`
`distance learning, distributed collaboration, distributed games, and large-scale
`
`wireless communication. The delivery of media through multicast often involves
`
`using Internet infrastructure, devices and protocols, including protocols for routing
`
`and TCP/IP.
`
`9.
`
`Starting in 1997, I worked on a project to integrate the streaming
`
`media capabilities of the Internet together with the interactivity of the web. I
`
`developed a project called the Interactive Multimedia Jukebox (IMJ). Users would
`
`visit a web page and select content to view. The content would then be scheduled
`
`on one of a number of channels, including delivery to students in Georgia Tech
`
`
`
`5
`
`Page 8 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`dorms delivered via the campus cable plant. The content of each channel was
`
`delivered using multicast communication.
`
`10.
`
`In the IMJ, the number of channels varied depending on the
`
`capabilities of the server including the available bandwidth of its connection to the
`
`Internet. If one of the channels was idle, the requesting user would be able to watch
`
`their selection immediately. If all channels were streaming previously selected
`
`content, the user’s selection would be queued on the channel with the shortest wait
`
`time. In the meantime, the user would see what content was currently playing on
`
`other channels, and because of the use of multicast, would be able to join one of the
`
`existing channels and watch the content at the point it was currently being
`
`transmitted.
`
`11.
`
`The IMJ service combined the interactivity of the web with the
`
`streaming capabilities of the Internet to create a jukebox-like service. It supported
`
`true Video-on-Demand when capacity allowed, but scaled to any number of users
`
`based on queuing requested programs. As part of the project, we obtained
`
`permission from Turner Broadcasting to transmit cartoons and other short-subject
`
`content. We also connected the IMJ into the Georgia Tech campus cable television
`
`network so that students in their dorms could use the web to request content and then
`
`view that content on one of the campus’s public access channels.
`
`
`
`6
`
`Page 9 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`More recently, I have also studied issues concerning how users
`
`12.
`
`choose content, especially when considering the price of that content. My research
`
`has examined how dynamic content pricing can be used to control system load. By
`
`raising prices when systems start to become overloaded (i.e., when all available
`
`resources are fully utilized) and reducing prices when system capacity is readily
`
`available, users’ capacity to pay as well as their willingness can be used as factors
`
`in stabilizing the response time of a system. This capability is particularly useful in
`
`systems where content is downloaded or streamed on-demand to users.
`
`13.
`
`As a parallel research theme, starting in 1997, I began researching
`
`issues related to wireless devices and sensors. In particular, I was interested in
`
`showing how to provide greater communication capability to “lightweight devices,”
`
`i.e., small form-factor, resource-constrained (e.g., CPU, memory, networking, and
`
`power) devices. Starting in 1998, I published several papers on my work to develop
`
`a flexible, lightweight, battery-aware network protocol stack. The lightweight
`
`protocols we envisioned were similar in nature to protocols like Bluetooth, Universal
`
`Plug and Play (UPnP) and Digital Living Network Alliance (DLNA).
`
`14.
`
`From this initial work, I have made wireless networking—
`
`including ad hoc, mesh networks and wireless devices—one of the major themes of
`
`my research. My work in wireless network spans the protocol stack from
`
`
`
`7
`
`Page 10 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`applications through to the encoding and exchange of data at the data link and
`
`physical layers.
`
`15.
`
`At the application layer, even before the large-scale “app stores”
`
`were available, my research looked at building, installing, and using apps for a
`
`variety of purposes, from network monitoring to support for traditional computer-
`
`based applications (e.g., content retrieval) to new applications enabled by
`
`ubiquitous, mobile devices. For example, my research has looked at developing
`
`applications for virally exchanging and tracking “coupons” through “opportunistic
`
`contact” (i.e., communication with other devices coming into communication range
`
`with a user). In many of the courses I have taught there is a project component.
`
`Through these projects I have supervised numerous efforts to develop new “apps”
`
`for download and use across a variety of mobile platforms.
`
`16.
`
`Toward the middle of the protocol stack, my research also looked
`
`to build wireless infrastructure support to enable communication among a set of
`
`mobile devices unaided by any other kind of network infrastructure. These kinds of
`
`networks are useful either in challenged network environments (e.g., when a natural
`
`disaster has destroyed existing infrastructure) or when suitable support for network
`
`communication never existed. The deployment of such networks (or even the use
`
`of traditional network support) are critical to support services like disaster relief,
`
`catastrophic event coordination, and emergency services deployment.
`
`
`
`8
`
`Page 11 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`Yet another theme is monitoring wireless networks, in particular
`
`17.
`
`different variants of IEEE 802.11 compliant networks, to (1) understand the
`
`operation of the various protocols used in real-world deployments, (2) use these
`
`measurements to characterize use of the networks and identify protocol limitations
`
`and weaknesses, and (3) propose and evaluate solutions to these problems. I have
`
`successfully used monitoring techniques to study wireless data link layer protocol
`
`operation and to improve performance by enhancing the operation of such protocols.
`
`For wireless protocols, this research includes functions like network acquisition and
`
`channel bonding.
`
`18.
`
`Protecting networks, including their operation and content, has
`
`been an underlying theme of my research almost since the beginning of my research
`
`career. Starting in 2000, I have been involved in several projects that specifically
`
`address security, network protection, and firewalls. After significant background
`
`work, a team on which I was a member successfully submitted a $4.3M grant
`
`proposal to the Army Research Office (ARO) at the Department of Defense to
`
`propose and develop a high-speed intrusion detection system. Key aspects of the
`
`system included associating streams of packets and analyzing them for viruses and
`
`other malware. Once the grant was awarded, we spent several years developing and
`
`meeting the milestones of the project. A number of my students worked on related
`
`projects and published papers on topics ranging from intrusion detection to
`
`
`
`9
`
`Page 12 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`developing advanced techniques to be incorporated into firewalls. I have also used
`
`firewalls, including their associated malware detection features, in developing
`
`techniques for the classroom to ensure that students are not distracted by online
`
`content.
`
`19.
`
`My recent work ties some of the various threads of my past
`
`research together. I have investigated content delivery in online social networks and
`
`proposed reputation management systems in large-scale social networks and
`
`marketplaces. On the content delivery side, I have looked at issues of caching and
`
`cache placement, especially when content being shared and the cache has
`
`geographical relevance. We were able to show that effective caching strategies can
`
`greatly improve performance and reduce deployment costs. Our work on reputation
`
`systems showed that reputations have economic value, and as such, creates a
`
`motivation to manipulate reputations. In response, we developed a variety of
`
`solutions to protect the integrity of reputations in online social networks. The
`
`techniques we developed for content delivery and reputation management were
`
`particularly relevant in peer-to-peer communication and recommendations for
`
`downloadable “apps.”
`
`20.
`
`As an important component of my research program, I have been
`
`involved in the development of academic research into available technology in the
`
`market place. One aspect of this work is my involvement in the Internet Engineering
`
`
`
`10
`
`Page 13 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`Task Force (IETF). The IETF is a large and open international community of
`
`network designers, operators, vendors, and researchers concerned with the evolution
`
`of the Internet architecture and the smooth operation of the Internet. I have been
`
`involved in various IETF groups including many content delivery-related working
`
`groups like the Audio Video Transport (AVT) group, the MBone Deployment
`
`(MBONED) group, Source Specific Multicast (SSM) group, the Inter-Domain
`
`Multicast Routing (IDMR) group, the Reliable Multicast Transport (RMT) group,
`
`the Protocol Independent Multicast (PIM) group, etc. I have also served as a member
`
`of the Multicast Directorate (MADDOGS), which oversaw the standardization of all
`
`things related to multicast in the IETF. Finally, I was the Chair of the Internet2
`
`Multicast Working Group for seven years.
`
`21.
`
`My involvement in the research community extends to leadership
`
`positions for several academic journals and conferences. I am the co-chair of the
`
`Steering Committee for the ACM Network and System Support for Digital Audio
`
`and Video (NOSSDAV) workshop and on the Steering Committees for the
`
`International Conference on Network Protocols (ICNP), ACM Sigcomm Workshop
`
`on Challenged Networks (CHANTS), and IEEE Global Internet (GI) Symposium. I
`
`have served or am serving on the Editorial Boards of IEEE/ACM Transactions on
`
`Networking, IEEE Transactions on Mobile Computing, IEEE Network, ACM
`
`Computers in Entertainment, AACE Journal of Interactive Learning Research
`
`
`
`11
`
`Page 14 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`(JILR), and ACM Computer Communications Review. I have co-chaired a number
`
`of conferences and workshops including the IEEE International Conference on
`
`Network Protocols (ICNP), IEEE Conference on Sensor, Mesh and Ad Hoc
`
`Communications and Networks
`
`(SECON),
`
`International Conference on
`
`Communication Systems and Networks (COMSNETS), IFIP/IEEE International
`
`Conference on Management of Multimedia Networks and Services (MMNS), the
`
`International Workshop On Wireless Network Measurement (WiNMee), ACM
`
`Sigcomm Workshop on Challenged Networks (CHANTS), the Network Group
`
`Communication (NGC) workshop, and the Global Internet Symposium, and I have
`
`served on the program committees for numerous conferences.
`
`22.
`
`Furthermore, in the courses I taught at UCSB, a significant portion
`
`of my curriculum covered aspects of the Internet and network communication
`
`including the physical and data link layers of the Open System Interconnect (OSI)
`
`protocol stack, and standardized protocols for communicating across a variety of
`
`physical media such as cable systems, telephone lines, wireless, and high-speed
`
`Local Area Networks (LANs). The courses I have taught also cover most major
`
`topics in Internet communication, including data communication, multimedia
`
`encoding, and mobile application design. My research and courses have covered a
`
`range of physical infrastructures for delivering content over networks, including
`
`cable, Integrated Services Digital Network (ISDN), Ethernet, Asynchronous
`
`
`
`12
`
`Page 15 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`Transfer Mode (ATM), fiber, and Digital Subscriber Line (DSL). For a complete list
`
`of courses I have taught, see my curriculum vitae (CV).
`
`23.
`
`In addition, I co-founded a technology company called Santa
`
`Barbara Labs that was working under a sub-contract from the U.S. Air Force to
`
`develop very accurate emulation systems for the military’s next generation
`
`internetwork. Santa Barbara Labs’ focus was in developing an emulation platform
`
`to test the performance characteristics of the network architecture in the variety of
`
`environments in which it was expected to operate, and, in particular, for network
`
`services including IPv6, multicast, Quality of Service (QoS), satellite-based
`
`communication, and security. Applications for this emulation program included
`
`communication of a variety of multimedia-based services, including video
`
`conferencing and video-on-demand.
`
`24.
`
`In addition to having co-founded a technology company myself, I
`
`have worked for, consulted with, and collaborated with companies for nearly 30
`
`years. These companies range from well-established companies to start-ups and
`
`include IBM, Hitachi Telecom, Turner Broadcasting System (TBS), Bell South,
`
`Digital Fountain, RealNetworks, Intel Research, Cisco Systems, and Lockheed
`
`Martin.
`
`
`
`13
`
`Page 16 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`leadership with CITS,
`
`25.
`
`Through my graduate education,
`
`involvement in TMP, role in the development of the Internet2 infrastructure, and
`
`consulting with ISPs, I have gained a strong understanding in the role of the Internet
`
`in our society and the challenges of deploying large-scale production networking
`
`infrastructure. CITS, since its inception, has looked at the role of the Internet in
`
`society, including how the evolution of technology have created communication
`
`opportunities and challenges,
`
`including,
`
`for example
`
`through disruptive
`
`technologies like P2P. TMP looks to focus on non-purely technical issues,
`
`including, for example, state-of-the-art business methods, strategies for successful
`
`technology commercialization, new venture creation, and best practices for fostering
`
`innovation. Through my industry collaborations and Internet2 work, I have
`
`developed significant experience in the challenges of deploying, monitoring,
`
`managing, and scaling communication infrastructure to support evolving Internet
`
`services like streaming media, conferencing, content exchange, social networking,
`
`and e-commerce.
`
`26.
`
`I am a Member of the Association of Computing Machinery
`
`(ACM) and a Fellow of the Institute of Electrical and Electronics Engineers (IEEE).
`
`27.
`
`Additional details about my employment history, fields of
`
`expertise, courses taught, and publications are further included in my curriculum
`
`vitae (Ex. 10xx).
`
`
`
`14
`
`Page 17 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`I am not an attorney and offer no legal opinions, but in the course
`
`28.
`
`of my work, I have had experience studying and analyzing patents and patent claims
`
`from the perspective of a person skilled in the art.
`
`III. MATERIALS REVIEWED
`
`29.
`
`The opinions in this declaration are based on the documents I
`
`reviewed, my knowledge and experience, and professional judgment. In forming my
`
`opinions expressed in this declaration, I have reviewed the following materials:
`
`• The ’599 patent (Ex. 1001);
`
`• Prosecution History of U.S. Patent No. 8,489,599 (Ex. 1004);
`
`• Snap’s Petition (Paper No. 1) and its accompanying exhibits, including
`
`for example:
`
`o the declaration of Steve Smoot (Ex. 1002), U.S. Patent No.
`7,577,522 to Rosenberg et al. (“Rosenberg”) (Ex. 1005); U.S.
`
`Patent No. 6,680,675 to Suzuki et al. (“Suzuki”) (Ex. 1006); U.S.
`
`Patent Pub. No. 2009/0089288 to Petersen (Ex. 1007); Apple
`
`Introduces the New iPhone 3G, Apple Newsroom, June 9, 2008
`
`(https://www.apple.com/newsroom/2008/06/09Apple-
`
`Introduces-the-New-iPhone-3G/)
`
`(Ex. 1008); Marguerite
`
`Reardon, Motion sensing comes to mobile phones, CNET (June
`
`11, 2007) (Ex. 1009); U.S. Patent Pub. No. 2006/0010240 to
`
`
`
`15
`
`Page 18 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`Chuah (Ex. 1010); U.S. Patent Pub. No. 2002/0052781 to
`
`Aufricht (Ex. 1011); U.S. Patent No. 9,195,765 to Russell (Ex.
`
`1012); U.S. Patent Pub. No. 2007/0124721 to Cowing (Ex.
`
`1013); U.S. Patent No. 6,756,882 to Benes (Ex. 1014); U.S.
`
`Patent No. 8,738,431 to Elliott (Ex. 1016); Context-Aware
`
`Computing and Self-Managing, Systems, CRC Press, Edited by
`
`Waltenegus Dargie (2009) (Ex. 1018);
`
`• The Institution Decision (“Dec.” or “Decision”) by the Board of Patent
`
`Appeals and Interferences (“Board”) (Paper No. 13.)
`
`• PARC’s Patent Owner Response and accompanying exhibits, including
`
`the declaration of Dr. David Martin (Ex. 2003) and the exhibits
`
`identified therein;
`
`• PARC’s Contingent Motion to Amend (“MTA”) and accompanying
`
`exhibits, including the declaration of Dr. David Martin (Ex. 2003) and
`
`the exhibits identified therein;
`
`• The deposition transcript of Dr. David Martin (dated April 21, 2022)
`
`(Ex. 1021);
`
`• The deposition transcript of Mr. Smoot (dated February 18, 2022) (Ex.
`
`2007);
`
`• U.S. Patent No. 7,599,036 to Buck (“Buck”) (Ex. 1023);
`
`
`
`16
`
`Page 19 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`
`• U.S. Patent No. 6,539,080 to Bruce et al. (“Bruce”) (Ex. 1024);
`
`• U.S. Patent No. 7,512,098 to Jiang et al. (“Jiang”) (Ex. 1025);
`
`• U.S. Patent No. 7,890,865 to Palmer et al. (“Palmer”) (Ex. 1026);
`
`• U.S. Patent No. 8,209,320 to Reitter et al. (“Reitter”) (Ex. 1027);
`
`• U.S. Patent Pub. No. 2006/0212408 to Nuestro et al. (“Nuestro”) (Ex.
`
`1028);
`
`• Any other materials I refer to in this declaration in support of my
`
`opinions.
`
`30.
`
`My opinions contained in this declaration are based on the
`
`materials I reviewed and my knowledge and professional judgment. My opinions
`
`have also been guided by my appreciation of how a person of ordinary skill in the
`
`art would have understood the claims and the specification of the ’599 patent at the
`
`time of the alleged invention, which I have been asked to consider as December 2,
`
`2008 as identified in the Petition (Pet., 2), considered by Mr. Smoot (Ex. 1002, ¶30),
`
`and as applied by Dr. Martin (Ex. 2003, ¶53). My opinions reflect how one of
`
`ordinary skill in the art would have understood the ’599 patent, the prior art to the
`
`patent, and the state of the art at the time of the alleged invention.
`
`31.
`
`Based on my experience and expertise, and based on my review of
`
`the materials identified above and referenced in this Declaration (including the
`
`Petition, POR, MTA, and accompanying exhibits including the declarations of Mr.
`
`
`
`17
`
`Page 20 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`Smoot and Dr. Martin), below I provide responses to positions taken by Dr. Martin
`
`and/or Patent Owner concerning Original Claims 1-25, and my opinions regarding
`
`Substitute Claims 26-40.
`
`IV. PERSON OF ORDINARY SKILL IN THE ART
`
`32.
`
`I am familiar with the level of ordinary skill in the art with respect
`
`to the alleged inventions of the ’599 patent as of what I have been asked to consider
`
`is December 2, 2008. I have reviewed the definition of such a person of ordinary
`
`skill in the art as defined by Mr. Smoot and applied by Dr. Martin (Ex. 1002, ¶¶30-
`
`31; Ex. 2003, ¶48). In particular, as pointed out by Dr. Martin in his declaration:
`
`Petitioner has proposed “A person of ordinary skill in the
`art as of the priority date (‘POSITA’) would have had an
`undergraduate degree
`in electrical engineering,
`computer engineering, computer science or a related
`field along with at least two years of work experience in
`the field of content presentation and context-based
`systems/processes. (Ex.1002, ¶¶30-32.) More education
`can supplement practical experience and vice versa.”
`Petition at 3 (internal footnote omitted). The Board has
`adopted this assessment of a person of ordinary skill in the
`art. Institution Decision at 6.
`
`(Ex. 2003, ¶48.) I have been asked to consider (and did consider) the time of the
`
`alleged inventions (of both the Original and Substitute Claims) to be the same
`
`
`
`18
`
`Page 21 of 116
`
`
`
`
`
`Declaration of Dr. Kevin C. Almeroth
`U.S. Patent No. 8,489,599
`
`timeframe considered by Mr. Smoot and Dr. Martin, which is December 2, 2008. I
`
`qualified as such a skilled person at the relevant time period.
`
`V. TECHNICAL BACKGROUND
`
`33.
`
`I have reviewed the technical background discussions by Mr.
`
`Smoot in his declaration (Ex. 1001, ¶¶33-36) and agree with Mr. Smoot’s opinions
`
`concerning the technologies and techniques that were known to a person of ordinary
`
`skill in the art at the time of the ’599 patent. Below, in response to the positions
`
`taken by Patent Owner and Dr. Martin, I provide additional insight as to the
`
`knowledge of a person of ordinary skill in the art at that time (e.g., around and up to
`
`December 2, 2008) regarding the state of the art associated with the ’599 patent. In
`
`my opinion, the features, concepts, and technologies discussed below (and elsewhere
`
`in this Declaration) support my opinions regarding the knowledge of a person of
`
`ordinary skill in the art had at the time of the ’599 patent.
`
`A. User Interface and Error Handling
`At the time of the ’599 patent, user interface (including graphical
`34.
`
`user interface (“GUI”)) technologies and related processes were well-known in the
`
`art. A GUI typically included different elements and objects