`
`IN THE UNITED STATES PATENT AND TRADEMARK OFFICE
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`
`
`In re U.S. Patent No. 8,092,345
`
`
`
`
`
`Filed:
`
`November 13, 2009
`
`Issued:
`
`January 10, 2012
`
`Inventors: Michael Ellis; Caron Ellis
`
`Title:
`
`Systems and Methods for a Portable Electronic Journal
`
`
`Mail Stop PATENT BOARD, PTAB
`Patent Trial and Appeal Board
`U.S.P.T.O.
`P.O. Box 1450
`Alexandria, VA 22313-1450
`
`
`DECLARATION OF JOSEPH A. PARADISO
`
`I, Joseph A. Paradiso, make this declaration in connection with the petition for
`
`inter partes review submitted by Petitioner for U.S. Patent No. 8,092,345 (“the ‘345
`
`Patent”). All statements herein made of my own knowledge are true, and all
`
`statements herein made based on information and belief are believed to be true. I am
`
`over age 21 and otherwise competent to make this declaration. Although I am being
`
`compensated for my time in preparing this declaration, the positions articulated herein
`
`are my own, and I have no stake in the outcome of this proceeding or any related
`
`litigation or administrative proceedings.
`
`
`
`UA-1003.001
`
`
`
`
`
`I.
`
`Background and Qualifications
`1. Appendix A to this declaration is my curriculum vitae. As shown in my curriculum
`
`vitae, I have devoted my career to various fields of physical, electrical, and computer
`
`science with more than two decades focused on embedding sensing, including
`
`wearable and wireless sensors.
`
`2. I am an Associate Professor of Media Arts and Sciences at the Massachusetts
`
`Institute of Technology (MIT) where I direct the Responsive Environments Group,
`
`which explores how sensor networks augment and mediate human experience,
`
`interaction and perception. I also serve as co-director of the Things That Think
`
`Consortium, a group of MIT Media Lab researchers and industrial partners focused
`
`on the future of embedded computation and sensing.
`
`3. I received my B.S. in electrical engineering and physics summa cum laude from
`
`Tufts University in 1977 and my Ph.D. in physics from MIT in 1981. From 1981 to
`
`1984 I did post-doctoral research at the Swiss Federal Institute of Technology (ETH)
`
`in Zurich, working on sensor technology for high-energy particle physics. From
`
`1984-1994, I was a physicist at the Draper Laboratory in Cambridge, Massachusetts,
`
`where, as a member of the NASA Systems and Advanced Sensors and Signal
`
`Processing Directorates, my research included spacecraft control systems and sensor
`
`technology for both sonar systems and high-energy physics. From 1992-1994, I
`
`directed the development of precision alignment sensors for the GEM muon detector
`
` 2
`
`
`
`
`
`
`UA-1003.002
`
`
`
`
`
`at the Superconducting Supercollider, and worked on design of particle detectors at
`
`the CERN Large Hadron Collider (LHC). I joined the MIT Media Laboratory in
`
`1994.
`
`4. Upon joining the Media Laboratory, I focused on developing new sensing
`
`modalities for human-computer interaction, then evolved my research into wearable
`
`wireless sensing and distributed sensor networks. This work anticipated and
`
`influenced transformative products and industries that have blossomed in recent
`
`years. For example, the sensor-laden wireless shoe I developed for interactive dance
`
`in 1997 is recognized as a watershed in the field of wearable wireless sensing and was
`
`an inspiration for the Nike+, one of the very first activity trackers and the first
`
`commercial product to integrate dynamic music with monitored exercise (accordingly,
`
`I am often requested to consult on IP as a technical expert for these companies). My
`
`team went on to pioneer clinical gait analysis with wearable wireless sensors in
`
`collaboration with the Massachusetts General Hospital (MGH) in 2002, and then
`
`broke new ground in sports medicine with another MGH collaboration that
`
`developed an ultra-wide-range wireless inertial measurement unit system for
`
`evaluating professional baseball pitchers in 2007.
`
`5. Leading to over 250 publications, 15 issued patents, and a string of awards in
`
`the Pervasive Computing, Human Computer Interaction, and sensor network
`
`communities, my research has become the basis for widely established curricula. I
`
` 3
`
`
`
`
`
`
`UA-1003.003
`
`
`
`
`
`have also advised over 55 graduate students on various research projects and
`
`publications. For example, I have advised one former student—Ari T. Adler—on the
`
`development of a portable Telemedicine Kit for collecting and sharing patient data in
`
`remote areas lacking developed medical facilities and infrastructure. I also have been
`
`invited to keynote on the sensor revolution for prestigious venues ranging from the
`
`Sensors Expo (the main industrial sensors conference) to the World Economic
`
`Forum.
`
`A.
`Status as an Independent Expert Witness
`6. I have been retained in this matter by Weil, Gotshal & Manges LLP ("Weil") to
`
`provide various observations regarding the ‘345 Patent. I am being compensated at
`
`the rate of $450.00 per hour for my work. My fee is not contingent on the outcome
`
`of this matter or on any of the positions I have taken, as discussed below.
`
`7. I have been advised that Weil represents the Petitioner in this matter. I have
`
`no direct financial interest in the Petitioner.
`
`8. I have been advised that adidas AG (hereinafter referred to as “adidas”) owns
`
`the ‘345 Patent. I have no financial interest in adidas, including its subsidiaries, or the
`
`‘345 Patent. To the best of my knowledge I have not ever had any contact with
`
`Michael Ellis or Caron Ellis, the named inventors of the ‘345 Patent.
`
` 4
`
`
`
`
`
`
`UA-1003.004
`
`
`
`
`
`II. Materials Considered
`9. I have reviewed the ‘345 Patent and its prosecution history. I have also
`
`reviewed U.S. Patent No. 6,513,532 to James R. Mault et al. (“Mault”; Exhibit UA-
`
`1004 to the petition); U.S. Patent No. 6,321,158 to David M. DeLorme et al.
`
`(“DeLorme”; Exhibit UA-1005 to the petition); A Cost-Effective Portable Telemedicine Kit
`
`for Use in Developing Countries by Ari. T. Adler (“Telemedicine Kit”; Exhibit UA-1006 to
`
`the petition); U.S. Patent No. 6,790,178; NavTalk™ Cellular Phone/ GPS Receiver,
`
`Owner’s Manual and Reference Guide (January 2000); Toshiba Satellite 2530CDS
`
`Product Specifications (February 2000); and the File History for U.S. Patent No.
`
`7,905,815 to Ellis, et al. Additionally, I have reviewed each of the following
`
`documents included herewith as Appendices:
`
`Curriculum Vitae for Joseph A. Paradiso
`
`Appendix A
`
`III. The Person of Ordinary Skill in the Relevant Field in the Relevant
`Timeframe
`10. I have been informed that “a person of ordinary skill in the relevant field” is a
`
`hypothetical person to whom an expert in the relevant field could assign a routine task
`
`with reasonable confidence that the task would be successfully carried out. I have
`
`been informed that the level of skill in the art is evidenced by the prior art. The prior
`
`art discussed herein and otherwise demonstrates that a person of ordinary skill in the
`
`art, at the time the ‘815 patent was filed, was aware of wireless networking, wearable
`
` 5
`
`
`
`
`
`
`UA-1003.005
`
`
`
`
`
`computers and mobile systems, computer programming, embedded computing, basic
`
`human-computer interaction devices, basic movement, biometric, and position
`
`sensors, and basic media recording devices.
`
`11. In my opinion, a person having ordinary skill in the art would have, through
`
`training or experience, an understanding of basic analog and digital circuits,
`
`microcontrollers, transmitters, receivers, signaling, sensing, and embedded software,
`
`and that such a person would have at least a bachelor’s degree in electrical
`
`engineering, computer engineering, or computer science, and three or more years of
`
`practical experience with sensing, signaling, and embedded and/or mobile systems, or
`
`the equivalent.
`
`12. Furthermore, a person of ordinary skill would have a Bachelor’s degree in
`
`electrical engineering or computer science and at least two years industry experience
`
`or the equivalent. Based on my experience, I have a good understanding of the
`
`capabilities of a person of ordinary skill in the relevant field. I have interviewed,
`
`hired, trained, supervised, directed, and advised many such persons over the course of
`
`my career.
`
`IV. The ‘345 Patent
`13. The ‘345 Patent describes that, in the prior art, there is a proliferation of
`
`portable electronic devices. See UA-1001 at 1:27-34. The ‘345 Patent argues that,
`
`while individually useful, these devices cannot interoperate and therefore cannot be
`
` 6
`
`
`
`
`
`
`UA-1003.006
`
`
`
`
`
`combined to provide improved functions. See UA-1001 at 1:35-40. To address this
`
`problem, the ‘345 Patent introduces a “modular personal network.” UA-1001 at 3:32-
`
`33. A modular personal network is network of wireless devices with a control unit,
`
`and it may include a base station. See UA-1001 at 3:33-39, 3:57-62. Wireless devices
`
`can be added and subtracted from the system. See UA-1001 at 3:33-59. In this way, a
`
`wireless device can be upgraded or the functionality of the system augmented without
`
`having to replace the entire system.
`
`14. While the modular personal network is described in the ‘345 Patent Summary
`
`as the invention, the ‘345 Patent claims are not so broad. Instead, the claims are
`
`directed to one of several different wireless devices described by the ‘345 Patent.
`
`Specifically, the ‘345 Patent claims a portable electronic journal. See UA-1001 at claim
`
`1. The electronic journal enables a user to create electronic journal entries using voice
`
`or text input. See UA-1001 at 39:42-46, 39:59-65, claims 1, 20. The electronic journal
`
`can include a digital camera whereby a digital image can be stored along with the
`
`journal entry. See UA-1001 at 39:65-40:4, claims 1, 20. Each journal entry is also
`
`tagged with a date and time. See UA-1001 at 40:4-6, claims 1, 20.
`
`15. In essence, the ‘345 Patent claims take the long-established concept of keeping
`
`a personal journal, but implements the journal using commonplace electronics. As
`
`seen below, however, electronic journals were well-known in the prior art prior to the
`
`earliest possible priority date of the ‘345 Patent.
`
` 7
`
`
`
`
`
`
`UA-1003.007
`
`
`
`
`
`V.
`
`Claim Interpretation
`16. In the present proceeding, I have been advised that the claims are to be given
`
`their broadest reasonable interpretation in view of the specification (“BRI”) and that
`
`this standard differs from the one used in district court patent litigation. I therefore
`
`understand that I am not bound by the findings of the district court. I note that my
`
`conclusions below may vary if I were to apply the district court's claim construction
`
`standard.
`
`A.
`“common file format” (claims 1, 20)
`17. The ‘345 Patent claims software on a portable electronic journal that is capable
`
`of, or in fact does, “format[s] the journal entry to a common file format.” One of
`
`ordinary skill in the art would understand that “common file format” can be any well-
`
`known or standardized format that permits easy viewing or printing with a computer
`
`under the broadest reasonable interpretation and in light of the specification. The
`
`specification of the ‘345 Patent states that “the uploaded journal may be converted
`
`into a standard file format, so that it may be easily viewed or printed with the personal
`
`computer.” UA-1001 at 40:26-28. Further, “[t]he file format may include HTML,
`
`PDF, or any other suitable format,” and “[i]mages and audio segments may also be
`
`stored in a common file format.” Ex. UA-1001 at 40:28-31. A person of ordinary
`
`skill in the art would therefore interpret “common file format” to be any well-known
`
` 8
`
`
`
`
`
`
`UA-1003.008
`
`
`
`
`
`or standardized format that permits easy viewing or printing with a computer, such as
`
`a personal computer.
`
`B.
`“advertisement” (claim 18)
`18. The ‘345 Patent claims a portable electronic journal that provides localized
`
`advertisements or discounts. One of ordinary skill in the art would understand that
`
`the broadest reasonable interpretation of the term “advertisement” is “a calling
`
`attention to or making known.” This is consistent with the specification, which only
`
`uses the term twice to recite that an advertisement for a local business is presented to
`
`the user. See UA-1001 at 65:39-42, 66:50-59.
`
`VI. Unpatentability Based on Prior Art in the Present Proceedings
`19. I have been informed that the ‘345 Patent is a division of U.S. Patent
`
`Application No. 10/645,713, filed on May August 20, 2003, now U.S. Patent No.
`
`7,670,263, which is a continuation of U.S. Patent Application No. PCT/US02/04947,
`
`filed on February 20, 2002, which claims the benefit of U.S. Provisional Patent
`
`Application No. 60/270,400, filed on February 20, 2001. Note that I have not
`
`considered whether the ‘345 Patent claims are entitled to the filing the date of the
`
`Provisional Application, but I have been informed that the art that supports my
`
`conclusions is prior art.
`
`20. I have been further informed that a patent claim can be found unpatentable as
`
`obvious where the differences between the subject matter sought to be patented and
`
` 9
`
`
`
`
`
`
`UA-1003.009
`
`
`
`
`
`the prior art are such that the subject matter as a whole would have been obvious at
`
`the time the invention was made to a person having ordinary skill in the relevant field.
`
`I understand that an obviousness analysis involves a consideration of (l) the scope and
`
`content of the prior art; (2) the differences between the claimed inventions and the
`
`prior art; (3) the level of ordinary skill in the pertinent art; and (4) secondary
`
`considerations of non-obviousness.
`
`A.
`Claims 1-4, 6-11, 15-18, and 20 are Obvious Over Mault in View of
`DeLorme
`21. It is my opinion that claims 1-4, 6-11, 15-18, and 20 would have been obvious
`
`to one of ordinary skill in the art over Mault in view of DeLorme. My analysis of the
`
`scope and content of the prior art references follows. Additionally, I have compared
`
`the prior art references with claims 1-11, 15-18, and 20 of the ‘345 Patent, noting
`
`differences, or lack thereof.
`
`22. Mault is U.S. Patent No. 6,513,532. The patent lists James R. Mault, Edwin
`
`Pearce, David Gilmore, Roshi Givechi, Jeanne Ragan, Andrzej Skoskiewicz, and Neil
`
`Grimmer as its inventors. It is titled “Diet and Activity-Monitoring Device,” was filed
`
`on December 23, 2000, and issued on February 4, 2003. Mault incorporates by
`
`reference several then co-pending patent applications. In particular, Mault
`
`incorporates by reference U.S. Patent App. No. 09/669,125, which was filed
`
`
`
`
`
`10
`
`UA-1003.010
`
`
`
`
`
`September 25, 2000 and since issued on September 14, 2004 at U.S. Patent No.
`
`6,790,178. See UA-1004 at 18:11-14; UA-1007.
`
`23. Much like the ‘345 Patent, Mault discloses a portable activity monitoring device
`
`that enables a user to log activity and food consumption, thereby tracking one’s
`
`caloric balance (i.e., calories consumed less calories expended). See, e.g., UA-1004 at
`
`3:9-19. Specifically, Mault discloses a monitoring device, which can comprise a single
`
`device (e.g., a wrist-watch with integrated GPS and heart-rate monitor) or multiple
`
`distributed components (e.g., such as a wrist-watch with a separate heart-rate monitor).
`
`See, e.g., UA-1004 at 10:46-52.
`
`
`
`
`
`11
`
`UA-1003.011
`
`
`
`
`
`
`
`UA-1004 at Fig. 1.
`
`24. The monitoring device includes a “body activity monitor” and a “consumption
`
`notation control.” The former is used to log a user’s daily activities and accordingly
`
`may include a GPS, a heart-rate monitor, an accelerometer, or some other means of
`
`outputting a signal indicative of the user’s body activity. See, e.g., UA-1004 at 3:34-52,
`
`3:63-4:5, 7:3-22, 8:43-60. By time-stamping these signals, the monitoring device can
`
`keep track of the user’s activity over time. See, e.g., UA-1004 at 5:40-43. Further, the
`
`
`
`
`
`12
`
`UA-1003.012
`
`
`
`
`
`user can manipulate the monitoring device when a workout is completed, and the
`
`monitoring unit will record this and the time the control was manipulated as an
`
`exercise “flag.” See, e.g., UA-1004 at 4:28-35. Additionally, a user may log an activity
`
`entry by using “audio or video recording … to note exercise conducted.” UA-1004 at
`
`16:63-17:3.
`
`25. The consumption notation control of the body activity monitor is used to log
`
`food and caloric consumption. See, e.g., UA-1004 at 4:48-55. As with exercise, a user
`
`can manipulate the monitoring device to record a food flag, an audio notation, or an
`
`image of the food along with the time the food was consumed. See, e.g., UA-1004 at
`
`4:55-61, 5:3-14.
`
`26. Mault discloses that the monitoring device comprising the body activity
`
`monitor and/or the consumption notation control may take several forms. For
`
`example, “the monitoring device may be a PDA that includes or communicates with a
`
`body activity monitor.” UA-1004 at 18:7-14. This PDA embodiment provides
`
`additional food and exercise logging capabilities, including using the PDA to, “in
`
`addition to recording food flags, … log actual foods consumed either at the time of
`
`consumption or later.” UA-1004 at 18:14-18. Further, “additional information may
`
`be easily input as to activity level.” UA-1004 at 18:18-19.
`
`27. According to Mault, information disclosed on the monitoring device may be
`
`communicated to “local and remote computers using any of a variety of wired and
`
`13
`
`
`
`
`UA-1003.013
`
`
`
`
`
`wireless approaches.” UA-1004 at 6:34-37. The term “local computers” and
`
`“PDAs,” as used by Mault, includes “all computing devices, whether portable or
`
`stationary,” such as “electronic books, laptop and handheld computers, cellular
`
`phones, pagers, desktop computers, and wearable computers.” UA-1004 at 6:46-51.
`
`Information uploaded to a local computer can then be further annotated and analyzed
`
`with tables and graphs, as shown in Figure 5, below. See, e.g., UA-1004 at 9:30-52.
`
`28. Mault therefore discloses the fundamental features of the ‘345 Patent claims.
`
`The software for each monitoring device tracking a user’s daily caloric balance is a
`
`
`
`
`
`
`
`14
`
`UA-1003.014
`
`
`
`
`
`journal. Entries are made in the journal by the user to record an activity performed or
`
`a food consumed. This information may take the form of voice and/or may take the
`
`form of images. The user may then upload the information to a personal computer at
`
`a later time.
`
`29. DeLorme is U.S. Patent No. 6,321,158. The patent lists David M. DeLorme,
`
`Keith A. Gray, Gordon Autry, and Keith A. Moulton as its inventors. It is titled
`
`“Integrated Routing/Mapping Information,” was filed on August 31, 1998, and issued
`
`on November 20, 2001.
`
`30. The alleged invention disclosed by DeLorme sets out to address numerous
`
`problems that apparently existed in the field of electronic travel planning and
`
`recording. For example, DeLorme cites to limitations of existing routing software,
`
`including the fact that recommended travel routes and itineraries were pre-determined
`
`by travel editors and therefore limited in number. See UA-1005 at 2:59-65, 3:5-10.
`
`Other alleged problems of the then-existing technology were the limited graphical and
`
`interactive aspects of personal GPS navigation devices. See UA-1005 at 3:38-47, 3:62-
`
`67. To solve these problems, DeLorme discloses a customizable and travel-related
`
`mapping, routing, positional tracking, and annotating system implemented on a
`
`desktop and handheld device.
`
`31. Specifically, DeLorme discloses an “Integrated Routing/Mapping Information
`
`System (IRMIS),” which includes a desktop computer application that can link to
`
`15
`
`
`
`
`UA-1003.015
`
`
`
`
`
`“handheld organizer, personal digital assistant (PDA) or ‘palmtop’ devices.” UA-1005
`
`at Abstract. DeLorme also discloses that the IRMIS includes a geographical
`
`information system (GIS), which is a database of geographically locatable objects or
`
`points of interest (POIs) that are tied to geographical coordinates such as longitude
`
`and latitude. See UA-1005 at 6:7-31. With the desktop application disclosed by
`
`DeLorme, a user can conduct travel planning through an interface that includes
`
`electronic maps and interactive media regarding various POIs and that permits
`
`selection of travel origin, travel destination, and desired waypoints between the travel
`
`origin and travel destination. See UA-1005 at 6:33-49. In this way, the IRMIS
`
`disclosed by DeLorme can calculate travel routes. See UA-1005 at 6:50-49.
`
`32. According to DeLorme, the maps, routes, and POIs of a planned trip may be
`
`converted for download to, and use on, a PDA. See UA-1005 at 6:50-63, 13:9-10
`
`(“IRMIS facilitates use of the PDA to display map, route and point information ….”).
`
`DeLorme discloses that the PDA may be used in conjunction with a detachable or
`
`integrated GPS receiver. See UA-1005 at 5:56-62, 13:59-64. When joined with a GPS
`
`receiver, the PDA may also display the user’s real-time position on a map, travel
`
`direction, speed, elevation, and directions. See UA-1005 at 13:9-11, 13:22-31, 13:39-
`
`45, 14:16-20, Figs. 1A2, 1A3. DeLorme also teaches that the GPS and PDA
`
`combination can track the user’s real-time position over time, so that the user’s trip is
`
`
`
`
`
`16
`
`UA-1003.016
`
`
`
`
`
`recorded and can be uploaded at a later time to the desktop. See UA-1005 at 10:47-55,
`
`13:22-31.
`
`33. The GPS and PDA combination disclosed by DeLorme also permits a user to
`
`create text and image entries associated with their trip. For example, “the user can
`
`‘mark’ particular locations, recording exact geographic coordinates (e.g., lat/long), and
`
`make related notes or text annotations using the stylus or equivalent.” UA-1005 at
`
`12:40-44. See also UA-1005 at 25:50-56 (“The ‘Mark List’ screen shown in FIG. 1A4(e)
`
`allows the user to page through and annotate ‘marks’ which are records of particular
`
`lat/longs.”). In addition to these annotated marks, DeLorme discloses that the GPS
`
`and PDA combination can be linked with “another device … such as a digital
`
`camera” such that the “IRMIS can be used to provide location and/or time/date
`
`‘stamps’ on digital photos, which in turn can be imported and processed by the
`
`IRMIS desktop ….” UA-1005 at 14:9-16. See also UA-1005 at 25:50-56 (“‘Mark List’
`
`entries can relate to another device, such as a digital camera e.g. for purposes of
`
`recording and stamping the date, time and exact lat/long at which one or more digital
`
`photos are taken.”). As disclosed by DeLorme, these text and image entries can be
`
`tagged with date, time and location: “IRMIS PDA/GPS devices facilitate marking
`
`locations, tracking or logging ‘breadcrumbs’ or series of points representing actual
`
`travel paths, plus date/time/lat-long stamping of user annotations and/or digital
`
`photos made in conjunction with the PDA/GPS.” UA-1005 at 64:34-38.
`
`17
`
`
`
`
`UA-1003.017
`
`
`
`
`
`34. Accordingly, DeLorme discloses fundamental features claimed by the ‘345
`
`Patent. Specifically, the IRMIS embodied on the GPS and PDA combination taught
`
`by DeLorme can serve as a record, or journal, of the user’s travels. The user can
`
`input text entries associated with their trip and tag photos to that trip as well. This
`
`information is further stamped with the date and time it was recorded. This
`
`information can then be uploaded to a personal computer for further review and
`
`analysis.
`
`35. It would have been obvious to a person of ordinary skill in the art to combine
`
`the features and functions disclosed by DeLorme with those disclosed by Mault. As
`
`discussed below, each reference discloses advantages associated with portable
`
`electronic devices that are aimed at tracking personal information about a user,
`
`whether it is travelling, exercising, or dieting. Further, the portable electronic devices
`
`respectively disclosed by Mault and DeLorme share many similarities that would
`
`suggest combination to a person of ordinary skill. The complementary nature of the
`
`references is apparent from the fact that Mault discloses a portable device, such as a
`
`PDA, that may be used in conjunction with a GPS receiver, whereas DeLorme
`
`primarily discloses a GPS that may be used in conjunction with a PDA. Put another
`
`way, Mault discloses the use of a well-known device (a GPS receiver) and DeLorme
`
`provides additional detail as to the specific capabilities and uses of that well-known
`
`device.
`
`
`
`
`
`18
`
`UA-1003.018
`
`
`
`
`
`36. To illustrate, both references disclose portable electronic devices for
`
`monitoring and logging information about a user. Specifically, Mault teaches that a
`
`PDA can be used to record a user’s location over time. See, e.g., UA-1004 at 8:47-53
`
`(“… the body activity monitor 80 includes a GPS antenna ….”; “In this embodiment,
`
`the device uses the GPS signals to periodically or continuously determine the location
`
`of the subject.”), 8:57-61 (“The position and time data … are stored to memory”),
`
`9:42-51 (“The software may graph out the route followed by the subject, as shown in
`
`FIG. 7.”), 18:7-19 (“For example, the monitoring device may be a PDA that includes
`
`… a body activity monitor.”). DeLorme also teaches that a PDA can be used to
`
`record a user’s location over time. See, e.g., UA-1005 at Abstract (“The IRMIS also
`
`enables the user to … record specific locations and/or log actual travel routes, using
`
`GPS position information”), 10:47-55, 13:22-31.
`
`37. In addition, both Mault and DeLorme teach that a user may log time-stamped
`
`information about happenings, and optionally photographs, with these portable
`
`electronic devices. See, e.g., UA-1004 at 5:10-14 (“… additionally the monitoring
`
`device may include a video recording system such as a miniaturized camera. The
`
`subject may then photograph what was consumed ….”), 15:55-16:4 (“… following a
`
`meal, the subject may record ‘large salad, low fat ranch dressing, iced tea.’”), 16:63-
`
`17:3 (“… audio or video recording may also be used to note exercise conducted.”);
`
`UA-1005 at 12:40-44 (“the user can ‘mark’ particular locations, recording exact
`
`19
`
`
`
`
`UA-1003.019
`
`
`
`
`
`geographic coordinates (e.g., lat/long), and make related notes or text annotations
`
`using the stylus or equivalent.”), 14:9-16 (“IRMIS can be used to provide location
`
`and/or time/date ‘stamps’ on digital photos ….”). Mault and DeLorme both teach
`
`that such information, including a user’s GPS tracks, can be later uploaded to a
`
`personal computer for further review and analysis. See, e.g., UA-1004 at 9:21-29
`
`(“Periodically, … the subject transfers data from the monitoring device 84 to a local
`
`or remote computing device ….”); UA-1005 at 10:47-55 (“… map, route, or point
`
`information recorded and/or recorded at remote locations on the PDA/GPS
`
`component of IRMIS can be displayed, incorporated and otherwise processed by the
`
`more fully articulated desktop GIS ….”)).
`
`38. There are no technical barriers preventing a combination of the Mault and
`
`Delorme disclosures. Mault specifically teaches that the disclosed system can use a
`
`GPS receiver. The specific type of GPS device is a matter of simple design choice.
`
`Indeed, given that DeLorme GPS devices were on the market at the time the ‘345
`
`Patent application was filed, a person of ordinary skill in the art would have
`
`recognized that the teaching of the DeLorme patents, which are directed to those
`
`devices, would have applicability to the Mault system. The similarities of the devices
`
`and features disclosed by Mault and DeLorme would have encouraged a person of
`
`ordinary skill in the art to consider them both for purposes of combination.
`
`
`
`
`
`20
`
`UA-1003.020
`
`
`
`
`
`39. The different features disclosed in DeLorme are complementary to the Mault
`
`system, such that a person of ordinary skill would recognize the advantages of
`
`incorporating features taught by DeLorme into the portable electronic device
`
`disclosed by Mault. For example, DeLorme expressly discloses stamping entered
`
`information (i.e., a user marking his or her current location with a photograph or
`
`written annotation) with the current date. See, e.g., UA-1005 at 64:32-38 (“IRMIS
`
`PDA/GPS devices facilitate marking locations, tracking or logging ‘breadcrumbs’ or
`
`series of points representing actual travel paths, plus date/time/lat-long stamping of
`
`user annotations and/or digital photos made in conjunction with the
`
`PDA/GPS.” (emphasis added)). Date-stamping was a well-known feature that would
`
`be particularly advantageous in the portable electronic device of Mault to facilitate the
`
`device’s ability to “display information from previous days showing caloric balance
`
`for individual days or weeks, etc.” UA-1004 at 19:29-31 (emphasis added).
`
`Further, a person of ordinary skill would not be dissuaded from tacking on this useful
`
`feature to Mault’s device as the combination would not impose an undue
`
`technological challenge, require unknown methods or processes to implement, or
`
`impair the functionality of the device. Rather, because Mault already discloses a
`
`“timer that outputs a time indicative signal for use in time stamping” (UA-1004 at
`
`5:40-43), a person of ordinary skill in the art would recognize that implementing date
`
`
`
`
`
`21
`
`UA-1003.021
`
`
`
`
`
`stamping would simply require using a timer or clock that additionally reported the
`
`date and recording the reported date with the stored entries.
`
`40. Another exemplary advantage of DeLorme that is applicable to Mault is the
`
`ability to provide route guidance. UA-1005 at Abstract (“Maps and related route
`
`information are configured with differential detail and levels of magnitude. Used in
`
`the field, in conjunction with GPS receiver, the PDA device is configured to display
`
`directions, text and map formats, the user's current position, heading, speed,
`
`elevation, and so forth.”). DeLorme is but one example of how route guidance on a
`
`portable electronic device was well known. Another example is the Garmin NavTalk,
`
`which combined a mobile phone with GPS-enabled route guidance. See UA-1008.032
`
`(describing graphical navigation features showing the user’s location in relation to the
`
`desired route of travel). A person of ordinary skill in the art would recognize that
`
`Mault could also be adapted to include this well-known feature and that this
`
`adaptation would not pose unreasonable technological challenges or require unknown
`
`methods to implement. Further, a person of ordinary skill would be motivated to
`
`combine the well-known route guidance feature of DeLorme with the Mault system.
`
`To illustrate, Mault already discloses a computing device that presents a graphical map
`
`showing the user’s routes as tracked by the GPS receiver. See UA-1004 at 6:3-5
`
`(“FIG. 7 is a view of a street level map illustrating a running route as tracked by the
`
`activity monitoring portion of one embodiment of the present invention”), 9:49-51,
`
`22
`
`
`
`
`UA-1003.022
`
`
`
`
`
`Fig. 7. It would therefore be logical, and extremely useful, to extend this functionality
`
`to provide well-known route guidance so that the user could view his or her position
`
`on the map in real-time. This would be particularly advantageous for a user in need
`
`directions for unfamiliar routes and neighborhoods when out on a run. Thus, it
`
`would have been obvious to a person of ordinary skill in the art to combine Mault and
`
`DeLorme because the disclosed features and functionality are complementary, with
`
`Mault disclosing the use of GPS receivers and DeLorme merely providing additional
`
`details concerning the functionality of such GPS devices.
`
`41. In my opinion, the following claims of the ’345 Patent are invalid over Mault in
`
`view of DeLorme for the following reasons.
`
`1.a. A portable electronic journal configured to be worn or carried by a user
`comprising
`42. A journal is simply a record of happenings over time. Mault discloses an
`
`activity and dieting “monitoring device,” which comprises a portable electronic
`
`journal configured to be worn or carried by the user. See, e.g., UA-1004 at 1:23-25,
`
`3:34-62, 4:48-5:39, 6:66-7:1, Fig. 1. The monitoring device “includes a body activity
`
`monitor for monitoring the body activity of the subject” and “a consumption
`
`notation control for use by the subject to indicate when the subject consumes food.”
`
`UA-1004 at 3:34-36, 4:48-51. See UA-1004