`
`
`
`
`
`
`
`
`
`
`UNITED STATES PATENT AND TRADEMARK OFFICE
`
`_________________
`
`BEFORE THE PATENT TRIAL AND APPEAL BOARD
`
`_________________
`
`GOOGLE LLC,
`Petitioner,
`
`v.
`
`BLACKBERRY LTD.,
`Patent Owner.
`
`_________________
`
`Case IPR2017-00912
`Patent 8,745,149 B2
`_________________
`
`PETITIONER’S REPLY
`
`
`
`
`
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`I.
`II.
`
`TABLE OF CONTENTS
`
`INTRODUCTION ........................................................................................... 1
`CLAIM CONSTRUCTION ............................................................................ 1
`The Board Should Adopt the Plain and Ordinary Meaning of
`A.
`“Automatically,” which Is “by Itself with Little or No Direct
`Human Control” .................................................................................... 2
`The Intrinsic and Extrinsic Evidence Supports
`1.
`Petitioner’s Plain and Ordinary Meaning ................................... 2
`PO’s Construction Should Be Rejected Because It Is
`Inconsistent with the Intrinsic Record and Vague ...................... 6
`“Automatically” Does Not Modify “Displaying” ................................. 8
`B.
`III. THE CHALLENGED CLAIMS ARE OBVIOUS ....................................... 11
`A. Graham Discloses Communicating Mixed Media Messages via
`SMS Instant Messages ........................................................................ 11
`It Would have been Obvious to Communicate Mixed Media
`Messages via non-SMS Instant Messaging Based on Deshpande ...... 14
`C. Graham Discloses the “Automatically Changing” and
`“Displaying” Limitations Under Any Construction ............................ 15
`Graham Discloses the “Automatically Changing” and
`1.
`“Displaying” Limitations Under Petitioner’s and the
`Board’s Interpretations .............................................................. 15
`Graham Discloses the “Automatically Changing” and
`“Displaying” Limitations Under PO’s Construction ................ 16
`PO Previously Argued During Foreign Prosecution that
`the Patent Application Publication Leading to Graham
`Discloses Automatically Displaying Changed Time
`Information ................................................................................ 20
`
`B.
`
`2.
`
`2.
`
`3.
`
`i
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`E.
`
`F.
`
`2.
`
`2.
`
`D.
`
`The Graham-Toshio Combination Discloses the “Automatically
`Changing” and “Displaying” Limitations Under Any
`Construction ........................................................................................ 22
`PO Does Not Contest That the Graham-Toshio
`1.
`Combination Discloses the “Automatically Changing”
`and “Displaying” Limitations Under Petitioner’s and the
`Board’s Interpretations .............................................................. 22
`The Graham-Toshio Combination Discloses the
`“Automatically Changing” and “Displaying” Limitations
`Under PO’s Construction .......................................................... 23
`The Graham-Milton Combination Discloses the “Automatically
`Changing” and “Displaying” Limitations Under Petitioner’s
`and the Board’s Interpretations ........................................................... 25
`The “Displaying” Limitation Is Also Obvious Under PO’s
`Construction ........................................................................................ 26
`G. Milton Is Analogous Art ...................................................................... 27
`The ’149 Patent and Milton are from the Same Field of
`1.
`Endeavor ................................................................................... 27
`The ’149 Patent and Milton Relate to the Same Problem
`of Indicating Time Information ................................................ 29
`IV. CONCLUSION .............................................................................................. 30
`
`
`
`
`
`
`ii
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`TABLE OF AUTHORITIES
`
` Page(s)
`
`Federal Cases
`Application of Glasser, 363 F.2d 449 (CCPA 1966) ............................................... 24
`Belden Inc. v. Berk-Tek LLC,
`805 F.3d 1064 (Fed. Cir. 2015) .......................................................................... 14
`In re Bigio,
`381 F.3d 1320 (Fed. Cir. 2004) .......................................................................... 28
`HTC Corp. v. IPCom GmbH & Co.,
`667 F.3d 1270 (Fed. Cir. 2012) ............................................................................ 8
`Innovention Toys, LLC v. MGA Entm’t, Inc.,
`637 F.3d 1314 (Fed. Cir. 2011) .......................................................................... 29
`Powell v. Home Depot U.S.A., Inc.,
`663 F.3d 1221 (Fed. Cir. 2011) ............................................................................ 6
`In re Power Integrations, Inc.,
`No. 2017-1304, 2018 WL 1370551 (Fed. Cir. Mar. 19, 2018) ............................ 7
`Tehrani v. Hamilton Medical, Inc.,
`331 F.3d 1355 (Fed. Cir. 2003) ............................................................................ 6
`Unwired Planet, LLC v. Google Inc.,
`841 F.3d 995 (Fed. Cir. 2016) ............................................................................ 28
`Other Authorities
`William Strunk, Jr. & E.B. White, The Elements of Style 30 (4th ed.
`2000) ..................................................................................................................... 8
`
`
`
`
`
`
`
`iii
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`LIST OF EXHIBITS
`
`
`Ex. 1001
`
`U.S. Patent No. 8,745,149
`
`Ex. 1002
`
`Declaration of Dr. Dan R. Olsen Jr.
`
`Ex. 1003
`
`CV of Dr. Dan R. Olsen Jr.
`
`Ex. 1004
`
`File History of U.S. Patent No. 8,745,149
`
`Ex. 1005
`
`RESERVED
`
`Ex. 1006
`
`U.S. Patent No. 5,631,949 (“Milton”)
`
`Ex. 1007
`
`JP Patent Application No. H03-89639 (“Toshio”)
`
`Ex. 1008
`
`RESERVED
`
`Ex. 1009
`
`U.S. Patent No. 6,661,434 (“MacPhail”)
`
`Ex. 1010
`
`File History of U.S. Patent No. 9,385,973
`
`Ex. 1011
`
`Ex. 1012
`
`BlackBerry’s Opposition to Motion to Dismiss in BlackBerry LTD.
`v. BLU Prods., Inc., Case No. 1:16-cv-23535 (S.D. Fla.)
`
`International Publication No. WO 01/24036 (“Appelman”)
`
`Ex. 1013
`
`Caroline Rose et al., “Inside Macintosh Volume 1” (1985)
`
`Ex. 1014
`
`U.S. Patent No. 8,554,859
`
`Ex. 1015
`
`RESERVED
`
`Ex. 1016
`
`RESERVED
`
`Ex. 1017
`
`RESERVED
`
`Ex. 1018
`
`Deposition Transcript of Dr. George T. Ligler (March 2, 2018)
`
`iv
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`Ex. 1019
`
`International Publication No. WO 02/21413
`
`Ex. 1020
`
`International Publication No. WO 02/065250
`
`Ex. 1021
`
`Oxford English Reference Dictionary (2nd ed. 2003)
`
`Ex. 1022
`
`File History of European Patent No. 1668824
`
`Ex. 1023
`
`U.S. Patent Application Publication No. 2003/0060240 (“Graham
`Publication”)
`
`v
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`I.
`INTRODUCTION
`Petitioner replies to Patent Owner’s (PO) Response (Paper 17, “Resp.”) and
`
`the Board’s decision to institute IPR (Paper 7, “Dec.”) of the ’149 patent. PO’s
`
`arguments should be rejected and claims 1-17 of the ’149 patent found
`
`unpatentable for at least the reasons set forth in the Petition (Paper 1, “Pet.”) and
`
`accompanying exhibits, and the additional reasons provided below.
`
`II. CLAIM CONSTRUCTION
`PO proposes a vague construction of “automatically” and wrongly argues
`
`that this term modifies both the “changing” and “displaying” limitations.1 (Resp.,
`
`9-18.) The Board agreed with PO’s constructions for purposes of institution, with
`
`the important clarification that “other prior operations can be manually initiated.”
`
`(Dec., 5-8.) While Petitioner agrees with the Board that other prior operations can
`
`be manually initiated, PO’s constructions should be rejected in favor of the plain
`
`and ordinary meaning of these terms under the BRI standard, as applied in the
`
`Petition.2
`
`
`1 Given there is no meaningful difference between claims 1, 9, and 17 for purposes
`
`of this proceeding with respect to these limitations, for simplicity, Petitioner’s
`
`analysis refers to the language of claim 1.
`
`2 As discussed in the Petition, “first input” (claims 1, 9, and 17) should be
`
`interpreted to mean “any event detected by the electronic device.” (Pet., 13-14.)
`
`1
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`A. The Board Should Adopt the Plain and Ordinary Meaning of
`“Automatically,” which Is “by Itself with Little or No Direct
`Human Control”
`The Board should adopt the plain and ordinary meaning of “automatically,”
`
`as applied in the Petition, which is “by itself with little or no direct human control.”
`
`1.
`
`The Intrinsic and Extrinsic Evidence Supports Petitioner’s
`Plain and Ordinary Meaning
`Petitioner’s plain and ordinary meaning of “automatically” is consistent with
`
`the intrinsic record. To begin, claim 1 states “automatically changing the first time
`
`information for the instant message to a second time information as time
`
`progresses and displaying the second time information instead of the first time
`
`information.” Claims 9 and 17 recite similar limitations. No further details are
`
`provided. Thus, while the claims offer little guidance, they use “automatically” in a
`
`way that is consistent with Petitioner’s plain and ordinary meaning.
`
`The specification, which applies Petitioner’s plain and ordinary meaning, is
`
`more helpful. In the single instance where “automatically” is used, the
`
`specification explains that time stamp 84 of FIG. 4 may “automatically” change “if
`
`the conversation was not resumed until the following day.” (Ex. 1001, 7:40-50.) As
`
`explained with respect to FIGS. 4-5, and admitted by PO’s expert, a conversation
`
`
`While PO believes this term need not be construed, PO does not dispute
`
`Petitioner’s interpretation. (Resp., 10.)
`
`2
`
`
`
`
`
`IPR2017-00912
`
`
`
`
`
`Patent 88,745,149 BB2
`
`
`
`is resummed manuaally by a deevice user. (Id., 5:62--6:2; Ex. 1
`
`
`
`
`
`
`
`
`
`018, 85:144-20.) Thuss,
`
`
`
`
`
`althoughh the time stamp chaanges as a rresult of a
`
`
`
`
`
`
`
`
`
`user manuually resumming a
`
`
`
`
`
`converssation, the change is aautomatic bbecause it
`
`
`
`
`
`
`
`
`
`
`
`
`
`direct human conttrol, consisstent with PPetitioner’
`
`
`
`occurs by
`
`
`
`itself withh little or noo
`
`
`
`
`
`s plain andd ordinary
`
`meaning.
`
`
`
`Inn contrast, in the singgle instance where “mmanually”
`
`
`
`
`
`
`
`
`
`
`
`is used, thhe specificaation
`
`
`
`
`
`describees a user diirectly conntrolling the system ffor the purppose of dissplaying a ttime
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`stamp bby “manuallly” selectiing an option (“Insertt Time” in n FIG. 6a) tto display ttime
`
`
`
`
`
`
`
`
`
`stamp 998 (FIG. 6bb). (Id., 6:114-23.) Durring his deeposition, PPO’s experrt agreed thhat
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`this opeeration is mmanual. (Exx. 1018, 844:2-13.)
`
`
`
`
`
`
`
`
`
`
`
`
`
`(Id., FIGGS. 6a-6b (annotatedd).) Accorddingly, connsistent witth Petitioneer’s plain aand
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`ordinaryy meaning of “autommatically,” tthe use of
`
`
`
`
`
`
`
`
`
`“automaticcally” and
`
`
`
`“manuallyy” in
`
`
`
`
`
`
`
`
`
`
`
`the speccification cconvey thatt an operattion initiateed by direcct human ccontrol is
`
`
`
`
`
`
`
`manuallly performmed and thaat an operattion may bbe automattically perfformed eveen if
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`it is the result of aa different pprior operaation that i
`
`
`
`
`
`
`
`
`
`s manuallyy initiated.
`
`
`
`3
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`The prosecution history also supports Petitioner’s interpretation. During
`
`prosecution, the applicant attempted to distinguish U.S. Patent No. 7,219,109
`
`(“Lapuyade”) by amending claim 1 to recite “automatically changing the first time
`
`information for the instant message to a second time information as time
`
`progresses,” and by arguing that Lapuyade does not teach this limitation because
`
`Lapuyade “shows a prompt allowing the user to select an option to change to a new
`
`time zone.” (Ex. 1004, 231-39; id., 17-19, 68-72, 213-15.) As shown in FIG. 7 of
`
`Lapuyade below, when a new time zone is detected, window 712 appears, in which
`
`“[t]he user is offered the opportunity to accept the new time zone as the display
`
`time zone” by “selecting button 724 or reject it by selecting button 730.” (Ex.
`
`2002, 6:21-38.) Thus, to distinguish Lapuyade, the applicant amended the claims to
`
`indicate that “changing” occurs “automatically” and represented to the PTO that
`
`this limitation is not met by a user selecting a displayed button for the purpose of
`
`changing a time, consistent with Petitioner’s plain and ordinary meaning of
`
`“automatic.”
`
`4
`
`
`
`
`IPR201
`7-00912
`
`
`
`
`Patent 88,745,149 BB2
`
`
`
`
`
`(Id., FIGG. 7 (annottated).)
`
`
`
`
`
`
`
`
`
`
`
`also osecution aNNumerous pprior art reeferences cited by thee applicant during pro
`
`
`
`
`
`
`
`
`
`
`
`confirmm this meanning of “auutomaticallyy.” (See, ee.g., id., 33
`
`
`
`
`
`
`
`
`
`
`
`0 (citing Innternationaal
`
`
`
`
`
`Publicattion Nos. WWO 02/214413 and WWO 02/0652250).) For
`
`
`
`
`
`
`
`
`
`
`
`Publicattion No. WWO 02/21413 explainns that “in rresponse”
`
`
`
`
`
`
`
`
`
`
`
`example, IInternationnal
`
`
`
`
`
`to “the useer open[ingg]
`
`
`
`
`
`the messsage” the ccontents off the appliccation “aree automatiically dynaamically
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`updatedd from a server.” (Ex.. 1019, 30 (emphasiss added); idd., 7, 51; EEx. 1020,
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`[0144] ((“automatiically direccted”).) Thhus, the citeed prior artt describess operationns
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`that are automaticcally perforrmed in ressponse to pprior manuual operatioons. This iss
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`5
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`further intrinsic evidence that Petitioner’s plain and ordinary meaning of
`
`“automatically” should be adopted over PO’s construction, which is inconsistent
`
`with the use of this term in the prior art. See Powell v. Home Depot U.S.A., Inc.,
`
`663 F.3d 1221, 1230-31 (Fed. Cir. 2011).
`
`Finally, Petitioner’s plain and ordinary meaning is also supported by
`
`contemporaneous dictionary definitions. For example, the Oxford English
`
`Reference Dictionary defines “automatically” as “working by itself, without direct
`
`human intervention.” (Ex. 1021, 3 (emphasis added).) Unlike PO’s proffered
`
`dictionary definition, this definition is consistent with the intrinsic record, and
`
`therefore is a better indicator of the true meaning and scope of “automatically” in
`
`the claims. See Tehrani v. Hamilton Medical, Inc., 331 F.3d 1355, 1361 (Fed. Cir.
`
`2003).
`
`2.
`
`PO’s Construction Should Be Rejected Because It Is
`Inconsistent with the Intrinsic Record and Vague
`PO’s claim construction analysis begins by cherry-picking a dictionary
`
`definition and calling it the “well-known common meaning” of “automatic.”
`
`(Resp., 10-11.) Based on this definition, PO concludes that “a manually initiated
`
`action is not ‘automatically’ performed.” (Id.) Only then did PO look to the
`
`intrinsic evidence. (Id., 11-12.) This approach to claim construction is
`
`fundamentally flawed.
`
`6
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`
`By starting with a dictionary definition to determine the meaning of
`
`“automatically,” PO improperly limits the role of intrinsic sources. As a result, PO
`
`transformed the meaning of “automatically” to a POSA to the meaning of the term
`
`in the abstract, out of its particular context. As a result, PO’s construction is vague
`
`and does little if anything to delineate the metes and bounds of the claim. See In re
`
`Power Integrations, Inc., No. 2017-1304, 2018 WL 1370551, at *3-6 (Fed. Cir.
`
`Mar. 19, 2018) (rejecting the Board’s construction because it was based on a
`
`dictionary definition instead of intrinsic evidence).
`
`PO’s arguments that the intrinsic record supports its construction also fall
`
`short. PO contends that the claims and specification confirm its construction by
`
`distinguishing between manual and automatic operations (Resp., 11-12), but there
`
`is no dispute that manual and automatic operations are different. The dispute is
`
`whether “automatically” means that other prior operations cannot be manually
`
`initiated. As discussed above, neither the claims nor the specification indicates that
`
`it does.
`
`In fact, the portions of the specification cited by PO support Petitioner’s
`
`plain and ordinary meaning. (See id., 11-12.) As discussed above, the specification
`
`describes a time stamp that “automatically” changes in response to a user resuming
`
`the conversation the following day (Ex. 1001, 7:40-50), and a time stamp that is
`
`“manually” displayed in response to a user selecting an option to display the time
`
`7
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`stamp (id., 6:14-23, FIG. 6a-6b). The only distinction between these two
`
`operations is that the manual operation is initiated by direct human control and the
`
`automatic operation is not.
`
`PO also suggests that Petitioner’s interpretation would render PO’s
`
`amendment during prosecution “superfluous.” (Resp., 12.) The portions of the
`
`prosecution history file cited by PO, however, only confirm the above distinction
`
`between manual and automatic operations. As discussed above, to distinguish
`
`Lapuyade, the applicant amended the claims to indicate that “changing” occurs
`
`“automatically” and represented to the PTO that this limitation is not met by a user
`
`directly changing a time by selecting a displayed button. (See, e.g., Ex. 1004, 70-
`
`71, 231-39.)
`
`B.
`“Automatically” Does Not Modify “Displaying”
`PO’s argument that “automatically” modifies both the “changing” and
`
`“displaying” limitations is flawed for several reasons.
`
`First, “automatically” appears immediately before “changing” but not
`
`“displaying.” Grammatically, modifiers should be placed next to the words they
`
`modify to avoid ambiguity. William Strunk, Jr. & E.B. White, The Elements of
`
`Style 30 (4th ed. 2000); see also HTC Corp. v. IPCom GmbH & Co., 667 F.3d
`
`1270, 1274-75 (Fed. Cir. 2012). Applying this grammatical principle here,
`
`“automatically” only modifies “changing.” Had the claim drafter intended
`
`8
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`“automatically” to also modify “displaying,” the drafter likely would have also
`
`included the modifier immediately before “displaying.” Having not done so, the
`
`claims should be interpreted so that “automatically” does not modify “displaying.”
`
`The prosecution history supports this understanding by repeatedly and
`
`explicitly stating that “the ‘changing’ is done automatically”—but not the
`
`“displaying.” (Ex. 1004, 236; id., 237 (“automatic changing”), 238 (“automatically
`
`changing”), 70 (same), 71 (“particularly when Appelman does not mention
`
`changing timestamps (let alone automatically as recited in claim 1)”), 70
`
`(“automatically changing”), 71 (“automatic change”), 72 (“automatically
`
`changing”), 72 (“automatically changing”).)
`
`Despite these explicit statements, PO contends that the prosecution history
`
`mandates its claim interpretation because the original claims were amended to
`
`combine the “changing” and “displaying” limitations into one clause and to
`
`remove any reference to the “displaying” limitation occurring “in response to a
`
`second input.” (Resp., 16-17.) This argument, however, elevates form over
`
`substance. Without more, simply merging the “changing” and “displaying” clauses
`
`by removing a semicolon and injecting the word “and” does not change the
`
`meaning of the claim language. It is the words of the claim that matter, and the
`
`claim amendments did not further alter those words beyond adding the modifier
`
`“automatically” and removing the reference to “in response to a second input.”
`
`9
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`However, the rules of grammar and the intrinsic evidence establishes that
`
`“automatically” only modifies the “changing” limitation, as discussed above, and
`
`removing “in response to a second input” only broadens the “displaying”
`
`limitation.
`
`PO also contends that the specification supports its proposed construction in
`
`two places (Resp., 16-17), but in neither place does the specification indicate that
`
`the time stamp is automatically displayed. First, the specification describes
`
`displayed absolute time stamps that could “automatically” change “if the
`
`conversation was not resumed until the following day.” (Ex. 1001, 7:40-50.) Here,
`
`the specification does not indicate what triggers the display of the changed time
`
`stamp. Indeed, in the two immediately preceding paragraphs, the specification
`
`explains that a time stamp may not be displayed until activated by an input device
`
`(and only temporarily). (Id., 7:10-33.)
`
`Second, the specification describes relative time stamps that “could be
`
`configured to…change as time progressed.” (Ex. 1001, 7:51-64.) This portion of
`
`the specification, which does not use the word “automatically,” is describing an
`
`event that may cause a time stamp to change (rather than display). What is more,
`
`as shown in FIG. 10 below, this portion of the specification describes a relative
`
`time stamp 478 that is “output” when “the message 468…has been activated by the
`
`cursor 474.” (Ex. 1001, 7:53-58.) According to PO and its expert, displaying a time
`
`10
`
`
`
`
`
`IPR2017-00912
`
`
`
`
`
`
`
`stamp inn responsee to such a pointing ddevice is a mmanual opperation. (RResp., 11; EEx.
`
`
`
`
`
`
`
`
`
`
`
`
`
`Patent 88,745,149 BB2
`
`
`
`1018, 87:10-88:133, 90:11-911:18.)
`
`
`
`
`
`
`
`
`
`(Ex. 10001, FIG. 100 (annotateed).)
`
`
`
`
`
`
`
`
`
`
`
`III. TTHE CHAALLENGEED CLAIMMS ARE OOBVIOUSS
`
`
`
`
`
`
`
`
`PPO’s Respoonse raises a handful of argumeents concerrning the pprior art; al
`
`l are
`
`
`
`unavailiing.
`
`
`
`
`
`A. Grahham Disclooses Commmunicatingg Mixed MMedia Messsages via
`
`
`
`
`
`
`
`
`
`
`
`SMSS Instant MMessages
`
`
`
`
`
`
`As discusseed in the Peetition, Graaham’s miixed mediaa messaginng embodimment
`
`
`
`A A
`
`
`
`disclosees “a conveersation of f instant meessages” beecause thee mixed meedia messaages
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`constituute a threadd of messagges that caan be commmunicated uusing SMSS. (Pet., 133-
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`15.) POO respondss that Grahham’s mixeed media mmessages arre not “insstant
`
`
`
`
`
`11
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`messages” because these messages “rel[y] on email, not SMS.” (Resp., 18-28.)
`
`PO’s argument, however, is based only on text that appears in FIGS. 13a-13c
`
`rather than Graham’s teachings as a whole, which establishes that one medium for
`
`transmitting mixed media messages is SMS. (Id.)
`
`PO argues that Graham’s mixed media messaging embodiment is limited to
`
`email because FIGS. 13a-13c recite “Texting with bob_test using email.” (Id., 21-
`
`25.) But the specification does not limit the medium for communicating mixed
`
`media messages to email. For example, where the specification describes the
`
`process for communicating mixed media messages, Graham does not state which
`
`transport medium is used. (Ex. 1005, 14:15-15:56.) Likewise, FIG. 12, which
`
`illustrates this process, does not indicate which transport medium is used. While
`
`FIGS. 13a-13c mentions “email,” these figures merely illustrate “example screen
`
`snapshots for the communication process of FIG. 12.” (Ex. 1001, 3:16-17
`
`(emphasis added); id., 15:1-2.) Thus, at most, FIGS. 13a-13c indicate that email is
`
`one medium for communicating mixed media messages—but it certainly is not the
`
`only medium.
`
`Indeed, Graham elsewhere describes that its invention includes a mobile
`
`device 400 that communicates messages via various mediums, including SMS. For
`
`example, referring to FIG. 1, Graham explains that Gateway 115 may be used to
`
`translate exchanges of “SMS (short message service) messages.” (Id., 4:43-47; id.,
`
`12
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`4:22-30.) With reference to FIG. 4, Graham explains that “device 400 may be
`
`arranged to send and receive SMS messages.” (Id., 7:1-6; id., 7:28-31.) While PO
`
`attempts to restrict these teachings to Graham’s “image-only embodiment” (Resp.,
`
`22-23), these teachings are not specific to either the image messaging embodiment
`
`or the mixed media messaging embodiment, which are described later.3 (See Ex.
`
`1018, 146:15-150:8 (confirming that FIGS. 1 and 4 relate to both image and mixed
`
`media messages).) And PO does not argue that SMS cannot be used to transmit
`
`mixed media messages.4 Accordingly, considering all of Graham’s teachings, Dr.
`
`Olsen concluded that Graham discloses communicating mixed media messages via
`
`SMS. (Ex. 1002, ¶40.) PO’s disregard of these teachings violates the principle that
`
`“[a] reference must be considered for everything it teaches by way of technology
`
`3 That Graham states that device 400 may “send and receive SMS messages that
`
`can include data representing an image” does not mean that SMS is described only
`
`for use with image messages because Graham explains that mixed media messages
`
`may have “image contents.” (Ex. 1005, 14:17-22; id., 14:50-55, 14:64-67, 15:15-
`
`17.)
`
`4 Presumably this is because mixed media messages may include, for example,
`
`“textual and image contents,” “only textual content,” or “only image content” (Ex.
`
`1005, 14:17-24; id., 15:50-56), which Graham explains can be transmitted via
`
`SMS (id., 11:20-61).
`
`13
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`and is not limited to the particular invention it is describing and attempting to
`
`protect.” Belden Inc. v. Berk-Tek LLC, 805 F.3d 1064, 1076-77 (Fed. Cir. 2015)
`
`(citation omitted).
`
`B.
`
`It Would have been Obvious to Communicate Mixed Media
`Messages via non-SMS Instant Messaging Based on Deshpande
`The Petition also presents Grounds 7-12, which describe how the instant
`
`messaging terms would have been obvious based on Deshpande. (Pet., 60-62.) PO
`
`argues that Petitioner’s reliance on Deshpande is insufficient because Graham’s
`
`mixed media messaging embodiment “does not use SMS messages” (Resp., 29
`
`(emphasis omitted)) and “Petitioner’s entire obviousness analysis is predicated on
`
`comparing Deshpande’s non-SMS messaging to Graham’s SMS messaging” (id.,
`
`30). However, PO’s characterization of Graham is wrong for the reasons discussed
`
`above, but even if correct, the Petition sufficiently explains how these terms would
`
`have been obvious based on Deshpande.
`
`Contrary to PO’s allegations, the Petition does “identify the differences
`
`between the claimed subject matter…and the prior references, and demonstrate that
`
`the differences…would have been obvious.” (Id., 29-30 (internal quotation marks
`
`and citations omitted).) The identified difference is that Graham does not disclose
`
`the instant messaging terms, under the assumption that SMS messages are not
`
`instant messages. (Pet., 60-61.) The Petition then describes several reasons
`
`explicitly identified in Deshpande for why this difference would have been
`
`14
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`obvious. For example, as discussed in the Petition, Deshpande explains that non-
`
`SMS instant messaging was well known, could have been used with a wide variety
`
`of devices, allows for presence awareness, and could have been achieved via the
`
`Internet (e.g., cellular service is not required). (Id., 61-62.) Given these well-
`
`known benefits of non-SMS instant messaging, whether the modification results in
`
`replacing SMS or email messaging is irrelevant. Indeed, the portions of Deshpande
`
`cited in the Petition describe these benefits as improvements over both SMS and
`
`email messaging. (Id. (citing Ex. 1008, ¶¶[0006]-[0008], [0016]-[0017], [0028]-
`
`[0029], [0039]); Ex. 1008, ¶¶[0004]-[0005].) Even PO and its expert acknowledge
`
`the benefits of instant messaging over email. (Resp., 25-27; Ex. 2007, ¶¶59-62.)
`
`C. Graham Discloses the “Automatically Changing” and
`“Displaying” Limitations Under Any Construction
`1.
`Graham Discloses the “Automatically Changing” and
`“Displaying” Limitations Under Petitioner’s and the
`Board’s Interpretations
`The Petition demonstrates—and PO and its expert do not dispute—that
`
`Graham discloses the “automatically changing” and “displaying” limitations under
`
`Petitioner’s plain and ordinary meaning. (Pet., 24-27; Resp., 31-43.) Accordingly,
`
`under Petitioner’s plain and ordinary meaning, it is uncontested that Graham
`
`discloses all of the limitations of the challenged claims.
`
`If the Board agrees with PO that “automatically” modifies “displaying,” PO
`
`also does not dispute that Graham discloses the “displaying” limitation under
`
`15
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`either Petitioner’s plain and ordinary meaning of the term “automatically” or the
`
`Board’s interpretation where “other prior operations can be manually initiated.”
`
`(Dec., 8.) Thus, it is also uncontested that Graham discloses the challenged claims
`
`if the Board maintains its construction of “automatically” or adopts Petitioner’s
`
`plain and ordinary meaning.
`
`2.
`
`Graham Discloses the “Automatically Changing” and
`“Displaying” Limitations Under PO’s Construction
`The Petition demonstrates that it would have been obvious to modify
`
`Graham to display first time information for instant messages in a conversation as
`
`(i) an elapsed time, and/or (ii) a color that indicates age, and that Graham discloses
`
`“automatically changing” such time information to a second time information as
`
`time progresses and “displaying” the second time information instead of the first
`
`time information. (Pet., 16-27.) PO argues that Graham does not disclose the
`
`“automatically changing” and “displaying” limitations under its proposed
`
`construction for either type of time information. PO’s arguments fail, however,
`
`because they are centered on a faulty understanding of Graham.
`
`PO argues that Graham does not disclose these claim limitations for an
`
`elapsed time because “the user must manually request an update to the image
`
`messages.” (Resp., 32-34 (citing Ex. 1005, 10:29-37).) As described with respect
`
`to FIG. 10 and confirmed by PO’s expert, however, this “update” functionality
`
`relates to receiving “new image messages” rather than updating previously
`
`16
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`received messages. (Ex. 1005, 13:17-19; Ex. 1018, 165:14-166:18 (confirming that
`
`the “update” functionality is for receiving “new image messages”), 173:21-176:12
`
`(confirming that the teachings in Ex. 1005 at columns 10:29-37 and 13:17-46 are
`
`interrelated).) That is, after a user has received an image message sent by another
`
`user, the sending user may have updated its image message by selecting one or
`
`more new images. (Ex. 1005, 13:17-27, FIG. 10; Ex. 1018, 156:3-157:2.)
`
`Accordingly, the recipient user can “request and receive an update to any of the
`
`image messages received.” (Ex. 1005, 10:32-37.) As shown in FIG. 10, an image
`
`message server sends (step 630/650) only new image message(s) that it has
`
`received and stored (step 610) upon receiving such a request (step 620/640). (Ex.
`
`1018, 172:5-180:13 (confirming that the “update” functionality illustrated in FIG.
`
`10 results in sending an image message to a recipient device only if both the image
`
`message is new and the recipient device user requested an update).) Accordingly,
`
`this functionality does not update an elapsed time for a previously received image
`
`message, as PO contends.
`
`This is further confirmed by the format of the image message illustrated in
`
`FIG. 7, which shows that an image message includes “time information 1040” (Ex.
`
`1005, 10:59-61) indicating “when the image message was sent” by a sending user
`
`so that the “recipient mobile device” can “compute and display the amount of
`
`elapsed time for the received image message” (id., 11:14-18 (emphasis added)).
`
`17
`
`
`
`
`IPR2017-00912
`Patent 8,745,149 B2
`
`(Id., 9:53-54, 10:29-32; Ex. 1018, 157:14-164:5 (confirming that the timestamp is
`
`the time the message was sent).) Thus, a message received from the image message
`
`server does not indicate a changed elapsed time. It indicates the time the message
`
`was sent by the sending user, which never changes. The recipient device is
`
`responsible for determining the elapsed time to display, which may automatically
`
`change as time progresses. (Pet., 16-27.)
`
`Moreover, even if PO is correct that a displayed elapsed time only changes
`
`in response to receiving an update, Graham still disclose these limitations because
`
`a user can enable the image server to automatically forward each new image
`
`message to other users. (Ex. 1005, 13:47-14:11, FIG. 11; Ex. 1018, 171:8-172:4.)
`
`PO argues that Graham does not disclose these claim limitations for a color
`
`that indicates age because illuminator 450 will illuminate