Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 1 of 37 PageID #: 41
`
`Exhibit A
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 2 of 37 PageID #: 42
`case lizo'cv'01345'UNA D°°“"‘e“t 1'1|||1|11111111111111111111111I‘llll’1I11111111111111112
`
`US009860198B1
`
`(12) United States Patent
`US 9,860,198 B1
`(10) Patent N0.:
`Cohen et al.
`
`(45) Date of Patent: Jan. 2, 2018
`
`(54) APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`(71)
`
`Applicant: Wrinkl, Inc., Sands Point, NY (US)
`
`(72)
`
`Inventors: Marc A. Cohen, Blue Bell, PA (US);
`Erik S. Katz, Sands Point, NY (US)
`
`(73)
`
`Assignee:
`
`Wrinkl, Inc., Sands Point, NY (US)
`
`(*)
`
`Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`
`(21)
`
`Appl. N0.: 15/431,077
`
`(22)
`
`Filed:
`
`Feb. 13, 2017
`
`Related US. Application Data
`
`(60)
`
`Provisional application No. 62/446,067, filed on Jan.
`13, 2017.
`
`(51)
`
`(52)
`
`(58)
`
`Int. Cl.
`
`H04L 12/58
`US. Cl.
`
`(2006.01)
`
`CPC .............. H04L 51/04 (2013.01); H04L 51/08
`(2013.01); H04L 51/10 (2013.01)
`Field of Classification Search
`CPC ....................................................... H04L 12/58
`
`See application file for complete search history.
`
`9,218,603 B2 * 12/2015 Kumar ................... G06Q 10/10
`2009/0119371 A1*
`5/2009 Chang ................. H04L 12/1827
`709/206
`2011/0289406 A1* 11/2011 Wassingbo ............ G06F 3/0488
`715/256
`7/2014 Rao Dv .............. H04L 12/1827
`709/206
`6/2016 Shen ..................... G06F 3/0488
`715/753
`2016/0294742 A1* 10/2016 Weaver .................. G06Q 10/10
`
`2014/0195621 A1*
`
`2016/0179773 A1*
`
`OTHER PUBLICATIONS
`
`WhatsApp Jun. 13, 2016*
`Slack. “Share messages in Slack” in “Using Slack”. Obtained from
`https://get.slack.help/hc/en-us/articles/203274767-Share-messages-
`in-Slack. Jan. 2017.
`
`* cited by examiner
`
`Primary Examiner 7 David Choi
`(74) Attorney, Agent, or Firm 7 Caesar Rivise, PC
`
`ABSTRACT
`(57)
`A method for referencing a message comprises the steps of
`receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`24 Claims, 24 Drawing Sheets
`
`Wednesday, iwwmgf mm
`
`
`= ma‘fa‘mmm M121?
`
`
`
` 1.: “am. e.
`
`,
`.
`{$315, 4. ‘z‘n. want mam. n. $0.-
`
`
`
`
`M3Mayhem
`
`
`”'
`
`21551451
`
` C.) Erikxla-fz .
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 3 of 37 PageID #: 43
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 3 of 37 PageID #: 43
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 1 of 24
`
`US 9,860,198 B1
`
`
`
`Figure 1
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 4 of 37 PageID #: 44
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 4 of 37 PageID #: 44
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 2 of 24
`
`US 9,860,198 B1
`
`1012:
`
`1012
`
`190
`
` \ }
`
`)'
`
`' my;{reficm
`
`
`
`
`
`
`
`
`Swarm: {Bewfz‘rs'a
`
`140 “’
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 5 of 37 PageID #: 45
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 5 of 37 PageID #: 45
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 3 of 24
`
`US 9,860,198 B1
`
`310 N\
`
`
`
`Figure 3
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 6 of 37 PageID #: 46
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 6 of 37 PageID #: 46
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 4 of 24
`
`US 9,860,198 B1
`
` Receive “Selection” Of Area or Object
`
`
`410 m Asseciaiedwith First Message
`
`Area or Object has been received.
`
`
`
`Provide indication that Seieetieri of
`
`
`420
`
`
`
`Aiiew Seeend Message to be Farmed
`
`with “Link” 120 First Message — “Link”
`
`440 —
`
`to Seieeiieri of Further Area or Object
`
`
`
`is Associated with Further Message
`
`Respense to “Seieetiem.
`
`
` Cause Display ofirifermatien Response
`
`
`
`
`
`
`
`
`Associated with a) First Message, and
`
`‘0) “Link”
`
`Figure 4
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 7 of 37 PageID #: 47
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 7 of 37 PageID #: 47
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 5 of 24
`
`US 9,860,198 B1
`
`Display Mex/ions messages and Text
`
`5l0
`
`529
`
`330
`
`Entry Bar (ready to create second.
`
`message)
`
`Click on Area or Portion Of First
`
`Message to be Referenced by Second
`
`Message
`
`Insert Object into Text Entry Bar
`
`lndieating intent to Reference First
`Message
`
`
`
`Complete Second Me:sage and
`
`Transmit
`
`Message
`
`Display
`
`Second
`
`Sisplay First Message (for Portion of \
`First Message) when Display iject
`560
`
`associated with Second Message is
`
`Selected
`
`figure 5%
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 8 of 37 PageID #: 48
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 8 of 37 PageID #: 48
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 6 of 24
`
`US 9,860,198 B1
`
`\1
`
`0 i b
`
`Second Client Device
`
`\
`
`1 '40
`
`1
`
`Network
`
`______
`
`.129;
`
`Message Server
`
`
`
`
`
`
`
`Engine
`
`
`
`First Client Device
`
`Figure 6
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 9 of 37 PageID #: 49
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 9 of 37 PageID #: 49
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 7 of 24
`
`US 9,860,198 B1
`
`Secend Client
`
`Device
`
`:
`
`Message
`Engine
`
`Lin}. .
`
`Engine
`
`Engine
`
`; Message
`Engine
`Link
`
`First Client
`Dawes
`
`Figure ’7
`
`101a
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 10 of 37 PageID #: 50
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 10 of 37 PageID #: 50
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 8 of 24
`
`US 9,860,198 B1
`
`
`
`
`
`wwmmamJenner?253sz
`
`2;}Em“A3éx
`
`Figure8A
`
`éfiarflahw
`
` Marsfimfismt‘
`
`_
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 11 of 37 PageID #: 51
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 11 of 37 PageID #: 51
`
`U.S. Patent
`
`Jan.2,2018
`
`Sheet9 on4
`
`US 9,860,198 B1
`
`
`
`......................................................................................................................«wwm‘nmfimgmfiwflfifimfinfifig.
`
`mm2:5
`
`$33,2.”mg“my:53
`
`
`
`
`
`$meEgmmmn.m.§:mmm.
`
`MM
`
`
`

`

`mPl.ws.aU
`
`ww
`
`
`
`myamy?mhmngmw“3&3?wa
`
`aD.m
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 12 of 37 PageID #: 52
`m
`F
`2
`f
`C
`0
`w
`&
`
`P6700.,39
`
`..1#Bm8e91w0,gm335
`
`1n
`
`m2,
`
`e00
`
`11
`
`S
`
`4
`
`1Uw
`
`OS
`
`
`
`Kwm3?,“an4Um.“E3tmax“?w
`
`”ammxxmm
`
`
`
`Mpara?5.33.meREa“5aEggmAJ
`
`
`
`maxaufiam
`
`mm...w2
`
`figfiww
`
`1..
`
`..1
`
`dtEE5%»“(16.3.33.5.hmfiwfibwflhmfi
`
`Mm.3«ugfiwmmMSwnfiuwwhwfi
`
`
`
`
`
`

`

`aPO
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 13 of 37 PageID #: 53
`1..1m
`2
`NU.Mu
`31w
`C
`O
`3
`/
`
`2P1oeSsoaU
`
`ca
`
`
`
`O.m3%3mg?»Vt3%»hwmwfimwEmu.L
`
`Bt
`
`em0m2m2.,Dn.aAJ
`
`01l1dtmwn%
`OM
`
`mu
`
`a0P6700939,mm
`
`6.1#B
`
`
`
`m%a;w1,Qmfigak
`
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 14 of 37 PageID #: 54
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 14 of 37 PageID #: 54
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 12 0f 24
`
`US 9,860,198 B1
`
`
`
`figgang”:Ammwmwmfimwa
`
`#7?A”:a3
`
`@@Emmm
`
`“flaxmfiw
`
`gfifim
`
`mgeufiefi
`
`maxawwemfi
`
`mwfiwmafi
`
`EganMAE$qu$3
`
`
`
`.sagaAw
`
`
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 15 of 37 PageID #: 55
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 15 of 37 PageID #: 55
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 13 of 24
`
`US 9,860,198 B1
`
`
`
`Figure10A
`
`
`
`25:5fut.“a.»
`
`
`
`Marciehere
`
`.4:4+2
`can
`
`v f
`
`lM
`fit
`5:ES“*5, .9.
`:45
`m
`”‘5an
`5:;
`fi’99
`.3}
`01%
`
`
`
`
` -‘”a;32mmy::e§.£:-s::fiaraav~;;..-2
`
`
`

`

`_
`9
`1..1tn
`aPm
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 16 of 37 PageID #: 56
`f
`C
`5
`O
`6
`65
`d
`g
`g
`
`mm...
`
`1M
`
`4Z2mM
`
`1U
`
`OS
`
`P670039,
`
`mg.mm8em
`
`a0,m3255
`
`1.ws.aU
`
`_eVtca
`
`emm0C29O2Dn.aAJ
`
`
`mPfirm”@55an.flnfimmmwfim
`._H«MV
`
`
`4..2...;.J..‘33,..x,T.3tEQEWEQmm5%.??chm.nflmxfim
`
`N.VU.fifixmw
`
`
`

`

`_
`_
`6
`1tn
`aPm
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 17 of 37 PageID #: 57
`7
`7
`f
`C
`O
`M
`g
`
`51#.Bm8
`
`1U
`
`OS
`
`P67839,
`
`
`
`ww93%”a09Qmwm..nm
`
`%s.aU
`
`.L.figmhmmfimwfiwflmmfifififi
`
`2P
`
`Vtca
`
`MJ
`
`C29
`
`
`
`
`
`1m..4,0.e.cwmm3%.me.fimnfé5
`
`U3“5“353,
`
`
`
`O2.1Dm.wflwxeufiwfl
`
`e8.,mmfixfifi
`
`«mm»15.Hd1iafiwfim.3%;mm.bwm33E-%Rafi?.,
`4,Z2.............................................................Of.LW0“Em:mwwwmwxfi3%gmwwmfi
`“La;
`
`1wmwxfluwmmfi
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 18 of 37 PageID #: 58
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 18 of 37 PageID #: 58
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 16 of 24
`
`US 9,860,198 B1
`
`P5298; {Bu}:
`
`@513 am Emm- “1121:2531 $59.21 535,.
`
`Figure 11A
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 19 of 37 PageID #: 59
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 19 of 37 PageID #: 59
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 17 of 24
`
`US 9,860,198 B1
`
`Phem {Rut}
`
`
`
` You mod to touch—1211 [Ens area. I 58.92051 you use a
`
`Figure 113
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 20 of 37 PageID #: 60
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 20 of 37 PageID #: 60
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 18 of 24
`
`US 9,860,198 B1
`
`Pia-em {Rub
`
`Sena (3:.
`
`;:::‘
`
`’ 35:43:? sitar}, §$2=$5§.1"::=§:7$f-ilfz‘fz’fiiffigg.
`
`'i’nzi
`
`-
`
`Figure 11C
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 21 of 37 PageID #: 61
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 21 of 37 PageID #: 61
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 19 of 24
`
`US 9,860,198 B1
`
`
`
`Figure 11D
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 22 of 37 PageID #: 62
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 22 of 37 PageID #: 62
`
`U.S. Patent
`
`J
`
`102
`
`S
`
`42f002
`
`US 9,860,198 B1
`
`00mag?gm
`
`agum.3.9mmewMfin;km5
`
`Magma
`
`
`
`....................................................................................................................fimwhwmfififiwfimmgwmvmwfi
`
`
`
`7mage?4.2%mag?m?.3mm3n,aEV333mm
`
`69$3%gmAmtma5Efifigmw
`
`23a:—
`
`WEEEmnew:me3.$me..mg.Mmmgw
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 23 of 37 PageID #: 63
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 23 of 37 PageID #: 63
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 21 of 24
`
`US 9,860,198 B1
`
`
`
`wwmwag,gammy3.“$2:
`
`
`
`Figure13A
`
`
`
`5213.:*
`as
`
`emsmm' it":
`
`
`
`

`

`a
`1..1tn
`aP
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 24 of 37 PageID #: 64
`1
`4
`NU.5M
`46
`f
`O
`d
`
`
`
` .L.eSsOCU
`
`Onwwmya
`
`t
`
`emm0C2aO2Dn.aAJ
`
`mm...HhS
`
`1n
`
`Z2mM
`
`2Uw
`
`OS
`
`7839,
`
`mg.mD8a9w1,0p6m28:3
`
`
`
`
`
`
`
`
`
`mP..........................................................................................................................fiwfiflrEwflWwflma«mwfimwfigmfi..........................................................................................................................
`
`
`m4meEngEmaEggflungEmfifififiEmmmma».,wEwmwmmfi
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 25 of 37 PageID #: 65
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 25 of 37 PageID #: 65
`
`U.S. Patent
`
`Jan. 2, 2018
`
`Sheet 23 0f 24
`
`US 9,860,198 B1
`
`
`
`.......................................................................................................................fiwmfflfififlfifififlmwfifimg
`
`”:53,3mmmew.mmgmE2Q
`
`
`
`.,<fim‘mxmawm
`
`Em.$memy?»5&3.xu., BEEwwmmEmEmmwmmmmém3“
`
`yawn:
`
`mucmefimm,20mamEw:,wfifi£3sz
`
`022:5
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 26 of 37 PageID #: 66
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 26 of 37 PageID #: 66
`
`U.S. Patent
`
`2n.aJ
`
`1
`
`2f042teehS
`
`US 9,860,198 B1
`
`0.2.,$.33“HEgemwe?»asx9%Eu3mk..33
`8figfifiw
`4......................
`
`...............................................................................................................fiflfimflfiawwflwwfififiwwwmflwg
`
`
`
`
`.mmmm:flummmm$3.}mugEG
`
`fifigfi
`
`
`
`BEEMm:mMumEmmwmmme.mEHmuamhfimmWEE3m“am
`
`A?gamma
`
`fig$0
`
`928%:
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 27 of 37 PageID #: 67
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 27 of 37 PageID #: 67
`
`US 9,860,198 B1
`
`1
`APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`This application claims priority under 35 U.S.C. 119 to
`US. Provisional Application 62/446,067 filed on Jan. 13,
`2017 which is hereby incorporated by reference in its
`entirety.
`
`FIELD OF THE INVENTION
`
`The present invention relates to computer messaging and
`more particularly to management thereof. In particular, an
`apparatus and method are disclosed for improving computer
`operational efficiency through message linkage manage-
`ment.
`
`BACKGROUND OF THE INVENTION
`
`including messaging, pro-
`Electronic communication,
`vides a very efficient manner of information exchange. In
`such forms of electronic communication, messages are
`exchanged between multiple parties in order to convey
`information. In one known form of messaging, two users
`operate respective client devices and effectively engage in
`conversation by transmitting messages between each other.
`Such communication may be in the form of a single con-
`tinuous stream of back and forth messaging. Also, in some
`situations, more than two users (operating, for example,
`more than two respective client devices) may be communi-
`cating in a single continuous stream. While a single stream
`of messages may be transmitted in an ongoing sequence, it
`is also possible to have multiple channels, each with their
`own respective stream of messages.
`A “conversation” of messages may be short or it may
`occur over an extended period of time. Such a period of time
`can last for hours, days, or even years. During the process of
`such a conversation, a large quantity of messages may be
`transmitted between multiple users. Typically, in order to
`reference an earlier message within a stream of messages, it
`may be desirable to scroll or somehow visually traverse
`through messages until an earlier message is located.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with an exemplary embodiment of the present invention.
`FIG. 2 is a block diagram that illustrates details of an
`exemplary client device in accordance with an exemplary
`embodiment of the present invention.
`FIG. 3 illustrates an exemplary interface portal of a client
`device in accordance with an exemplary embodiment of the
`present invention.
`FIG. 4 is a flowchart diagram that illustrates exemplary
`message referencing in accordance with an exemplary
`embodiment of the present invention.
`FIG. 5 is a flowchart diagram that illustrates exemplary
`message referencing in accordance with a further exemplary
`embodiment of the present invention.
`FIG. 6 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with a further exemplary embodiment of the present inven-
`tion.
`
`FIG. 7 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with yet another exemplary embodiment of the present
`invention.
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`FIGS. 8A-8D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIG. 9 is an exemplary screen shot that illustrates exem-
`plary operation of an exemplary embodiment of the present
`invention.
`
`FIGS. 10A-10C are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 11A-11D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`illustrates
`that
`FIG. 12 is an exemplary screen shot
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 13A-13D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`A method for referencing a message comprises the steps
`of receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`
`DETAILED DESCRIPTION
`
`The present invention relates to messaging and in par-
`ticular to the ability of one message to reference another
`message. With regard to messaging, what is referred to is the
`ability for one or more users to provide a series of messages.
`Messages typically occur in a stream, wherein each message
`comprises data. The data included in messages is often text,
`but this is merely exemplary as messages can include other
`content,
`including possibly any kind of data (e.g. audio,
`video, animation, graphics, web links, photos, etc.).
`In one or more exemplary embodiments of the present
`invention, a method and apparatus improves the operation of
`a computer device, by providing links that enable a com-
`puter device to operate with greater efficiency. In particular,
`in several exemplary embodiments, when one message
`references another message, and time has elapsed between
`the two messages, the invention enables a computer device
`to operate with advantages over the prior art. For example,
`in the prior art, to enable one message to reference an earlier
`message, a search for the earlier message can be inefficient,
`time consuming, can delay message response while an
`earlier message is located, and can request that data stored
`in memory be duplicated. By contrast, in accordance with
`exemplary embodiments of the present invention, the use of
`visual display of an earlier message (or portions thereof) and
`selection (in various manners to be described below),
`enables message referencing in a manner that enables faster
`computer processing and more efficient use of computer
`devices for exemplary forms of communication such as
`messaging.
`Messaging (such as chat messaging) has become a very
`popular form of electronic communication due to its afford-
`ability and ease of use. On any given day, users may
`exchange numerous messages regarding a diverse range of
`topics. The users may use the messages to discuss, for
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 28 of 37 PageID #: 68
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 28 of 37 PageID #: 68
`
`US 9,860,198 B1
`
`3
`example, group activities, to solicit opinions about various
`topics, or simply exchange short conversations with friends
`or co-workers. One of the drawbacks to using typical chat
`messaging systems is the sequential nature of the messages
`sent and received. For example, messages often appear in a
`channel or log in chronological order. If a user in a group
`chat session comes back from a meeting after several hours,
`they may be confronted with a bunch of messages. In this
`regard, the group chat sessions are often characterized by
`short bursts of dialog around a given topic. By the time a
`user views the messages,
`the topic may have changed
`several times. This makes it difficult for a user to post a
`response to a previous message that is within context of the
`ongoing message conversation.
`Methods and systems for providing references (such as
`context-based references) to link messages (such as chat
`messages) are disclosed herein. This allows a user to gen-
`erate and insert a (reference) object into a (chat) message
`stream that links or otherwise references a chat message
`(such as a prior message or later message) the user intended
`to send. It is contemplated that the techniques disclosed
`herein may be particularly beneficial
`in certain types of
`communication platforms. However, so as to illustrate the
`method and system functionality, and not by way of limi-
`tation, the communication platform described herein is an
`exemplary chat messaging platform. It is envisioned that one
`skilled in the art could make and use the methods and
`
`systems described herein with other types of communication
`platforms. Some of these communication platforms may
`include, for example, text messaging, short message services
`(SMS), e-mails and other types of similar on-line commu-
`nication platforms for facilitating electronic information
`exchanges between client devices of a plurality of users. The
`use of chat messaging described herein is merely exemplary,
`as other forms of messaging may also be used in accordance
`with exemplary embodiments of the present invention.
`With respect to chat messaging platforms, a message (for
`example in a chat message session) that a user wishes to
`respond to or reference occurred as a standalone comment or
`as part of a previous and unrelated (to a most recent
`discussion chain) discussion. A chat message session, as
`used herein, refers to a series of messages that are exchanged
`between one or more users, wherein for more than one user
`the users are in a group of users. When one of the users in
`the group adds a new message to a chat message session, the
`new message is sent
`to other users in the group. For
`example, if a first user adds a new message to the chat
`message session between three users in a group, then the
`new message may be sent to other selected users of the
`group, such as the second user and/or the third user. Thus,
`the chat message session may simulate a real-life conver-
`sation because users may communicate to the group at large,
`or to a specific person or a subset of the people in the group.
`In some situations, a user may want add a new message
`that is related to a previous message in the chat message
`session. When replying to the previous message at
`the
`current point in time in the session, the reply message may
`appear out of context and could be confusing to other users
`in the session. This is because the chat message sessions
`often include numerous messages that may have been
`entered over a short period of time. Some group messaging
`users employ various strategies to minimize the effect of
`their writing messages when trying to refer to or reply to a
`previous message in the session. In one example, a user may
`copy and paste the prior message into the text message entry
`bar and then add additional text. In another example, the user
`may include addition information in the new message to
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`make it clear what is being responded to. In yet another
`example, the user may specify the message being referenced
`by identifying and referencing something unique about the
`message such as who sent it, the date and/or the time it was
`sent. One problem with using these types of techniques is
`that extra text entry space may not be available in a chat
`message system that limits the amount of data that can be
`entered into a given message. Moreover, the user may miss
`some important information if they cut and paste only a
`portion of the previous message or the identifying informa-
`tion regarding the previous message may not be complete or
`accurate.
`
`To put it another way, a first message (“message”) may be
`one of several messages. A second message (“further mes-
`sage”) may also be one of the several messages. It may be
`desirable for the second message to reference the first
`message. By “reference” what is meant is that there is a
`connection between the second message and the first mes-
`sage. The connection may be for example a link. With such
`a link, while the second message is being viewed, some
`aspect of the first message may also be viewed. The aspect
`of the first message may be, for example, all of the first
`message, part of the first message, a modified form of all or
`part of the first message, and/or data associated with the first
`message. Exemplary associated data may include a user (or
`some form of identification of the user) associated with the
`first message, a date and/or time associated with the first
`message, Gucci and/or some other data associated with the
`first message.
`In one exemplary embodiment of the present invention, a
`“reference object” is inserted into a text entry box that is
`being used to form a second message so that (after the
`second message is transmitted) a “display object” can be
`displayed (with the second message) that references the first
`message. In one embodiment of the present invention the
`reference and display object are the same while in another
`embodiment of the present
`invention the reference and
`display object are different. The reference object, or the
`display object, or both, references the first message as more
`clearly described below.
`Chat messages (as an example of messages) are thus
`beneficially enhanced to provide users with additional infor-
`mation related to the meaning of their electronic conversa-
`tions without introducing expensive overhead or burden-
`some retrieval mechanisms. For example, a user may make
`a selection associated with a first message which then
`automatically inserts a reference object into a text entry bar
`of a chat message system. The reference object may provide
`a link to automatically identify and access data from the first
`message. The user may then add additional text in the text
`message box before or after the reference object. When the
`message is sent, a display object associated with the first
`message is included in the newly posted second message. If
`multiple messages are referenced then one or more of the
`display objects are displayed in the newly posted message.
`It is also possible for the same message to be referenced
`multiple times by different new messages at any time in the
`chat message session. In addition, computer processing
`efficiency is improved through the use of links and without
`simply duplicating previously inputted data. Efficiency is
`also improved by enabling access to at least a portion of
`previously available data without a need to manually locate
`the previously available data.
`Each display object can then be activated in the chat
`session in several ways. For example, by hovering over
`and/or selecting the display object, text data (or other data or
`portions thereof) associated with the referenced first mes-
`
`

`

`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 29 of 37 PageID #: 69
`Case 1:20-cv-01345-UNA Document 1-1 Filed 10/02/20 Page 29 of 37 PageID #: 69
`
`US 9,860,198 B1
`
`5
`sage may be displayed (e.g., above, to the side of, below)
`with respect to the newly posted message. The information
`thus provides the reader with immediate and useful context
`relating to the message they are reading by allowing them to
`see the message that is referenced. In some implementations,
`other Visual or audio mechanisms can be added to highlight
`the display object. For example,
`the display object may
`displayed in a different text color, font size, or a change to
`a portion or all of the background of the referred message or
`include various type of animation effects.
`While the above description is with regard to first and
`second messages, it is understood that “first” and “second”
`(or “message” and “further message”) are merely being used
`to identify two messages that have been separately entered
`into a computer system (and then, for example, sent). In one
`embodiment of the present invention, the first message is
`sent before the second message, although this merely exem-
`plary (i.e. the order may be reversed).
`In one implementation, a computer program product may
`be installed and/or a service may be selected from a cloud-
`computing environment in order to obtain the benefits of the
`techniques described herein. In an implementation, the com-
`puter program product may be downloaded onto a client
`device. For example, a user may elect to download the
`computer program product from a service associated with an
`online server. The client device may transmit a request for
`the computer program product over a network and,
`in
`response, receive the computer program product from the
`service. The computer program product may be installed
`locally on the client device or stored at the service and may
`be accessed through the client device, for example, via a
`mobile web browser. In one exemplary embodiment, soft-
`ware to achieve the above results is stored in a cloud
`
`10
`
`15
`
`20
`
`25
`
`30
`
`computing environment. In another exemplary embodiment,
`the software is stored in local client devices. In a further
`
`35
`
`exemplary embodiment of the present invention, the soft-
`ware is stored in a combination of a cloud computing
`environment and (one or more) local client device(s).
`FIG. 1 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with an exemplary embodiment of the present invention. In
`an exemplary embodiment of the present invention, two or
`more computing devices (e.g., client devices) may engage in
`an electronic communication session (e.g., chat session)
`with each other. In some implementations, a first participant/
`client device may engage in a chat session with a second
`participant/client device via a network. As shown, commu-
`nications network 100 includes a plurality of computing
`devices such as client devices 1010-1016 which may include
`for example, a base station, a personal data assistant (PDA),
`a laptop/netbook and a tablet as well as computing server
`devices and (e.g., computing devices that can be located at
`a number of different receiving stations). The various
`devices may be interconnected via a network or direct
`connection and/or may be coupled via a communications
`network (e.g., a LAN, WAN, the Internet, etc. that may be
`wired or wireless). In some implementations, the computing
`devices may communicate with each other before accessing
`the communication network. In some implementations, the
`network may include a database running on or in commu-
`nication with the server device and/or the client devices or
`
`some combination thereof. In some implementations, the
`database may store reference objects and/or display objects
`related to one or more chat messages. Server 190 is also
`illustrated. Server 190 includes computing device 120, com-
`puting device 130, a terminal for data input and/or display,
`etc. Communication may occur via network 140. While
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`client devices such a devices 101a and 10119 are shown, it is
`understood that fewer or more client devices such as client
`
`devices 101x and 1012 (not shown) may also be included).
`Memory for storing data that is useful in accordance with an
`exemplary embodiment of the present invention may be
`included in the form database 110.
`
`The above description is with regard to at least two users
`(or more) communicating with each other with respective
`client devices. In a further exemplary embodiment of the
`present
`invention,
`the “first message” and the “second
`message” are both entered into the same computing device.
`In a further exemplary embodiment of the present invention,
`further messages may or may not be included from a source
`outside of the computing device from which the “first
`message” and “second message” are entered. In yet another
`exemplary embodiment of the invention, a single user may
`enter the “first message” on one computing device and the
`“second message” on another computing device.
`FIG. 2 is a block diagram that illustrates details of an
`exemplary client device in accordance with an exemplary
`embodiment of the present invention. In one or more exem-
`plary embodiments of the present invention, the system may
`facilitate the transfer of electronic communications between
`
`computing devices of two or more users or participants over
`a communication network. The system can include one or
`more servers (e.g. a server device), which provide access or
`a communication link between a plurality of client devices
`in order to facilitate communication between two or more
`
`client devices over a network. In some implementations, the
`system may include an interface portal that provides for the
`display of network content, such as chat messages of a chat
`message session or any other type of network data received
`in response to a transmitted chat message.
`FIG. 2 illustrates a plurality of client devices 10111-1012.
`In an exemplary embodiment of the present
`invention,
`features of the invention may be included on a server 190
`(shown in FIG. 1) or on a client device 101a-1012. Exem-
`plary client device 101x is illustrated. Client device 101x
`may include I/O device driver(s) 141 (and/or related data-
`base structures), processing device(s) 142 (and/or re