`
`Exhibit B
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 2 of 39 PageID #: 79
`case 120200134500 Docurner“1'1lllllillllMlllfllllfilllilllllillllllllllll’flllllllflllllfillllllfllll9
`
`USOlO728 192B2
`
`(12) United States Patent
`US 10,728,192 B2
`(10) Patent N0.:
`
` Cohen et al. (45) Date of Patent: *Jul. 28, 2020
`
`
`(54) APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`(71) Applicant: Wrinkl, Inc., Sands Point, NY (US)
`
`(72)
`
`Inventors: Marc A. Cohen, Blue Bell, PA (US);
`Erik S. Katz, Sands Point, NY (US)
`
`(73) Assignee: Wrinkl, Inc., Sands Point, NY (US)
`
`(52) US. Cl.
`CPC ............ H04L 51/046 (2013.01); H04L 51/12
`(2013.01); H04L 51/16 (2013.01); H04L 51/18
`(2013.01); H04L 51/36 (2013.01); H04L
`65/1069 (2013.01); H04L 65/1093 (2013.01);
`H04L 65/4015 (2013.01)
`(58) Field of Classification Search
`CPC ........ H04L 51/046; H04L 51/12; H04L 51/16
`See application file for complete search history.
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(1)) by 0 days.
`
`This patent is subject to a terminal dis-
`claimer.
`
`(56)
`
`References Cited
`
`US. PATENT DOCUMENTS
`
`9/2014 Chen et al.
`8,832,569 B2
`9,218,603 B2 * 12/2015 Kumar ................... G06Q 10/10
`9,262,455 B2
`2/2016 Palay
`
`(21) Appl. N0.: 16/712,952
`
`(22)
`
`Filed:
`
`Dec. 12, 2019
`
`(65)
`
`Prior Publication Data
`
`US 2020/0120051 A1
`
`APL 16: 2020
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`b10g.standup1y.com [online], “Top 50 Features of Slack to Boost
`Your Productivity,” Sep. 2016, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://b10g.standuply.com/50-additi0na1-features-0f—
`slack-t0-b00st-y0ur-pr0ductivity-959cc56f7893>, 5 pages.
`
`Related US. Application Data
`
`(Continued)
`
`(63) Continuation of application No. 16/376,427, filed on
`APF- 5, 2019, HOW Pat. NO- 10,547,575, WhiCh is a
`continuation-in-part of application No. 16/014,578,
`filed on Jun. 21, 2018, which is a continuation-in-part
`ofappllcat1on NO: 15/8585696’ filed on Dec. 29520175
`now.
`Pat.
`. No:
`1050253475, Wthh
`1s
`a
`contmuatlon-m-part 0f appl1catlon NO- 15/431977:
`filed on Feb. 13, 2017, HOW Pat. NO- 9:860:198-
`
`(60) Provisional application No. 62/446,067, filed on Jan.
`13, 2017.
`
`(51)
`
`Int. Cl.
`H04L 12/58
`H04L 29/06
`
`(2006.01)
`(2006.01)
`
`Primary Examiner 7 David E Choi
`(74) Attorney, Agent, or Firm iFish & Richardson P.C.
`
`(57)
`ABSTRACT
`A method for referencing a message comprises the steps of
`receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`
`30 Claims, 24 Drawing Sheets
`
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 3 of 39 PageID #: 80
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 3 of 39 PageID #: 80
`
`US 10,728,192 B2
`
`Page 2
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`retrieved from: URL<https://b10g.hubsp0t.com/blog/tabid/6307/bid/
`27675/h0w-t0-retweet-the-right-way-in-4-easy-steps.aspx>, 16 pages.
`Mashable.com [online], “Twitter Updates TweetDeck, Allows Users
`to Edit and Retwee ,” Mar. 22, 2012, [retrieved on Dec. 11, 2019],
`retrieved from: URL<https://mashable.com/2012/03/22/tweetdeck-
`rt-updates/>, 3 pages.
`0ut100k.userv0ice.com [online], “Outlook for Android: Swipe Options,
`swipe left for reply, swipe right for forward. please add these
`options,” Sep. 30, 2015, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://0ut100k.userv0ice.com/forums/293346-0utlook-
`for-android/suggestions/99923 19 -swipe-0pti0ns-swipe-lefi-f0r-reply-
`swipe-right-f>, 5 pages.
`Plexus Worldwide [online], “How to Use the New Retweet Function
`on Twitter | Social Media Solutions,” Apr. 7, 2015, [retrieved on
`Dec. 11, 2019], retrieved from: URL<https://www.y0utube.com/
`watch?v:h9mAP8vwiQ>, 1 page. (Video Submission).
`slack.com [online], “Using Slack ,” 2019, [retrieved on Dec. 11,
`2019],
`retrieved from: URL<https://slack.com/help/articles/
`203274767>, 5 pages.
`slackhq.com [online], “Sharing messages in Slack ,” May 2016,
`[retrieved on Dec. 11, 2019], retrieved from: URL<https://slackhq.
`com/sharing-messages-in-slack>, 5 pages.
`T5 by Robin Good [online], “Free open-source distributed alterna-
`tive to Twitter: Mastodon,” Oct. 10, 2016 [retrieved on Dec. 11,
`2019],
`retrieved from: URL<t001s.robingood.com/site/contents/
`content/765621/2016-l0-06/free-0pen-s0urce-djstributed-alternative-
`t0-twitter-mast0d0n>, 2 pages (Video Submission).
`Tech & Design [online], “How to Retweet anything iPhone iPad
`iPod Mac,” Jul. 18, 2015, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://www.y0utube.com/watch?v:6D7MkQOOZjY>,
`1 page (Video Submission).
`express.co.uk [online], “WhatsApp quietly introduced a brand-new
`way to reply to your messages,” Jun. 13, 2016, [retrieved on Dec.
`16, 2019] retrieved from: URL<https://www.express.co.uldlife-style/
`science-technology/679325/WhatsApp-H0w-T0-Qu0te-Message-In-
`Reply-iOS-Android-Chat>, 4 page.
`PCT International Search Report and Written Opinion in Interna-
`tional Appln. N0. PCT/US2018/l3462, dated Jan. 12, 2018, 7 pages.
`slack.com [online], “Share messages in Slack: From channels to
`searchilearn how Slack works from top to bottoml,” [retrieved on
`Dec. 16, 2019] retrieved from: URL<https://slack.com/help/articles/
`203274767-Share-messages-in-Slack>, 1 page.
`
`* cited by examiner
`
`8/2016 Wong et a1.
`1/2018 Cohen
`5/2018 Yang et a1.
`6/2018 Park et a1.
`9/2005 Matthews et al.
`2/2006 Bailey et al.
`4/2009 Berry et al.
`5/2009 Chang ................. H04L 12/1827
`709/206
`
`11/2010 Shin et a1.
`ll/2011 Wassingbo ............ G06F 3/0488
`715/256
`
`9,426,102 B1
`9,860,198 B1
`9,971,500 B2
`9,996,248 B2
`2005/0198584 A1
`2006/0031361 A1
`2009/0094288 A1
`2009/0119371 A1 *
`
`2010/0299599 A1
`2011/0289406 A1 *
`
`2012/0198360 A1
`2014/0096033 A1
`2014/0143684 A1
`2014/0195621 A1 *
`
`8/2012 Wanderski et al.
`4/2014 Blair
`5/2014 Oh et a1.
`7/2014 Rao DV ............. H04L12/1827
`709/206
`6/2016 Shen ................. H04M l/72552
`715/753
`2016/0294742 A1 * 10/2016 Weaver ................. H04L 67/306
`2018/0159812 A1
`6/2018 Sarafa et a1.
`
`2016/0179773 A1*
`
`OTHER PUBLICATIONS
`
`Bustle.com [online], “How to Retweet With a Comment, aka Use
`the Life-Changing Feature Twitter Just Added,” Apr. 7, 2015,
`[retrieved on Dec. 11, 2019], retrieved from: URL<https://www.
`bustle.com/a1ticles/74648-h0w-t0-retweet-with-a-c0mment-aka-use-
`
`the-life-changing-feature-twitter-just-added>, 4 pages.
`Corban Tech [online], “Narwhal: The Best Reddit Client | Apps
`(App Walkthrough,” Dec. 16, 2016, [retrieved on Dec. 11, 2019],
`retrieved from: URL<https://www.y0utube.com/watch?v:
`78wgthlhKE>, 1 page (Video Submission).
`engadget.com [online], “WhatsApp can quote messages you want to
`respond to,” Jun. 2016, [retrieved on Dec. 11, 2019], retrieved from:
`URL<https://www.engadget.com/2016/06/12/whatsapp-qu0te-
`messages/>, 3 pages.
`HubSpot.com [online], “How to Retweet the Right Way (With a
`Comment) on Twitter,” Apr. 15, 2015, [retrieved on Dec. 11, 2019],
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 4 of 39 PageID #: 81
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 4 of 39 PageID #: 81
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 1 of 24
`
`US 10,728,192 132
`
` ................
`
`
`,»
`
`Figare i
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 5 of 39 PageID #: 82
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 5 of 39 PageID #: 82
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 2 of 24
`
`US 10,728,192 132
`
`
`
`
`
`0000000000000000000
`
`
`
`kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk,
`ukkubbkkkbbbkkkbbbkkkbbbkw.:Ebkkkbbbkkkbbbkkkbbbkkkbbbkkk
`
`
`
`,
`
`.
`
`-
`
`.‘; 5 .
`
`-
`
`..
`
`i:00000000000000000000000000000000000000000000
`
`0
`WWW
`
`
`
`Figure 2
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 6 of 39 PageID #: 83
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 6 of 39 PageID #: 83
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 3 0f 24
`
`US 10,728,192 B2
`
`
`
`Figure 3
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 7 of 39 PageID #: 84
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 7 of 39 PageID #: 84
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 4 of 24
`
`US 10,728,192 132
`
`4 i0
`
`W, m
`4‘40
`
`4%
`‘ 0
`
`449
`
`Receive “Seieetiee” of Area or 0bject
`Assecéated with First Ivlessage
`
`Provide lndieatien that 8021234311011 of
`.
`u
`v
`1
`V
`Area or Objee‘i has. been reeewed.
`
`b) “Link”
`
`Aliew Second Message 10 be Farmed
`with “Link” 10 First Message __ “Link”
`is Asseciated with Further M‘egsage
`Response te “Seieetien.
`
`Cause Dispiay of inferemtien Response
`
`to Seleetien ef Further Area or Object
`Asseeiated with a) First Message, and
`
`Figure 4
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 8 of 39 PageID #: 85
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 8 of 39 PageID #: 85
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 5 0f 24
`
`US 10,728,192 B2
`
`Dispiay Previous Ilteesages and Text
`
`5.10 “““““““““ Entry Bar (ready to create second
`
`megsage‘)
`
`Ciiek on Area 93' Battier} 0f FiYSt
`
`520
`
`Message to be Referenced by Second
`
`Meesege
`
`Insert Object irate Text £301??me
`
`indicating Intent to Reference Firs-t,
`
`Message
`
`Transmit
`
`Complete Second Message and
`
`560
`
`Dispiay First Meg-sage (or Portion of \
`First Message) when Display Obj eet
`
`associated with 86001141 Meesage is
`
`Selected
`
`Frigate 5
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 9 of 39 PageID #: 86
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 9 of 39 PageID #: 86
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 6 0f 24
`
`US 10,728,192 B2
`
`Second {Bier}: Device
`
`Megsage Server
`
`Network
`
`Firgt Ciiem Device
`
`
`
`Figure 6
`
`Engine
`
`Message
`
`Eng;fine
`
`Link.
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 10 of 39 PageID #: 87
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 10 of 39 PageID #: 87
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 7 0f 24
`
`US 10,728,192 B2
`
`Second Client
`Device
`
`Message
`Engine
`,
`.
`Lmk
`
`Netwerk
`
`140
`
`Engine
`
`
`Engine
`
`First Chem:
`Dex/Ice
`
`Megsage
`Engine
`Link
`
`Fagme 7
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 11 of 39 PageID #: 88
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 11 of 39 PageID #: 88
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 8 0f 24
`
`US 10,728,192 B2
`
`
`
` Figure8A
`
`$19;.)
`x5:
`:5,
`w9.!N(‘3
`
`3
`
`
`
`em
`
`wMWM19mm...n%
`
`97,30pm12S1UW
`
`ammmmm33;
`.«new‘
`
`no.2#BD2am
`
`g
`
`aPm
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 12 of 39 PageID #: 89
`S
`Q1m
`U.5
`C
`O
`9
`
`aU
`
`2P1oe«D.
`
`mm
`
`u
`
`0—e...........................................................................................
`.I!r
`
`
`
`
`1n..........”Mmawmmhwmmwwmfi“Ammmwmwwmflmwfi.............
`...................................................................................
`3t
`5
`
`my00.,.fihfixvfifimD«1,.
`‘,u
`AJ
`N
`fining
`U
`.‘.
`.....................
`4
`mm
`_
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 13 of 39 PageID #: 90
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 13 of 39 PageID #: 90
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 10 0f 24
`
`US 10,728,192 B2
`
`
`
`Figure8C
`
`
`"
`
`m:.’
`
`
`Mamflmh
`
`
`Maraiafwn
`
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 14 of 39 PageID #: 91
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 14 of 39 PageID #: 91
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 11 of 24
`
`US 10,728,192 132
`
`
`
`Figure83)
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 15 of 39 PageID #: 92
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 15 of 39 PageID #: 92
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 12 of 24
`
`US 10,728,192 132
`
`
`
`
`
`Figure59
`
`013220;;
`
`'E§‘2111112-1111
`:553‘51'34}:2!
`11.311111
`
`
`
`
`
`
`391$;211‘1-1;::2'1;‘:;
`
`
` Erikfimz
`:Ezzf.
`Martzfiohw
`
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 16 of 39 PageID #: 93
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 16 of 39 PageID #: 93
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 13 0f 24
`
`US 10,728,192 B2
`
`aic‘s-.
`
`
`
`hgm‘e10A‘“‘0
`
`"'31..
`
`x:W
`1:33
`1""
`98:3;
`9::13‘?”‘1!
`33?
`
`0:
`
`2
`~33
`:59
`%
`
` ,,
`am.ittam-A3
`
`133,4,
`
`
`5:39%weran-men, Ma-mfluehm:
`
`
`
`Ur:my;
`
`
`Eflikfifiz‘:
`
`52:
`'m
`w.
`
`0}
`
`flag-flair
`
`
`
`aD.
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 17 of 39 PageID #: 94
`l
`4
`4
`C
`O
`5
`d
`
`2Pl.ws.aU
`
`
`
`
`
`n.wt,mmafiwflwwfifimgmyaaummmag.«w.
`
`om
`
`mt
`
`mmw,mml._u
`
`.Ih
`mm...
`
`“55%y,
`
`
`
`rK.._$5z.
`
`##me
`
`.
`.
`TE5U.
`
`AJ
`
`N
`
`mfigufififi
`
`magma“.m
`wmxmwfiE;aim
`
`E:S
`mwxfiwummfi
`
`92#.B
`
`9l}a8P29-/930pm17S1Uw
`
`
`
`D2:gm“,awmiQMam
`
`11
`
`m4/2
`
`/
`
`O42fO0
`
`
`
`
`
`
`aD.
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 18 of 39 PageID #: 95
`1
`,m
`C
`5
`
`a9g19a8P29-/9301
`
`
`,,.
`
`gmEng.D2y
`
`#B
`
`ma.2
`
`mmw,omDl.uAJ
`
`mwn%
`
`m4/22fmom.5
`
`8S1Uw
`
`N
`
`U.
`
`finwfiwwwgfii
`
`a:n
`
`mmfifim‘
`m0
`e2
`
`dHHmwwmaufimfi
`2
`
`2P1.ws.aU
`
`
`
`Emw3m3£mwflammfibwwg
`
`3tmw
`
`mya
`,a
`4
`‘
`
`
`
`n...gamma,imammammwn331%am5
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 19 of 39 PageID #: 96
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 19 of 39 PageID #: 96
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 16 0f 24
`
`US 10,728,192 B2
`
`9235.81.44.21: 1.23:2" 1m.
`
`
`
`1'??? {11:3 {311%}
`
`
`
`
`J-‘ezfi’k’;
`
`
`
`' F
`
`ig’u.2*e 11A
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 20 of 39 PageID #: 97
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 20 of 39 PageID #: 97
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 17 of 24
`
`US 10,728,192 132
`
`01512000130020
`
`
`1,,
`52:3,
`5::
`
`
`
`L1,: 1, $143155 :5; fl:
`
`Mfiffii 13
`
`
`
`
`. «ms» acme use
`
`
`Figure H33
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 21 of 39 PageID #: 98
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 21 of 39 PageID #: 98
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 18 0f 24
`
`US 10,728,192 B2
`
`9?:6‘26 we
`
`
`
`Figure NC
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 22 of 39 PageID #: 99
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 22 of 39 PageID #: 99
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 19 0f 24
`
`US 10,728,192 B2
`
`
`
`“gem 1111
`
`
`
`
`
` 3t1nNAmmya2P1.w“aaU
`
`omDl.uAJ
`mmw2,
`
`mMfm01mdtbwH%
`
`e
`e
`aPO
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 23 of 39 PageID #: 100OO
`21m
`NU.
`C
`O
`:4u
`g
`
`g19mm97:30m13S2U
`
`A2#Bmn
`
`Nmakmmmm
`
`mflmwmvmhw
`
`
`
`WEE”mm5»rawé3%,3m.”5méYumwd
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 24 of 39 PageID #: 101
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 24 of 39 PageID #: 101
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 21 of 24
`
`US 10,728,192 132
`
`
`
`
`
`'Wfififlfifiififiy31559211212505?133$?
`
`
`
`
`it"?!32.55315:155’'fl.
`
`
`
`
`Macaw-sis
`
`
`
`
`Figm‘g13A
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 25 of 39 PageID #: 102
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 25 of 39 PageID #: 102
`
`U.S. Patent
`
`2l._
`
`0202
`
`hS
`
`42f02
`
`US 10,728,192 B2
`
`u.,(JMmamJaw
`
`
`
`00.,..EHEEGMEEE
`
`
`
`EwmmEggmEHEEEEEEE,
`
`team.3%wwm
`£3mEEm
`
`fimfimfi
`
`Ewanmmu
`
`
`
`”U.:rEm?Exit3WEEKmay“.m5,w.w.Hufimawgwfi
`
`ENSfimwmm
`
`
`
`.ENEEE.EEm?mm95%.DEVEEENEmmfivEEu3mmmW
`
`
`
`
`
`
`
`G
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 26 of 39 PageID #: 103
`2lm
`NU.
`O2
`C
`0
`3O
`g
`
`
`
` 10ws.aU
`
`1n0.eVt
`
`mmw2,mm
`
`4m2fm01BdtbwHow
`
`97:30m16S2U
`
`A2#BD2a9
`
`g1.,mmmE;EWW
`
`
`Pmm?£93Emfi$3.3gums”5w2.3%?Sm9.fig
`
`
`:4uimamaimwm.mmefiEcm3t.fififim
`M...3E33%m,“mmmamwmmmmwgmatwuammflwmwa.mamEmAJ933%qu
`
`
`
`
`
`
`mum.........................................................................................................................fiwmmmum"mafia»:mmfifimuwflgg.........................................................................................................................
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 27 of 39 PageID #: 104
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 27 of 39 PageID #: 104
`
`U.S. Patent
`
`HJ
`
`02028.,
`
`42teehS
`
`US 10,728,192 B2
`
`2..
`
`_I._mwxmuuhfi
`
`
`
`
`
`4..........................................................................................................................................................................................................................................................................2.V.a.MmmEEmma:Ewe,mcacm..,~§§5%w,fiuEmamaE;m.WEEm$5.
`
`e2egg
`
`
`
`
`
`gm,“EwmwmwWamfimwmmwflfi
`
`
`
`.caommew.mewsame“a:a:3
`
`..Ewanfiu..
`
`
`
`
`
`Gufihfimwmhwm“5%mam,wmwmmmrcmg“www.cmhmww‘Mu“Em.“mew
`
`
`
`
`
`
`
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 28 of 39 PageID #: 105
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 28 of 39 PageID #: 105
`
`US 10,728,192 B2
`
`1
`APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`This application is a continuation of US. Ser. No. 16/376,
`427, filed Apr. 5, 2019, which is a continuation-in-part of 5
`US. Ser. No. 16/014,578, filed Jun. 21, 2018, which is a
`continuation-in-part of US. Ser. No. 15/858,696, filed Dec.
`29, 2017, now as US. Pat. No. 10,025,475, issued Jul. 7,
`2018, which is a continuation-in-part of Ser. No. 15/431,
`077, filed Feb. 13, 2017, now as US. Pat. No. 9,860,198,
`issued Jan. 2, 2018.
`US. Ser. No. 15/431,077, filed Feb. 13, 2017 claims the
`benefit of US. Provisional application No. 62/446,067, filed
`Jan. 13, 2017.
`
`15
`
`10
`
`FIELD OF THE INVENTION
`
`The present invention relates to computer messaging and
`more particularly to management thereof. In particular, an 20
`apparatus and method are disclosed for improving computer
`operational efficiency through message linkage manage-
`ment.
`
`BACKGROUND OF THE INVENTION
`
`25
`
`including messaging, pro-
`Electronic communication,
`vides a very efficient manner of information exchange. In
`such forms of electronic communication, messages are
`exchanged between multiple parties in order to convey 30
`information. In one known form of messaging, two users
`operate respective client devices and effectively engage in
`conversation by transmitting messages between each other.
`Such communication may be in the form of a single con-
`tinuous stream of back and forth messaging. Also, in some 35
`situations, more than two users (operating, for example,
`more than two respective client devices) may be communi-
`cating in a single continuous stream. While a single stream
`of messages may be transmitted in an ongoing sequence, it
`is also possible to have multiple channels, each with their 40
`own respective stream of messages.
`A “conversation” of messages may be short or it may
`occur over an extended period of time. Such a period of time
`can last for hours, days, or even years. During the process of
`such a conversation, a large quantity of messages may be 45
`transmitted between multiple users. Typically, in order to
`reference an earlier message within a stream of messages, it
`may be desirable to scroll or somehow visually traverse
`through messages until an earlier message is located.
`
`50
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`55
`
`FIG. 1 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with an exemplary embodiment of the present invention.
`FIG. 2 is a block diagram that illustrates details of an
`exemplary client device in accordance with an exemplary
`embodiment of the present invention.
`FIG. 3 illustrates an exemplary interface portal of a client
`device in accordance with an exemplary embodiment of the 60
`present invention.
`FIG. 4 is a flowchart diagram that illustrates exemplary
`message referencing in accordance with an exemplary
`embodiment of the present invention.
`FIG. 5 is a flowchart diagram that illustrates exemplary 65
`message referencing in accordance with a further exemplary
`embodiment of the present invention.
`
`2
`
`FIG. 6 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with a further exemplary embodiment of the present inven-
`tion.
`
`FIG. 7 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with yet another exemplary embodiment of the present
`invention.
`
`FIGS. 8A-8D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIG. 9 is an exemplary screen shot that illustrates exem-
`plary operation of an exemplary embodiment of the present
`invention.
`
`FIGS. 10A-10C are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 11A-11D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`illustrates
`that
`FIG. 12 is an exemplary screen shot
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 13A-13D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`A method for referencing a message comprises the steps
`of receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`
`DETAILED DESCRIPTION
`
`The present invention relates to messaging and in par-
`ticular to the ability of one message to reference another
`message. With regard to messaging, what is referred to is the
`ability for one or more users to provide a series of messages.
`Messages typically occur in a stream, wherein each message
`comprises data. The data included in messages is often text,
`but this is merely exemplary as messages can include other
`content,
`including possibly any kind of data (e.g. audio,
`video, animation, graphics, web links, photos, etc.).
`In one or more exemplary embodiments of the present
`invention, a method and apparatus improves the operation of
`a computer device, by providing links that enable a com-
`puter device to operate with greater efficiency. In particular,
`in several exemplary embodiments, when one message
`references another message, and time has elapsed between
`the two messages, the invention enables a computer device
`to operate with advantages over the prior art. For example,
`in the prior art, to enable one message to reference an earlier
`message, a search for the earlier message can be inefficient,
`time consuming, can delay message response while an
`earlier message is located, and can request that data stored
`in memory be duplicated. By contrast, in accordance with
`exemplary embodiments of the present invention, the use of
`visual display of an earlier message (or portions thereof) and
`selection (in various manners to be described below),
`enables message referencing in a manner that enables faster
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 29 of 39 PageID #: 106
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 29 of 39 PageID #: 106
`
`US 10,728,192 B2
`
`3
`computer processing and more efficient use of computer
`devices for exemplary forms of communication such as
`messaging.
`Messaging (such as chat messaging) has become a very
`popular form of electronic communication due to its afford-
`ability and ease of use. On any given day, users may
`exchange numerous messages regarding a diverse range of
`topics. The users may use the messages to discuss, for
`example, group activities, to solicit opinions about various
`topics, or simply exchange short conversations with friends
`or co-workers. One of the drawbacks to using typical chat
`messaging systems is the sequential nature of the messages
`sent and received. For example, messages often appear in a
`channel or log in chronological order. If a user in a group
`chat session comes back from a meeting after several hours,
`they may be confronted with a bunch of messages. In this
`regard, the group chat sessions are often characterized by
`short bursts of dialog around a given topic. By the time a
`user views the messages,
`the topic may have changed
`several times. This makes it difficult for a user to post a
`response to a previous message that is within context of the
`ongoing message conversation.
`Methods and systems for providing references (such as
`context-based references) to link messages (such as chat
`messages) are disclosed herein. This allows a user to gen-
`erate and insert a (reference) object into a (chat) message
`stream that links or otherwise references a chat message
`(such as a prior message or later message) the user intended
`to send. It is contemplated that the techniques disclosed
`herein may be particularly beneficial
`in certain types of
`communication platforms. However, so as to illustrate the
`method and system functionality, and not by way of limi-
`tation, the communication platform described herein is an
`exemplary chat messaging platform. It is envisioned that one
`skilled in the art could make and use the methods and
`
`systems described herein with other types of communication
`platforms. Some of these communication platforms may
`include, for example, text messaging, short message services
`(SMS), e-mails and other types of similar on-line commu-
`nication platforms for facilitating electronic information
`exchanges between client devices of a plurality of users. The
`use of chat messaging described herein is merely exemplary,
`as other forms of messaging may also be used in accordance
`with exemplary embodiments of the present invention.
`With respect to chat messaging platforms, a message (for
`example in a chat message session) that a user wishes to
`respond to or reference occurred as a standalone comment or
`as part of a previous and unrelated (to a most recent
`discussion chain) discussion. A chat message session, as
`used herein, refers to a series of messages that are exchanged
`between one or more users, wherein for more than one user
`the users are in a group of users. When one of the users in
`the group adds a new message to a chat message session, the
`new message is sent
`to other users in the group. For
`example, if a first user adds a new message to the chat
`message session between three users in a group, then the
`new message may be sent to other selected users of the
`group, such as the second user and/or the third user. Thus,
`the chat message session may simulate a real-life conver-
`sation because users may communicate to the group at large,
`or to a specific person or a subset of the people in the group.
`In some situations, a user may want add a new message
`that is related to a previous message in the chat message
`session. When replying to the previous message at
`the
`current point in time in the session, the reply message may
`appear out of context and could be confusing to other users
`in the session. This is because the chat message sessions
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`often include numerous messages that may have been
`entered over a short period of time. Some group messaging
`users employ various strategies to minimize the effect of
`their writing messages when trying to refer to or reply to a
`previous message in the session. In one example, a user may
`copy and paste the prior message into the text message entry
`bar and then add additional text. In another example, the user
`may include addition information in the new message to
`make it clear what is being responded to. In yet another
`example, the user may specify the message being referenced
`by identifying and referencing something unique about the
`message such as who sent it, the date and/or the time it was
`sent. One problem with using these types of techniques is
`that extra text entry space may not be available in a chat
`message system that limits the amount of data that can be
`entered into a given message. Moreover, the user may miss
`some important information if they cut and paste only a
`portion of the previous message or the identifying informa-
`tion regarding the previous message may not be complete or
`accurate.
`
`To put it another way, a first message (“message”) may be
`one of several messages. A second message (“further mes-
`sage”) may also be one of the several messages. It may be
`desirable for the second message to reference the first
`message. By “reference” what is meant is that there is a
`connection between the second message and the first mes-
`sage. The connection may be for example a link. With such
`a link, while the second message is being viewed, some
`aspect of the first message may also be viewed. The aspect
`of the first message may be, for example, all of the first
`message, part of the first message, a modified form of all or
`part of the first message, and/or data associated with the first
`message. Exemplary associated data may include a user (or
`some form of identification of the user) associated with the
`first message, a date and/or time associated with the first
`message, Gucci and/or some other data associated with the
`first message.
`In one exemplary embodiment of the present invention, a
`“reference object” is inserted into a text entry box that is
`being used to form a second message so that (after the
`second message is transmitted) a “display object” can be
`displayed (with the second message) that references the first
`message. In one embodiment of the present invention the
`reference and display object are the same while in another
`embodiment of the present
`invention the reference and
`display object are different. The reference object, or the
`display object, or both, references the first message as more
`clearly described below.
`Chat messages (as an example of messages) are thus
`beneficially enhanced to provide users with additional infor-
`mation related to the meaning of their electronic conversa-
`tions without introducing expensive overhead or burden-
`some retrieval mechanisms. For example, a user may make
`a selection associated with a first message which then
`automatically inserts a reference object into a text entry bar
`of a chat message system. The reference object may provide
`a link to automatically identify and access data from the first
`message. The user may then add additional text in the text
`message box before or after the reference object. When the
`message is sent, a display object associated with the first
`message is included in the newly posted second message. If
`multiple messages are referenced then one or more of the
`display objects are displayed in the newly posted message.
`It is also possible for the same message to be referenced
`multiple times by different new messages at any time in the
`chat message session. In addition, computer processing
`efficiency is improved through the use of links and without
`
`
`
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 30 of 39 PageID #: 107
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 30 of 39 PageID #: 107
`
`US 10,728,192 B2
`
`5
`simply duplicating previously inputted data. Efficiency is
`also improved by enabling access to at least a portion of
`previously available data without a need to manually locate
`the previously available data.
`Each display object can then be activated in the chat
`session in several ways. For example, by hovering over
`and/or selecting the display object, text data (or other data or
`portions thereof) associated with the referenced first mes-
`sage may be displayed (e.g., above, to the side of, below)
`with respect to the newly posted message. The information
`thus provides the reader with immediate and useful context
`relating to the message they are reading by allowing them to
`see the message that is referenced. In some implementations,
`other visual or audio mechanisms can be added to highlight
`the display object. For example,
`the display object may
`displayed in a different text color, font size, or a change to
`a portion or all of the background of the referred message or
`include various type of animation effects.
`While the above description is with regard to first and
`second messages, it is understood that “first” and “second”
`(or “message” and “further message”) are merely being used
`to identify two messages that have been separately entered
`into a computer system (and then, for example, sent). In one
`embodiment of the present invention, the first message is
`sent before the second message, although this merely exem-
`plary (i.e. the order may be reversed).
`In one implementation, a computer program product may
`be installed and/or a service may be selected from a clo