throbber
Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 1 of 39 PageID #: 78
`
`Exhibit B
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 2 of 39 PageID #: 79
`case 120200134500 Docurner“1'1lllllillllMlllfllllfilllilllllillllllllllll’flllllllflllllfillllllfllll9
`
`USOlO728 192B2
`
`(12) United States Patent
`US 10,728,192 B2
`(10) Patent N0.:
`
` Cohen et al. (45) Date of Patent: *Jul. 28, 2020
`
`
`(54) APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`(71) Applicant: Wrinkl, Inc., Sands Point, NY (US)
`
`(72)
`
`Inventors: Marc A. Cohen, Blue Bell, PA (US);
`Erik S. Katz, Sands Point, NY (US)
`
`(73) Assignee: Wrinkl, Inc., Sands Point, NY (US)
`
`(52) US. Cl.
`CPC ............ H04L 51/046 (2013.01); H04L 51/12
`(2013.01); H04L 51/16 (2013.01); H04L 51/18
`(2013.01); H04L 51/36 (2013.01); H04L
`65/1069 (2013.01); H04L 65/1093 (2013.01);
`H04L 65/4015 (2013.01)
`(58) Field of Classification Search
`CPC ........ H04L 51/046; H04L 51/12; H04L 51/16
`See application file for complete search history.
`
`( * ) Notice:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(1)) by 0 days.
`
`This patent is subject to a terminal dis-
`claimer.
`
`(56)
`
`References Cited
`
`US. PATENT DOCUMENTS
`
`9/2014 Chen et al.
`8,832,569 B2
`9,218,603 B2 * 12/2015 Kumar ................... G06Q 10/10
`9,262,455 B2
`2/2016 Palay
`
`(21) Appl. N0.: 16/712,952
`
`(22)
`
`Filed:
`
`Dec. 12, 2019
`
`(65)
`
`Prior Publication Data
`
`US 2020/0120051 A1
`
`APL 16: 2020
`
`(Continued)
`
`OTHER PUBLICATIONS
`
`b10g.standup1y.com [online], “Top 50 Features of Slack to Boost
`Your Productivity,” Sep. 2016, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://b10g.standuply.com/50-additi0na1-features-0f—
`slack-t0-b00st-y0ur-pr0ductivity-959cc56f7893>, 5 pages.
`
`Related US. Application Data
`
`(Continued)
`
`(63) Continuation of application No. 16/376,427, filed on
`APF- 5, 2019, HOW Pat. NO- 10,547,575, WhiCh is a
`continuation-in-part of application No. 16/014,578,
`filed on Jun. 21, 2018, which is a continuation-in-part
`ofappllcat1on NO: 15/8585696’ filed on Dec. 29520175
`now.
`Pat.
`. No:
`1050253475, Wthh
`1s
`a
`contmuatlon-m-part 0f appl1catlon NO- 15/431977:
`filed on Feb. 13, 2017, HOW Pat. NO- 9:860:198-
`
`(60) Provisional application No. 62/446,067, filed on Jan.
`13, 2017.
`
`(51)
`
`Int. Cl.
`H04L 12/58
`H04L 29/06
`
`(2006.01)
`(2006.01)
`
`Primary Examiner 7 David E Choi
`(74) Attorney, Agent, or Firm iFish & Richardson P.C.
`
`(57)
`ABSTRACT
`A method for referencing a message comprises the steps of
`receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`
`30 Claims, 24 Drawing Sheets
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 3 of 39 PageID #: 80
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 3 of 39 PageID #: 80
`
`US 10,728,192 B2
`
`Page 2
`
`(56)
`
`References Cited
`U.S. PATENT DOCUMENTS
`
`retrieved from: URL<https://b10g.hubsp0t.com/blog/tabid/6307/bid/
`27675/h0w-t0-retweet-the-right-way-in-4-easy-steps.aspx>, 16 pages.
`Mashable.com [online], “Twitter Updates TweetDeck, Allows Users
`to Edit and Retwee ,” Mar. 22, 2012, [retrieved on Dec. 11, 2019],
`retrieved from: URL<https://mashable.com/2012/03/22/tweetdeck-
`rt-updates/>, 3 pages.
`0ut100k.userv0ice.com [online], “Outlook for Android: Swipe Options,
`swipe left for reply, swipe right for forward. please add these
`options,” Sep. 30, 2015, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://0ut100k.userv0ice.com/forums/293346-0utlook-
`for-android/suggestions/99923 19 -swipe-0pti0ns-swipe-lefi-f0r-reply-
`swipe-right-f>, 5 pages.
`Plexus Worldwide [online], “How to Use the New Retweet Function
`on Twitter | Social Media Solutions,” Apr. 7, 2015, [retrieved on
`Dec. 11, 2019], retrieved from: URL<https://www.y0utube.com/
`watch?v:h9mAP8vwiQ>, 1 page. (Video Submission).
`slack.com [online], “Using Slack ,” 2019, [retrieved on Dec. 11,
`2019],
`retrieved from: URL<https://slack.com/help/articles/
`203274767>, 5 pages.
`slackhq.com [online], “Sharing messages in Slack ,” May 2016,
`[retrieved on Dec. 11, 2019], retrieved from: URL<https://slackhq.
`com/sharing-messages-in-slack>, 5 pages.
`T5 by Robin Good [online], “Free open-source distributed alterna-
`tive to Twitter: Mastodon,” Oct. 10, 2016 [retrieved on Dec. 11,
`2019],
`retrieved from: URL<t001s.robingood.com/site/contents/
`content/765621/2016-l0-06/free-0pen-s0urce-djstributed-alternative-
`t0-twitter-mast0d0n>, 2 pages (Video Submission).
`Tech & Design [online], “How to Retweet anything iPhone iPad
`iPod Mac,” Jul. 18, 2015, [retrieved on Dec. 11, 2019], retrieved
`from: URL<https://www.y0utube.com/watch?v:6D7MkQOOZjY>,
`1 page (Video Submission).
`express.co.uk [online], “WhatsApp quietly introduced a brand-new
`way to reply to your messages,” Jun. 13, 2016, [retrieved on Dec.
`16, 2019] retrieved from: URL<https://www.express.co.uldlife-style/
`science-technology/679325/WhatsApp-H0w-T0-Qu0te-Message-In-
`Reply-iOS-Android-Chat>, 4 page.
`PCT International Search Report and Written Opinion in Interna-
`tional Appln. N0. PCT/US2018/l3462, dated Jan. 12, 2018, 7 pages.
`slack.com [online], “Share messages in Slack: From channels to
`searchilearn how Slack works from top to bottoml,” [retrieved on
`Dec. 16, 2019] retrieved from: URL<https://slack.com/help/articles/
`203274767-Share-messages-in-Slack>, 1 page.
`
`* cited by examiner
`
`8/2016 Wong et a1.
`1/2018 Cohen
`5/2018 Yang et a1.
`6/2018 Park et a1.
`9/2005 Matthews et al.
`2/2006 Bailey et al.
`4/2009 Berry et al.
`5/2009 Chang ................. H04L 12/1827
`709/206
`
`11/2010 Shin et a1.
`ll/2011 Wassingbo ............ G06F 3/0488
`715/256
`
`9,426,102 B1
`9,860,198 B1
`9,971,500 B2
`9,996,248 B2
`2005/0198584 A1
`2006/0031361 A1
`2009/0094288 A1
`2009/0119371 A1 *
`
`2010/0299599 A1
`2011/0289406 A1 *
`
`2012/0198360 A1
`2014/0096033 A1
`2014/0143684 A1
`2014/0195621 A1 *
`
`8/2012 Wanderski et al.
`4/2014 Blair
`5/2014 Oh et a1.
`7/2014 Rao DV ............. H04L12/1827
`709/206
`6/2016 Shen ................. H04M l/72552
`715/753
`2016/0294742 A1 * 10/2016 Weaver ................. H04L 67/306
`2018/0159812 A1
`6/2018 Sarafa et a1.
`
`2016/0179773 A1*
`
`OTHER PUBLICATIONS
`
`Bustle.com [online], “How to Retweet With a Comment, aka Use
`the Life-Changing Feature Twitter Just Added,” Apr. 7, 2015,
`[retrieved on Dec. 11, 2019], retrieved from: URL<https://www.
`bustle.com/a1ticles/74648-h0w-t0-retweet-with-a-c0mment-aka-use-
`
`the-life-changing-feature-twitter-just-added>, 4 pages.
`Corban Tech [online], “Narwhal: The Best Reddit Client | Apps
`(App Walkthrough,” Dec. 16, 2016, [retrieved on Dec. 11, 2019],
`retrieved from: URL<https://www.y0utube.com/watch?v:
`78wgthlhKE>, 1 page (Video Submission).
`engadget.com [online], “WhatsApp can quote messages you want to
`respond to,” Jun. 2016, [retrieved on Dec. 11, 2019], retrieved from:
`URL<https://www.engadget.com/2016/06/12/whatsapp-qu0te-
`messages/>, 3 pages.
`HubSpot.com [online], “How to Retweet the Right Way (With a
`Comment) on Twitter,” Apr. 15, 2015, [retrieved on Dec. 11, 2019],
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 4 of 39 PageID #: 81
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 4 of 39 PageID #: 81
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 1 of 24
`
`US 10,728,192 132
`
` ................
`
`
`,»
`
`Figare i
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 5 of 39 PageID #: 82
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 5 of 39 PageID #: 82
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 2 of 24
`
`US 10,728,192 132
`
`
`
`
`
`0000000000000000000
`
`
`
`kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk,
`ukkubbkkkbbbkkkbbbkkkbbbkw.:Ebkkkbbbkkkbbbkkkbbbkkkbbbkkk
`
`
`
`,
`
`.
`
`-
`
`.‘; 5 .
`
`-
`
`..
`
`i:00000000000000000000000000000000000000000000
`
`0
`WWW
`
`
`
`Figure 2
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 6 of 39 PageID #: 83
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 6 of 39 PageID #: 83
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 3 0f 24
`
`US 10,728,192 B2
`
`
`
`Figure 3
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 7 of 39 PageID #: 84
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 7 of 39 PageID #: 84
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 4 of 24
`
`US 10,728,192 132
`
`4 i0
`
`W, m
`4‘40
`
`4%
`‘ 0
`
`449
`
`Receive “Seieetiee” of Area or 0bject
`Assecéated with First Ivlessage
`
`Provide lndieatien that 8021234311011 of
`.
`u
`v
`1
`V
`Area or Objee‘i has. been reeewed.
`
`b) “Link”
`
`Aliew Second Message 10 be Farmed
`with “Link” 10 First Message __ “Link”
`is Asseciated with Further M‘egsage
`Response te “Seieetien.
`
`Cause Dispiay of inferemtien Response
`
`to Seleetien ef Further Area or Object
`Asseeiated with a) First Message, and
`
`Figure 4
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 8 of 39 PageID #: 85
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 8 of 39 PageID #: 85
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 5 0f 24
`
`US 10,728,192 B2
`
`Dispiay Previous Ilteesages and Text
`
`5.10 “““““““““ Entry Bar (ready to create second
`
`megsage‘)
`
`Ciiek on Area 93' Battier} 0f FiYSt
`
`520
`
`Message to be Referenced by Second
`
`Meesege
`
`Insert Object irate Text £301??me
`
`indicating Intent to Reference Firs-t,
`
`Message
`
`Transmit
`
`Complete Second Message and
`
`560
`
`Dispiay First Meg-sage (or Portion of \
`First Message) when Display Obj eet
`
`associated with 86001141 Meesage is
`
`Selected
`
`Frigate 5
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 9 of 39 PageID #: 86
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 9 of 39 PageID #: 86
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 6 0f 24
`
`US 10,728,192 B2
`
`Second {Bier}: Device
`
`Megsage Server
`
`Network
`
`Firgt Ciiem Device
`
`
`
`Figure 6
`
`Engine
`
`Message
`
`Eng;fine
`
`Link.
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 10 of 39 PageID #: 87
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 10 of 39 PageID #: 87
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 7 0f 24
`
`US 10,728,192 B2
`
`Second Client
`Device
`
`Message
`Engine
`,
`.
`Lmk
`
`Netwerk
`
`140
`
`Engine
`
`
`Engine
`
`First Chem:
`Dex/Ice
`
`Megsage
`Engine
`Link
`
`Fagme 7
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 11 of 39 PageID #: 88
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 11 of 39 PageID #: 88
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 8 0f 24
`
`US 10,728,192 B2
`
`
`
` Figure8A
`
`$19;.)
`x5:
`:5,
`w9.!N(‘3
`
`3
`
`

`

`em
`
`wMWM19mm...n%
`
`97,30pm12S1UW
`
`ammmmm33;
`.«new‘
`
`no.2#BD2am
`
`g
`
`aPm
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 12 of 39 PageID #: 89
`S
`Q1m
`U.5
`C
`O
`9
`
`aU
`
`2P1oe«D.
`
`mm
`
`u
`
`0—e...........................................................................................
`.I!r
`
`
`
`
`1n..........”Mmawmmhwmmwwmfi“Ammmwmwwmflmwfi.............
`...................................................................................
`3t
`5
`
`my00.,.fihfixvfifimD«1,.
`‘,u
`AJ
`N
`fining
`U
`.‘.
`.....................
`4
`mm
`_
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 13 of 39 PageID #: 90
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 13 of 39 PageID #: 90
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 10 0f 24
`
`US 10,728,192 B2
`
`
`
`Figure8C
`
`
`"
`
`m:.’
`
`
`Mamflmh
`
`
`Maraiafwn
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 14 of 39 PageID #: 91
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 14 of 39 PageID #: 91
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 11 of 24
`
`US 10,728,192 132
`
`
`
`Figure83)
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 15 of 39 PageID #: 92
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 15 of 39 PageID #: 92
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 12 of 24
`
`US 10,728,192 132
`
`
`
`
`
`Figure59
`
`013220;;
`
`'E§‘2111112-1111
`:553‘51'34}:2!
`11.311111
`
`
`
`
`
`
`391$;211‘1-1;::2'1;‘:;
`
`
` Erikfimz
`:Ezzf.
`Martzfiohw
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 16 of 39 PageID #: 93
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 16 of 39 PageID #: 93
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 13 0f 24
`
`US 10,728,192 B2
`
`aic‘s-.
`
`
`
`hgm‘e10A‘“‘0
`
`"'31..
`
`x:W
`1:33
`1""
`98:3;
`9::13‘?”‘1!
`33?
`
`0:
`
`2
`~33
`:59
`%
`
` ,,
`am.ittam-A3
`
`133,4,
`
`
`5:39%weran-men, Ma-mfluehm:
`
`
`
`Ur:my;
`
`
`Eflikfifiz‘:
`
`52:
`'m
`w.
`
`0}
`
`flag-flair
`
`

`

`aD.
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 17 of 39 PageID #: 94
`l
`4
`4
`C
`O
`5
`d
`
`2Pl.ws.aU
`
`
`
`
`
`n.wt,mmafiwflwwfifimgmyaaummmag.«w.
`
`om
`
`mt
`
`mmw,mml._u
`
`.Ih
`mm...
`
`“55%y,
`
`
`
`rK.._$5z.
`
`##me
`
`.
`.
`TE5U.
`
`AJ
`
`N
`
`mfigufififi
`
`magma“.m
`wmxmwfiE;aim
`
`E:S
`mwxfiwummfi
`
`92#.B
`
`9l}a8P29-/930pm17S1Uw
`
`
`
`D2:gm“,awmiQMam
`
`11
`
`m4/2
`
`/
`
`O42fO0
`
`
`
`
`

`

`aD.
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 18 of 39 PageID #: 95
`1
`,m
`C
`5
`
`a9g19a8P29-/9301
`
`
`,,.
`
`gmEng.D2y
`
`#B
`
`ma.2
`
`mmw,omDl.uAJ
`
`mwn%
`
`m4/22fmom.5
`
`8S1Uw
`
`N
`
`U.
`
`finwfiwwwgfii
`
`a:n
`
`mmfifim‘
`m0
`e2
`
`dHHmwwmaufimfi
`2
`
`2P1.ws.aU
`
`
`
`Emw3m3£mwflammfibwwg
`
`3tmw
`
`mya
`,a
`4
`‘
`
`
`
`n...gamma,imammammwn331%am5
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 19 of 39 PageID #: 96
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 19 of 39 PageID #: 96
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 16 0f 24
`
`US 10,728,192 B2
`
`9235.81.44.21: 1.23:2" 1m.
`
`
`
`1'??? {11:3 {311%}
`
`
`
`
`J-‘ezfi’k’;
`
`
`
`' F
`
`ig’u.2*e 11A
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 20 of 39 PageID #: 97
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 20 of 39 PageID #: 97
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 17 of 24
`
`US 10,728,192 132
`
`01512000130020
`
`
`1,,
`52:3,
`5::
`
`
`
`L1,: 1, $143155 :5; fl:
`
`Mfiffii 13
`
`
`
`
`. «ms» acme use
`
`
`Figure H33
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 21 of 39 PageID #: 98
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 21 of 39 PageID #: 98
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 18 0f 24
`
`US 10,728,192 B2
`
`9?:6‘26 we
`
`
`
`Figure NC
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 22 of 39 PageID #: 99
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 22 of 39 PageID #: 99
`
`U.S. Patent
`
`Jul. 28, 2020
`
`Sheet 19 0f 24
`
`US 10,728,192 B2
`
`
`
`“gem 1111
`
`

`

`
`
` 3t1nNAmmya2P1.w“aaU
`
`omDl.uAJ
`mmw2,
`
`mMfm01mdtbwH%
`
`e
`e
`aPO
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 23 of 39 PageID #: 100OO
`21m
`NU.
`C
`O
`:4u
`g
`
`g19mm97:30m13S2U
`
`A2#Bmn
`
`Nmakmmmm
`
`mflmwmvmhw
`
`
`
`WEE”mm5»rawé3%,3m.”5méYumwd
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 24 of 39 PageID #: 101
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 24 of 39 PageID #: 101
`
`U.S. Patent
`
`Jul. 28,2020
`
`Sheet 21 of 24
`
`US 10,728,192 132
`
`
`
`
`
`'Wfififlfifiififiy31559211212505?133$?
`
`
`
`
`it"?!32.55315:155’'fl.
`
`
`
`
`Macaw-sis
`
`
`
`
`Figm‘g13A
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 25 of 39 PageID #: 102
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 25 of 39 PageID #: 102
`
`U.S. Patent
`
`2l._
`
`0202
`
`hS
`
`42f02
`
`US 10,728,192 B2
`
`u.,(JMmamJaw
`
`
`
`00.,..EHEEGMEEE
`
`
`
`EwmmEggmEHEEEEEEE,
`
`team.3%wwm
`£3mEEm
`
`fimfimfi
`
`Ewanmmu
`
`
`
`”U.:rEm?Exit3WEEKmay“.m5,w.w.Hufimawgwfi
`
`ENSfimwmm
`
`
`
`.ENEEE.EEm?mm95%.DEVEEENEmmfivEEu3mmmW
`
`
`
`
`
`

`

`G
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 26 of 39 PageID #: 103
`2lm
`NU.
`O2
`C
`0
`3O
`g
`
`
`
` 10ws.aU
`
`1n0.eVt
`
`mmw2,mm
`
`4m2fm01BdtbwHow
`
`97:30m16S2U
`
`A2#BD2a9
`
`g1.,mmmE;EWW
`
`
`Pmm?£93Emfi$3.3gums”5w2.3%?Sm9.fig
`
`
`:4uimamaimwm.mmefiEcm3t.fififim
`M...3E33%m,“mmmamwmmmmwgmatwuammflwmwa.mamEmAJ933%qu
`
`
`
`
`
`
`mum.........................................................................................................................fiwmmmum"mafia»:mmfifimuwflgg.........................................................................................................................
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 27 of 39 PageID #: 104
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 27 of 39 PageID #: 104
`
`U.S. Patent
`
`HJ
`
`02028.,
`
`42teehS
`
`US 10,728,192 B2
`
`2..
`
`_I._mwxmuuhfi
`
`
`
`
`
`4..........................................................................................................................................................................................................................................................................2.V.a.MmmEEmma:Ewe,mcacm..,~§§5%w,fiuEmamaE;m.WEEm$5.
`
`e2egg
`
`
`
`
`
`gm,“EwmwmwWamfimwmmwflfi
`
`
`
`.caommew.mewsame“a:a:3
`
`..Ewanfiu..
`
`
`
`
`
`Gufihfimwmhwm“5%mam,wmwmmmrcmg“www.cmhmww‘Mu“Em.“mew
`
`
`
`
`
`
`
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 28 of 39 PageID #: 105
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 28 of 39 PageID #: 105
`
`US 10,728,192 B2
`
`1
`APPARATUS AND METHOD FOR MESSAGE
`REFERENCE MANAGEMENT
`
`This application is a continuation of US. Ser. No. 16/376,
`427, filed Apr. 5, 2019, which is a continuation-in-part of 5
`US. Ser. No. 16/014,578, filed Jun. 21, 2018, which is a
`continuation-in-part of US. Ser. No. 15/858,696, filed Dec.
`29, 2017, now as US. Pat. No. 10,025,475, issued Jul. 7,
`2018, which is a continuation-in-part of Ser. No. 15/431,
`077, filed Feb. 13, 2017, now as US. Pat. No. 9,860,198,
`issued Jan. 2, 2018.
`US. Ser. No. 15/431,077, filed Feb. 13, 2017 claims the
`benefit of US. Provisional application No. 62/446,067, filed
`Jan. 13, 2017.
`
`15
`
`10
`
`FIELD OF THE INVENTION
`
`The present invention relates to computer messaging and
`more particularly to management thereof. In particular, an 20
`apparatus and method are disclosed for improving computer
`operational efficiency through message linkage manage-
`ment.
`
`BACKGROUND OF THE INVENTION
`
`25
`
`including messaging, pro-
`Electronic communication,
`vides a very efficient manner of information exchange. In
`such forms of electronic communication, messages are
`exchanged between multiple parties in order to convey 30
`information. In one known form of messaging, two users
`operate respective client devices and effectively engage in
`conversation by transmitting messages between each other.
`Such communication may be in the form of a single con-
`tinuous stream of back and forth messaging. Also, in some 35
`situations, more than two users (operating, for example,
`more than two respective client devices) may be communi-
`cating in a single continuous stream. While a single stream
`of messages may be transmitted in an ongoing sequence, it
`is also possible to have multiple channels, each with their 40
`own respective stream of messages.
`A “conversation” of messages may be short or it may
`occur over an extended period of time. Such a period of time
`can last for hours, days, or even years. During the process of
`such a conversation, a large quantity of messages may be 45
`transmitted between multiple users. Typically, in order to
`reference an earlier message within a stream of messages, it
`may be desirable to scroll or somehow visually traverse
`through messages until an earlier message is located.
`
`50
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`55
`
`FIG. 1 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with an exemplary embodiment of the present invention.
`FIG. 2 is a block diagram that illustrates details of an
`exemplary client device in accordance with an exemplary
`embodiment of the present invention.
`FIG. 3 illustrates an exemplary interface portal of a client
`device in accordance with an exemplary embodiment of the 60
`present invention.
`FIG. 4 is a flowchart diagram that illustrates exemplary
`message referencing in accordance with an exemplary
`embodiment of the present invention.
`FIG. 5 is a flowchart diagram that illustrates exemplary 65
`message referencing in accordance with a further exemplary
`embodiment of the present invention.
`
`2
`
`FIG. 6 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with a further exemplary embodiment of the present inven-
`tion.
`
`FIG. 7 is a block diagram that illustrates an exemplary
`network with associated computing devices in accordance
`with yet another exemplary embodiment of the present
`invention.
`
`FIGS. 8A-8D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIG. 9 is an exemplary screen shot that illustrates exem-
`plary operation of an exemplary embodiment of the present
`invention.
`
`FIGS. 10A-10C are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 11A-11D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`illustrates
`that
`FIG. 12 is an exemplary screen shot
`exemplary operation of an exemplary embodiment of the
`present invention.
`FIGS. 13A-13D are exemplary screen shots that illustrate
`exemplary operation of an exemplary embodiment of the
`present invention.
`
`SUMMARY OF THE INVENTION
`
`A method for referencing a message comprises the steps
`of receiving selection of an area or object associated with the
`message on a display, optionally providing an indication that
`the selection of the area or object has been received,
`allowing a further message to be formed with a link to the
`message, wherein the link is associated with the further
`message responsive to the selection, and causing display of
`the information associated with the message responsive to
`selection of a further area or portion.
`
`DETAILED DESCRIPTION
`
`The present invention relates to messaging and in par-
`ticular to the ability of one message to reference another
`message. With regard to messaging, what is referred to is the
`ability for one or more users to provide a series of messages.
`Messages typically occur in a stream, wherein each message
`comprises data. The data included in messages is often text,
`but this is merely exemplary as messages can include other
`content,
`including possibly any kind of data (e.g. audio,
`video, animation, graphics, web links, photos, etc.).
`In one or more exemplary embodiments of the present
`invention, a method and apparatus improves the operation of
`a computer device, by providing links that enable a com-
`puter device to operate with greater efficiency. In particular,
`in several exemplary embodiments, when one message
`references another message, and time has elapsed between
`the two messages, the invention enables a computer device
`to operate with advantages over the prior art. For example,
`in the prior art, to enable one message to reference an earlier
`message, a search for the earlier message can be inefficient,
`time consuming, can delay message response while an
`earlier message is located, and can request that data stored
`in memory be duplicated. By contrast, in accordance with
`exemplary embodiments of the present invention, the use of
`visual display of an earlier message (or portions thereof) and
`selection (in various manners to be described below),
`enables message referencing in a manner that enables faster
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 29 of 39 PageID #: 106
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 29 of 39 PageID #: 106
`
`US 10,728,192 B2
`
`3
`computer processing and more efficient use of computer
`devices for exemplary forms of communication such as
`messaging.
`Messaging (such as chat messaging) has become a very
`popular form of electronic communication due to its afford-
`ability and ease of use. On any given day, users may
`exchange numerous messages regarding a diverse range of
`topics. The users may use the messages to discuss, for
`example, group activities, to solicit opinions about various
`topics, or simply exchange short conversations with friends
`or co-workers. One of the drawbacks to using typical chat
`messaging systems is the sequential nature of the messages
`sent and received. For example, messages often appear in a
`channel or log in chronological order. If a user in a group
`chat session comes back from a meeting after several hours,
`they may be confronted with a bunch of messages. In this
`regard, the group chat sessions are often characterized by
`short bursts of dialog around a given topic. By the time a
`user views the messages,
`the topic may have changed
`several times. This makes it difficult for a user to post a
`response to a previous message that is within context of the
`ongoing message conversation.
`Methods and systems for providing references (such as
`context-based references) to link messages (such as chat
`messages) are disclosed herein. This allows a user to gen-
`erate and insert a (reference) object into a (chat) message
`stream that links or otherwise references a chat message
`(such as a prior message or later message) the user intended
`to send. It is contemplated that the techniques disclosed
`herein may be particularly beneficial
`in certain types of
`communication platforms. However, so as to illustrate the
`method and system functionality, and not by way of limi-
`tation, the communication platform described herein is an
`exemplary chat messaging platform. It is envisioned that one
`skilled in the art could make and use the methods and
`
`systems described herein with other types of communication
`platforms. Some of these communication platforms may
`include, for example, text messaging, short message services
`(SMS), e-mails and other types of similar on-line commu-
`nication platforms for facilitating electronic information
`exchanges between client devices of a plurality of users. The
`use of chat messaging described herein is merely exemplary,
`as other forms of messaging may also be used in accordance
`with exemplary embodiments of the present invention.
`With respect to chat messaging platforms, a message (for
`example in a chat message session) that a user wishes to
`respond to or reference occurred as a standalone comment or
`as part of a previous and unrelated (to a most recent
`discussion chain) discussion. A chat message session, as
`used herein, refers to a series of messages that are exchanged
`between one or more users, wherein for more than one user
`the users are in a group of users. When one of the users in
`the group adds a new message to a chat message session, the
`new message is sent
`to other users in the group. For
`example, if a first user adds a new message to the chat
`message session between three users in a group, then the
`new message may be sent to other selected users of the
`group, such as the second user and/or the third user. Thus,
`the chat message session may simulate a real-life conver-
`sation because users may communicate to the group at large,
`or to a specific person or a subset of the people in the group.
`In some situations, a user may want add a new message
`that is related to a previous message in the chat message
`session. When replying to the previous message at
`the
`current point in time in the session, the reply message may
`appear out of context and could be confusing to other users
`in the session. This is because the chat message sessions
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`often include numerous messages that may have been
`entered over a short period of time. Some group messaging
`users employ various strategies to minimize the effect of
`their writing messages when trying to refer to or reply to a
`previous message in the session. In one example, a user may
`copy and paste the prior message into the text message entry
`bar and then add additional text. In another example, the user
`may include addition information in the new message to
`make it clear what is being responded to. In yet another
`example, the user may specify the message being referenced
`by identifying and referencing something unique about the
`message such as who sent it, the date and/or the time it was
`sent. One problem with using these types of techniques is
`that extra text entry space may not be available in a chat
`message system that limits the amount of data that can be
`entered into a given message. Moreover, the user may miss
`some important information if they cut and paste only a
`portion of the previous message or the identifying informa-
`tion regarding the previous message may not be complete or
`accurate.
`
`To put it another way, a first message (“message”) may be
`one of several messages. A second message (“further mes-
`sage”) may also be one of the several messages. It may be
`desirable for the second message to reference the first
`message. By “reference” what is meant is that there is a
`connection between the second message and the first mes-
`sage. The connection may be for example a link. With such
`a link, while the second message is being viewed, some
`aspect of the first message may also be viewed. The aspect
`of the first message may be, for example, all of the first
`message, part of the first message, a modified form of all or
`part of the first message, and/or data associated with the first
`message. Exemplary associated data may include a user (or
`some form of identification of the user) associated with the
`first message, a date and/or time associated with the first
`message, Gucci and/or some other data associated with the
`first message.
`In one exemplary embodiment of the present invention, a
`“reference object” is inserted into a text entry box that is
`being used to form a second message so that (after the
`second message is transmitted) a “display object” can be
`displayed (with the second message) that references the first
`message. In one embodiment of the present invention the
`reference and display object are the same while in another
`embodiment of the present
`invention the reference and
`display object are different. The reference object, or the
`display object, or both, references the first message as more
`clearly described below.
`Chat messages (as an example of messages) are thus
`beneficially enhanced to provide users with additional infor-
`mation related to the meaning of their electronic conversa-
`tions without introducing expensive overhead or burden-
`some retrieval mechanisms. For example, a user may make
`a selection associated with a first message which then
`automatically inserts a reference object into a text entry bar
`of a chat message system. The reference object may provide
`a link to automatically identify and access data from the first
`message. The user may then add additional text in the text
`message box before or after the reference object. When the
`message is sent, a display object associated with the first
`message is included in the newly posted second message. If
`multiple messages are referenced then one or more of the
`display objects are displayed in the newly posted message.
`It is also possible for the same message to be referenced
`multiple times by different new messages at any time in the
`chat message session. In addition, computer processing
`efficiency is improved through the use of links and without
`
`

`

`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 30 of 39 PageID #: 107
`Case 1:20-cv-01345-UNA Document 1-2 Filed 10/02/20 Page 30 of 39 PageID #: 107
`
`US 10,728,192 B2
`
`5
`simply duplicating previously inputted data. Efficiency is
`also improved by enabling access to at least a portion of
`previously available data without a need to manually locate
`the previously available data.
`Each display object can then be activated in the chat
`session in several ways. For example, by hovering over
`and/or selecting the display object, text data (or other data or
`portions thereof) associated with the referenced first mes-
`sage may be displayed (e.g., above, to the side of, below)
`with respect to the newly posted message. The information
`thus provides the reader with immediate and useful context
`relating to the message they are reading by allowing them to
`see the message that is referenced. In some implementations,
`other visual or audio mechanisms can be added to highlight
`the display object. For example,
`the display object may
`displayed in a different text color, font size, or a change to
`a portion or all of the background of the referred message or
`include various type of animation effects.
`While the above description is with regard to first and
`second messages, it is understood that “first” and “second”
`(or “message” and “further message”) are merely being used
`to identify two messages that have been separately entered
`into a computer system (and then, for example, sent). In one
`embodiment of the present invention, the first message is
`sent before the second message, although this merely exem-
`plary (i.e. the order may be reversed).
`In one implementation, a computer program product may
`be installed and/or a service may be selected from a clo

This document is available on Docket Alarm but you must sign up to view it.


Or .

Accessing this document will incur an additional charge of $.

After purchase, you can access this document again without charge.

Accept $ Charge
throbber

Still Working On It

This document is taking longer than usual to download. This can happen if we need to contact the court directly to obtain the document and their servers are running slowly.

Give it another minute or two to complete, and then try the refresh button.

throbber

A few More Minutes ... Still Working

It can take up to 5 minutes for us to download a document if the court servers are running slowly.

Thank you for your continued patience.

This document could not be displayed.

We could not find this document within its docket. Please go back to the docket page and check the link. If that does not work, go back to the docket and refresh it to pull the newest information.

Your account does not support viewing this document.

You need a Paid Account to view this document. Click here to change your account type.

Your account does not support viewing this document.

Set your membership status to view this document.

With a Docket Alarm membership, you'll get a whole lot more, including:

  • Up-to-date information for this case.
  • Email alerts whenever there is an update.
  • Full text search for other cases.
  • Get email alerts whenever a new case matches your search.

Become a Member

One Moment Please

The filing “” is large (MB) and is being downloaded.

Please refresh this page in a few minutes to see if the filing has been downloaded. The filing will also be emailed to you when the download completes.

Your document is on its way!

If you do not receive the document in five minutes, contact support at support@docketalarm.com.

Sealed Document

We are unable to display this document, it may be under a court ordered seal.

If you have proper credentials to access the file, you may proceed directly to the court's system using your government issued username and password.


Access Government Site

We are redirecting you
to a mobile optimized page.





Document Unreadable or Corrupt

Refresh this Document
Go to the Docket

We are unable to display this document.

Refresh this Document
Go to the Docket