`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 1 of 24 PageID 48Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 1 of 24 PageID 48
`
`
`
`
`Exhibit 2
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 2 of 24 PageID 49
`US009792662B2
`
`( 12 ) United States Patent
`Crutchfield et al .
`
`( 10 ) Patent No . :
`( 45 ) Date of Patent :
`
`US 9 , 792 , 662 B2
`Oct . 17 , 2017
`
`( 72 )
`
`( * ) Notice :
`
`( 54 ) EMBEDDING DIGITAL CONTENT WITHIN A
`DIGITAL PHOTOGRAPH DURING CAPTURE
`OF THE DIGITAL PHOTOGRAPH
`( 71 ) Applicant : Pixmarx The Spot LLC , Austin , TX
`( US )
`Inventors : Barry Crutchfield , Austin , TX ( US ) ;
`Gary Lipps , Mandeville , LA ( US )
`( 73 ) Assignee : PixMarx the Spot , LLC , Austin , TX
`( US )
`Subject to any disclaimer , the term of this
`patent is extended or adjusted under 35
`U . S . C . 154 ( b ) by 0 days .
`( 21 ) Appl . No . : 15 / 275 , 166
`( 22 ) Filed :
`Sep . 23 , 2016
`Prior Publication Data
`( 65 )
`US 2017 / 0011485 A1
`Jan . 12 , 2017
`Related U . S . Application Data
`( 63 ) Continuation of application No . 14 / 251 , 707 , filed on
`Apr . 14 , 2014 , now Pat . No . 9 , 477 , 689 .
`( 60 ) Provisional application No . 61 / 966 , 161 , filed on Feb .
`15 , 2014 .
`Int . Ci .
`G06K 9 / 00
`( 2006 . 01 )
`G06T 1 / 00
`( 2006 . 01 )
`GOOF 1730
`( 2006 . 01 )
`H04N 5 / 77
`( 2006 . 01 )
`H04N 5 / 913
`( 2006 . 01 )
`U . S . CI .
`CPC . . . . . . . GO6T 1 / 0021 ( 2013 . 01 ) ; G06F 17 / 3028
`( 2013 . 01 ) ; G06F 17 / 30265 ( 2013 . 01 ) ; H04N
`5 / 77 ( 2013 . 01 ) ; H04N 5 / 772 ( 2013 . 01 ) ; H04N
`
`( 51 )
`
`( 52 )
`
`( 56 )
`
`5 / 913 ( 2013 . 01 ) ; G06T 2201 / 0064 ( 2013 . 01 ) ;
`H04N 2005 / 91335 ( 2013 . 01 )
`( 58 ) Field of Classification Search
`None
`See application file for complete search history .
`References Cited
`U . S . PATENT DOCUMENTS
`2011 / 0173565 A1 *
`7 / 2011 Ofek
`G06T 5 / 50
`715 / 790
`2012 / 0023457 Al *
`1 / 2012 Lai . . . . . . . . . . . . . . . . . G06 , 30 / 0251
`715 / 863
`2012 / 0069051 Al
`3 / 2012 Hagbi et al .
`( Continued )
`Primary Examiner — Weiwen Yang
`( 74 ) Attorney , Agent , or Firm — Hunt Pennington Kumar
`& Dula , PLLC
`ABSTRACT
`( 57 )
`A wireless communication device comprises position deter
`mining system , a digital imaging system and a photograph
`customization system coupled to the position locating sys
`tem and the digital imaging system . The position determin
`ing system is configured to provide information indicating a
`current position of the wireless communication device . The
`digital imaging system is configured to create digitally
`rendered images of visual content acquired thereby . The
`visual content is displayed on an image viewing structure of
`the digital imaging device while being acquired . The pho
`tograph customization system is configured to use the cur
`rent location of the digital imaging device for providing one
`or more embeddable content images and to display infor
`mation from at least one of the one or more embeddable
`content images on an image viewing structure of the digital
`imaging device while the visual content being acquired by
`the digital imaging system is being displayed on the image
`viewing structure .
`16 Claims , 13 Drawing Sheets
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 2 of 24 PageID 49
`
`100
`
`Start
`
`Activating Camera
`102
`
`Receiving Request For
`Embedding of Watermark
`104
`
`Determining If Default
`:
`Watermark Source Selected
`106
`
`Selected ?
`
`YES
`
`Displaying Available
`Watermark Sources
`108
`
`Receiving Seiected Default
`Watemark Source
`110
`
`Determining Source Of
`Watermarks
`111
`
`NO
`
`Manually
`Entered ?
`YES
`Requesting Watermark
`Information
`12
`Receiving Watermark
`Information
`113
`+
`Creating Watermark image
`: 14
`
`Determining Available
`Watermark Selections
`116
`
`Displaying Available
`Watermark Selections
`118
`
`Receiving Chosen
`Watermark Selection
`120
`
`Registered ?
`YESY
`Downloading Watermark
`Image
`122
`
`Creating Watermark Image
`124
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 3 of 24 PageID 50
`
`US 9 , 792 , 662 B2
`Page 2
`
`( 56 )
`
`References Cited
`U . S . PATENT DOCUMENTS
`2012 / 0304052 AL 11 / 2012 Tanaka et al .
`2013 / 0307842 A1 11 / 2013 Grinberg et al .
`* cited by examiner
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 3 of 24 PageID 50
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 4 of 24 PageID 51
`U . S . Patent
`US 9 , 792 , 662 B2
`Oct . 17 , 2017
`
`Sheet 1 of 13
`
`FIG . 1A
`
`100
`
`Start
`
`Activating Camera
`102
`
`Receiving Request For
`Embedding Of Watermark
`104
`
`Determining If Default
`Watermark Source Selected
`106
`
`YES
`
`Selected ?
`
`NO
`
`Displaying Available
`Watermark Sources
`108
`
`Receiving Selected Default
`Watermark Source
`110
`
`Determining Source Of
`Watermarks
`111
`
`NO
`
`Manually
`Entered ?
`YVES
`Requesting Watermark
`Information
`112
`
`Receiving Watermark
`Information
`113
`
`Creating Watermark Image
`114
`
`Determining Available
`Watermark Selections
`116
`
`Displaying Available
`Watermark Selections
`118
`
`Receiving Chosen
`Watermark Selection
`120
`
`Registered ?
`YES Y
`Downloading Watermark
`Image
`122
`
`Creating Watermark Image
`124
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 4 of 24 PageID 51
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 5 of 24 PageID 52
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 2 of 13
`
`US 9 , 792 , 662 B2
`
`@
`
`capturing Viewed Visual
`Content
`126
`
`Offering Application Of Filter
`128
`
`Filter
`Requested ?
`YES
`Applying Filter
`130
`
`Saving Finished Photo
`132
`
`Offering Ability To Share
`Photo
`134
`
`FIG . 1B
`
`100
`
`Displaying Options For
`Sharing Photo
`136
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 5 of 24 PageID 52
`
`Share
`Photo ?
`
`End
`
`YES
`
`Receiving Selected Sharing
`Option
`138
`
`Implementing Sharing Of
`Photo
`140
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 6 of 24 PageID 53
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 3 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 2A
`
`?? ??
`
`? ? ??
`
` ? ? ? ??????
`
`??
`
`???????
`???????
`????
`?????
`
`
`
` ??? ??? ??? ???????? ??
`
`
`
`
`
`
`
`
`
`??? ???
`
`
`
` ??? ??? ???
`
`
`
`???
`
`????
`???
`
`? ?? ?
`
`
`??? ??????????
`??
`??
`
`????? ??
`
`???????????
`
`- :
`
`? 43
`
`???
`
`7
`
`2 - 204
`206
`
`?
`
`????
`
`' ' :
`
`?? ??
`
`???
`
`? ??????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
`
`????? ?????
`
`
`
`?? ??? ??????????
`
`???
`
`?????
`?????
`???????????????????
`
`
`
`??? ?????
`
`???????????
`
`?????
`
`?
`
`???
`???
`Pirmarx
`
`(
`
`?
`
`F
`
`o
`
`)
`
`? ?????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 6 of 24 PageID 53
`
`. .
`
`
`???? ?????
`
`?? ????
`. . ??????
`??? ?? ???
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 7 of 24 PageID 54
`U . S . Patent
`Oct . 17 , 2017
`Sheet 4 of 13
`US 9 , 792 , 662 B2
`
`FIG . 2B
`?
`?????? ???
`?? ????????
`??? ? ????
`
`: : : .
`:
`
`????????????
`????????
`??????????????????????????????????????????
`-
`??? ? ??? ?? ????
`
`????????????????????????????????????????????????????????????????????????????????????????????
`
`
`
` ?? ?????? ????
`?????
`
`: :
`
`???????
`???? ?????????????
`
`:
`
`:
`
`? ???????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????????
`
`???
`
`2
`
`?
`
`?
`
`Back Set Default Pixmarx
`Please select one :
`
`ggg
`
`??
`
`23 { }
`
`-
`
`afir ?
`
`.
`
`?????
`
`ex {
`
`????
`
`} } } }
`
`} }
`
`?????
`
`. : : . . . . . . . . . . . . . . . . . . .
`
`?
`
`? ?????? ????? ???? ???? ????? ????? ???????
`
`
`
`?????? ??????
`.
`
`:
`
`:
`
`
`
`??? ??? ??? ?
`
`???????
` ???? ?? ???????? ???
`
`
`: ??????
`
`: :
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 7 of 24 PageID 54
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 8 of 24 PageID 55
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 5 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 2C
`
`destitutions
`votre coup dengan di
`eneration
`
`wwwwwwwwww
`W
`
`219
`
`200
`
`204
`
`open
`im
`
`TTTTTTTT
`
`TTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTTrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`217
`
`216
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 8 of 24 PageID 55
`
`.
`
`nii * * *
`
`doodoooooooooooo000000000000000000000000000000000000000
`
`mm .
`
`vos .
`
`. . . . . . . . . . . . . . . . . . . . . .
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`-
`
`10 * * A
`Select Location
`Back
`Registered
`Registered . .
`Watermarks
`Watermarks
`Pixmarx Co creator
`39 yards 400 Torrington Drive
`mixmarx font 003
`130 yards 400 Torrington Dri
`Pixmanx font 002
`130 yards 400 Torrington Dri
`Pixmarx Font 001
`130 yards 400 Torrington Drit
`SXSW Template
`144 yards 320 Torrington Driv
`The 1975
`144 yards 320 Torrington Drit
`
`age
`
`DOO Easter Egg
`10
`
`144 yards 320 Torrington Dris
`Springtime
`144 yards 320 Torrington Dri
`
`*
`
`re
`
`seth
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 9 of 24 PageID 56
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 6 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 2D
`
`. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
`
`. . .
`*
`
`PORT *
`
`200
`
`IIITITITITITITITITITITITITITITITITITIT
`
`204
`
`Trrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
`
`rrrrrrrrr
`Cache
`
`* * * * *
`
`219
`
`*
`
`*
`
`*
`
`*
`
`* *
`
`. : ; : ; :
`
`02 AM
`Select Location
`Registered
`Registered
`Watermarks
`Watermarks
`Soul
`2 parcs 400 Lona 2
`BOAS O
`128 yards 4380 L
`O MN
`198 yards 4375
`2
`SOS
`16 % ya
`4 * 44 Loxana 2
`
`IM
`
`168 yards
`
`22
`
`. 2
`
`22
`
`179 yards 488 LEXUS
`
`181 yards 1990 o
`
`OO 192 Yards 224 M
`
`A
`
`mmmmmmmmmmmmmmm
`
`senyor * * * * *
`
`217 .
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 9 of 24 PageID 56
`
`218 mg wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`KOOKKKKKKKKKKKKKKKK
`
`,
`
`KKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKKK * * * * * * * * * KKKKKKKKKKKKKKKKKKKKKKK * * * * * * * * * * KOKKKKKKKKKKKKKKKKKK * * * * * * * * * * * * * * mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 10 of 24 PageID 57
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 7 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 2E
`
`. : .
`
`000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`:
`
`:
`
`:
`
`:
`
`A .
`
`- www : www : www
`
`mama
`
`mama www www www
`
`Pirmarx
`
`m 200
`
`they . .
`
`204
`
`Yumi
`
`Om
`
`. . . .
`
`226 -
`
`Dr . . .
`
`224 mm
`
`Co - creator of imax the spot }
`AOO LOXATION ASED WATERMARKS TO PHOTOS
`000 000 000 000 000 1999
`00
`000 000 000 DO DO 20 00
`mi w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`w
`
`00
`
`in 220
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 10 of 24 PageID 57
`
`. . . . . .
`
`Add Watermark
`
`
`
`? ??????????????
`
`
`
`??????????????????????????????????????????? ??
`
`. . . . . . . . . . . . . . . .
`MYYYYYYYYYYYYY
`
`.
`
`fyriuwing .
`
`an
`
`* * *
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 11 of 24 PageID 58
`
`U . S . Paten
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 8 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 2F
`
`* * * ighting
`
`m baye
`
`all
`
`: .
`
`10
`Filter
`
`ter
`
`iririririririririririririririr .
`
`rrrrr
`
`Save H
`
`Ca - creator of Pirmarx the spot
`AOD LOCATION 049ED WATERMARKS TO MOTOS
`
`200
`
`204
`
`204
`
`866
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`h
`
`w wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww r rrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`rr
`
`* *
`
`: . * * *
`
`* *
`
`*
`
`* * * * * * * * * * * wwwwwwwwwwwwww
`
`w
`
`ww
`
`00000000000000000000ccccccccccccccc0000000000000000000000000000000000000
`0 00000000ccccccccccccccccccccc000000000000000000000000000
`c cccccccccccccccccccccccccccccccc00000000
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 11 of 24 PageID 58
`
`tentang man
`
`?
`
`
`
`?? ?????
`
`
`
`?? ?????????????????????????????????????????????????????????????????????????????????????????????? ?????????????????????????????????? ??
`
`
`
`
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 12 of 24 PageID 59
`US 9 , 792 , 662 B2
`
`Oct . 17 , 2017
`
`Sheet 9 of 13
`
`atent
`
`200
`
`FIG . 2G
`
`termination
`hermostaterade
`
`* * *
`
`w
`
`sivivivivie
`
`.
`
`vi
`
`.
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`: 30 AM
`cccccccccccccc
`Share
`
`ww
`
`* * *
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 12 of 24 PageID 59
`
`ccccccc
`
`. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
`
`. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
`
`.
`
`wwwwwwwwwww
`
`Concreator or Pumarx on se
`* * * *
`* * * *
`* * * *
`*
`
`koning
`
`: . 1111111111111
`
`1
`
`TRUTTURUTRUTTURUTRUTTURUTRUTTURTTUR
`UUTTUURFRÉTTTTTTTTTTTTTTTTTTT
`
`I .
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`204
`
`Trrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr
`
`win
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 13 of 24 PageID 60
`US 9 , 792 , 662 B2
`
`Oct . 17 , 2017
`
`Sheet 10 of 13
`
`atent
`
`FIG . 2H
`
`internet
`
`wiki
`
`OOOOOO
`
`!
`
`0000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000
`
`wwwwwwwwwwwwwwwww
`
`. ' "
`
`* 20909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909090909
`
`Warm .
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 13 of 24 PageID 60
`
`I
`IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIII :
`
`TTTTTTTTTTTTTTTTTTTTTTTTTTTTT
`
`204 204
`
`mamo . 230
`
`32
`234
`236
`236
`987
`
`rescicies and
`
`consists
`
`scrisoarerincianis .
`
`Print to Walgreens
`E
`Facebook
`Copy
`aqun
`NOG
`JONW
`Cancel
`
`. . . . . . . . . . . . . . . .
`
`: . . . . . . . . . .
`
`.
`
`. . . . .
`
`. . . . . . . .
`
`tttttttttttttt
`
`tttttttttttttttttt
`
`www . 00000000000000000000000000000000000000000000000000000
`
`pa
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 14 of 24 PageID 61
`
`atent
`
`Oct . 17 , 2017
`
`Sheet 11 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 3
`
`300
`
`30 . 4
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 14 of 24 PageID 61
`
`All Seasons Nursery
`Mandeville , LA
`i
`
`+ 302
`
`302
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 15 of 24 PageID 62
`
`U . S . Patent
`
`Oct . 17 , 2017
`
`Sheet 12 of 13
`
`US 9 , 792 , 662 B2
`
`FIG . 4
`
`400
`
`poss
`
`o
`
`no
`
`000000
`
`.
`
`. .
`
`Add watermark
`
`.
`
`.
`
`. . . . . . . . . .
`
`404 www
`?i
`
`instag
`
`Making
`
`17 : 00
`
`W
`
`oene
`
`. * . . * . . . . * . . * . . * . * . * . . * . * . * . . * . . * . * . * . * * *
`
`. .
`
`KOSME
`HMS 3
`LatRÉE
`do wa Love
`
`i
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`w wwwwww
`
`w wwwwwwwwwwwwww
`
`wwwwwww
`
`WWWWWWW
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 15 of 24 PageID 62
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 16 of 24 PageID 63
`US 9 , 792 , 662 B2
`
`Oct . 17 , 2017
`
`Sheet 13 of 13
`
`atent
`
`FIG . 5
`
`500
`
`501
`
`COMPUTER SYSTEM
`540
`
`520
`
`VIDEO INTERFACE
`
`DISPLAY
`
`533
`
`530
`
`NETWORK
`
`532
`
`INPUT
`DEVICE ( S )
`
`534
`
`OUTPUT
`DEVICE ( S )
`535
`
`STORAGE
`DEVICE ( S )
`
`536
`
`THA
`
`PROCESSORIS
`502
`CACHE
`
`K
`
`503
`
`504
`505
`506
`
`MEMORY
`pris
`i
`RAM
`
`mini
`
`ROM ROM
`BIOS
`
`BIOS
`
`www mwana www . mimo won www
`
`STORAGE CONTROL
`
`STORAGE
`
`509
`
`OPERATING
`SYSTEM
`
`EXECS
`
`DATA
`
`5
`
`AP /
`APPLICATIONS
`yhteytheythuys
`hyyty
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 16 of 24 PageID 63
`
`.
`
`NETWORK
`INTERFACE
`
`GRAPHICS
`CONTROL
`
`INPUT INTERFACE
`
`QUTPUT
`INTERFACE
`
`525
`
`STORAGE DEVICE
`INTERFACE
`
`526
`
`STORAGE MEDIUM
`INTERFACE
`
`STORAGE
`MEDIUM
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 17 of 24 PageID 64
`
`US 9 , 792 , 662 B2
`
`5
`
`EMBEDDING DIGITAL CONTENT WITHIN A
`DIGITAL PHOTOGRAPH DURING CAPTURE
`OF THE DIGITAL PHOTOGRAPH
`
`shared or added to an album because one or more separate
`process must performed after taking the photograph to
`achieve such contextualization and / or customization . There
`fore , enabling such contextualization and / or customization
`to be performed in combination with taking a photograph is
`CROSS REFERENCE TO RELATED
`advantageous , desirable and useful .
`APPLICATIONS
`SUMMARY OF THE DISCLOSURE
`This continuation patent application claims priority from
`co - pending U . S . Non - provisional patent application having
`Embodiments of the present invention are directed to a
`Ser . No . 14 / 251 , 707 , filed 14 Apr . 2014 , entitled “ Embed - 10
`system - implemented solution ( e . g . , an internal process of a
`ding digital content within a digital photograph during
`digital imaging device ) for enabling personalization ( e . g . ,
`capture of the digital photograph ” , which have a common
`via contextualization and / or customization ) to be performed
`applicant herewith and is being incorporated herein in its
`in combination with taking a photograph with a digital
`entirety by reference .
`U . S . Non - provisional patent application having Ser . No . 15 imaging device . A digital camera , a smartphone camera , and
`a tablet are examples of a digital imaging device that can be
`14 / 251 , 707 , filed 14 Apr . 2014 , entitled “ Embedding digital
`content within a digital photograph during capture of the
`configured in accordance with an embodiment of the present
`digital photograph ” claims priority from Provisional Patent
`invention . More specifically , embodiments of the present
`Application having Ser . No . 61 / 966 , 161 , filed 15 Feb . 2014 ,
`invention are directed to displaying an embedded digital
`entitled “ Viewfinder watermark technique is a new WYSI - 20 image ( e . g . , an electronic digital icon ( e . g . , watermark ) ,
`WYG ( What You See Is What You Get ) method for embed
`picture , text , or the like ) within an image viewing structure
`ding an electronic digital watermark / image within a users
`( e . g . , eyepiece , visual display , or the like ) of a digital
`live camera lens / window viewer whether the lens is a digital
`imaging device prior to and during a photograph being taken
`screen or eyepiece . This method occurs prior to the user
`using the digital imaging device . Accordingly , when a user
`taking a photo . In addition , this method would be internal to 25 of such a digital imaging device takes the photograph ,
`the device process whether it was on a camera or smart
`as - viewed visual content seen within the image viewing
`structure ( i . e . , the embedded digital image overlaid on
`phone or hand held device . When user snaps / takes photo ,
`what was seen in the live viewer with embedded image
`to - be - photographed visual content ) is the same as what
`becomes the same image in a digital photo ' s output file ;
`would be a corresponding outputted digital file of the
`therefore , when comparing what was seen in the camera 30 imaging device . In this regard , the corresponding outputted
`viewer with the digital photo file or printed photo , the result
`digital file is a ‘ What You See Is What You Get ( WYSI
`is WYSIWYG ( What You See Is What You Get ) ” , both of WYG ) representation of the as - viewed visual content
`within the image viewing structure of the imaging device
`which have a common applicant herewith and are being
`when the to - be - photographed visual content is captured by
`incorporated herein in their entirety by reference .
`35 the digital imaging device . Advantageously , the embedded
`FIELD OF THE DISCLOSURE
`digital image can be selected based on an actual location of
`the digital imaging device at the time when the to - be
`The disclosures made herein relate generally to digital
`photographed visual content is captured using the digital
`photography solutions and , more particularly , to embedding
`imaging device ( i . e . , the current location of the digital
`digital content within a digital photograph during capture of 40 imaging device ) .
`the digital photograph .
`In one embodiment of the present invention , a computer
`implemented method comprises a plurality of operations . An
`BACKGROUND
`operation is performed for receiving a request to embed
`system - provided content into a photograph to be taken using
`Digital photography , like traditional film photography , is 45 a digital imaging device . An operation is performed for
`providing , dependent upon a current location of the digital
`widely used for memorializing events and moments . With
`the advent of social media and wireless communication , it
`imaging device when the request is received , one or more
`has become common place for people to use digital photo -
`embeddable images . An operation is performed for display
`graphs as an integral part of their social networking endeav -
`ing , on an image viewing structure of the digital imaging
`ors such as through posting of pictures on their on - line social 50 device , the one or more embeddable content images in
`network page . This is due in no small part to the inclusion
`combination with visual content being viewed by the digital
`of digital cameras in wireless communication devices ( e . g . ,
`imaging device .
`smartphones , tablets , etc ) and the affordability of digital
`In another embodiment of the present invention , a wire
`cameras . As such , ever increasing numbers of people are
`less communication device comprises position determining
`now taking photographs as a routine part of their daily lives 55 system , a digital imaging system and a photograph customi
`whether it be for personal enjoyment and entertainment , to
`zation system coupled to the position locating system and
`the digital imaging system . The position determining system
`share with friends and family , or both .
`Unlike traditional film photography , digital photography
`is configured to provide information indicating a current
`position of the wireless communication device . The digital
`offers the ability to immediately view , edit and share pho -
`tographs . This being the case , people have an expectation 60 imaging system is configured to create digitally rendered
`that their digital imaging solution offer them various
`images of visual content acquired thereby . The visual con
`approaches for enhancing their digital photographs though
`tent is displayed on an image viewing structure of the digital
`contextualization ( e . g . , editing a label into the photograph
`imaging device while being acquired . The photograph cus
`after it is taken ) and / or customization ( e . g . , editing a border ,
`tomization system is configured to use the current location
`special effect , etc into the photograph after it is taken ) . 65 of the digital imaging device for providing one or more
`However , these post - capture approaches for enhancing their
`embeddable content images and to display information from
`digital photographs often contribute to photos not being
`at least one of the one or more embeddable content images
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 17 of 24 PageID 64
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 18 of 24 PageID 65
`
`US 9 , 792 , 662 B2
`
`tograph being taken thereby ensuring desired framing of the
`on an image viewing structure of the digital imaging device
`photographed visual content with respect to the embedded
`while the visual content being acquired by the digital
`digital content . To this end , the embedded digital content is
`imaging system is being displayed on the image viewing
`maintained at a static position within an area of the image
`structure .
`In another embodiment of the present invention , a non - 5 viewing structure . Accordingly , when the photograph is
`taken , as - viewed visual content seen within the image view
`transitory computer - readable medium has tangibly embod
`ied thereon and accessible therefrom processor - executable
`ing structure includes the embedded digital content merged
`instructions that , when executed by at least one data pro -
`( e . g . , overlaid onto ) to - be - photographed visual content such
`that what is seen is the same as what would be a corre
`cessing device of at least one computer , causes the at least
`one data processing device to perform a method for gener - 10 sponding outputted digital file of the imaging device ( i . e . the
`ating a photo . Generating the photo comprises a plurality of
`outputted photograph ) . Furthermore , the embedded digital
`operations . An operation of receiving a request to embed
`content is advantageously selected based on an actual loca
`tion of the digital imaging device at the time when the
`system - provided content into a photograph to be taken using
`a digital imaging device is performed . An operation of
`to - be - photographed visual content is captured using the
`providing one or more embeddable images dependent upon 15 digital imaging device .
`a current location of the digital imaging device when the
`The method 100 is preferably implemented via an appli
`request is received is performed . An operation of displaying
`cation ( or operating system ) of a digital imaging device such
`the one or more embeddable content images on an image
`as , for example , the smartphone 200 shown in FIGS . 2A - 2G .
`viewing structure of the digital imaging device in combina
`A smartphone and similarly capable types of tablets , note
`tion with visual content being viewed by the digital imaging 20 pads and cameras are each an example of a data processing
`system in the context of embodiments of the present inven
`device is performed .
`These and other objects , embodiments , advantages and / or
`tion . An Apple iPhone brand cellular telephone and a cellular
`phone with an Android brand operating system are examples
`distinctions of the present invention will become readily
`of smart phones . It is disclosed herein that embodiments of
`apparent upon further review of the following specification ,
`25 the present invention are not limited to any particular brand ,
`associated drawings and appended claims .
`form or configuration of data processing system .
`The method 100 begins with an operation 102 for acti
`BRIEF DESCRIPTION OF THE DRAWINGS
`vating a camera ( e . g . , a digital camera , a camera or a
`FIGS . 1A and 1B are a flow diagram showing a system -
`smartphone , a camera of a tablet or the like ) , followed by an
`implemented method configured in accordance with an 30 operation 104 for receiving a request for the addition of a
`watermark ( i . e . , embedded digital content ) to a photo to be
`embodiment of the present invention .
`FIGS . 2A - 2H are diagrammatic views showing various
`taken . As shown in FIG . 2A , the visual content that is being
`aspects of a smartphone application configured in accor -
`viewed by the camera of the smartphone 200 is displayed
`within a respective area 202 of a visual display 204 ( i . e . ,
`dance with an embodiment of the present invention .
`FIG . 3 is a diagrammatic view showing a watermark 35 image viewing structure ) of the smartphone 200 . The request
`image configured in accordance with an embodiment of the
`for the addition of the watermark to the photograph to be
`taken can be implemented through the pressing of an ‘ Add
`present invention .
`FIG . 4 is a diagrammatic view showing a watermark
`Watermark ' button 206 .
`registration form configured in accordance with an embodi -
`After receiving the request for the addition of the water
`40 mark , an operation 106 is performed for determining if a
`ment of the present invention .
`FIG . 5 is a diagrammatic view of a computer system
`default watermark source has been selected . For example , if
`configured in accordance with an embodiment of the present
`not previously selected such as upon an initial implemen
`tation of the method 100 on the smartphone 200 , the default
`invention .
`watermark source may need to be selected from a plurality
`DETAILED DESCRIPTION
`45 of available watermark sources . If it is determined that the
`default watermark source has not been selected , an operation
`108 is performed for displaying available watermark
`FIGS . 1A and 1B are a flow diagram showing an embodi -
`sources , followed by an operation 110 being performed for
`ment of a system - implemented method ( i . e . , method 100 )
`receiving a selected default watermark source . After receiv
`for embedding digital content within a digital photograph
`during capture of the digital photograph . It is disclosed 50 ing the default watermark source , or if the default watermark
`herein that the embedded digital content can be that in the
`source has already been selected , an operation 111 is per
`form of an icon , a logo , a string of text / numerals , a picture ,
`formed for determining the source of watermarks ( i . e . , the
`a photograph , and / or the like ( i . e . , generally referred to
`default watermark source ) . As shown in FIG . 2B , selection
`herein as a watermark ) . In this regard , embodiments of the
`of a preferred watermark source can include be implemented
`present invention are not limited to any particular type of 55 via the visual display 204 of the smartphone 200 through
`embedding digital content . Furthermore , although the
`selection of a button 208 for choosing location - based water
`method steps described herein are discussed in a particular
`marks ( e . g . , as determined through use of a global position
`order , one of skill in the art will recognize that many method
`ing system to determine a current location of the smartphone
`steps can be carried out in a different order and overlap in
`200 ) as the default watermark source , through selection of a
`time without departing from the spirit of this disclosure .
`60 button 210 for choosing user - provided textual watermarks
`The method 100 of FIG . 1 provides for customization of
`( e . g . , provided though manual entry of text by a user ) as the
`a photograph through embedding supplemental content ( i . e . ,
`default watermark source , or through selection of a button
`embedded digital content ) into a photograph being taken
`212 for choosing user - imported watermarks as the default
`using the digital imaging device . Advantageously , the
`watermark source .
`embedded digital content is displayed within an image 65
`If it is determined that the source of watermarks is
`viewing structure ( e . g . , eyepiece , visual display , or the like )
`manually entered watermark information ( e . g . , user - pro
`of the digital imaging device prior to and during the pho -
`vided textual watermarks , user - imported watermark , or the
`
`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 18 of 24 PageID 65
`
`

`

`Case 3:20-cv-01157-M Document 1-3 Filed 05/07/20 Page 19 of 24 PageID 66
`
`US 9 , 792 , 662 B2
`
`10
`
`un
`FIGS . 2C and 2D , for example , a list of available registered
`like ) , an operation 112 is performed for requesting the
`watermarks 216 can be provided on a first location - based
`watermark information ( e . g . , text or imported watermark
`watermark page displayed in response to selection of a
`file ) , followed by an operation 113 being preformed for
`registered watermarks display button 217 and a list of
`receiving the requested watermark information . Thereafter ,
`an operation 114 is performed for creati