`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 1 of 24 PageID 72Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 1 of 24 PageID 72
`
`
`
`
`Exhibit 3
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 2 of 24 PageID 73
`US010102601B2
`
`( 12 ) United States Patent
`Crutchfield et al .
`
`( 72 )
`
`( * ) Notice :
`
`( 54 ) EMBEDDING DIGITAL CONTENT WITHIN A
`DIGITAL PHOTOGRAPH DURING CAPTURE
`OF THE DIGITAL PHOTOGRAPH
`( 71 ) Applicant : PixMarx The Spot , LLC , Austin , TX
`( US )
`Inventors : Barry Crutchfield , Austin , TX ( US ) ;
`Gary Lipps , Mandeville , LA ( US )
`( 73 ) Assignee : PixMarx The Spot , LLC , Austin , TX
`( US )
`Subject to any disclaimer , the term of this
`patent is extended or adjusted under 35
`U . S . C . 154 ( b ) by 0 days .
`( 21 ) Appl . No . : 15 / 705 , 703
`( 22 ) Filed :
`Sep . 15 , 2017
`( 65 )
`Prior Publication Data
`US 2018 / 0068411 A1 Mar . 8 , 2018
`Related U . S . Application Data
`( 63 ) Continuation of application No . 15 / 275 , 166 , filed on
`Sep . 23 , 2016 , now Pat . No . 9 , 792 , 662 , which is a
`( Continued )
`
`( 56 )
`
`( 10 ) Patent No . : US 10 , 102 , 601 B2
`( 45 ) Date of Patent :
`Oct . 16 , 2018
`( 58 ) Field of Classification Search
`None
`See application file for complete search history .
`References Cited
`U . S . PATENT DOCUMENTS
`6 , 023 , 231 A
`2 / 2000 Tsunoda
`10 / 2016 Hogeg et al .
`9 , 459 , 778 B2
`( Continued )
`FOREIGN PATENT DOCUMENTS
`1420366 A2
`5 / 2004
`EP
`Primary Examiner — Weiwen Yang
`( 74 ) Attorney , Agent , or Firm — Hunt Pennington Kumar
`& Dula PLLC
`ABSTRACT
`( 57 )
`A wireless communication device comprises position deter
`mining system , a digital imaging system and a photograph
`customization system coupled to the position locating sys
`tem and the digital imaging system . The position determin
`ing system is configured to provide information indicating a
`current position of the wireless communication device . The
`digital imaging system
`is configured to create digitally
`rendered images of visual content acquired thereby . The
`visual content is displayed on an image viewing structure of
`the digital imaging device while being acquired . The pho
`tograph customization system is configured to use the cur
`rent location of the digital imaging device for providing one
`or more embeddable content images and to display infor
`mation from at least one of the one or more embeddable
`content images on an image viewing structure of the digital
`imaging device while the visual content being acquired by
`the digital imaging system is being displayed on the image
`viewing structure .
`16 Claims , 13 Drawing Sheets
`
`( 51 ) Int . Ci .
`G06K 9 / 00
`G06T 1 / 00
`
`( 2006 . 01 )
`( 2006 . 01 )
`( Continued )
`U . S . CI .
`CPC . . . . . . . GO6T 1 / 0021 ( 2013 . 01 ) ; G06F 17 / 3028
`( 2013 . 01 ) ; G06F 17 / 30265 ( 2013 . 01 ) ;
`( Continued )
`
`( 52 )
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 2 of 24 PageID 73
`
`100
`
`Star
`
`Activating Camera
`102
`
`Receiving Request For
`Embedding Of Wateneck
`104
`
`Determining If Default
`Watermark Source Selected
`ID6
`
`Selected ?
`
`VES
`
`Displaying Available
`Watermark Sources
`168
`
`Receiving Selected Defau !
`Watermark Source
`119
`
`- - - - - - - -
`- - - - - - - - - - - -
`Deimining Source OH
`Watermarks
`
`Manually
`Entered ?
`YTES
`Requesting Watermart
`inforniation
`: 12
`
`Receiving Watermark
`Information
`112
`
`-
`
`- - -
`
`Creating Waterpark linaje
`
`Determining Available
`Watermark Selections
`116
`
`Displaying Available
`Watermark Selections
`118
`
`- -
`Receiving Choser
`Waterinszk Selection
`120
`
`Registerect ?
`YES Y
`Downloading Watermark
`mago
`122
`
`| Creating Watermark Image
`122
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 3 of 24 PageID 74
`
`US 10 , 102 , 601 B2
`Page 2
`
`Related U . S . Application Data
`continuation of application No . 14 / 251 , 707 , filed on
`Apr . 14 , 2014 , now Pat . No . 9 , 477 , 689 .
`
`( 60 ) Provisional application No . 61 / 966 , 161 , filed on Feb .
`15 , 2014 .
`( 51 ) Int . Cl .
`GOOF 1730
`H04N 5 / 77
`H04N 5 / 913
`U . S . CI .
`CPC
`
`( 2006 . 01 )
`( 2006 . 01 )
`( 2006 . 01 )
`H04N 5 / 77 ( 2013 . 01 ) ; H04N 5 / 772
`( 2013 . 01 ) ; H04N 5 / 913 ( 2013 . 01 ) ; GOOT
`2201 / 0064 ( 2013 . 01 ) ; H04N 2005 / 91335
`( 2013 . 01 )
`
`( 52 )
`
`( 56 )
`
`References Cited
`U . S . PATENT DOCUMENTS
`2003 / 0020816 A11 / 2003 Hunter et al .
`2005 / 0169499 A1 *
`8 / 2005 Rodriguez . . . . . . . . . . . . . . GOIS 19 / 14
`382 / 100
`2008 / 0014917 A1 *
`1 / 2008 Rhoads
`G06F 3 / 017
`455 / 422 . 1
`2008 / 0198409 A1
`8 / 2008 Bodin et al .
`2011 / 0173565 A1 7 / 2011 Ofek et al .
`2012 / 0023457 Al 1 / 2012 Lai et al .
`2012 / 0069051 A1
`3 / 2012 Hagbi et al .
`2012 / 0304052 AL 11 / 2012 Tanaka et al .
`2013 / 0307842 Al 11 / 2013 Grinberg et al .
`2014 / 0049614 A1 *
`2 / 2014 Yamada . . . . . . . . . . . . . . HO4N 5 / 2226
`348 / 46
`2015 / 0154779 A1 *
`6 / 2015 Kelley . . . . . . . . . .
`G06T 11 / 60
`382 / 154
`* cited by examiner
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 3 of 24 PageID 74
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 4 of 24 PageID 75
`US 10 , 102 , 601 B2
`
`U . S . Patent
`
`tent
`
`Oct . 16 , 2018
`
`Sheet 1 of 13
`
`Sheet 1 of 13
`
`FIG . 1A
`
`Start
`
`Activating Camera
`102
`
`
`
`AAA - 4
`
`-
`
`4
`
`-
`
`4
`
`-
`
`4
`
`-
`
`4
`
`- AAAAAAAAAAAAAAALAALALIA
`
`Receiving Request for
`Embedding of Watermark
`
`stutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutitutit
`
`Determining If Default
`Watermark Source Selected
`
`Selected ?
`
`YES
`
`Displaying Available
`Watermark Sources
`
`A
`
`A
`
`A
`
`A
`
`A
`
`A
`
`Receiving Selected Default
`Watermark Source
`
`JUODVODOV
`
`O
`
`DOUDOR
`
`www2P * * * * * *
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 4 of 24 PageID 75
`
`+ + + + +
`
`+ + + + +
`
`+ + + + + + + + +
`
`+ + + + + + + + +
`
`+
`
`Determining Source of
`Watermarks
`
`HAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA !
`
`Manually
`Entered ?
`YES
`Requesting Watermark
`Information
`112
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`w
`
`wwwwwwwww
`
`w
`
`Receiving Watermark
`Information
`113
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`Creating Watermark Image
`114
`
`Determining Available
`Watermark Selections
`
`Displaying Available
`Watermark Selections
`118
`
`Receiving Chosen
`Watermark Selection
`120
`
`w
`
`Registered ?
`YESI
`Downloading Watermark
`Image
`122
`
`Creating Watermark Image
`
`wwwwwwwwwwwwwwww
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 5 of 24 PageID 76
`U . S . Patent
`Oct . 16 , 2018
`Sheet 2 of 13
`US 10 , 102 , 601 B2
`
`capturing Viewed Visual
`Content
`126
`
`Offering Application of Filter
`128
`
`Filter
`Requested ?
`I YES
`Applying Filter
`130
`
`Saving Finished Photo
`
`Offering Ability To Share
`Photo
`
`000000000000000000000000000000000000000000000000000000000000000000000000
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 5 of 24 PageID 76
`
`Share
`Photo ?
`
`DOO
`
`YES
`
`FIG . 1B
`
`100
`
`Displaying Options For
`Sharing Photo
`136
`
`Receiving Selected Sharing
`Option
`138
`
`Implementing Sharing or
`Photo
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 6 of 24 PageID 77
`US 10 , 102 , 601 B2
`
`atent
`
`Oct . 16 , 2018
`
`Sheet 3 of 13
`
`FIG . 2A
`
`200
`
`MMMMMMMMMMMMMMMMM
`
`' . ' . ' . ' . ' .
`
`mmmmmmmmmmm
`mmmmmmmmmmmmmmm
`
`202
`
`hmmmmmmmmmmmm
`
`204
`206
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 6 of 24 PageID 77
`
`mo
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 7 of 24 PageID 78
`U . S . Patent
`Oct . 16 , 2018
`Sheet 4 of 13
`US 10 , 102 , 601 B2
`
`FIG . 2B
`
`200000000000000pppppppppppppp00000000000000000
`
`22
`
`* * * * *
`
`Location
`
`arom 208 de
`
`210
`
`-
`
`ZIZ
`
`* * * * *
`
`* * *
`
`* * * * * *
`
`9933333333333333333 * * * * *
`
`* * * * * * XXXXXXXXXXXXX29999999
`
`www * * * * * * *
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 7 of 24 PageID 78
`
`200
`
`204
`
`H mooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooopppppppppppppppppppppppppppppppppppppppppppppppppppppppppppppppppport
`
`OOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOOC
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 8 of 24 PageID 79
`U . S . Patent
`Oct . 16 , 2018
`Sheet 5 of 13
`US 10 , 102 , 601 B2
`
`FIG . 2C
`
`217 -
`
`200
`
`204
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`219
`
`??????????
`
`Registered
`Registered mamma
`Watermarks
`Watermarks
`39 yards 400 Torrington Drive
`Pixmarx Font 003
`
`. .
`
`.
`
`!
`
`' , '
`
`, '
`
`'
`
`' . '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`. '
`
`War
`
`Springtime
`
`ook
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 8 of 24 PageID 79
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 9 of 24 PageID 80
`U . S . Patent
`Oct . 16 , 2018
`Sheet 6 of 13
`US 10 , 102 , 601 B2
`
`FIG . 2D
`
`200
`
`219
`
`. . . . . . . . . . . . . . . . ' . ' . ' . ' . ' . ' . ' . ' . ' . ' . ' . ' .
`
`217
`
`Registered
`Watermarks
`
`.
`
`.
`
`.
`
`.
`
`Registered
`Watermarks
`
`1 . 1
`
`204
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 9 of 24 PageID 80
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 10 of 24 PageID 81
`U . S . Patent
`Oct . 16 , 2018
`Sheet 7 of 13
`US 10 , 102 , 601 B2
`
`FIG . 2E
`
`. VY LIIIIIIIIIIIIIIIIIII .
`
`200
`
`no
`
`. . .
`
`.
`
`. . .
`
`219
`
`.
`
`. . w
`
`.
`
`M
`
`.
`
`M
`
`.
`
`.
`
`w
`
`.
`
`w
`
`.
`
`m
`
`.
`
`m
`
`.
`
`m
`
`. .
`
`. w
`
`.
`
`.
`
`m
`
`.
`
`m
`
`.
`
`.
`
`W
`
`. .
`
`. W
`
`.
`
`W
`
`. .
`
`m
`
`.
`
`m
`
`204
`
`. . w
`
`226 mm
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 10 of 24 PageID 81
`
`102
`
`220
`
`L
`
`L L
`
`y
`
`by bylyhyytyytytybylylyyyyyyyyyyyyyyyyyyyyyyyyyyyyyyy .
`
`.
`
`. . .
`
`. . .
`
`. . . .
`
`.
`
`. . .
`
`.
`
`. . . . . . . . . .
`
`export
`
`. . . . . . . . . . . . . . . . . . . . . . . DOOOOOOOO0000000000000 . .
`
`.
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`. .
`
`mom mom www
`
`am
`
`SO
`
`D
`#
`
`w OB
`
`* *
`
`*
`
`W
`
`the .
`
`
`
`you with
`
`.
`
`what *
`
`them
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 11 of 24 PageID 82
`US 10 , 102 , 601 B2
`
`atent
`
`Oct . 16 , 2018
`
`Sheet 8 of 13
`
`FIG . 2F
`
`200
`
`Savelo 204
`
`228
`
`n nnnnnnnnnnnnnnnnnnnMMMMMMMMMMMMMM
`
`A
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 11 of 24 PageID 82
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 12 of 24 PageID 83
`U . S . Patent
`Oct . 16 , 2018
`Sheet 9 of 13
`US 10 , 102 , 601 B2
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`w
`
`
`
`. 000
`
`0
`
`.
`
`.
`. . .
`
`FIG . 2G
`
`wenn
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`more
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 12 of 24 PageID 83
`
`007
`
`wwwww
`
`#
`
`204
`
`204
`
`o
`
`RRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRRR
`
`* * * oooooooooooooo
`
`o
`
`oooooo
`
`o
`
`oooooooo
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 13 of 24 PageID 84
`US 10 , 102 , 601 B2
`
`atent
`
`Oct . 16 , 2018
`
`Sheet 10 of 13
`
`FIG . 2H
`
`200
`
`4
`
`:
`
`w
`
`w wwwwwwww
`
`www
`
`in
`
`. .
`
`.
`
`204
`
`234
`
`987
`236
`
`236
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 13 of 24 PageID 84
`
`Annon
`
`D
`
`. 00000000000000000000000000000000000000000000000
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 14 of 24 PageID 85
`
`U . S . Patent
`
`Oct . 16 , 2018
`
`Sheet 11 of 13
`
`US 10 , 102 , 601 B2
`
`FIG . 3
`
`iiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiiii
`
`w wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`
`wwwww
`
`SSSSSSSSSSSSSSSSSS
`
`304
`
`cocococececececececete
`
`* * * * *
`
`SES
`
`000022
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 14 of 24 PageID 85
`
`All Seasons Nursery
`Mandeville , LA
`
`20€
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 15 of 24 PageID 86
`US 10 , 102 , 601 B2
`
`U . S . Patent
`
`Oct . 16 , 2018
`
`Sheet 12 of 13
`
`FIG . 4
`
`, 400
`
`wwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwwww
`Add watermark
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`.
`
`. . .
`
`annman nage
`
`. . . . . . . . .
`
`Browse No file selected
`
`Hashtag 1
`
`Hashtag 2
`
`Hashtag 3
`
`Longitude
`
`Latitueo
`
`Address
`
`Logo
`
`wr
`
`tt
`
`wwwwwwwwwwwww
`
`w wwwwwwwwwwwwwwwwwwwwwwww
`
`: : : : : : : : : : : : : : : : : : : :
`
`Show on map
`
`OOOOOOOOOOOOOOOOOO
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 15 of 24 PageID 86
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 16 of 24 PageID 87
`U . S . Patent
`US 10 , 102 , 601 B2
`Oct . 16 , 2018
`
`Sheet 13 of 13
`
`FIG . 5
`
`inimiiiiiiiiiiiiiii
`
`minimizaniniainianinaimanisanimin minimanina imaniminisani na inianiniwaniniwang
`COMPUTER SYSTEM
`
`YYYYYYYYYYYY
`
`:
`
`LLLLLLLLLLLLLLLLL HUUUUUUUUUUUUUUUUUUUULU
`
`. .
`
`????????????????????????????????????????
`
`.
`
`.
`W
`
`.
`
`WWW
`
`CONTROL
`
`.
`
`VA
`
`ROM
`
`BIOS
`
`y ma ma
`
`ma m
`
`amma um ummon
`
`STORAGE CONTROL
`
`VAYA
`
`MMMMMMMMMMMMMMMMMMMMMMMM
`
`OPERATING
`SYSTEM
`
`EXECS
`
`DAIA
`Y APPLICATIONS
`
`wwwwwwwwwwwwwwwwwwww
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 16 of 24 PageID 87
`
`Vytyyyyyyyyyy INPUT INTERFACE
`Chytyyyyyyyyy
`
`INTERFACE
`
`yy
`
`STORAGE DEVICE
`INTERFACE
`
`DISPLAY
`
`533
`
`W
`
`We
`
`DEVICEIS )
`
`DEVICE ( S )
`
`???????????????????????????????????????????????????????????????
`
`STORAGE MEDIUM
`INTERFACE
`
`vivivivivivivie
`
`?
`
`MEDIUM
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 17 of 24 PageID 88
`
`US 10 , 102 , 601 B2
`
`EMBEDDING DIGITAL CONTENT WITHIN A
`DIGITAL PHOTOGRAPH DURING CAPTURE
`OF THE DIGITAL PHOTOGRAPH
`
`Unlike traditional film photography , digital photography
`offers the ability to immediately view , edit and share pho
`tographs . This being the case , people have an expectation
`that their digital imaging solution offer them various
`5 approaches for enhancing their digital photographs though
`CROSS REFERENCE TO RELATED
`contextualization ( e . g . , editing a label into the photograph
`APPLICATIONS
`after it is taken ) and / or customization ( e . g . , editing a border ,
`special effect , etc into the photograph after it is taken ) .
`This continuation patent application claims priority from
`However , these post - capture approaches for enhancing their
`U . S . Non - provisional patent application Ser . No . 15 / 275 ,
`166 , filed 23 Sep . 2016 , entitled “ Embedding Digital Con - 10 digital photographs often contribute to photos not being
`tent Within a Digital Photograph During Capture of the
`shared or added to an album because one or more separate
`Digital Photograph ” , which is expressly incorporated by
`process must performed after taking the photograph to
`reference in its entirety . This application is related to , and
`achieve such contextualization and / or customization . There
`claims priority from , U . S . Non - provisional patent applica -
`fore , enabling such contextualization and / or customization
`tion Ser . No . 14 / 251 , 707 , filed 14 Apr . 2014 , entitled 15 to be performed in combination with taking a photograph is
`“ Embedding digital content within a digital photograph
`advantageous , desirable and useful .
`during capture of the digital photograph ” , which is expressly
`SUMMARY OF THE DISCLOSURE
`incorporated by reference in its entirety . This application is
`related to , and claims priority from , U . S . Provisional Appli
`Embodiments of the present invention are directed to a
`cation Ser . No . 61 / 966 , 161 , filed 15 Feb . 2014 , entitled 20
`“ Embedding digital content within a digital photograph
`system - implemented solution ( e . g . , an internal process of a
`during capture of the digital photograph ” , which is expressly
`digital imaging device ) for enabling personalization ( e . g . ,
`via contextualization and / or customization ) to be performed
`incorporated by reference in its entirety .
`United States Non - provisional Patent Application having
`in combination with taking a photograph with a digital
`Ser . No . 14 / 251 , 707 , filed 14 . Apr . 2014 , entitled “ Embed - 25 imaging device . A digital camera , a smartphone camera , and
`ding digital content within a digital photograph during
`a tablet are examples of a digital imaging device that can be
`capture of the digital photograph ” claims priority from
`configured in accordance with an embodiment of the present
`Provisional Patent Application having Ser No . 61 / 966 . 161 .
`invention . More specifically , embodiments of the present
`filed 15 . Feb . 2014 , entitled “ Viewfinder watermark tech -
`invention are directed to displaying an embedded digital
`nique is a new WYSIWYG ( What You See Is What You Get ) 30 image ( e . g . , an electronic digital icon ( e . g . , watermark ) ,
`method for embedding an electronic digital watermark /
`picture , text , or the like ) within an image viewing structure
`image within a users live camera lens / window viewer
`( e . g . , eyepiece , visual display , or the like ) of a digital
`whether the lens is a digital screen or eyepiece . This method
`imaging device prior to and during a photograph being taken
`occurs prior to the user taking a photo . In addition , this
`using the digital imaging device . Accordingly , when a user
`method would be internal to the device process whether it 35 of such a digital imaging device takes the photograph ,
`was on a camera or smart phone or hand held device . When
`as - viewed visual content seen within the image viewing
`user snaps / takes photo , what was seen in the live viewer
`structure ( i . e . , the embedded digital image overlaid on
`with embedded image becomes the same image in a digital
`to - be - photographed visual content ) is the same as what
`photo ' s output file ; therefore , when comparing what was
`would be a corresponding outputted digital file of the
`seen in the camera viewer with the digital photo file or 40 imaging device . In this regard , the corresponding outputted
`printed photo , the result is WYSIWYG ( What You See Is
`digital file is a ‘ What You See Is What You Get ( WYSI
`WYG ) ' representation of the as - viewed visual content
`What You Get ) ” , both of which have a common applicant
`within the image viewing structure of the imaging device
`herewith and are being incorporated herein in their entirety
`when the to - be - photographed visual content is captured by
`by reference .
`45 the digital imaging device . Advantageously , the embedded
`digital image can be selected based on an actual location of
`FIELD OF THE DISCLOSURE
`the digital imaging device at the time when the to - be
`The disclosures made herein relate generally to digital
`photographed visual content is captured using the digital
`photography solutions and , more particularly , to embedding
`imaging device ( i . e . , the current location of the digital
`digital content within a digital photograph during capture of 50 imaging device ) .
`the digital photograph .
`In one embodiment of the present invention , a computer
`implemented method comprises a plurality of operations . An
`BACKGROUND
`operation is performed for receiving a request to embed
`system - provided content into a photograph to be taken using
`Digital photography , like traditional film photography , is 55 a digital imaging device . An operation is performed for
`providing , dependent upon a current location of the digital
`widely used for memorializing events and moments . With
`the advent of social media and wireless communication , it
`imaging device when the request is received , one or more
`has become common place for people to use digital photo -
`embeddable images . An operation is performed for display
`graphs as an integral part of their social networking endeav -
`ing , on an image viewing structure of the digital imaging
`ors such as through posting of pictures on their on - line social 60 device , the one or more embeddable content images in
`network page . This is due in no small part to the inclusion
`combination with visual content being viewed by the digital
`of digital cameras in wireless communication devices ( e . g . ,
`imaging device .
`ne dorine
`smartphones , tablets , etc ) and the affordability of digital
`In another embodiment of the present invention , a wire
`cameras . As such , ever increasing numbers of people are
`less communication device comprises position determining
`now taking photographs as a routine part of their daily lives 65 system , a digital imaging system and a photograph customi
`whether it be for personal enjoyment and entertainment , to
`zation system coupled to the position locating system and
`the digital imaging system . The position determining system
`share with friends and family , or both .
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 17 of 24 PageID 88
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 18 of 24 PageID 89
`
`US 10 , 102 , 601 B2
`
`order , one of skill in the art will recognize that many method
`is configured to provide information indicating a current
`steps can be carried out in a different order and overlap in
`position of the wireless communication device . The digital
`time without departing from the spirit of this disclosure .
`imaging system is configured to create digitally rendered
`The method 100 of FIG . 1 provides for customization of
`images of visual content acquired thereby . The visual con -
`tent is displayed on an image viewing structure of the digital 5 a photograph through embedding supplemental content ( i . e . ,
`imaging device while being acquired . The photograph cus -
`embedded digital content ) into a photograph being taken
`tomization system is configured to use the current location
`using the digital imaging device . Advantageously , the
`embedded digital content is displayed within an image
`of the digital imaging device for providing one or more
`embeddable content images and to display information from
`viewing structure ( e . g . , eyepiece , visual display , or the like )
`at least one of the one or more embeddable content images 10 of the digital imaging device prior to and during the pho
`on an image viewing structure of the digital imaging device
`tograph being taken thereby ensuring desired framing of the
`while the visual content being acquired by the digital
`photographed visual content with respect to the embedded
`digital content . To this end , the embedded digital content is
`imaging system is being displayed on the image viewing
`maintained at a static position within an area of the image
`structure .
`In another embodiment of the present invention , a non - 15 viewing structure . Accordingly , when the photograph is
`transitory computer - readable medium has tangibly embod -
`taken , as - viewed visual content seen within the image view
`ied thereon and accessible therefrom processor - executable
`ing structure includes the embedded digital content merged
`instructions that , when executed by at least one data pro -
`( e . g . , overlaid onto ) to - be - photographed visual content such
`that what is seen is the same as what would be a corre
`cessing device of at least one computer , causes the at least
`one data processing device to perform a method for gener - 20 sponding outputted digital file of the imaging device ( i . e . the
`ating a photo . Generating the photo comprises a plurality of
`outputted photograph ) . Furthermore , the embedded digital
`operations . An operation of receiving a request to embed
`content is advantageously selected based on an actual loca
`tion of the digital imaging device at the time when the
`system - provided content into a photograph to be taken using
`a digital imaging device is performed . An operation of
`to - be - photographed visual content is captured using the
`providing one or more embeddable images dependent upon 25 digital imaging device .
`a current location of the digital imaging device when the
`The method 100 is preferably implemented via an appli
`request is received is performed . An operation of displaying
`cation ( or operating system ) of a digital imaging device such
`as , for example , the smartphone 200 shown in FIGS . 2A - 26 .
`the one or more embeddable content images on an image
`A smartphone and similarly capable types of tablets , note
`viewing structure of the digital imaging device in combina
`tion with visual content being viewed by the digital imaging 30 pads and cameras are each an example of a data processing
`system in the context of embodiments of the present inven
`device is performed .
`These and other objects , embodiments , advantages and / or
`tion . An Apple iPhone brand cellular telephone and a cellular
`phone with an Android brand operating system are examples
`distinctions of the present invention will become readily
`apparent upon further review of the following specification ,
`of smart phones . It is disclosed herein that embodiments of
`35 the present invention are not limited to any particular brand ,
`associated drawings and appended claims .
`form or configuration of data processing system .
`The method 100 begins with an operation 102 for acti
`BRIEF DESCRIPTION OF THE DRAWINGS
`vating a camera ( e . g . , a digital camera , a camera or a
`FIGS . 1A and 1B are a flow diagram showing a system -
`smartphone , a camera of a tablet or the like ) , followed by an
`implemented method configured in accordance with an 40 operation 104 for receiving a request for the addition of a
`watermark ( i . e . , embedded digital content ) to a photo to be
`embodiment of the present invention .
`FIGS . 2A - 2H are diagrammatic views showing various
`taken . As shown in FIG . 2A , the visual content that is being
`aspects of a smartphone application configured in accor -
`viewed by the camera of the smartphone 200 is displayed
`within a respective area 202 of a visual display 204 ( i . e . ,
`dance with an embodiment of the present invention .
`FIG . 3 is
`a diagrammatic view showing a watermark 45 image viewing structure ) of the smartphone 200 . The request
`image configured in accordance with an embodiment of the
`for the addition of the watermark to the photograph to be
`taken can be implemented through the pressing of an ' Add
`present invention .
`FIG . 4 is a diagrammatic view showing a watermark
`Watermark ' button 206 .
`registration form configured in accordance with an embodi -
`After receiving the request for the addition of the water
`50 mark , an operation 106 is performed for determining if a
`ment of the present invention .
`FIG . 5 is a diagrammatic view of a computer system
`default watermark source has been selected . For example , if
`configured in accordance with an embodiment of the present
`not previously selected such as upon an initial implemen
`tation of the method 100 on the smartphone 200 , the default
`invention .
`watermark source may need to be selected from a plurality
`55 of available watermark sources . If it is determined that the
`default watermark source has not been selected , an operation
`108 is performed for displaying available watermark
`FIGS . 1A and 1B are a flow diagram showing an embodi -
`sources , followed by an operation 110 being performed for
`ment of a system - implemented method ( i . e . , method 100 )
`receiving a selected default watermark source . After receiv
`for embedding digital content within a digital photograph
`during capture of the digital photograph . It is disclosed 60 ing the default watermark source , or if the default watermark
`herein that the embedded digital content can be that in the
`source has already been selected , an operation 111 is per
`form of an icon , a logo , a string of text / numerals , a picture ,
`formed for determining the source of watermarks ( i . e . , the
`a photograph , and / or the like ( i . e . , generally refereed to
`default watermark source ) . As shown in FIG . 2B , selection
`herein as a watermark ) . In this regard , embodiments of the
`of a preferred watermark source can include be implemented
`present invention are not limited to any particular type of 65 via the visual display 204 of the smartphone 200 through
`embedding digital content . Furthermore , although the
`selection of a button 208 for choosing location - based water
`method steps described herein are discussed in a particular
`marks ( e . g . , as determined through use of a global position
`
`DETAILED DESCRIPTION
`
`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 18 of 24 PageID 89
`
`

`

`Case 3:20-cv-01157-M Document 1-4 Filed 05/07/20 Page 19 of 24 PageID 90
`
`US 10 , 102 , 601 B2
`
`includes determining a current location of the digital imag
`ing system to determine a current location of the smartphone
`ing device and using such location to retrieve entries from a
`200 ) as the default watermark source , through selection of a
`database of entries ( e . g . , places / destinations ) searchable by
`button 210 for choosing user - provided textual watermarks
`their global positioning system coordinates ( e . g . , those hav
`( e . g . , provided though manual entry of text by a user ) as the
`ing global positioning system coordinates that are within a
`default watermark source , or through selection of a button 5
`prescribed distance from the current location of the digital
`212 for choosing user - imported watermarks as the default
`imaging device ) .
`watermark source .
`After determining the available location - based watermark
`If it is determined that the source of watermarks is
`selections , an operation 118 is performed for displaying the
`manually entered watermark information ( e . g . , user - pro -
`vided textual watermarks , user - imported watermark , or the 10 available location - based watermark selections . As shown in
`like ) , an operation 112 is performed for requesting the
`FIGS . 2C and 2D , for example , a list of available registered
`watermark information ( e . g . , text or imported watermark
`watermarks 216 can be provided on a first location - based
`file ) , followed by an operation 113 being preformed for
`watermark page displayed in response to selection of a
`receiving the requested watermark information . Thereafter ,
`registered watermarks display button 217 and a list of
`an operation 114 is performed for creating the selected 15 available unregistered watermarks 218 can be provided on a
`watermark image using the received watermark information .
`second location - based watermark page displayed in
`For example , if the manually entered watermark information
`response to selection of an unregistered watermarks display
`specifies a text string ( e . g . , All Season Nursery Mandeville ,
`button 219 . It is disclosed herein that additional information
`La . ) , a watermark image is created by instantiating a water
`can be garnished by each one of the watermark selections .
`mark image template 300 with the watermark information , 20 In one example , hovering over a particular one of the
`as shown in FIG . 3 . As can be seen , in preferred embodi
`watermark selections causes supplemental information
`ments , the watermark image template 300 includes an water
`about it to be displayed and the particular one of the
`mark content portion 302 ( i . e . , an optically opaque portion
`watermarks is chosen by clicking / tapping on it . In another
`of the watermark image ) in which watermark information is
`example , clicking on a particular one of the watermark
`located and a captured image portion 304 ( i . e . , an optically 25 selections causes supplemental information to be displayed
`transparent portion of the watermark image ) in which visual
`and the particular one of the watermark is chosen by
`content captured by a digital imaging device is located . As
`clicking / tapping on a choose this watermark selection ' but
`discussed below in greater detail , the optically transparent
`ton that is displayed in conjunction with the supplemental
`portion of the watermark image allows a portion of an image
`information .
`in a background layer to be visible through the optically 30
`In preferred embodiments of the present invention , reg
`transparent portion of the watermark image .
`istered watermarks are maintained in a database of regis
`In preferred embodiments of the present invention , the
`tered watermarks that have respective location defining
`water