I lllll llllllll Ill lllll lllll lllll lllll lllll 111111111111111111111111111111111
`US0093 80282B2
`
`c12) United States Patent
`Abecassis
`
`(IO) Patent No.:
`(45) Date of Patent:
`
`US 9,380,282 B2
`*Jun. 28, 2016
`
`(54) PROVIDING ITEM INFORMATION DURING
`VIDEO PLAYING
`
`(76)
`Inventor: Max Abecassis, Boca Raton, FL (US)
`( * ) Notice:
`
`Subject to any disclaimer, the term ofthis
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 394 days.
`
`This patent is subject to a terminal dis(cid:173)
`claimer.
`
`(21) Appl. No.: 13/506,093
`
`(22) Filed:
`
`Mar. 26, 2012
`
`(65)
`
`Prior Publication Data
`
`US 2013/0251337 Al
`
`Sep. 26, 2013
`
`(51)
`
`(2006.01)
`(2006.01)
`(2011.01)
`(2011.01)
`(2011.01)
`(2011.01)
`
`Int. Cl.
`H04N5/92
`H04N9/87
`H04N21/422
`H04N211472
`H04N 2114725
`H04N211478
`(52) U.S. Cl.
`CPC ......... H04N9/8715 (2013.01); H04N 2114221
`(2013.01); H04N 2114725 (2013.01); H04N
`21147202 (2013.01); H04N 21147217
`(2013.01); H04N 21147815 (2013.01)
`( 58) Field of Classification Search
`CPC ......... H04N 9/80; H04N 5/445; H04N 5/765;
`H04N 5/783; H04N 5/85; H04N 9/8205;
`H04N 21/00; H04N 9/8042; Gl lB 27/105;
`GllB 27/329; GllB 27/034
`USPC .................................. 386/239, 241, 248, 250
`See application file for complete search history.
`
`(56)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`5,434,678 A
`5,596,705 A
`
`7/1995 Abecassis
`1/1997 Reimer et al.
`
`5,809,471 A
`6,192,340 Bl
`6,208,805 Bl
`6,263,505 Bl
`6,408,128 Bl
`6,504,990 Bl
`6,553,178 B2
`6,577,346 Bl
`8,402,500 B2
`8,494,346 B2
`8,645,991 B2
`2003/0037068 Al *
`200710250901 Al *
`2012/0210343 Al*
`2012/0311649 Al*
`
`9/1998 Brodsky
`212001 Abecassis
`3/2001 Abecassis
`7/2001 Walker et al.
`612002 Abecassis
`1/2003 Abecassis
`4/2003 Abecassis
`6/2003 Perlman
`3/2013 Walker et al.
`712013 Abecassis
`212014 Mcintire et al.
`............... 7071200
`212003 Thomas et al.
`.............. 725/146
`10/2007 Mcintire et al.
`8/2012 McCoy et al.
`.................. 725/25
`12/2012 Patten et al.
`.................... 725/97
`
`OTHER PUBLICATIONS
`
`Customplay LLC, Shopping, CustomPlay LLC Shopping website
`page www.customplay.com/Shopping.htm (C) 2009 Miami, FL
`USA.
`* cited by examiner
`
`Primary Examiner - William Tran
`
`(57)
`
`ABSTRACT
`
`An apparatus capable of, and a method comprising, the steps
`of: receiving, from a user during a playing of a feature-length
`movie, a request for item information relating to a product
`placement depicted within the feature-length movie; identi(cid:173)
`fying a request location that is responsive to the request for
`item information; searching a plurality of segment definitions
`to identify a segment definition that is responsive to the
`request location, a segment definition defines, responsive to a
`depiction of a product placement, a beginning and an ending
`of a video segment within the feature-length movie; display(cid:173)
`ing item information associated with a segment definition that
`is responsive to the request location; receiving from the user
`a request for additional item information relating to a dis(cid:173)
`played item information; and enabling a display of product
`placement purchase information in response to the request for
`additional item information.
`
`20 Claims, 10 Drawing Sheets
`
`Page 1
`
`AMAZON EX. 1001
`Amazon v. CustomPlay
`US Patent No. 9,380,282
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 1of10
`
`US 9,380,282 B2
`
`(100
`
`140
`
`100
`
`FIG. 1A
`
`FIG. 1 B
`
`Page 2
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 2of10
`
`US 9,380,282 B2
`
`(100
`
`101
`
`112
`113
`
`FIG. 1C
`
`FIG. 1 D
`
`Page 3
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 3of10
`
`US 9,380,282 B2
`
`101
`
`FIG. 1E
`
`100
`
`190
`
`112
`113
`
`Stripe Dress
`
`Top Hat
`
`FIG. 1F
`
`Page 4
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 4of10
`
`US 9,380,282 B2
`
`100
`
`140
`
`\.
`
`.........,,,,-----J
`201
`
`FIG. 2A
`
`217
`
`} 210
`
`L--+------+--+-----+----+------1--+----' } 220
`
`FIG. 28
`
`Page 5
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 5of10
`
`US 9,380,282 B2
`
`~------~~--300
`305
`301
`
`Q CABLE
`Q PHONE
`
`302
`
`307
`308
`315
`~__...--324
`313 _J_-=::;L~~~-
`314
`~-.......-303
`
`320
`
`304
`
`FIG. 3
`
`Page 6
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 6of10
`
`US 9,380,282 B2
`
`LAST
`RESPONSIVE 415
`ITEM DATA
`
`START
`
`401
`
`PAUSE
`11
`VIDEO PLAY
`....__--..-----' 4
`
`IDENTIFY
`REQUEST
`LOCATION
`
`412
`
`DISPLAY
`ITEM
`INFORMATION 416
`
`RESUME
`VIDEO
`PLAY
`
`431
`
`FIG. 4A
`
`Page 7
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 7of10
`
`US 9,380,282 B2
`
`START
`
`401
`
`M~~JR 402
`LOCATION
`
`PAUSE
`VIDEO PLAY 411
`
`'----~----'
`
`IDENTIFY
`REQUEST
`LOCATION
`
`412
`
`DISPLAY
`ITEM
`INFORMATION
`
`LAST
`RESPONSIVE 415
`ITEM DATA
`
`RESUME
`VIDEO
`PLAY
`
`431
`
`FIG. 48
`
`Page 8
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 8of10
`
`US 9,380,282 B2
`
`START
`
`SPECIFICATION 501
`
`PUBLISH
`SPECIFICATION
`
`511
`
`PROVIDE
`MAPPING
`CAPABILITY
`
`512
`
`TRAIN
`MAPPER
`
`515
`
`PROVIDE
`MAPPING
`SOFTWARE
`
`516
`
`USER
`MAPS
`
`513
`
`MAPPER
`MAPS
`
`517
`
`PUBLISH
`MAPS
`
`521
`
`PROVIDE
`QC
`CAPABILITY
`
`522
`
`QC MAPS
`
`523
`
`PUBLISH
`MAPS
`
`539
`
`PROVIDE
`QC
`SOFTWARE
`
`535
`
`INTERNAL
`QC MAPS
`
`536
`
`END
`
`FIG. 5
`
`Page 9
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 9of10
`
`US 9,380,282 B2
`
`Services
`provider
`
`602 communications module
`606 video sound
`607 multi-user
`608 multi-services
`611 system cpu
`612 memory
`
`MULTIMEDIA PLAYER
`600
`
`video/ 1,.__ __ f--"'-.,.......,
`data L---+-J:f~~+-tfL.~,_._:r~~~=:;il
`buffers 1-•---i--..,.""i
`615 ..U-----+->---i
`non(cid:173)
`volatile
`
`609
`power
`supply
`
`603
`fixed
`storage
`
`631
`user
`interface
`
`01 ..__ :___.1..........,....1
`
`641
`remote
`control
`
`642
`keyboard
`
`643
`voice
`recognition
`User Access
`
`'-----=:::-----1604
`removable
`storage
`
`FIG. 6
`
`Page 10
`
`

`

`U.S. Patent
`
`Jun.28,2016
`
`Sheet 10 of 10
`
`US 9,380,282 B2
`
`761
`
`712
`
`O[II]O
`
`711
`
`701 ~
`700 ~'734
`
`702
`D 752
`
`O[ILJO
`
`751
`
`FIG. 7
`
`Page 11
`
`

`

`US 9,380,282 B2
`
`1
`PROVIDING ITEM INFORMATION DURING
`VIDEO PLAYING
`
`RELATED U.S. APPLCIATION DATA
`
`This application is related to patent application Ser. No.
`13/506,099 filed on Mar. 26, 2012, titled Providing Item
`Information Notification During Video Playing.
`
`BACKGROUND OF THE INVENTION
`
`2
`passive viewing of a video, or the interactive playing of a
`video, as in the playing of a computer game, a primary ele(cid:173)
`ment of the "autoactive" systems and methodologies dis(cid:173)
`closed herein is the synergistic integration of a map of the
`content of the video with the playing of the video to satisfy the
`real-time informational interests of a user and to deliver a
`more informed and entertaining video viewing experience.
`Accordingly, it is an object of the present inventions to
`provide, during a playing of a video, with efficient access to
`10 information that identifies the purchasable item that is
`depicted in a segment within a video.
`It is also an object of a particular on of the present inven(cid:173)
`tions to provide, during a playing of a video, an indication that
`15 item information is available for an item being currently
`depicted within the video.
`It is also an object to associate the identification of the
`purchasable item with other information that may be avail(cid:173)
`able, internally or externally, for a selected purchasable item.
`It is also an object to provide for an appropriately labeled
`key on a remote control device for efficient access to the
`purchasable item information function.
`Briefly, these and other objects are accomplished by auto(cid:173)
`active capabilities and functions provided by systems com-
`25 prising, and methodologies utilizing processing, random
`accessing, and control software functions, integrated with
`video segment information, such as information that identi(cid:173)
`fies items that are depicted within the video. The creation of
`the segment information comprises the analysis of the content
`30 of a video to define segments within the video responsive to
`the depiction of a significant or noteworthy item. Segments
`may be associated with identifying information, purchase
`information, additional item information, information that
`35 may be retrieved from sources other than the video, and other
`descriptors relating to the depiction of that item. Each of the
`items is associated with an image of the item from the video,
`preferably a close-up shot featuring the item. In one of a
`number of inventions disclosed herein, during playing of the
`40 video, when a user desires to obtain information on an item
`depicted during a playing of a video, the user activates item
`notification routines that display an indication that item infor(cid:173)
`mation is available for an item being depicted; the user acti(cid:173)
`vates item identification routines by requesting item informa-
`45 tion relating to an item depicted within the video or in
`response to the a display indicating item information is avail(cid:173)
`able; the video is paused in response to the request for item
`information; a request location is identified that is responsive
`to the request for item information, the request location may
`50 also comprise a predetermined playing period prior to the
`request location; a plurality of segment definitions is searched
`to identify segment definitions that are responsive to the
`request location, a segment definition defines, responsive to a
`depiction of an item, a beginning and an ending of a video
`55 segment within the video, a segment definition is associated
`with item information; and item information associated with
`a responsive segment definition is displayed. If the user
`desires to obtain additional item information, additional item
`information is provided in response to the request for addi-
`60 tional item information, the additional item information may
`comprises item purchase information. Following a termina(cid:173)
`tion of a displaying of additional item information, playing of
`the video is resumed at the request location.
`This and other inventions, embodiments, features, advan-
`65 tages, and objects, are apparent in the context of the detailed
`description, accompanying drawings, and appended claims
`that follow.
`
`1. Field of the Invention
`Systems for, and methods of, providing, a user, during a
`playing of a video, an identification of a purchasable item that
`is depicted in the video. The source of the identifying infor(cid:173)
`mation is provided by a map of the video that identifies the
`items that are visually depicted within the video. The map of
`the video may be provided by the source that provides the
`video or by a source other than the source that provides the
`video. A source of the video may be a hard format such as a 20
`DVD or Blu-ray disc, or a soft format that is broadcasted,
`narrow casted, delivered on-demand, streamed, and/or down(cid:173)
`loaded by a variety of means such as over-the-air broadcast,
`cable, satellite, cellular, internet, and any other means of
`receiving content/data. The means for playing the video com(cid:173)
`prises any device capable of playing video such as, for
`example, an optical disc player, a personal computer, a set
`box, a multimedia player, gaming device, and/or smart phone.
`2. Description of the Related Art
`DVDs and Blu-rays are "optical discs" capable of storing
`one full length motion picture in one of two layers on either
`side of the disc. Optical discs generally provide scene selec(cid:173)
`tion and subtitles and/or closed captioning in a plurality of
`languages. Among other features, some optical discs include
`multiple camera angles for a scene, and the capability to play
`one of a plurality of different content versions (e.g. a direc(cid:173)
`tor's cut or unrated version and an "R" rated versions). Blu(cid:173)
`rays provide more advanced features such as a search func(cid:173)
`tion that list keywords corresponding to noteworthy names,
`items, and actions, and enable a user to select a keyword to
`retrieve segments matching the keyword selection.
`Devices capable of playing optical discs provide for,
`among other features, fast-forward, fast-rewind, skip-for(cid:173)
`ward or skip-backwards by chapters, turn on/off subtitles,
`subtitle and audio language selection, camera angle selection,
`and optical disc menu navigation to select, for example, mul(cid:173)
`tiple content versions.
`While the optical discs formats provide many capabilities
`and functions exceeding those provided by, for example, con(cid:173)
`ventional-linear playing formats, many of the capabilities and
`functions do not fully realize the potential of a random access
`video playing capability that is synergistically integrated with
`a map of the content of the video. Optical disc playing devices
`do not provide a readily accessible identification of purchas(cid:173)
`able item depicted in a segment within a video. These defi(cid:173)
`ciencies are not addressed by the many sources that may
`provide an identification of the purchasable items present in a
`video, including, for example, a variety of web sites, or vari(cid:173)
`ous sources that may identify purchasable items present in a
`video.
`
`BRIEF SUMMARY OF THE INVENTIONS
`
`The present inventions relate generally to system and
`methods for providing a user, during playing of a segment
`from within a video, an identification of a purchasable item
`that is depicted in that segment. By contrast to the usual
`
`Page 12
`
`

`

`3
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`US 9,380,282 B2
`
`4
`forthe form of expression, explicitness, the absence of objec(cid:173)
`tionable segments, content categories and levels, length,
`detail, subjects, versions, thematic content, and items.A set of
`content preferences also includes technical preferences and
`presentation preferences. In the broadest sense, the term con(cid:173)
`tent preferences further comprises video, prograniming, and
`subject matter preferences (collectively "prograniming pref(cid:173)
`erences"). Programming preferences refer exclusively to a
`user's preferences as to specific videos (e.g. Sega' s "Sherlock
`10 Holmes Consulting Detective"), types of videos (e.g. inter(cid:173)
`active video detective games), broad subject matter of videos
`(e.g. mysteries), and/or time and date that the user may desire
`to view a video. Prograniming preferences are principally
`directed at the selection of a specific video.
`The term "content-on-demand system" refers to a video-
`on-demand system that is responsive to a user's content pref(cid:173)
`erences. A content-on-demand system not only permits a user
`to obtain a specific video(s) or segment(s) of videos in
`response to the user's programming preferences, a content-
`20 on-demand system also permits the user to receive a version
`of the video(s) or segment(s) of videos that are responsive to
`the user's other types of content preferences. A content-on(cid:173)
`demand system and the delivery of variable content video
`services as described herein may utilize a variety of types of
`25 hardware and network infrastructure and are not limited to
`any particular hardware or network infrastructure that may be
`employed in a given implementation.
`The terms "descriptors" and "keywords" refer to words,
`terms, phrases, keywords, designations, codes, descriptors,
`30 labels, data, metadata, numbers, or other information that
`identifies, describes, categorizes, and/or provides informa(cid:173)
`tion. Descriptors and keywords comprise, for example, words
`that identify, describe, categorize, and/or provide information
`about an item depicted within a video.
`The term "dialog" refers to a dialog, conversation, mono(cid:173)
`logue, lyric, utterance, and/or communication. Dialog also
`comprises information that may be included in the subtitles or
`the closed captioning.
`The term "feature-length movie" refers to a feature-length
`40 movie, a feature-length motion picture, a full-length motion
`picture, full-length movie, feature movie, feature film, and the
`like. A feature-length movie is a video which runs for 40
`minutes or longer. Theatrically-released full-length movies
`released by a major motion picture studio generally exceed 80
`45 minutes. A feature-length movie does not require a particular
`format (e.g., digital, analog, dimension) or media/transport
`(e.g., film).
`The term "item" refers to: (i) items, products, objects,
`properties, acts, or information, whether or not they offer a
`50 commercial or purchase opportunity; (ii) items, products,
`objects, properties, acts, or information that constitute actual
`or potential product placements, whether prior to or after
`production of the video; (iii) product placements; and (iv)
`items, products, objects, properties, acts, or information, that
`55 offer informational or entertainment opportunities. The term
`"product placement" refers to: (i) items, products, objects,
`properties, acts, or information that offer a commercial or
`purchase opportunity; (ii) items, products, objects, proper(cid:173)
`ties, acts, or information that constitute actual or potential
`60 product placements, whether prior to or after production of
`the video; and (iii) product placements.
`The term "keywording" refers to associating descriptors
`and/or keywords.
`The term "network" herein refers to any private or public,
`65 wired or wireless video transmission infrastructure, such as
`may be provided by the utilization of one or a hybrid combi(cid:173)
`nation of the following: fiber optic, coaxial cable, twisted
`
`35
`
`The following drawing figures, which form a part of this
`application, are illustrative of embodiments of the present
`inventions and are not meant to limit the scope of the inven(cid:173)
`tions in any manner.
`FIG. lA is a representation of a video frame within a
`motion picture and the display of an indication that informa(cid:173)
`tion is available for an item being depicted;
`FIG. lB is a representation of a video frame within a
`motion picture and the highlighting of an item for which
`information is available;
`FIG. lC is a representation of a video frame with a display
`of item information;
`FIG. lD is a representation of a video frame following the 15
`video frame shown in FIG. lC;
`FIG. lE is a representation of a frame accurate display of
`item information;
`FIG. lF is a representation of a video screen where the
`display ofitem information is not superimposed on the video;
`FIG. 2A is a representation of a video frame within a video
`comprising a play control panel;
`FIG. 2B is a magnified representation of the play control
`panel shown in FIG. 2A;
`FIG. 3 is an illustration of a remote control device;
`FIG. 4A is a flow chart of a set of steps for providing a user
`item information for an item depicted in a video;
`FIG. 4B is a flow chart of a set of steps for monitoring the
`depictions of items within a video and providing a user an
`indication that item information is available;
`FIG. 5 is a flow chart of a method for creating a video map;
`FIG. 6 is a schematic diagram of a multi-featured multi(cid:173)
`media player; and
`FIG. 7 is a schematic diagram of a video provider and end
`user network architecture.
`
`DETAILED DESCRIPTION OF THE
`INVENTIONS
`
`U.S. Pat. Nos. 5,434,678; 6,192,340; 6,208,805; 6,408,
`128; 6,504,990; 6,553,178; and their respective divisions are
`incorporated herein by reference. Where a particular detail
`disclosed in an incorporated reference and a detail described
`here may appear inconsistent, the detail disclosed in the
`incorporated reference should be understood as an alternative
`detail description.
`For purposes of the present disclosure, various terms used
`in the art are defined as follows:
`The term "associated" refers to associated, linked, related,
`connected, brought into relationship, joined, designated,
`ascribe, and/or attributed.
`The term "character" refers to a role or a part in a video,
`and/or a participant in a video, typically displaying human(cid:173)
`like qualities.
`The term "chapter" refers to a division of a video generally
`defined by the author of the video. Optical discs, for example,
`typically have multiple chapters such as with DVDs, which
`often refer to a chapter as a scene.
`The term "clip" refers to a segment that is smaller than a
`chapter and usually smaller than a scene. A clip includes one
`or more contiguous shots, and usually depicts the same pri(cid:173)
`mary characters within a location. A clip's definition is
`responsive to a material change in the participation of the
`principal characters, a material change in location, and/or a
`distinct change in thematic content or topic of conversation.
`The term "content preferences" refers, specifically and
`principally, although not exclusively, to a user's preferences
`
`Page 13
`
`

`

`US 9,380,282 B2
`
`5
`copper wire, cellular, radio, satellite, and/or other existing
`and/or
`forthcoming video
`transmission
`technologies.
`Examples include a Broadband Integrated Services Digital
`Network ("B-ISDN") utilizing fiber optic cable in its primary
`trunks, a Digital Subscriber Line that provides high band(cid:173)
`width over twisted copper-pair phone lines, and the internet.
`In the broadest sense, a network also comprises the utilization
`of, for example, the U.S. Postal Service to deliver DVDs.
`The term "noteworthy" in connection with an item refers to
`an item that: (i) may be of interest to a significant audience; 10
`(ii) is noteworthy, remarkable, or compelling; (iii) is uncom(cid:173)
`mon, atypical, peculiar, unusual, unique, rare, or extraordi(cid:173)
`nary; (iv) is purchasable; and/or (v) is a product placement.
`The term "performer" refers to an individual, participant,
`actor, or actress, appearing in a video and/or credited for the
`physical and/or the verbal performance of a character. A
`performer refers to, for example, an actor in a motion picture,
`an athlete in a televised sporting event, a newscaster in a news
`program, and a chef in a cooking show.
`The term "playing", dos nor require a playing of the
`entirety of a segment or portion of a video and does not
`necessarily require that a playing of every aspect of the video,
`audio, sub picture, and/or bit of data of a frame or segment.
`The term "search terms" refers to terms, words, phrases, 25
`designations, codes, descriptors, labels, data, metadata, num(cid:173)
`bers, or other information that identifies, describes, or speci(cid:173)
`fies what is being searched.
`The terms "segment" and "video segment" refer to one or
`more video frames.
`The term "shot" refers to a sequence of video frames result(cid:173)
`ing from a single continuous run of a video camera.
`The term "user" as used herein is meant to include and be
`interchangeable with the words "player" (when referring to a
`person), "subscriber", and "viewer". That is, the term "user" 35
`is to be understood in the general sense of, for example, a
`person actively using video content, passively viewing a
`video, interactively playing a video game, retrieving video
`from a video provider, and/or actively using multimedia,
`interne, and/or communication services.
`The term "variable content video" refers to a video char(cid:173)
`acterized by a nonlinear architecture facilitating a variety of
`possible logical sequences of segments. A variable content
`video comprises segment information and parallel, transi(cid:173)
`tional, and/or overlapping segments. The parallel, transi(cid:173)
`tional, and/or overlapping segments may support, for
`example, objectionable content control and focused versions.
`A variable content video may also include a user interface,
`software program routines, and system control codes for con(cid:173)
`trolling the playing of the video/audio.
`The terms "video" and "video program" are interchange(cid:173)
`able and refer to any video image regardless of the source,
`motion, or technology implemented. Unless otherwise quali(cid:173)
`fied to mean a computer software program, the term "pro(cid:173)
`gram" is interchangeable and may be replaced with the word
`video. A video comprises images found in full motion picture
`programs and films, in interactive electronic games, and in
`video produced by multi-media systems. Video comprises
`still characters, graphics, images, motion pictures, films, and
`multimedia productions; feature-length movies, shorts, and
`television programming; news, sports, cultural, entertain(cid:173)
`ment, commercial, advertisements, instructional, and educa(cid:173)
`tional programming. As the context permits, a video may also
`comprise video, audio, sub picture information, a video map
`(e.g., navigation data), or other information associated with
`the video, such as a user interface, software program routines,
`and system control codes.
`
`6
`The terms "video map", "map", and "segment map", refer
`to a combination, arrangement, table, database, or listing of
`information comprising an identification of a beginning and
`ending of one or more segments and at least one descriptor
`associated with at least one segment or a sequence of seg(cid:173)
`ments. A video map comprises, for example, a combination,
`arrangement, table, listing, tables and fields, database, meta(cid:173)
`data, or xml file, or other data comprising segment informa(cid:173)
`tion.
`The term "video-on-demand system" refers to any video
`delivery system that is responsive to a user's progrannning
`preferences, i.e. provides a user-selected video at a user(cid:173)
`selected time. Video-on-demand comprises for example mov(cid:173)
`ies-on-demand, video dial tone, cellular video, and digital
`15 satellite systems that are responsive to a user's time and date
`preferences and that provide play control functionality in the
`viewing of a video.
`Where not clearly and unambiguously inconsistent with
`the specific context, these and other terms defined herein are
`20 to be understood in the broadest sense.
`The teachings herein with respect to a video may be applied
`to, for example, any type or kind of content that may be
`captured in a video format, including motion pictures, mov(cid:173)
`ies, television programs, news programs, sports programs,
`educational videos, advertisements, informational, commer(cid:173)
`cials, and other videos that promote products and services.
`While a particular feature may be detailed with respect to a
`specified type of video, it is intended to apply the teachings
`herein broadly and harmoniously across all different types
`30 and classes of video, including, for example, and not by way
`oflimitation, a variable content video and a variable content
`game.
`FIG. lA is a representation of a video frame within a
`motion picture and the display of an indication that informa(cid:173)
`tion is available for an item being depicted. The frame 100 of
`the video depicts three characters: a boy 110 holding balloons
`111, a girl 120 wearing a dress 121 and a man 130 wearing a
`hat 131. In this particular invention, the play location is moni(cid:173)
`tored for the presence of a purchasable item. The current play
`40 location within a video is monitored and a plurality of seg(cid:173)
`ment definitions is searched to identify a segment definition
`that is responsive to the play location. In the instance that a
`segment definition is responsive to the play location, and
`during the period defined by the segment definition, an indi-
`45 cation 140 is displayed that item information is available for
`an item or items being depicted. In this example, the indica(cid:173)
`tion is an icon of a shopping bag 140 superimposed in each
`frame of video during the period defined by the responsive
`segment.
`A segment definition defines, responsive to a depiction of
`an item, a beginning and an ending of a video segment within
`the video. A segment definition is associated with item infor(cid:173)
`mation. There are a number of different methods that may be
`implemented for a segment definition to define a beginning
`55 and an ending of a video segment within the video. For
`example, a segment definition may directly specify a begin(cid:173)
`ning point of a portion of content (e.g., a segment) within the
`video, and directly specify an ending point of a portion of
`content within the video. In a second example, a segment
`60 definition may directly specify a beginning point of a portion
`of content within the video, and indirectly specify an ending
`point of a portion of content within the video by specifying a
`duration of the portion of content. In a third example, a
`segment definition may indirectly specify a beginning point
`65 of a portion of content within the video and indirectly specify
`an ending point of a portion of content within the video, by,
`for example, individually specifying one or a plurality of
`
`50
`
`Page 14
`
`

`

`US 9,380,282 B2
`
`15
`
`7
`individual units of content (e.g., a video frame or a group of
`pictures). Accordingly, a segment definition may define,
`responsive to a depiction of an item, a beginning and an
`ending of a video segment within the video by, for example,
`specifying a single video frame. Such as segment consists of
`a single video frame. A video frame is any image or partial
`image in any digital or analog format comprising, for
`example, a frame of video, a video field, an I, B, or P frame.
`A video frame may comprise audio information. The term
`"specify" should be understood in the broadest sense and 10
`comprises the meaning associated with the following terms:
`detail, indicate, enumerate, stipulate, identify, and their
`respective synonyms. The terms "segment definition" and
`"segment definitions" should be understood in the broadest
`sense and comprises the meaning associated with the follow-
`ing terms: datum, data, information, and their respective syn-
`onyms.
`Similarly, there are a variety of methods for associating
`item information with a segment definition. For example,
`item information is associated with an item, the item is asso- 20
`ciated with a frame location where the item is depicted within
`the video, and the frame location is associated with a segment
`definition. In that example, item information is indirectly
`associated with a segment definition. Information associated
`with a segment definition does not require any particular 25
`direct or indirect methodology.
`A beginning and ending of a segment may be defined by a
`variety of means including, for example, time codes in a
`seconds and milliseconds format or an HH:MM:SS:FF
`(Hours, Minutes, Seconds, and Frames) format, bit positions,
`logical positions identifiers, or any format that can consis(cid:173)
`tently identify a location or position in a video. A segment
`definition may be individually responsive to a single depicted
`item or to multiple depicted items. In those instances where a
`segment definition is associated with only a single item. 35
`Advantageously, segment definitions may overlap but not
`necessarily congruently.
`An indication that item information is available for an item
`can take many forms, including, for example, text, actual
`images of the item, representations of the items, or anything 40
`visual or audio that would signal to the user that information
`is available on an item being depicted. For example, as is
`illustrated in FIG. lB, alternatively or additionally, the item
`being depicted for which information is available may be
`highlighted by an outline 141, or highlighted by an area of 45
`increased brightness as if a spotlight was focused on the item.
`Such an embodiment may implement item frame coordinate
`and dimension information associated with a frame identifier.
`A display of an indication that item information is available
`may be a generalized, categorized, individualized icon or 50
`other visual representation, or a picture of the actual item,
`extracted from within the video or external to the video. For
`example, a shopping bag icon may be displayed in connection
`with a purchasable item. A musical note icon may be dis(cid:173)
`played in connection with a purchase musical item, e.g., a
`song being currently played within the video. A travel icon
`may be displayed in connection with travel destination and
`accommodations information. An indication that item infor(cid:173)
`mation is available may be responsive to multiple items. For
`example, multiple shopping bags and musical icons may be
`contemporaneously displayed. In instances of multiple items,
`a shopping bag icon may include the depiction of a number to
`indicate the number of items at that location for which item
`information is available.
`The same noteworthy item may appear in multiple differ(cid:173)
`ent locations within a feature-length movie. In such a case
`multiple segment definitions are created, each responsive to
`
`8
`the particular de