(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2007/0003223 A1
`Armstrong et al.
`(43) Pub. Date:
`Jan. 4, 2007
`
`US 2007.0003223A1
`
`(54) USER INITIATED ACCESS TO SECONDARY
`CONTENT FROM PRIMARY VIDEO/AUDIO
`CONTENT
`
`(75) Inventors: James B. Armstrong, Agoura Hills, CA
`(US); Jorgen P. Makitalo, Agoura
`Hills, CA (US)
`Correspondence Address:
`BLAKELY SOKOLOFFTAYLOR & ZAFMAN
`124OO WILSHIRE BOULEVARD
`SEVENTH FLOOR
`LOS ANGELES, CA 90025-1030 (US)
`(73) Assignee: PhatCat Media, Inc.
`(21) Appl. No.:
`11/402,485
`
`(22) Filed:
`
`Apr. 11, 2006
`Related U.S. Application Data
`
`(60) Provisional application No. 60/670,042, filed on Apr.
`11, 2005.
`
`Publication Classification
`
`(51) Int. Cl.
`(2006.01)
`H04N 700
`(52) U.S. Cl. ................................................................ 386/95
`
`(57)
`
`ABSTRACT
`
`Embodiments of the invention allow viewers of video con
`tent to access more information about specific items in a
`Video segment are disclosed. The video content can be
`movies, video advertisements, TV programs, instructional
`videos, home videos, surveillance videos, or other video
`content. The embodiments pertain to content distributed by
`a standard digital versatile disc (DVD). The embodiments
`may involve a viewer Suspending (or “pausing”) the viewing
`of motion pictures from a DVD, and then allowing the
`viewer to access information about items in the video
`pertinent to the scene where the video was suspended.
`
`#210
`
`it.211
`
`First play
`
`it 2-67
`/11
`End video (t=n)
`
`Chapter 3
`
`Chapter N
`
`/2
`
`a's
`//
`
`|
`
`Start video (t=0)
`
`T.
`A
`
`Chapter 1
`
`Start chapter 2
`End chapter 2 / Beginning Chapter 3
`23 — Chapter 2 --- Chapter3
`
`220
`
`
`
`
`
`
`
`A paused frame
`of scene 1-207
`
`Menu 1-208
`
`#216
`Start scene 3 Frame #1
`
`V /
`w
`
`#217
`End scene 3 Frame M
`
`221
`
`I Scene 3 frames a - a -
`
`- - - III
`
`7
`
`
`
`Video frames
`211
`
`A paused frame
`of scene 3-227
`
`224
`
`Page i
`
`AMAZON EX. 1021
`Amazon v. CustomPlay
`US Patent No. 9,380,282
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 1 of 8
`
`US 2007/0003223 A1
`
`
`
`#100
`
`#102
`
`... light jacket 2. Scarf 3. Sweater 4. restaurant 5, wine 6. holel 7. Wrist watch -
`
`#104
`
`FIGURE A
`
`Page ii
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 2 of 8
`
`US 2007/0003223 A1
`
`#10
`
`
`
`Resume
`
`#105
`
`#1 10
`
`ill
`
`# 2
`
`#113
`
`il 14
`
`FIGURE 1B
`
`Page iii
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 3 of 8
`
`US 2007/0003223 A1
`
`#210
`l
`
`
`
`#211
`
`Start video (t=0)
`
`
`
`at 2-62
`/11
`
`End video (t=n) y
`
`Chapter N
`
`#214
`
`#202
`
`Chapter 3
`
`Ay
`/
`a
`?/
`
`#212
`
`
`
`
`
`
`
`Start chapter 2
`
`End chapter 2 / Beginning Chapter 3
`
`#213 — —- hapt
`
`Chapter 2
`
`Chapter 3
`
`#220
`
`
`
`
`
`A paused frame
`of scene 2-204
`
`-
`
`
`
`
`
`
`
`A paused frame
`of scene 1-207
`
`sg,
`
`- #206
`
`Menu 1-208
`
`#224
`
`#216
`Start scene 3 Frane #1
`
`A
`V /
`
`#217
`End Scene 3 Frame M
`
`221
`
`
`
`e I w a Scene 3 frames w
`
`w w y I
`
`Video frames
`#211
`
`FIGURE 2A
`
`
`
`
`
`A paused frame
`of scene 3-227
`
`# 200 =e
`
`224
`
`Page iv
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 4 of 8
`
`US 2007/0003223 A1
`
`Start scene frame #6600
`(or GOP frame index
`time code 01.10.00.00)
`
`Video frames
`#700
`
`V
`
`X C
`
`l
`
`If frame count is
`6600-8400
`of scene 4
`
`... scene 4 frames.
`l
`
`If frame count is
`8401-10200
`of scene 4
`
`End Scene frame #12000
`(or GOP frame index time
`code 01.13.00.00)
`
`V
`
`If frame count is
`10201 - 12000
`of scene 4
`
`
`
`Background frame
`#7500 of Scene 4
`
`Background frame
`#9301 of scene 4
`
`Background frame
`# 11 100 of scene 4
`
`FIGURE 2 B
`
`Page v
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 5 of 8
`
`US 2007/0003223 A1
`
`#300
`
`Paused frame Chapter 2, Scene 4
`#317
`
`Menu area
`#318
`
`
`
`#310
`
`#311
`
`#312
`
`#313
`
`#314 #315 #316
`
`FIGURE 3
`
`Page vi
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 6 of 8
`
`US 2007/0003223 A1
`
`
`
`
`
`
`
`Text
`overlay
`410
`
`
`
`
`
`
`
`#414
`
`Paused Video frame area #413
`
`\
`N
`
`Wardrobe
`
`(Shirt) Armani
`(Suite) Hugo Boss
`(Hat) Stetson
`(Belt) Stetson
`(Shoes) Gucci
`
`Mrs. Smith
`
`(Blouse) Old Navy
`(Suite) Hugo Boss
`(Hat) Follette
`(Coat) Armani
`(Shoes) Tom King
`(Shawl) Hermes
`
`FIGURE 4
`
`#411 #412
`
`Page vii
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 7 of 8
`
`US 2007/0003223 A1
`
`#517
`
`
`
`#515
`
`its 4
`
`52d
`
`#514
`
`#513
`
`WWW.Arman
`Mr. Smith's shirt
`Available at:
`Model # 22342
`Nordstom
`Price S67
`www.amani/mod/22342 Macy's
`Discount code #444
`Other Armani products
`Jacket
`
`Pants
`
`Play Armani video
`Motion
`video button
`
`S 236
`www.armani/mod/7638
`
`www.armani/mod/2332
`
`Page viii
`
`

`

`Patent Application Publication Jan. 4, 2007 Sheet 8 of 8
`
`US 2007/0003223 A1
`
`
`
`Soundtrack
`Artist: Johnny Cash
`Song: Trouble
`S1.99
`Album title: Bounty
`S13.99
`Download at: www.tunes.com
`
`Other Johnny Cash albums products
`Abcd
`Xyz
`RStu
`
`www.record.com
`Available at: Tower record
`
`-
`Play music video
`Button
`
`#610
`
`# 1
`
`h 12
`
`FIGURE 6
`
`Page ix
`
`

`

`US 2007/0003223 A1
`
`Jan. 4, 2007
`
`USER INITIATED ACCESS TO SECONDARY
`CONTENT FROM PRIMARY VIDEO/AUDIO
`CONTENT
`
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`0001. This application claims priority of U.S. Provisional
`Patent Application Ser. No. 60/670,042 filed Apr. 11, 2005
`entitled “User Initiated Access to Secondary Content from
`Primary Video/Audio Content.”
`
`FIELD
`0002 Embodiments of the invention relate to accessing
`Supplementary information (e.g., advertising, instructional,
`historical, product information) related to the primary video/
`audio information (e.g., items, objects, goods, services,
`Songs, audio, situations, and geographical information) con
`tained on a Digital Versatile Disc (DVD).
`
`BACKGROUND
`0003. In broadcast media, only the primary content is
`available to viewers. For example, if one is watching a
`television program and is interested to know what music is
`playing in the background, there is no way to find out unless
`it is explicitly mentioned or a vast amount of research is
`done. This has led to the growth of the product placement
`business, where a manufacturer is willing to pay the pro
`ducer to place its product (e.g., car, watch, hotel) in a video
`production. The producer is responsible for adapting the
`video content or the script to identify clearly the placed
`product.
`0004 There are two shortcomings with the product place
`ment model. The first is that the script or video content must
`be adapted to force the product information into the “pri
`mary content. Directors and actors often complain that the
`artistic integrity of the video production is compromised.
`Screen shots of logos are annoying and obvious to viewers.
`The second shortcoming is that only a limited amount and
`type of product information can be included, because it has
`to be part of the primary content. For product placement
`advertisement, this usually means two or three items per
`movie are placed. Similarly, the type of product information
`is typically restricted to showing or using a product. The
`viewer, however, may be quite interested in additional
`amounts and/or types of information than that which was
`included in the product placement.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`0005 The various embodiments of the present invention
`are illustrated by way of example, and not by way of
`limitation, in the figures of the accompanying drawings and
`in which:
`0006 FIG. 1A is an example view of suspended video/
`audio stream primary video content of a DVD with a menu
`overlay that allows the traversal of a menu structure hier
`archy to retrieve secondary information for the scene.
`0007 FIG. 1B is another example view example of
`Suspended video/audio stream primary video content of a
`DVD with a menu overlay that allows the traversal of a
`menu structure hierarchy to retrieve secondary information
`for the scene.
`
`0008 FIG. 2A is an example of a hierarchical description
`showing related primary video content, menus, video chap
`ters, Scenes and frames.
`0009 FIG. 2B shows an example of index pointers with
`background frames of a scene.
`0010 FIG. 3 is an example of how the video screen will
`appear when the “menu' or “pause” button on the DVD
`remote control is pressed.
`0011
`FIG. 4 is an example of a text menu page appearing
`after the “wardrobe’” button in FIG. 3 is asserted.
`0012 FIG. 5 is an example of types of description and/or
`information a manufacture’s product page could access or
`provide.
`0013 FIG. 6 is an example of types of description and/or
`information a Soundtrack menu page could access or pro
`vide.
`
`DETAILED DESCRIPTION
`0014) Reference in the specification to “one embodi
`ment” or “an embodiment of the present invention means
`that a particular feature, structure or characteristic described
`in connection with the embodiment is included in at least
`one embodiment of the present invention. Thus, the appear
`ances of the phrases “in one embodiment,”“according to one
`embodiment’ or the like appearing in various places
`throughout the specification are not necessarily all referring
`to the same embodiment.
`00.15
`Descriptions herein include methods, apparatus
`and systems for allowing viewers of video content to access
`more information about specific items in a video segment
`are disclosed. The video content can be movies, video
`advertisements, TV programs, instructional videos, home
`videos, surveillance videos, or other video content. The
`embodiments pertain to authoring of data-files (e.g., files, a
`file-set, an “image' and/or other data authored or otherwise
`created to produce a DVD from) for producing, and devices
`including or storing video content. Some embodiments
`pertain to video content such as content distributed by a
`standard digital versatile disc (DVD), High definition DVD,
`flash drives, Hard-drives and the like that can be authored,
`data-files can be created, and/or can store video content,
`such as in a DVD format or the like. The embodiments may
`involve a viewer Suspending (or “pausing) the viewing of
`motion pictures from a DVD or other video source, and then
`allowing the viewer to access information about items in the
`video pertinent to the scene where the video was suspended.
`0016 Specifically, interactive media of video sources,
`such as DVD media, allows the viewer to indicate his/her
`interest in secondary content. This allows the viewer to
`immediately retrieve secondary content or information
`about the primary content without the restrictions of the
`current product placement methodology. No logo shots or
`extra information need to be forced into the primary content
`and thus the artistic integrity of the primary content, movie,
`artist, actors, writers, etc. is preserved. As a result, an
`abundance of secondary information can be made available
`to the viewer at the most relevant place in the video stream
`of the primary content.
`0017. In the following description, numerous specific
`details such primary video content and play thereof iden
`
`Page 1
`
`

`

`US 2007/0003223 A1
`
`Jan. 4, 2007
`
`tifying items or content in the primary video content, index
`ing primary video content, menu structure and creating
`thereof, secondary content and display thereof, video scenes,
`Video frames, background frames, items or content in a
`frame or scene, Suspending a video at a point in time,
`resuming play of a suspended video are set forth to provide
`a thorough understanding of embodiments of the invention.
`It can be appreciated that these descriptions apply to
`embodiments in various forms including as methods, appa
`ratus, Systems, and the like applicable to video source
`authors, producers, users, viewers, and the like. Herein
`reference to a user, viewer, person, he, she, and the like may
`be synonymous with respect to performing processes related
`to authoring a DVD and/or with respect to performing
`processes related to viewing or playing a DVD.
`00.18 Embodiments of the invention allow viewers of
`on-demand and/or DVD video content to access more infor
`mation about specific items in a video segment. The video
`content can be movies, video advertisements, television
`(TV) programs, instructional videos, home videos, Surveil
`lance videos, or other video content.
`0019. One manifestation of the embodiments is depicted
`in FIGS. 1A and 1B. FIGS. 1A and 1B are graphic view
`examples of Suspended video/audio stream primary video
`content of a DVD with a menu overlay that allows the
`traversal of a menu hierarchy to retrieve (e.g., display or
`access) secondary information or content (in this case,
`product information) in the scene. In this particular mani
`festation, a person is watching a movie on a DVD. He/she
`presses the “pause' or "menu button on the remote and the
`playback of the movie is suspended and the last viewed
`frame or scene (e.g., a scene may or may not correspond to
`a chapter, Such as by being Smaller than, the same size as, or
`larger than a chapter) is displayed (for Some configurable
`amount of time and/or until the movie is resumed). As
`shown, displays #100 and #101 display frames #102 and
`#103 (e.g., a last viewed frame when the button was pushed)
`above menus #104 and #105 in FIGS. 1A and 1B, respec
`tively. FIG. 1A shows frame #102 having a “pause indicator
`and bottle of wine 106. FIG. 1A also shows menu it 104
`including buttons (e.g., selections) 1 light jacket, 2 Scarf, 3
`sweater, 4 restaurant, 5 wine, 6 hotel, and 7 wrist watch.
`FIG. 1B shows frame #103 having character 115; and menu
`#105 including buttons Location #110, Wardrobe #111,
`Accessories #112, Props #113, and Resume #114. This may
`be the result of pressing the “pause” button today on a DVD
`player. Another manifestation would be to have a fixed
`background picture (e.g., a pre-selected frame of the frames
`of the scene), which is a representation of the current scene.
`However, in this manifestation, a partial overlay appears on
`the screen that itemizes products within the scene about
`which the user can get more information. As shown, menus
`#104 and #105 in FIGS. 1A and 1B respectively, may
`overlay a lower or bottom portion of displays #100 and #101
`(a portion that is or is not displaying video content or frames
`#102 and #103). For example, if the user highlights and then
`Selects item #5 of menu H104 in FIG. 1A for the wine in the
`scene, information about the wine is displayed to the user
`(e.g., information describing the manufacture, year, grape
`variety, type of wine, cost, and where/how to purchase the
`wine, such as from a restaurant or store). Similarly, for
`example, in FIG. 1B if the user highlights and then selects
`item “Location, #110, in the scene, information about the
`
`location is displayed to the user (e.g., information describing
`the establishment, business, city, State, country, continent,
`and the like).
`0020. The way this information is displayed can vary.
`One approach would be to replace the current overlay with
`another partial overlay that briefly describes the wine or
`location in FIGS. 1A and 1B, respectively (e.g., an overlay
`of frames #102 and #103 or menus #104 and #105. Another
`approach would be to replace the entire video frame with
`another frame that describes the wine or location. Yet
`another approach would be to run another video that further
`describes the wine or location (i.e., hotel) in a more com
`pelling way. In fact, for each product thus indexed in a scene,
`an entire navigational tree of static descriptions, video
`images (JPEGs, MPEG stills, or other similar formats), or
`full motion video clips can be used. For example, if
`#111“Wardrobe' is selected, the next menu to appear can
`identify a number of characters in the scene. The user could
`then select the character and information about the charac
`ter's wardrobe appears. Music can also be incorporated into
`the navigation or menu for the secondary content. For
`example, the DVD user may want to know what music is
`being played during the scene. By selecting the music option
`of the menu for the secondary content, a brief part of the
`Song or audio track can play and information about com
`poser, identification of the piece of music, performers,
`conductor, studio, location of performance, type of music,
`instruments, and the like, appears. Thus multiple levels of
`indirection can be employed to provide secondary informa
`tion about objects, situations, people, goods, services, items,
`history, locations, buildings, address, processes (e.g., how to
`construct, prepare, cook, use, and perform other processes),
`and the like, in the primary video clip or content. In
`advertisement applications, this could ultimately be used to
`purchase the product through the TV (i.e., t-commerce)
`interface. Initially, it envisioned that a product code is
`displayed, which a user can enter into a web site online
`purchase form or over the telephone to buy the product
`(possibly at a discount that is specific to the secondary
`content being viewed).
`0021 One important aspect of embodiments of this
`invention is that the user initiates the interruption of the
`primary video clip to get the secondary information. There
`is nothing added to the original video or audio components
`of the primary video to accommodate embodiments of this
`invention. Thus, the implementation of embodiments of this
`invention will not alter the playback of the primary video
`content in any way, until the user initiates the interruption.
`This feature is important to the content creator for a number
`of reasons (artistry, story clarity, graphics production, audio
`production, video information, audio information, synchro
`nization of video information and audio information, and the
`like).
`0022. However, according to embodiments, in some
`Video (e.g., in an educational application) there may be
`indications or prompts appearing on Screen or audio during
`playback that secondary information is available. For
`instance, there may be application of Such indications or
`prompts for educational, instructional, learning video etc.,
`were indicators appearing on screen are desirable to show
`that secondary information is available during certain epi
`sodes (e.g., Scenes) of video playback. Examples of visual
`indicators could be but not limited to, icons, text, menus,
`
`Page 2
`
`

`

`US 2007/0003223 A1
`
`Jan. 4, 2007
`
`watermarks, figures, flashing, scrolling banners or Solid
`appearances and the like, to draw attention to viewer. Audio
`indicators can also be considered during video playback that
`secondary information is available. Examples of Such indi
`cators may be music clip, audio tones, voice, chimes, and the
`like. This implies that embodiments of the invention pertain
`to a video-viewing environment that is interactive, like
`DVD.
`0023 Embodiments of this invention encompasses a
`multitude of manifestations, one of which is described
`above. A few other manifestations are described in this
`paragraph. In the above description the “pause” button is
`pressed. This could be another button, like the “menu
`button. In addition, a fixed background can be used when the
`button is pressed instead of “freezing the current frame. In
`addition, upon pressing the button, the video does not have
`to pause but can keep playing with an overlay displayed as
`well. While this affects the playback of the original video
`clip, it was user initiated. As new items are introduced in the
`primary video, indices to them can be added as they appear
`in the scenes. Also, in the manifestation described above, the
`overlay only contains an index of items in the current scene.
`However, this can be generalized to any duration video
`segment, which can be a single frame or the entire primary
`Video content.
`0024. A natural extension to embodiments of this inven
`tion that is covered in this application is to use “hot spots.”
`When the user presses the “pause” or "menu button, a still
`image from the scene would appear. The DVD is authored
`so that certain items in the scene are “hot spots” so that the
`user can navigate to an item in the image and select it. For
`example, instead of selecting #5 in FIG. 1A or “Wardrobe'
`in FIG. 1B to get information about the wine or what a
`character is wearing, the user can navigate to the bottle or to
`the character (e.g., James Bond) in the image and select the
`bottle 106, or character 115 in FIGS. 1A and 1B, respec
`tively (such as by navigating using arrows, UP/DOWN,
`LEFT/RIGHT or joystick interface on a remote control or a
`mouse). Then information about the wine or character's
`tuxedo, watch, shoes, glasses, wallet, jewelry, clothes, cell
`phone, computing devices, communications devices (e.g.,
`radio, cell, point to point, telephone, satellite and other
`communications devices), cosmetics, hair, other aspect of
`his appearance, actions, and/or statements, and the like
`would appear. This would also work for many of the other
`objects in the scene (e.g., characters, furniture, cars).
`0.025 To return to the primary content, the user can select
`the resume item on the screen and the video continues from
`the point it was suspended. It is also possible for the user to
`select a button on the remote (like “menu' or play) to
`continue from the point of Suspension. Thus, embodiments
`of the invention pertain to any user-initiated approach to
`access secondary information from a primary video clip or
`content, which does not affect the playback viewing of the
`primary content unless initiated by the viewer.
`0026. When a DVD is created (e.g., authored to create a
`fileset (e.g., a DVD set of files, fileset or “image') including
`data for producing a DVD disk), movie or program Scenes
`are divided into video "chunks' called cells. The cell is the
`fundamental video/audio sequence on the DVD disk. The
`author can specify commands to execute prior to or after
`each cell. One implementation of embodiments of the inven
`
`tion would be to add commands prior to each cell that
`specifies which overlay to use if a “pause' command is
`received during the playback of the cell. This may be done
`through a “linkPDC command. When “pause' is pressed
`the “linkPDC command is executed to branch control to the
`PDC, based on a conditional statements stored in the GPRM
`and/or SPRM registers, that will display the “menu of items
`associated with the cell (e.g., a portion of Sub-menu of a
`menu structure for the primary video content that provides
`access to secondary content, Such as on a scene by scene
`bases). At this point, the PDC may be authored using
`standard DVD practices to create a navigation tree of
`secondary content with one exception. When the “button' is
`pressed (e.g., when “pause' is pressed a second time), the
`PDC is exited and the control is passed back to the cell that
`was last played back to the user (e.g., thus, resuming play of
`the primary video content at that cell). This again is done
`using the “linkPDC command. Thus, the standard virtual
`DVD command set can be used (with off-the-shelf DVD
`authoring programs) to implement embodiments of the
`invention. Some examples of DVD authoring software tools
`to use to implement embodiments of this invention are
`Scenarist, “DVD producer HD by Sonic solutions, DVD
`lab Pro V 1.5 by MediaChance and other authoring software
`tools. These software tools are industry standard tools that
`operate on a personal computer. Many other implementa
`tions are possible using the flexible command set of the
`DVD (e.g., of the DVD specifications and authoring tool
`capabilities) in addition to the one described here. Those
`implementations are also covered under this application.
`0027 According to embodiments, items in a primary
`video content may be identified, for which secondary con
`tent will be created describing content of scenes of the
`primary video content. The primary video content may be a
`movie, DVD, or television (TV) program, having items,
`goods, services, and Songs for which secondary content will
`provide information or descriptions, such as to allow a
`viewer to purchase the items, goods, services and Songs. The
`secondary content is then created. Next, a menu structure
`that allows access to the secondary content is built or
`created. The primary video content, menu structure and
`secondary content can then be used to author a DVD.
`Specifically, the DVD primary video content may be
`authored with the menu, primary and secondary content to
`allow the presentation of the menu to access secondary
`content by Suspending presentation of the primary content at
`a point of Suspension. The authoring may allow resumption
`of the presentation of the primary content at the point of
`Suspension.
`0028. According to embodiments, primary video content
`and secondary content may include various types of video
`data (e.g., standards, such as NTSC, PAL, SIF (Source Input
`Format or Standard Interchange Format) and the like),
`compressed video (e.g., according MPEG or JPEG or other
`Video compression standards, coded video, compiled video,
`authored audio and/or video information. Moreover, the
`“content of the primary video content may include video of
`scenes, frames, actors, locations, props and the like of
`movies, shows, programs, and the like. Also, secondary
`content may include description text, audio, video, and/or
`graphics of the content of the primary video content (e.g.,
`goods and services shown in the primary video content).
`Thus, the secondary information can be information and/or
`types of information in addition to information that identifies
`
`Page 3
`
`

`

`US 2007/0003223 A1
`
`Jan. 4, 2007
`
`the product, Such as historical information about a person or
`situation, instructional information (e.g., how to make, use,
`cook, repair, etc.), or any related information to a situation,
`person, Song, location, good, service or object in the video
`COntent.
`0029. The menu structure and secondary content can be
`information or data that is not included in or part of the
`primary content (e.g., not included in the “fileset' or
`“image' to be used to produce a DVD (e.g., “burn”, “press'.
`or otherwise create a physical DVD having digital code
`thereon)). For instance, it may not be necessary to change
`the video information or audio information of the primary
`video content at all when authoring the DVD to include the
`menu structure and secondary content. Thus, during play, the
`video information or audio information of the primary video
`content will look and Sound the same (e.g., to a viewer or
`user of a DVD produced using the fileset) for DVD authored
`with and without the menu structure and secondary content.
`0030 FIG. 2A is a hierarchical description relating to
`menus and video chapters, Scenes and frames. FIG. 2A is a
`diagram showing an example of how embodiments of this
`invention’s menu structure can be built or implemented prior
`to or during the DVD authoring process. For instance, the
`menu structure of movie, show or movie #201 can be built
`or implemented using standard DVD authoring tools, such
`as Scenarist, Sonic (e.g., Sonic(R) DVD ProducerTM HD, My
`DVDTM 8 for Windows XP or Toast(R) 7 Titanium for Mac
`OS X, all by Sonic solutions of Novato, Calif., USA),
`DVDlab (e.g., DVD-lab Pro v1.5 or Studio 1.1, both by
`Mediachance of Ottawa, Canada) and the like. Stream #202
`(e.g., a stream of primary video content) includes first play
`#210 of movie #201. Play 210 may play automatically when
`a DVD is placed in a DVD player. An example of were the
`Video chapter indexing program code (e.g., the menu struc
`ture of the primary content for this authored DVD, which
`may be used to display the menu structure and provide
`access to secondary content as describe herein) is located is
`in Root Menu i211 which allows users to start a video at
`different chapters if desired. Menu #211 may be a location
`where the menu structure of embodiments of the invention
`will exist when authored as data to be stored and/or when
`stored on a DVD. Chapters, chapter 1#212 and chapter
`2#213 show different chapters with Chapter N #214 being
`the last chapter of the movie. Here, “N' may be a number
`between 1 and infinity (typically between 10 and 200, such
`as 1, 2, 4, 8, 10, 20, 40, 80, 100, 200, 400, 800 or a
`combination thereof) that represents a variable number
`depending on how long the video is. Stream #220 (part of
`stream #202) show an example of how a Chapter 2 #213
`may be broken down in to a number of scenes, from scene
`1, Scene 2 to scene N depending how long the video movie
`#201 is. Stream #221 shows an example of how Scene
`3 #223 may include video frames #211. Frames #211 may
`include start frame #216 and end frame #217 of scene 3223.
`Examples in how to determine were the scene start and ends,
`is using MPEG group of pictures (GOP) time code indexing
`or frame count indexing or similar time or frame indexing.
`For examples, see FIG. 2B.
`0031
`FIG. 2A also shows display #203 including paused
`frame 204 of Scene 2 of chapter 2 and corresponding menu
`205 (e.g., corresponding to scene 2 and/or frame 204;
`display #206 including paused frame 207 of scene 1 of
`chapter 3 and corresponding menu 208 (e.g., corresponding
`
`to scene 1 and/or frame 208); display 200 including paused
`frame 227 of scene 3223 and corresponding menu 224 (e.g.,
`corresponding to scene 3 and/or frame 227). Display #200
`show an example of a Suspended frame, which may be an
`original and/or a background frame (e.g., See FIG. 2B),
`displayed on a monitor or display (Such as a television, HD
`television, computing device monitor or any other monitor
`capable of displaying video content). Menu 3#224, may
`include content or menu choices/selections that appear when
`the video (e.g., movie #201) is paused. Thus, menu 2#224,
`or choices thereof, may be determined according to which
`scene the video was playing, therefore making the menus
`dynamic. Dynamic menus may be described as menus that
`allow Suspension of the primary video at points of Suspen
`sion within Scenes to display secondary content for that
`scene where one or more points of Suspension for a scene
`may or may not be pre-selected (e.g., prior to authoring the
`DVD). For instance, the dynamic menus may provide a
`different menu (e.g., a portion or Sub-menu of the menu
`structure) for each scene to access different secondary con
`tent for each scene. In some cases, Some of these menus and
`secondary content may be the same for adjacent scenes or
`scenes that are not adjacent. More particularly, a point of
`Suspension may be defined by one or more indexes,
`counters, registers (e.g., SPRM (system parameter registers)
`and/or GPRM (general purpose registers)), register counts,
`points in time, time indexes, memory addresses, and/or data
`locations (physical or virtual). For instance, a Sub-menu or
`portion of the menu structure may be correlated with,
`associated with, or otherwise related to a scene or frame of
`the primary video content by one or more SPRM (system
`parameter registers), GPRM (general purpose registers),
`time indexes, memory address, and/or locations (physical or
`virtual) of graphics or audio information or data of the
`primary video content. Similarly, the secondary content may
`be correlated with, associated with, provide information
`about, describe, or otherwise related to a scene or frame (or
`content thereof) of the primary video content by the sub
`menu or portion of the menu structure for that scene or
`frame. Also, note that chapters, Scenes, and frames of the
`primary content shown may or may not be consecutive
`sequences of content (e.g., they may have gaps in time,
`index, and/or register count there-between). Such as depend
`ing on the quality and type of data of the primary content.
`0032 Secondary content may be described as or include
`“more information”, “supplementary information”, “sec
`ondary information” related to the primary video and/or
`audio information contained on a Digital Versatile Disc
`(DVD). Secondary content may include information in
`addition to that shown or played in video information (e.g.,
`images, frames, scenes, pictures, items) and/or audio infor
`mation (e.g., Songs, music, Sound byte, Sound effect, Sound
`even, Sound wave (.wav) file, Sound Scheme, and the like) of
`a video source. Secondary content may be in a text format,
`a still image display, a JPEG image, video content, an
`MPEG 2 clip, audio content, an MP3 clip, an MPEG 4 clip,
`a JPEG2000 image, or any content compliant to that speci
`fied in DVD book B and C of DVD Format/Logo Licensing
`Corporation (or an