( 12 ) United States Patent
`Strober
`
`US 11,086,934 B2
`( 10 ) Patent No .:
`( 45 ) Date of Patent :
`Aug. 10 , 2021
`
`US011086934B2
`
`( 54 )
`
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`( 71 ) Applicant : Touchstream Technologies , Inc. ,
`Valhalla , NY ( US )
`( 72 ) Inventor : David Strober , Rye , NY ( US )
`( 73 ) Assignee : Touchstream Technologies , Inc. ,
`Valhalla , NY ( US )
`Subject to any disclaimer , the term of this
`patent is extended or adjusted under 35
`U.S.C. 154 ( b ) by 0 days .
`( 21 ) Appl . No .: 16 / 917,095
`( 22 ) Filed :
`Jun . 30 , 2020
`( 65 )
`Prior Publication Data
`Oct. 22 , 2020
`US 2020/0334291 A1
`
`( * ) Notice :
`
`Related U.S. Application Data
`( 63 ) Continuation of application No. 15 / 687,249 , filed on
`Aug. 25 , 2017 , now Pat . No. 11,048,751 , which is a
`( Continued )
`
`( 51 ) Int . Ci .
`G06F 3/01
`G06F 16/74
`
`( 2006.01 )
`( 2019.01 )
`( Continued )
`
`( 52 ) U.S. Cl .
`CPC
`
`G06F 16/74 ( 2019.01 ) ; G06F 9/452
`( 2018.02 ) ; G06F 16/951 ( 2019.01 )
`( 58 ) Field of Classification Search
`GO6F 16/74 ; GO6F 9/452 ; G06F 16/951
`CPC
`See application file for complete search history .
`
`( 56 )
`
`CN
`CN
`
`References Cited
`U.S. PATENT DOCUMENTS
`8/1989 Hayes et al .
`4,855,842 A
`5,613,137 A
`3/1997 Bertram et al .
`( Continued )
`FOREIGN PATENT DOCUMENTS
`
`9/2009
`101534449 A
`101577650 A 11/2009
`( Continued )
`
`OTHER PUBLICATIONS
`“ AnyRemote ” , Retrieved from Internet URL : http : // anyremote .
`sourceforge.net/ , pp . 2 ( 2013 ) .
`( Continued )
`Primary Examiner Tadesse Hailu
`Assistant Examiner Darrin Hope
`( 74 ) Attorney , Agent , or Firm — Shook , Hardy & Bacon
`L.L.P.
`( 57 )
`ABSTRACT
`A system for controlling playback of various types of
`content includes a first computing device that provides a
`unique identifier to a second computing device to establish
`an association there between . By virtue of the established
`association , the second computing device can send one or
`more messages to the first computing device , the one or
`more messages referencing a piece of content associated
`with a first media playing element of a plurality of media
`playing elements , and one or more commands correspond
`ing to the first media playing element . The first computing
`device can select the first media playing element based on
`the received one or more messages , and control how the first
`media playing element plays the referenced piece of content
`utilizing the one or more commands .
`20 Claims , 9 Drawing Sheets
`
`102
`24
`
`26
`API Adapter
`
`20
`
`28
`
`Server System
`Switchboard
`36
`Look - up
`Table
`
`342
`Database
`
`32
`Database
`
`23
`
`21
`
`22
`
`Internet
`
`30
`
`Content Providers
`
`Comcast, Ex. 1001
`
`1
`
`

`

`US 11,086,934 B2
`Page 2
`
`Related U.S. Application Data
`continuation of application No. 13 / 532,546 , filed on
`Jun . 25 , 2012 , now Pat . No. 9,767,195 , which is a
`continuation - in - part of application No. 13 / 157,821 ,
`filed on Jun . 10 , 2011 , now Pat . No. 8,904,289 .
`( 60 ) Provisional application No. 61 / 477,998 , filed on Apr.
`21 , 2011 .
`( 51 ) Int . Ci .
`GO6F 16/951
`G06F 9/451
`
`( 2019.01 )
`( 2018.01 )
`
`( 56 )
`
`References Cited
`U.S. PATENT DOCUMENTS
`5,875,311 A
`2/1999 Bertram et al .
`5,878,311 A
`3/1999 Ichinokawa
`6,181,713 B1
`1/2001 Patki et al .
`6,252,889 B1
`6/2001 Patki et al .
`6,756,965 B2
`6/2004 Combs et al .
`6,978,424 B2
`12/2005 Safadi
`7,058,356 B2
`6/2006 Slotznick
`8/2006 Fetkovich
`7,088,823 B2
`9/2006 Urdang et al .
`7,114,173 B2
`7,330,875 B1
`2/2008 Parasnis et al .
`7,424,718 B2
`9/2008 Dutton
`10/2008 Engstrom
`7,433,922 B2
`7,440,972 B2
`10/2008 Oetzel
`7,453,454 B2
`11/2008 Allen et al .
`12/2008 Vestergaard et al .
`7,466,823 B2
`7,509,588 B2
`3/2009 Van Os et al .
`11/2009 Urdang et al .
`7,614,070 B2
`3/2010 Koga et al .
`7,689,931 B2
`7,769,827 B2
`8/2010 Girouard et al .
`7,774,708 B2
`8/2010 Bell et al .
`10/2010 Koyama et al .
`7,814,144 B2
`11/2010 Toyama et al .
`7,835,505 B2
`7,849,485 B2
`12/2010 Paik et al .
`7,878,904 B2
`2/2011 Maehiro
`7,949,606 B1
`5/2011 Sweet
`6/2011 Ording et al .
`7,956,846 B2
`8,060,631 B2
`11/2011 Collart et al .
`8,086,679 B2
`12/2011 Nobori et al .
`8,171,507 B2
`5/2012 Hironaka et al .
`8,230,360 B2
`7/2012 Ma et al .
`8/2012 Filipov
`8,238,887 B2
`8/2012 Hayes et al .
`8,250,608 B2
`8,255,968 B2
`8/2012 Louie et al .
`8,316,308 B2
`11/2012 Sherman et al .
`8,344,870 B2
`1/2013 Evans et al .
`8,356,251 B2
`1/2013 Strober
`8,373,660 B2
`2/2013 Pallakoff
`8,402,494 B1
`3/2013 Hu et al .
`8,418,084 B1
`4/2013 Tischer
`4/2013 Mahajan et al .
`8,433,812 B2
`10/2013 Phillips et al .
`8,572,488 B2
`8,614,625 B2
`12/2013 Alsina et al .
`12/2013 Filipov
`8,620,284 B2
`8,659,553 B1
`2/2014 Chan et al .
`8,671,440 B2
`3/2014 Damola et al .
`8,738,536 B2
`5/2014 Strom et al .
`8,738,737 B2
`5/2014 Baldini et al .
`5/2014 Kinoshita
`8,739,074 B2
`6/2014 Russell et al .
`8,743,284 B2
`8,744,434 B2
`6/2014 Funderburk et al .
`8,745,228 B2
`6/2014 Beckert et al .
`6/2014 Kanungo
`8,745,388 B2
`8,751,159 B2
`6/2014 Hall
`6/2014 Bhattacharjee et al .
`8,751,520 B1
`8,751,793 B2
`6/2014 Ginter et al .
`8,752,016 B2
`6/2014 Hernandez Porras et al .
`6/2014 Pyle
`8,755,919 B2
`8,756,333 B2
`6/2014 Jannink et al .
`8,756,505 B2
`6/2014 Gonze et al .
`
`8,761,351 B1
`8,761,792 B2
`8,762,240 B2
`8,762,548 B1
`8,763,081 B2
`8,782,262 B2
`8,782,528 B2
`8,875,180 B2
`8,880,491 B2
`9,071,792 B2
`9,148,756 B2
`9,185,171 B2
`9,420,025 B2
`9,720,887 B2
`2002/0034193 A1
`2002/0075332 A1
`2002/0083147 A1
`2002/0120666 Al
`2002/0129102 A1
`2002/0133518 Al
`2002/0146122 A1
`2002/0198778 A1
`2003/0004804 A1
`2003/0005000 Al
`2003/0018885 A1
`2003/0023488 A1
`2003/0028565 Al
`2003/0112258 Al
`2003/0112268 A1
`2003/0142127 Al
`2003/0182663 A1
`2004/0008972 Al
`2004/0049743 A1
`2004/0088728 Al
`2004/0268224 A1
`2004/0268451 A1
`2005/0034151 A1
`2005/0144305 Al
`2005/0149970 A1
`2006/0062544 Al
`2006/0083194 Al
`2006/0098624 Al
`2006/0101098 Al
`2006/0203758 A1
`2006/0263038 Al
`2006/0265657 Al
`2007/0050054 Al
`2007/0052868 A1
`2007/0055986 Al
`2007/0083540 A1
`2007/0094408 A1
`2007/0112785 A1
`2007/0136778 Al
`2007/0150963 A1
`2007/0152978 Al
`2007/0152980 A1
`2007/0155506 A1
`2007/0156855 A1
`2007/0202923 Al
`2007/0288715 Al
`2007/0294621 Al
`2008/0008439 A1
`2008/0028037 Al
`2008/0034394 A1
`2008/0040758 Al
`2008/0077526 A1
`2008/0104267 A1
`2008/0126943 A1
`2008/0140849 Al
`2008/0155600 A1
`2008/0162670 A1
`2008/0178198 Al
`2008/0187279 A1
`2008/0189617 Al
`2008/0250190 Al
`2008/0267369 Al
`2008/0270881 A1
`2008/0301737 A1
`2009/0049373 Al
`
`6/2014 Daly et al .
`6/2014 Sennett et al .
`6/2014 Sogo et al .
`6/2014 Kessel et al .
`6/2014 Bogdanovic et al .
`7/2014 Collart et al .
`7/2014 Strober
`10/2014 Demchenko et al .
`11/2014 Morris
`6/2015 Alsina et al .
`9/2015 Filipov
`11/2015 Pahlavan et al .
`8/2016 Park
`8/2017 Pappu et al .
`3/2002 Patki et al .
`6/2002 Geilfuss , Jr. et al .
`6/2002 Ripperger
`8/2002 Landsman et al .
`9/2002 Landsman et al .
`9/2002 Landsman et al .
`10/2002 Vestergaard et al .
`12/2002 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`1/2003 Landsman et al .
`2/2003 Landsman et al .
`6/2003 Dietz et al .
`6/2003 Wettach
`7/2003 Markel
`9/2003 Gudorf et al .
`1/2004 Haken
`3/2004 Bogward
`5/2004 Shimizu
`12/2004 Balkus et al .
`12/2004 Robbin et al .
`2/2005 Abramson
`6/2005 Fegan , II et al .
`7/2005 Fairhurst et al .
`3/2006 Southwood et al .
`4/2006 Dhrimaj et al .
`5/2006 Morgan et al .
`5/2006 Morgan et al .
`9/2006 Tee et al .
`11/2006 Gilley
`11/2006 Gilley
`3/2007 Sambandam Guruparan et al .
`3/2007 Chou et al .
`3/2007 Gilley et al .
`4/2007 Gundla et al .
`4/2007 Gundla et al .
`5/2007 Murphy et al .
`6/2007 Birger et al .
`6/2007 Lee et al .
`7/2007 Kocienda et al .
`7/2007 Kocienda et al .
`7/2007 Malik
`7/2007 Johnson
`8/2007 Jung et al .
`12/2007 Boswell et al .
`12/2007 Hansen et al .
`1/2008 Liu et al .
`1/2008 Moyer et al .
`2/2008 Jacobs et al .
`2/2008 Beetcher et al .
`3/2008 Arumugam
`5/2008 Dawson
`5/2008 Parasnis et al .
`6/2008 Collazo
`6/2008 Klappert et al .
`7/2008 Chapweske et al .
`7/2008 Gauba
`8/2008 Gilley et al .
`8/2008 Covell et al .
`10/2008 Johnson
`10/2008 Parlamas et al .
`10/2008 Meyer et al .
`12/2008 Hjelmeland Almas et al .
`2/2009 Sharma et al .
`
`2
`
`

`

`US 11,086,934 B2
`Page 3
`
`( 56 )
`
`References Cited
`U.S. PATENT DOCUMENTS
`2009/0077467 Al
`3/2009 Adappa et al .
`2009/0100477 Al
`4/2009 Jeffs
`2009/0108057 Al
`4/2009 Mu et al .
`2009/0150553 Al
`6/2009 Collart et al .
`2009/0164641 A1
`6/2009 Rogers et al .
`2009/0172780 A1 *
`7/2009 Sukeda
`
`HO4N 21/4227
`726/3
`
`HO4L 65/4015
`709/204
`
`7/2009 Ehreth et al .
`2009/0193466 Al
`9/2009 Zott et al .
`2009/0228919 Al
`2009/0248802 A1 * 10/2009 Mahajan
`2009/0254827 A1 10/2009 Gonze et al .
`2009/0259944 A1 10/2009 Wu
`2009/0259969 Al 10/2009 Pallakoff
`2009/0282470 A1
`11/2009 Yang et al .
`2010/0027974 A1
`2/2010 Ansari
`2010/0081375 A1
`4/2010 Rosenblatt et al .
`2010/0094728 Al
`4/2010 Denning et al .
`2010/0094900 A1
`4/2010 Hughes , Jr.
`2010/0137028 A1
`6/2010 Farris et al .
`2010/0138746 A1
`6/2010 Zarom
`2010/0138780 A1
`6/2010 Marano et al .
`2010/0174993 A1
`7/2010 Pennington et al .
`2010/0198860 A1
`8/2010 Burnett et al .
`2010/0205628 Al
`8/2010 Davis et al .
`2010/0208136 A1
`8/2010 Castano
`2010/0241699 A1
`9/2010 Muthukumarasamy et al .
`2010/0257569 A1 10/2010 O'Hanlon
`2010/0265939 Al 10/2010 Parlamas et al .
`2010/0281042 Al
`11/2010 Windes et al .
`2010/0283586 A1 11/2010 Ikeda et al .
`2010/0313135 Al 12/2010 Johnson et al .
`2010/0325552 Al 12/2010 Sloo et al .
`2011/0007901 A1
`1/2011 Ikeda et al .
`2011/0014972 Al
`1/2011 Herrmann et al .
`2011/0030020 A1
`2/2011 Halttunen
`2011/0032870 Al
`2/2011 Kumar
`2011/0035692 A1
`2/2011 Sandone et al .
`2011/0060998 Al
`3/2011 Schwartz et al .
`2011/0084900 Al
`4/2011 Jacobsen et al .
`2011/0090898 A1
`4/2011 Patel et al .
`2011/0107227 Al
`5/2011 Rempell et al .
`2011/0125594 Al
`5/2011 Brown et al .
`2011/0131607 Al
`6/2011 Thomas et al .
`2011/0137729 A1
`6/2011 Weisman et al .
`2011/0138354 A1
`6/2011 Hertenstein et al .
`2011/0156879 Al
`6/2011 Matsushita et al .
`2011/0161396 A1
`6/2011 Filbrich et al .
`2011/0202466 A1
`8/2011 Carter
`2011/0214148 A1
`9/2011 Gossweiler , III et al .
`2011/0228768 A1
`9/2011 Gelter et al .
`2011/0231265 A1
`9/2011 Brown et al .
`2011/0231565 Al
`9/2011 Gelter et al .
`2011/0231566 Al
`9/2011 Gelter et al .
`2011/0267981 A1
`11/2011 Davies
`2011/0289419 Al
`11/2011 Yu et al .
`2011/0296454 A1
`12/2011 Xiong et al .
`2011/0296465 A1 12/2011 Krishnan et al .
`2011/0314386 A1 12/2011 Jeong et al .
`2012/0054616 Al
`3/2012 Mittal
`2012/0059875 A1
`3/2012 Clark
`2012/0059876 A1
`3/2012 Chinta et al .
`2012/0072846 Al
`3/2012 Curtis
`2012/0102209 A1
`4/2012 Fok Ah Chuen et al .
`2012/0110074 A1
`5/2012 Getchius
`2012/0110464 A1
`5/2012 Chen et al .
`2012/0114313 A1
`5/2012 Phillips et al .
`2012/0130971 A1
`5/2012 Morris
`2012/0166560 A1
`6/2012 Nobori et al .
`2012/0182994 Al
`7/2012 Dec et al .
`2012/0185887 Al
`7/2012 Newell
`2012/0192225 Al
`7/2012 Harwell et al .
`2012/0239218 A1
`9/2012 Forbes , Jr.
`2012/0254931 A1 10/2012 Oztaskent et al .
`2012/0272148 A1 10/2012 Strober
`
`2013/0014142 Al
`2013/0124759 Al
`2013/0250181 Al
`2014/0033198 A1
`2016/0241912 Al
`
`1/2013 Newell
`5/2013 Strober
`9/2013 Zhang et al .
`1/2014 Umapathy et al .
`8/2016 McCarthy et al .
`
`FOREIGN PATENT DOCUMENTS
`
`CN
`CN
`EP
`JP
`JP
`WO
`WO
`WO
`WO
`
`101778198 A
`101815073 A
`2 175 607 A1
`2004-356695 A
`2006-525771 A
`2004/100500 A2
`2007078745 A1
`2008/070050 A2
`2008108718 A1
`
`7/2010
`8/2010
`4/2010
`12/2004
`11/2006
`11/2004
`7/2007
`6/2008
`9/2008
`
`OTHER PUBLICATIONS
`“ Best way to generate Random , Unique Session ID's ” , vBulletin ,
`Nov. 19 , 2011 , p . 1 .
`“ Best way to generate Random , Unique ID's ” , vBulletin , Internet
`Archive Wayback Machine , on Nov. 19 , 2011 , p . 1 ( Jan. 2009 ) .
`" Control television phone ” , Retrieved from Internet URL : http : //
`www.bing.com/search?q=control+television+phone&go=Submit
`+ Query & qs = bs & for , Feb. 6 , 2014 , pp . 3 .
`“ Control television server phone ” , Retrieved from Internet URL :
`http : // www . bing.com/search ? q = control + television + server +
`phone & q s = n & form = QB LH & pq , Feb. 6 , 2014 , p . 1 .
`“ Mobile device server display device ” , Retrieved from Internet
`URL : http://www.ask.com/web?q=mobile+device+server+display+
`device & q src = 0 & o = 0 & l = dir , on Jul . 30 , 2012 , pp . 2 .
`“ Mashable — 10 Mobile Apps to Control Your TV ” , Retrieved from
`Internet URL : http://mashable.com/2012/11/28/apps-control-tv/ , Nov.
`28 , 2012 , pp . 102 .
`" Mobile Phone Television Remote Control ” , Retrieved from Inter
`net URL : http://www.fileguru.com/apps/mobile_phone_television
`remote_control_app , pp . 5 ( 2013 ) .
`“ Mobile server television control ” , Retrieved from Internet URL :
`http://www.bing.com/search ? q = mobile + server + television + control
`& qs = n & form = QBLH & p , Jun . 26 , 2014 , p . 1 .
`“ Mobile server television control media player ” , Retrieved from
`Internet URL : http://www.bing.com/search ? q = mobile + server +
`television + control + media + player & qs = n & f , Jun . 26 , 2014 , p . 1 .
`“ Phone Server television control ” , Retrieved from Internet URL :
`http : // www . bing.com/search?q=phone+server+television+
`control & q s = n & form = QBRE & p , Jun . 26 , 2014 , p . 1 .
`“ Phone server television control media player ” , Retrieved from
`Internet URL : http : // www . bing.com/search?q=phone+server+
`television + control + media + player & q s = n & f , Jun . 26 , 2014 , p . 1 .
`“ Session identifier random ” , Ask.com , Nov. 19 , 2011 , p . 1 .
`“ Session cookie ” , Webopedia Computer Dictionary , Nov. 19 , 2011 ,
`pp . 3 .
`" Snapstick ” , Snapstick — Home , Retrieved from Internet URL :
`http://www.snapstick.com/ , on Dec. 12 , 2019 , pp . 2 , ( Mar. 2011 ) .
`“ Smartphone Remote Control Apps Boxee Support " , Retrieved
`from Internet URL : http://support.boxee.tv/entries/20771358
`smartphone - remote - control - apps , on Feb. 6 , 2014 , pp . 2 ( Dec.
`2011 ) .
`“ Using AirPlay ” , Retrieved from Internet URL : https : //web.archive .
`org / web / 20101129073434 / http : //support.apple.com/kb/HT4437 , pp .
`2 ( 2011 ) .
`Using the Play to feature to stream media , Retrieved from the
`Internet URL : http://windows.microsoft.com/en-US/windows7/
`using - the - play - to - feature - to - stream - media , pp . 3 ( Jun . 2011 ) .
`“ User session " , Webopedia Computer Dictionary , Nov. 19 , 2011 ,
`pp . 3 .
`" Web identifier ” , Webopedia : Online Computer Dictionary for
`Internet Terms and Technical Support , Retrieved from Internet URL
`: http://www.webopedia.com/gsearchJresults?cx::::partner-pub
`8768004398756183 % 3A676 , on Nov. 19 , 2011 , pp . 3 .
`
`3
`
`

`

`US 11,086,934 B2
`Page 4
`
`( 56 )
`
`References Cited
`OTHER PUBLICATIONS
`“ You Tube — Leanback ” , Retrieved from Internet URL : https : //
`www.youtube.com/watch?v=bITse42LPKA , p . 1 ( 2010 ) .
`“ Yahoo ! 7 TV Guide ” , Retrieved from the Internet URL : http : //
`itunes.apple.com/au/app/yahoo-7-tv-guide/id424719922?mt=8 , pp .
`2 ( 2011 ) .
`Cheng , J. , “ Stream AirPlay video to regular TV ? Apple might make
`it happen ” , Retrieved from Internet URL : http://arstechnica.com/
`apple / news / 2011 / 03 / stream - airplay - video - to - a - regular - tv - apple - might
`make - it - happen / , on Dec. 12 , 2019 , pp . 5 ( Mar. 2011 ) .
`Dolcourt , J. , et al . ,
`“ Snapstick takes on Apple TV , Google TV , "
`Retrieved from Internet URL : https://www.cnet.com/news/snapstick
`takes - on - apple - tv - google - tv / , Dec. 9 , 2010 , pp . 3 .
`Fallahkhair , S. , et al . , “ Dual Device User interface Design for
`Ubiquitous Language Learning : Mobile Phone and Interactive Tele
`vision { iTV ) ” , Proceedings of the 2005 IEEE International Work
`shop on Wireless and Mobile Technologies in Education , 2005 , pp .
`8 .
`
`“ Mobile Media Content Sharing in UPnP - Based
`Hu , C. , et al . ,
`Home Network Environment ” , Journal of Information Science and
`Engineering 24 , pp . 1753-1769 ( 2008 ) .
`Hachman , M. , “ Snapstick's Media Streaming App Box : Hands on ” ,
`Retrieved from Internet URL : https://uk.pcmag.com/news/102838/
`snapsticks - media - streaming - appbox - hands - on , on Dec. 12 , 2019 ,
`pp . 2 ( Jan. 2011 ) .
`Paul , I. ,
`“ Hands on : YouTube Leanback ” , PCWORLD , Retrived
`from Internet URL : http://www.pcworld.com/article/200769/hands_
`on_youtube_leanback.html , pp . 6 ( Jul . 2010 ) .
`Notice of Allowance dated Sep. 3 , 2020 in U.S. Appl . No. 15 / 687,249 ,
`5 pages .
`Shaivitz , M. ,
`“ The Web to Your TV , With a Flick of a Wrist ?
`Slapstick Says Yes ” , http://techcocktail.com/the-web-to-our-tv-with
`a - flick - of - a - wrist - slapstick - says - yes - 2010-12 , 2pages , ( Dec. 10 , 2010 )
`( PDF not available ) .
`Non - Final Office Action dated Feb. 2 , 2021 in U.S. Appl . No.
`15 / 687,249 , 9 pages .
`* cited by examiner
`
`4
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 1 of 9
`
`US 11,086,934 B2
`
`10
`
`24
`
`Server System
`
`28
`
`26
`API Adapter
`
`342
`Database
`
`Switchboard
`361
`Look - up
`Table
`
`23
`
`32
`
`Database
`
`202
`
`21
`
`22
`
`Internet
`
`30
`
`Content Providers
`
`FIG . 1
`
`5
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 2 of 9
`
`US 11,086,934 B2
`
`FIG . 2
`
`122
`
`
`Copied to Display Message Database Device
`
`
`
`
`
`
`Back - end Servers
`
`
`
`Target Verification / Switchboard
`
`
`
`Added to Smart Message Phone Database
`
`
`
`118
`
`116
`
`
`
`Account Verification
`
`114
`
`
`Message Received from
`
`Smart Phone
`
`
`
`Universal API Adapter
`
`112
`
`120
`
`24
`
`
`
`Smart Phone
`
`Start App
`
`
`
`
`
`Request Video Data
`
`
`
`Display List of Videos
`
`
`
`Action Selected
`
`
`
`Selection Sent to Database
`
`100
`
`102
`
`106
`
`108
`
`110
`
`20
`
`Display Device Checks
`
`
`
`
`
`
`Switch Video Player Database for New Messages 126
`
`
`
`Display Device 124
`
`
`
`New Message Received
`by Display Device
`
`
`
`
`Display Device Executes
`
`New Message
`
`128
`
`30
`
`
`
`Video Files
`
`
`
`Video Player
`
`42
`
`40
`
`22
`
`
`
`
`
`Load New Video
`
`Play / Pause / ffwd / etc ..
`
`Presentation of Video
`
`130
`
`
`Content Providers
`
`Content Providers
`Content Providers .
`
`
`104
`
`
`
`
`
`XML Data File
`
`6
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 3 of 9
`
`US 11,086,934 B2
`
`Transmission Code
`Userid TargetID Media PlayerID Command Data
`
`Single Connection Look - up Table
`User
`Display Device
`Smartphone
`
`2
`1
`3
`4
`
`COA
`
`B
`
`FIG . 3
`
`FIG . 4
`
`26
`
`Universal API Adapter
`Universal Command Media PlayerID
`Specific Player Command
`YouTube
`yt_load Video
`New Video
`Ted.com
`getVideo
`loadNewVideo
`Vimeo
`yt_pauseVideo
`YouTube
`pauseVideo
`Ted.com
`pause
`Vimeo
`FIG . 5
`
`Pause
`
`7
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 4 of 9
`
`US 11,086,934 B2
`
`Is
`the Media Player that
`is Needed to play the Video
`Already Loaded in the
`Display Device
`?
`No
`
`Request and Obtain a
`Copy of the Appropriate
`Media Player and a Copy
`of the Video File from
`Content Provider
`
`Load the Media Player
`
`Yes
`
`is
`a Copy of the
`Yes
`Video Already Loaded in
`the Display Device
`
`No
`
`Obtain a Copy
`of the Video
`
`Play the Video
`
`FIG . 6
`
`8
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 5 of 9
`
`US 11,086,934 B2
`
`22
`
`Display Device
`Splash Page
`48
`435-05-342
`FIG . 7A
`
`Sync - code
`
`IP Address
`169.343.231.234
`
`Sync - code Look - up Table
`Cookie
`erjg988dhuj
`FIG . 7B
`
`Sync - code
`435-05-342
`
`Display Device
`22
`
`Smart Phone
`20
`
`FIG . 8
`
`Display Device
`22
`
`Smart Phone
`20
`
`Smart Phone
`20
`
`( A )
`
`( B )
`
`FIG . 9
`
`9
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 6 of 9
`
`US 11,086,934 B2
`
`Display Device
`22
`
`Smart Phone
`20
`
`Smart Phone
`20
`
`Smart Phone
`20
`
`Moderator
`
`Control of
`Display
`FIG . 10
`
`Display Device
`22
`
`Display Device
`22
`
`Smart Phone
`20
`
`FIG . 11
`
`10
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 7 of 9
`
`US 11,086,934 B2
`
`Display Device
`22
`
`Display Device
`22
`
`Display Device
`22
`
`Smart Phone Smart Phone Smart Phone
`20 .
`20
`20
`
`:
`
`Moderator
`
`Control of
`Display
`FIG . 12
`
`Display Device
`22
`
`Display Device
`22
`
`Smart Phone
`20
`
`Third Party
`
`Smart Phone
`20
`
`Playlist and Video Links
`FIG . 13
`
`11
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 8 of 9
`
`US 11,086,934 B2
`
`O
`
`>
`
`
`
`HEADER MENUICHANNELS | PLAYLIST SEARCH
`
`AD SPACE
`
`O
`
`my laptop 0
`
`
`friend's laptop
`living - room PC
`
`
`
`from one of your devices listed above
`
`
`
`Enter the Sync - code below or choose
`
`
`
`
`
`CONTROL PANEL GUEST DISPLAY 1 || DISPLAY 2 DISPLAY 3 [ DISPLAY 4
`
`-
`
`
`
`HEADER MENUICHANNELS | PLAYLIST SEARCH
`
`
`
`SPLASH PAGE
`
`FOOTER
`
`SEND
`
`FOOTER
`
`?
`
`FIG . 14C
`
`FIG . 14B
`
`FIG . 14A
`
`12
`
`

`

`U.S. Patent
`
`Aug. 10 , 2021
`
`Sheet 9 of 9
`
`US 11,086,934 B2
`
`B " * , E
`
`2 X A " , c * , D
`
`User - Smartphone
`Group Connection Look - up Table
`Group
`Display Device
`
`
`
`
`
`
`
`Group Moderator , = Control of Display Device FIG . 15
`
`1,3 Y
`
`SEND
`
`O
`
`
`
`OPTION 1 MORE INFO ... +
`
`
`
`FOOTER
`
`FIG . 14E
`
`FIG . 14D
`
`
`
`
`
`CONTROL PANEL DISPLAYS ME I GUEST 1 GUEST
`
`
`
`2IGUEST 3 GUEST ....
`
`
`
`NOW PLAYING
`
`AD SPACE
`
`13
`
`

`

`US 11,086,934 B2
`
`5
`
`BACKGROUND
`
`1
`PLAY CONTROL OF CONTENT ON A
`DISPLAY DEVICE
`
`2
`a first media player needed to play the content , to load the
`media player and to present the content on the display .
`In some implementations , the display device is operable ,
`in response to receiving the second message , to obtain the
`CROSS - REFERENCE TO RELATED
`first media player from the content provider only if the first
`APPLICATIONS
`media player is not already loaded in the display device .
`In some implementations , the personal computing device
`The present application is a continuation of U.S. appli-
`is operable to transmit a message according to a specified
`cation Ser . No. 15 / 687,249 , filed Aug. 25 , 2017 , which is a
`format over the network to the server system . The message
`continuation of U.S. application Ser . No. 13 / 532,546 , filed
`on Jun . 25 , 2012 , which is a continuation - in - part of U.S. 10 can include a command for controlling playing of the
`content on the display device . The server system is operable ,
`application Ser . No. 13 / 157,821 , filed on Jun . 10 , 2011 ,
`in response to receiving the message , to convert the com
`which issued on Dec. 2 , 2014 as U.S. Pat . No. 8,904,289 ,
`mand into a corresponding command recognizable by the
`which claims the benefit of priority to U.S. Provisional
`media player if the command received from the personal
`Patent Application No. 61 / 477,998 , filed on Apr. 21 , 2011 , 15 computing device is not recognizable by the media player .
`The contents of the earlier applications are incorporated
`The server system is operable to provide to the display
`herein by reference .
`device a message that includes the corresponding command ,
`and the display device is operable , in response to receiving
`the message from the server system , to execute the com
`20 mand .
`In some implementations , the personal computing device
`This disclosure relates to play control of content on a
`display device . Such display devices include , for example ,
`is , for example , a mobile phone , and the display device is a
`television set . Other personal computing devices or display
`television displays used by consumers in their home for
`devices can be used in other implementations . The network
`viewing videos and other media that are either provided
`from the Web or previously stored . In particular , the disclo- 25 can include , for example , the Internet .
`sure relates to the creation , storage , manipulation and access
`In some implementations , the server system stores a
`of media playlists used in conjunction with display devices
`look - up table that includes a synchronization code uniquely
`associated with the display device . A message from the
`and control of the display devices .
`Web media often is played on computers rather than
`personal computing device can include the synchronization
`television displays . Although it is known to connect a 30 code , and in response to receiving the message from per
`computer to a television set in order to watch Web media , it
`sonal computing device , the server system can use the
`is difficult to control such a system within the typical
`synchronization code and the look - up table to identify the
`scenario for television watching where the viewer is posi-
`display device on which the content is to be played . The
`tioned some distance from the television . Furthermore ,
`synchronization code can be different from an IP address
`although a wireless device can enable the user to control the 35 associated with the display device and / or a media access
`television from a distance , it can be difficult to view a web
`control address associated with the display device .
`browser display on the television set and may interfere with
`In various implementations , the system can facilitate
`normal television program viewing by other persons .
`allowing a personal computing device to be used to select
`Given the desire to watch various World Wide Web media
`different content to be played on a remote display even if
`on a family's primary television set , and to control this 40 different media players are required to present the different
`operation from the comfort of one's couch , there is a need
`content . The system also can allow the user to control how
`to operate a television set or other display remotely from a
`the content is displayed on the display device using the
`personal computing device , such as a mobile phone . It also
`personal computing device . For example , user - initiated play
`is desirable to allow a user to perform a general Web search
`commands can be passed from the user's personal comput
`to locate and capture Web media , and to control a television 45 ing device , through the server system , to the display devices .
`or other display remotely using the personal computing
`Other aspects , features and advantages will be apparent
`from the following detailed description , the accompanying
`device .
`drawings , and the claims .
`BRIEF DESCRIPTION OF THE FIGURES
`Various aspects of the invention are set forth in the claims .
`The present technology is illustrated by way of example ,
`For example , according to one aspect , a system for
`and not by way of limitation , in the figures of the accom
`presenting and controlling content on a display device
`panying drawings .
`includes a network , a server system coupled to the network
`FIG . 1 is a block diagram illustrating an example of a
`and comprising one or more servers , a display device 55
`system according to the invention .
`coupled to the network and having a display , and a personal
`FIG . 2 illustrates various details of the flow of information
`computing device operable to transmit a first message
`and signals according to some implementations .
`according to a specified format over the network to the
`FIG . 3 illustrates an example of a transmission code
`server system . The server system stores an association
`between the personal computing device and the display 60 incorporated into a message from a personal computing
`device . The first message identifies user - selected content and
`device .
`a media player to play the content . The server system is
`FIG . 4 illustrates an example of a look - up table that forms
`operable , in response to receiving the first message from the
`part of a server system .
`personal computing device , to provide to the display device
`FIG . 5 illustrates an example of entries in a universal API
`a second message identifying the user - selected content and 65 adapter .
`the media player to play the content . In response to receiving
`FIG . 6 is a flow chart showing steps for display device to
`the second message , the display device is operable to obtain
`load a video player and video .
`
`SUMMARY
`
`50
`
`14
`
`

`

`US 11,086,934 B2
`
`4
`3
`20 is a mobile phone that includes a display , an internal
`FIG . 7A illustrates an example of a display device includ-
`microprocessor or other processing circuitry , a keypad ,
`ing a synchronization code .
`keyboard , touchscreen , mouse , trackball , or other device to
`FIG . 7B illustrates an example of a synchronization code
`receive user selections and other input , and a transceiver to
`look - up table .
`FIGS . 8-13 illustrate examples of various scenarios in s establish communications to the Internet 21 or other com
`munications networks . More generally , however , the per
`which the invention can be used .
`FIGS . 14A through 14E illustrate examples of display
`sonal computing device 20 can be any type of handheld or
`screens that may appear on a user's personal computing
`other Internet - enabled personal computing device , including
`personal computers , e - books , kiosks , tablets , smart phones ,
`device in accordance with the invention .
`FIG . 15 illustrates further information that can be stored 10 media players , and motion and touch sensory interfaces . In
`some cases , input from the user can be received in forms
`in the look - up table in the server system .
`other than tactile input ( e.g. , acoustic or speech ) .
`FIG . 2 illustrates further details of the flow of information
`DETAILED DESCRIPTION
`and signals according to some implementations . The per
`As shown in FIG . 1 , a system 10 facilitates synchronizing 15 sonal computing device ( e.g. , mobile phone ) 20 is operable
`to display an application or web site that contains informa
`a connection between two or more devices 20 , 22 connected
`to the Internet 21 or other computer network . The connec-
`tion and links to content providers 30 on the Internet 21. The
`tion is designed to be made by a first device ( e.g. , a personal
`user operates the mobile phone 20 so as to start the appli
`computing device ) 20 that acts as a controller and a second
`cation or access the web site ( block 100 ) . In some imple
`device ( e.g. , a television set 22 with a display 23 ) that acts 20 mentations , a logo appears on the mobile phone's display .
`as a receiver to play content selected by a user of the first
`By selecting the logo , the user causes a menu to expand and
`device and to respond to commands that originate at the
`present various options . The options can include , for
`personal computing device . The personal computing device
`example : ( i ) add new content to a playlist , ( ii ) play a listed
`20 is operable to display an application or web site that
`item on a secondary device , ( iii ) play a listed item on the
`contains information and links to content providers 30 on the 25 mobile phone 20. If the user selects to add new content to the
`Internet 21. The television set 22 is operable to link back to
`playlist , the user is presented with a screen that allows him
`a server system 24 from which the television set receives
`to enter user - defined search parameters or o select pre
`commands . When a user makes a selection using the per-
`defined search parameters to request video data . The search
`sonal computing device 20 for particular content to be
`parameters are sent from the mobile phone 20 as part of a
`displayed on the television display 23 , a signal is sent 30 request for video data that satisfy the search parameters
`through the Internet ( or other network ) 21 to the server
`( block 102 ) . The request is transmitted via the Internet 21
`system 24. A corresponding command signal then is passed
`and through the server system 24 to the appropriate content
`along to the connected television set 22 , which acts on a
`provider web site . In response , the content provider 30
`transmission code contained within the signal and performs
`provides metadata ( e.g. , titles , links to the videos ) for one or
`specified commands . For example , in some scenarios , the 35 more video files that satisfy the search parameters ( block
`command instructs the television set 22 to access a content
`104 ) . The metadata can be provided to the mobile phone 20 ,
`provider 30 through the Internet 21 , load a specific media
`for example , in the form of an XML data file . Upon
`player , load the media player - specific content ( e.g. , a video )
`receiving the data file , the mobile phone 20 displays a list of
`and play the content on the television display 23. The user
`one or more videos based on the information received from
`can use the personal computing device 20 to control how the 40 the content provider 30 ( block 106 ) .
`content is played on the television display 23. The user may
`If desired , the user can take on