I 1111111111111111 11111 1111111111 11111 11111 1111111111 11111 lll111111111111111
`
`US008713206B2
`
`(IO) Patent No.: US 8,713,206 B2
`
`c12) United States Patent
`
`Apr. 29, 2014
`(45)Date of Patent:
`
`
`Kotani
`
`(54)DISPLAY APPARATUS, CONTROL METHOD
`
`THEREO�ANDPROGRAM
`
`(56)
`
`
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`
`
`
`
`(71)Applicant: Canon Kabushiki Kaisha, Tokyo (JP)
`
`
`
`
`
`
`
`(72)Inventor: Junji Kotani, Inagi (JP)
`
`
`
`
`
`(73) Assignee: Canon Kabushiki Kaisha, Tokyo (JP)
`
`
`
`10/2004 Rademacher
`
`6,804,727 Bl
`
`12/2011 Kotani
`
`8,078,767 B2
`3/2005 Tanaka
`2005/0060447 Al
`
`4/2007 Marriott et al.
`
`2007 /0088806 Al
`7 /2007 Nitta et al.
`
`2007/0162949 Al
`3/2008 Yoshida
`
`2008/0071937 Al
`6/2008 Sparrell
`2008/0148138 Al
`
`7/2011 Marriott et al.
`
`2011/0167140 Al
`( *) Notice: Subject to any disclaimer, the term ofthis
`
`
`
`
`
`patent is extended or adjusted under 35
`FOREIGN PATENT DOCUMENTS
`
`
`U.S.C. 154(b) by O days.
`
`
`
`(21) Appl. No.: 13/707,652
`
`
`
`(22) Filed:Dec. 7, 2012
`
`JP
`
`JP
`
`JP
`
`JP
`
`JP
`
`5/1995
`07-123379 A
`
`9/2002
`
`2002-271721 A
`12/2004
`
`2004-350160 A
`12/2005
`
`2005-333416 A
`7/2006
`
`2006-185288 A
`
`(Continued)
`
`(65)
`
`
`
`Prior Publication Data
`
`OTHER PUBLICATIONS
`
`
`
`US 2013/0162659 Al Jun. 27, 2013
`
`Korean Office Action dated Mar. 9, 2012, in related Korean Patent
`
`
`
`Application No. 10-2010-7025011.
`
`
`
`
`
`Related U.S. Application Data
`
`(Continued)
`
`(74)Attorney,Agent, or Firm - Fitzpatrick, Cella, Harper&
`
`(30)
`
`(51)Int. Cl.
`G06F 13/10 (2006.01)
`
`
`
`
`
`( 58)Field of Classification Search
`
`Primary Examiner - Ilwoo Park
`
`
`
`
`
`(60)Continuation of application No. 13/281,543, filed on
`
`
`
`
`Oct. 26, 2011, now Pat. No. 8,346,986, which is a
`Scinto
`
`
`
`division of application No. 12/545,270, filed on Aug.
`
`21, 2009, now Pat. No. 8,078,767, which is a
`(57)
`ABSTRACT
`
`
`continuation of application No. PCT/JP2009/055831,
`filed on Mar. 24, 2009.
`A display apparatus includes a USB connector used to con­
`
`
`
`
`
`
`
`nect an external device so as to be able to communicate with
`
`
`
`
`that device. The display apparatus also includes a CPU which
`Foreign Application Priority Data
`
`
`
`controls to make a display based on data received from the
`
`
`
`external device with which a communication connection is
`
`May 29, 2008 (JP) ................................. 2008-141678
`
`
`
`
`
`established via the USB connector. The CPU acquires class
`
`
`
`
`
`information indicating a class of the external device, the
`
`
`
`communication connection of which is established. When the
`
`
`
`
`communication connection with the external device is dis­
`(52)U.S. Cl.
`
`
`
`
`connected, if the acquired class information indicates a pre­
`
`USPC ...................... 710/8; 710/14; 710/15; 710/16
`
`
`
`
`determined class, the CPU controls to continue the display
`
`
`
`based on the received data, and if the class information does
`
`
`
`
`
`not indicate the predetermined class, the CPU controls to end
`the display.
`
`
`None
`
`
`
`
`
`
`
`
`See application file for complete search history.
`
`Roku Exhibit 1001
`Roku, Inc. v. Canon Kabushiki Kaisha
`IPR2020-00343
`Page 00001
`
`

`

`US 8,713,206 B2
`
`Page 2
`
`14 Claims, 28 Drawing Sheets
`
`IPR2020-00343 Page 00002
`
`IPR2020-00343 Page 00002
`
`

`

`US 8,713,206 B2
` Page 3
`
`(56)
`
`References Cited
`
`FOREIGN PATENT DOCUMENTS
`
`JP
`JP
`JP
`
`2006-235993 A
`2006-285070 A
`2007-279144 A
`
`9/2006
`10/2006
`10/2007
`
`JP
`KR
`WO
`
`2008-282160 A
`20070069016 A
`2005/111820 A1
`
`11/2008
`7/2007
`11/2005
`
`OTHER PUBLICATIONS
`
`European Search Report dated Jul. 11, 2012, in related European
`Patent Application No. 097545065.
`
`IPR2020-00343 Page 00003
`
`IPR2020-00343 Page 00003
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 1 of 28
`
`US 8,713,206 B2
`
`
`mm \§§
`
` \\\\\
`
`
`
`
`401 402
`
`IPR2020-00343 Page 00004
`
`IPR2020-00343 Page 00004
`
`

`

`U.S. Patent
`
`Apr. 29, 2014
`
`Sheet 2 of 28
`
`US 8,713,206 B2
`
`
`
`OmQ_>embomwomm
`
`._<Fm>mo
`
` mmZmo
`mor
`
`930: worEa
`
`mm_._.mm_>zoo._<z__>_mm_._.
`
`3&0Jomkzoo
`
`flm2.H
`
`N o
`
`r
`
`_._._.
`
`N:
`
`m:
`
`3;.
`
`IPR2020-00343 Page 00005
`
`Omn=>
`
`mOmmmGOmm
`
`Q<RES
`
`For
`
`4mz<m
`
`IPR2020-00343 Page 00005
`
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 3 of 28
`
`US 8,713,206 B2
`
`FIG. 3
`
`Z///////////////////////////////////////////////////////////////
`
`SELECT INPUT SOURCE.
`
`EXTERNAL VIDEO
`
`USB
`
`////////
`\\\\\\\\\\\\\\\
`
`V /
`////////\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`é/¢
`
`¢¢%%¢%é¢\
`
`E
`
`
`////////////////////////////////////////////////////////////\
`
`IPR2020-00343 Page 00006
`
`IPR2020-00343 Page 00006
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 4 of 28
`
`US 8,713,206 B2
`
`START
`
`8801
`
`0
`
`DISPLAY CONNECT REQUEST WINDOW
`
`8802
`
`9
`
`
`USB COMMUNICATION
`ESTABLISHED?
`
`YES
`
`MASS STORAGE
`CLASS
`
`9
`
`8804
`
`
`DETERMINE
`
`DEVICE CLASS
`
`9
`OTHER
`
`IMAGING CLASS
`
`9
`
`DISPLAY INCOMPATIBILITY WINDOW
`
`8831
`
`
`
`8832
`
`
`
`
`
`USB
`COMMUNICATION
`DISCONNECTED
`?
`
`
`
`YES
`
`IPR2020-00343 Page 00007
`
`IPR2020-00343 Page 00007
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 5 of 28
`
`US 8,713,206 B2
`
`F I G. 43-1
`
`9
`
`READ DIRECTORY ENTRY
`
`S805
`
`8806
`
`USB
`
`
`COMMUNICATION
`DISCONNECTED
`
`9
`0
`NO
`
`YES
`
`0
`
`DISPLAY FILE SELECTION WINDOW
`
`S807
`
`8808
`
`USB
`COMMUNICATION
`DISCONNECTED
`?
`
`8809
`
`USER INSTRUCTION
`TAKES PLACE?
`
`YES
`
`UPDATE FILE SELECTION WINDOW
`
`YES
`
`0
`
`S810
`
`
`
`
`
`
`S811
`
`
`
`
`INSTRUCTION TAKES PLACE?
`
`
`DISPLAY IMAGE SELECTION
`
`YES
`
`IPR2020-00343 Page 00008
`
`IPR2020-00343 Page 00008
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 6 of 28
`
`US 8,713,206 B2
`
`F I G. 4B-2
`
`
`
`ACQUIRE FILE IMAGE
`
`8812
`
`8813
`
`USB
`
`COMMUNICATION
`DISCONNECTED
`9
`
`
`
`
`
`
`
`8815
`
`USB
`COMMUNICATION
`DISCONNECTED
`?
`
` DISPLAY
`IMAGE END INSTRUCTION
`TAKES PLACE?
`
`IPR2020-00343 Page 00009
`
`NO
`
`DISPLAY INPUT IMAGE
`
`8814
`
`
`
`
`
`
`IPR2020-00343 Page 00009
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 7 of 28
`
`US 8,713,206 B2
`
`F I G. 4C-1
`
`PictBridge CONNECTION PROCESSING
`
`8817
`
`USB COMMUNICATION
`
`DISCONNECTED?
`
`
`
`
`
`PictBridge CONNECTION
`ESTABLISHED
`
`?
`
`DISPLAY INPUT WAITING WINDOW
`
`IPR2020-00343 Page 00010
`
`IPR2020-00343 Page 00010
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 8 of 28
`
`US 8,713,206 B2
`
`9
`
`F I G. 4C-2
`
`8821
`
`
`USB
` YES
`
`0
`COMMUNICATION
`DISCONIPNECTED
`
`
`
`
`PRINT JOB STARTED?
`
`
`
`
`
` USB
`COMMUNICATION
`
`DISCONONECTED
`
`YES
`
`NO
`
`ACQUIRE FILE INFORMATION
`
`8824
`
`8825
`
`USB
`COMMUNICATION
`DISCON9N ECTED
`
`
`
`YES
`
`NO
`
`ACQUIRE FILE IMAGE
`
`8826
`
`8827
`
`
`USB
`
`COMMUNICATION
`DISCONNECTED
`
`
`
`
`YES
`
`
`
`NO
`
`DISPLAY INPUT IMAGE
`
`8828
`
`
`
`
`
`IPR2020-00343 Page 00011
`
`IPR2020-00343 Page 00011
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 9 of 28
`
`US 8,713,206 B2
`
`W/
`
`V
` //
`///////
`
`\\\\\\\\\\\\
`
`////////////////////////////////////////////////////////////A
`\\
`
`\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`///////\\\\\\\\..\\\\\\\\\\\\\\\\\,\,\\\\\\\,\,\\\\\\\\\,\\/
`k\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`/////////\\\\\\\\\,\\\\\\\\,\\\\\\\\\\.\\\\\\\\,\\\\\\\\\. \\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\\
`
`V \§\\
`
`x\§§§§§§§§\§\§\
`
`ZZ/¢¢¢¢¢¢¢%¢
`
`\\§§\\§§\§
`
`'
`
`//////////////////////////////////////////////////////////////
`
`\\\\\\\\\\\\\\‘
`/
`/////////
`§\\\\\\\\\\\\\\
`
`§
`
`
`////////////////////////////////////////////////////////////\
`
`IPR2020-00343 Page 00012
`
`FIG. 5A
`
`FIG. 53
`
`FIG. 5C
`
`IPR2020-00343 Page 00012
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 10 of 28
`
`US 8,713,206 B2
`
`FIG. 6A
`
`PictBridge CONNECTION PROCESSING
`
`8817
`
`USB COMMUNICATION
`
`DISCONNECTED?
`
`
`
`
`
`PictBridge CONNECTION
`ESTABLISHED
`
`?
`
`DISPLAY INPUT WAITING WINDOW
`
`IPR2020-00343 Page 00013
`
`IPR2020-00343 Page 00013
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 11 of 28
`
`US 8,713,206 B2
`
`‘19
`
`FIG. 63
`
`
`
`S821
`
`YES
`
`
`
`
`
`
`USB
`COMMUNICATION
`DISCONINECTED
`
`
` 8830
`DISPLAY
`
`YES
`
`
`
`
`
`
`
` USB
`
`COMMUNICATION
`DISCON9NECTED
`
`81325
`
` USB
`
`
`0
`
`'NO
`
`
`
`
`
`NO
`
`DISPLAY INPUT IMAGE
`
`8828
`
`NOTIFY IDLE STATE
`
`8829
`
`IPR2020-00343 Page 00014
`
`COMMUBSHEEATION
`DISCONNECTED
`
`
`81327
`
`
`
`YES 0
`
`IPR2020-00343 Page 00014
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 12 of 28
`
`US 8,713,206 B2
`
`FIG. 7
`
`
`
`______________________________________________________________________________
`
`IPR2020-00343 Page 00015
`
`IPR2020-00343 Page 00015
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 13 of 28
`
`US 8,713,206 B2
`
`FIG. 8A
`
`DISPLAY
`
`OPERATION OF INPUT IMAGE IN
`PROGRESS
`?
`
`
`
`
`
`
`USB DEVICE REMOVAL
`RECOGNIZED?
`
`IPR2020-00343 Page 00016
`
`IPR2020-00343 Page 00016
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 14 of 28
`
`US 8,713,206 B2
`
`F I G. 83-1
`
`9
`
`READ DIRECTORY ENTRY
`
`S805
`
`81506
`
`
`USB
`
`
`COMMUNICATION
`DISCONNECTED
`
`?
`NO
`
`GI
`
`YES 0
`
`DISPLAY FILE SELECTION WINDOW
`
`8807
`
`
`81508
`
`USB
`COMMUNICATION
`DISCONNECTED
`
`?
`
`
`
`
`UPDATE FILE SELECTION WINDOW
`
`S811
`
`8809
`
`USER INSTRUCTION
`TAKES PLACE?
`
`YES
`
`YES
`
`0
`
`S810
`
`
`
`DISPLAY IMAGE SELECTION
`INSTRUCTION TAKES PLACE?
`
`
`YES
`
`IPR2020-00343 Page 00017
`
`IPR2020-00343 Page 00017
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 15 of 28
`
`US 8,713,206 B2
`
`F I G. 83-2
`
`ACQUIRE FILE IMAGE
`
`8812
`
`
`
`
`
`
`
`
`
`9
`
`S1513
`
`USB
`COMMUNICATION
`DISCONNECTED
`
`
`NO
`
`DISPLAY INPUT IMAGE
`
`8814
`
`S1515
`
`USB
`COMMUNICATION
`DISCONNECTED
`?
`
`
`
`
`
`
`
` DISPLAY
`IMAGE END INSTRUCTION
`TAKES PLACE
`?
`
`YES
`
`IPR2020-00343 Page 00018
`
`IPR2020-00343 Page 00018
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 16 of 28
`
`US 8,713,206 B2
`
`F | G. 8C-1
`
`PictBridge CONNECTION PROCESSING
`
`8817
`
`USB COMMUNICATION
`
`DISCONNECTED?
`
`
`
`
`
`PictBridge CONNECTION
`ESTABLISHED
`
`?
`
`DISPLAY INPUT WAITING WINDOW
`
`IPR2020-00343 Page 00019
`
`IPR2020-00343 Page 00019
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 17 of 28
`
`US 8,713,206 B2
`
`‘3’
`
`F I G. 8C-2
`
`S1521
`
`
`
`
` YES
`USB
`COMMUNICATION
`DISCONN ECTED
`
`
`
`
`NO
`
`S822
`
`
`PRINT JOB STARTED?
`
` YES
`USB
`COMMUNICATION
`
`DISCONvNECTED
`
`81523
`
`0
`
`G
`
`
`
`
`
`NO
`
`ACQUIRE FILE INFORMATION
`
`S1525
`
` USB
`COMMUNICATION
`DISCONON ECTED
`
`NO
`
`ACQUIRE FILE IMAGE
`
`8824
`
`YES @
`
`8826
`
`YES
`
`G
`
`S1527
`
`
`USB
`
`COMMUNICATION
`
`DISCON’N ECTED
`
`
`
`
`
`
`NO
`
`DISPLAY INPUT IMAGE
`
`3828
`
`NOTIFY IDLE STATE
`
`8829
`
`IPR2020-00343 Page 00020
`
`IPR2020-00343 Page 00020
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 18 of 28
`
`US 8,713,206 B2
`
`FIG. 9A
`
`DISPLAY
`
`OPERATION OF INPUT IMAGE IN
`PROGRESS
`?
`
`
`
`
`
`
`USB DEVICE REMOVAL
`RECOGNIZED?
`
`IPR2020-00343 Page 00021
`
`IPR2020-00343 Page 00021
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 19 of 28
`
`US 8,713,206 B2
`
`START
`
`8801
`
`‘E 8802
`
`DISPLAY CONNECT REQUEST WINDOW
`
`$1634
`
`9
`
`SET COUNT-DOWN TIMER
`
`
`
`USB COMMUNICATION
`
`
`
`ESTABLISHED?
`
`
`
`81635
`
`
`TIME-OUT OR USER
`INSTRUCTION TAKES
`PLACE?
`
`
`YES
`
`YES
`
`81636
`
`USB COMMUNICATION
`ESTABLISHED
`?
`
`YES
`
`MASS STORAGE
`CLASS
`
`9
`
`8804
`
`
`
`DETERMINE
`DEVICE CLASS
`
`
`6
`OTHER
`
`IMAGING
`CLASS
`
`8831 9
`
`DISPLAY INCOMPATIBILITY WINDOW
`
`NO
`
`8832
`
`
`USB
`
`COMMUNICATION
`DISCONNECTED
`
`’?
`
`FIG. QB
`
`YES
`o
`
`IPR2020-00343 Page 00022
`
`IPR2020-00343 Page 00022
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 20 of 28
`
`US 8,713,206 B2
`
`FIG. 10A
`
`
`
`DISPLAY
`
`OPERATION OF INPUT IMAGE IN
`PROGRESS
`
`?
`
`
`
`USB DEVICE REMOVAL
`RECOGNIZED?
`
`IPR2020-00343 Page 00023
`
`IPR2020-00343 Page 00023
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 21 of 28
`
`US 8,713,206 B2
`
`SET COUNT-DOWN TIMER
`
`USB COMMUNICATION
`ESTABLISHED?
`
`YES
`
` TIME-OUT OR
`USER INSTRUCTION
`TAKES PLACE?
`
`YES
`
`
`
`
`
`
`USB COMMUNICATION
`ESTABLISHED
`9
`
` '
`
`
`
`MASS STORAGE
`CLASS
`
`
`8804
`
`IMAGING
`CLASS DETERMINE
`DEVICE CLASS
`
`
`
`
`
`
`DISPLAY INCOMPATIBILITY WINDOW
`
`
`USB
`COMMUNICATION
`DISCONNECTED
`?
`
`YES
`
`FIG.
`
`1OB
`
`IPR2020-00343 Page 00024
`
`IPR2020-00343 Page 00024
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 22 of 28
`
`US 8,713,206 B2
`
`
`
`FIG. 11B
`
`9101
`
`9011
`
`9015
`
`9016
`
`IPR2020-00343 Page 00025
`
`IPR2020-00343 Page 00025
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 23 of 28
`
`US 8,713,206 B2
`
`FIG. 12
`
`
`
`
`
`
`FLASH
`MEMORY
`
`PROJECTOR
`
`DISPLAY CONNECTION
`REQUEST WINDOW
`
`
`
`
`
`
`
`DEVICE CONNECTION
`
` S201
`
`ESTABLISH USB S202
`CONNECTION
`
`READ DIRECTORY S203
`
`ENTRY
`g
`
`
`
`
`
`
`
`
`DISPLAY FILE
`3204
`S205
`"DISPLAY"
`SELECTION WINDOW
`
`INSTRUCTION
`3
`
`8206
`
`READ IMAGE FILE
`
`"DISPLAY END"
`INSTRUCTION
`
`2 7
`
`DISPLAY IMAGE
`
`
`
`____________________
`
`DEVICE REMOVAL
`
`S209
`
`
`
`
`DISPLAY CONNECTION
`REQUEST WINDOW
`
`IPR2020—00343 Page 00026
`
`IPR2020-00343 Page 00026
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 24 of 28
`
`US 8,713,206 B2
`
`F | G. 13A
`
`F | G_ 133
`
`
`
`V//////////////////////////////////////////////////////////////
`
`V
`2/
`¢\\\\\\\ /
`g\
`CONNECT USB DEVICE
`g
`/
`/
`%
`%
`%
`¢
`%
`%
`K
`%
`é)”
`/,
`
`V///////////////////////////////////////////////////////////[/%
`
`/
`
`/
`
`/
`
`img0004.jpg
`
`
`
`%
`SELE(i3nT]g[(:|080F1’II_j:;(FILE
`g§
`g
`img0002.jpg
`é\
`g
`imgOOO3.jpg
`é§
`g
`img0005.jpg
`g§
`/
`/
`%
`%
`é§\\\\\\\\\\\\\\\\\\\\\\\\ /%
`//////////////////////////////////////////////////////////////%
`
`
`
`F | G. 13C ¢
`
`V/////////////////////////////////////////////////////////////
`
`W
`
`1\\\\\\\\\\\\\.\\\\\\\\\\\\\\\\\\\\\\,\.\\\\\\\
`
`WWI/WM
`
`IPR2020-00343 Page 00027
`
`IPR2020-00343 Page 00027
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 25 of 28
`
`US 8,713,206 B2
`
`FIG. 14A
`
`
`
`9401
`
`9402
`
`IPR2020-00343 Page 00028
`
`IPR2020-00343 Page 00028
`
`

`

`U.S. Patent
`
`Apr. 29, 2014
`
`Sheet 26 of 28
`
`US 8,713,206 B2
`
`._.mO_._mm:
`
`mm._._Om._.zOo
`
`m_O_>m_n_mm:
`
`
`mm._._Om._.Zoo
`
`IPR2020-00343 Page 00029
`
`IPR2020-00343 Page 00029
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 27 of 28
`
`US 8,713,206 B2
`
`I: I (3.
`
`'155
`
`DIGITAL CAMERA
`
`PRINTER
`
`DEVICE CONNECTION
`
`8500
`
`ESTABLISH USB
`CONNECTION
`
`$501
`
`ESTABLISH PiCtBridge S502
`CONNECTION
`
`"PRINT" INSTRUCTION
`
`S504
`
`S505
`
`8506
`
`START PRINT JOB
`
`ACQUIRE FILE
`INFORMATION
`
`ACQUIRE FILE IMAGE
`
`I
`i
`
`8508
`
`NOTIFY IDLE STATE
`
`
`
`DEVICE REMOVAL
`
`S509
`
`IPR2020-00343 Page 00030
`
`IPR2020-00343 Page 00030
`
`

`

`US. Patent
`
`Apr. 29, 2014
`
`Sheet 28 of 28
`
`US 8,713,206 B2
`
`FIG. 16
`
`92
`
`\“\\\W
`
`\
`
`
`
`
`
`
`
`\‘M‘hm‘n
`
`9401 9402
`
`IPR2020-00343 Page 00031
`
`IPR2020-00343 Page 00031
`
`

`

`US 8,713,206 B2
`
`1
`DISPLAY APPARATUS, CONTROL METHOD
`THEREOF, AND PROGRAM
`
`This application is a continuation of application Ser. No.
`13/281,543, filed Oct. 26, 2011, now US. Pat. No. 8,078,767,
`issued Dec. 13, 201 1, which is a divisional of application Ser.
`No. 12/545,270, filed Aug. 21, 2009, which is a continuation
`of PCT Application No. PCT/JP/2009/055831, filed Mar. 24,
`2009.
`
`TECHNICAL FIELD
`
`The present invention relates to a display apparatus, a
`control method thereof, and a program.
`
`BACKGROUND ART
`
`Conventionally, a display apparatus such as a projector is
`connected to various devices via, for example, USB (Univer-
`sal Serial Bus), and displays image data transmitted from
`these connected devices. Various devices connected to the
`
`display apparatus include a semiconductor memory device
`such as a flash memory device, a PC (Personal Computer), a
`digital still camera (to be referred to as a “digital camera”
`hereinafter), and the like.
`A case will be explained first with reference to FIGS. 11A
`to 13C wherein a flash memory as a semiconductor memory
`device is connected to a projector as a display apparatus, and
`image data stored in that flash memory is displayed on the
`projector. FIG. 11A is a schematic view showing an overview
`when a flash memory 93 is connected to a conventional pro-
`jector 91 to display an image. FIG. 11B is a schematic view
`showing details of a control panel 9101. FIG. 12 is a sequence
`chart showing the operation sequence executed when the
`flash memory 93 is connected to the projector 91 to display an
`image. FIGS. 13A to 13C are schematic views exemplifying
`images to be projected by the projector 91 onto a screen 92.
`As shown in FIG. 11A, the projector 91 has the control
`panel 9101 and a USB connector 9102. As shown in FIG.
`11B, the control panel 9101 has an up arrow button 9011, left
`arrow button 9012, down arrow button 9013, right arrow
`button 9014, enter button 9015, input button 9016, and power
`button 9017. The projector 91 accepts operation instructions
`from the user from various buttons on the control panel 9101.
`The USB connector 9102 receives the flash memory 93 hav-
`ing a USB connection terminal. This flash memory 93 stores
`image data to be displayed by the projector 91. By the user
`plugging the flash memory 93 into the USB connector 9102
`and operating the control panel 9101, he or she can browse
`image data stored in the flash memory 93 as an image 921 on
`the screen 92.
`
`The operation sequence among the user, flash memory 93,
`and projector 91 will be described below. Assume that the
`projector 91 is powered, and the flash memory 93 is not
`connected to the projector 91 in an advance state. As shown in
`FIG. 12, the operation sequence by the user, flash memory 93,
`and projector 91 mainly include steps $200 to $210 which are
`executed in turn. In step $200, the projector 91 displays a
`connection request window that requests the user to connect
`the flash memory 93 to the USB connector 9102 by projecting
`that window on the screen 92. The connection request win-
`dow in step $200 displays a message that prompts the user to
`connect the flash memory 93 as a USB device, as shown in
`FIG. 13A.
`
`In step $201, the user connects the flash memory 93 to the
`USB connector 9102. In step $202, a USB communication is
`established based on the USB standard between the projector
`
`5
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`2
`
`91 and flash memory 93 which are physically connected via
`the USB connector 102. In this case, the projector 91 recog-
`nizes the flash memory 93 as Mass Storage Class based on the
`USB standard.
`
`In step $203, the projector 91 reads directory entry infor-
`mation stored in the flash memory 93. In step $204, the
`projector 91 displays a file selection window that prompts the
`user to select an image file to be displayed by projecting that
`window on the screen 92. The file selection window in step
`$204 is as shown in FIG. 13B, and is a window that displays
`a file name list of image files stored in the flash memory 93,
`and a cursor used to select them.
`
`In step $205, the user who confirmed the aforementioned
`file selection window selects an image file to be displayed by
`operating the control panel 9101 and issues a display instruc-
`tion to the projector 91. For example, in step $205 the user
`gives an instruction to move the cursor by pressing the up or
`down arrow button 9011 or 9013 on the control panel 9101,
`and issues a display instruction of an image file selected by
`the cursor by pressing the enter button 9015.
`In step $206, the projector 91 reads data of the image file
`designated in step $205 from the flash memory 93. In step
`$207, the projector 91 displays an image based on the image
`file read in step $206 by projecting that image on the screen
`92. As the image displayed in step 8207, image data of a
`landscape or the like captured using a digital camera is stored
`in advance in the flash memory 93, as shown in FIG. 13C.
`In step $208, the user issues a display end instruction to the
`projector 91 by operating the control panel 9101. More spe-
`cifically, when the user presses the enter button 9015, a dis-
`play end instruction is issued to the projector 91. Note that the
`operations for accepting selection of an image file by the user
`and displaying the selected image file can be repeated by
`repeating steps $204 to $208 bounded by the broken line in
`FIG. 12.
`
`In step $209, the user removes the flash memory 93 from
`the USB connector 9102. In step $210, the projector 91 clears
`a display image projected onto the screen 92 (or overwrites
`the image by a predetermined image such as a menu window)
`due to removal of the flash memory 93 in step $209. For
`example, in step $210 the connection request window shown
`in FIG. 13A is overwritten on an image displayed in steps
`$204 to $208.As a result, the projector 91 can prompt the user
`to connect the next device. The user removes the flash
`
`memory 93 with the intention to end browsing of image files
`stored in the flash memory 93. Therefore, since the projector
`91 clears an image displayed in steps $204 to 8208, it can
`attain an image display operation according to the user’s
`intention.
`
`Note that patent reference 1 is known as a technique of
`clearing (overwriting) a display image by a predetermined
`image in step $210 above. Patent reference 1 discloses a
`technique for clearing a display image at the end of a com-
`munication and a technique for clearing a previous display
`image at the beginning of a communication.
`A case will be exemplified below wherein another example
`of various devices to be connected is a digital camera. Note
`that a case will be exemplified below with reference to FIGS.
`14A and 14B, and FIG. 15 wherein a digital camera is con-
`nected to a printer, and the printer outputs an image based on
`image data stored in that digital camera. As a typical example
`in this case, the CIPA DC-001-2003 standard (to be referred
`to as “PictBridge” hereinafter) is available. In a method of
`outputting an image using this PictBridge, even a user
`unskilled in operations of devices such as PCs can output an
`
`IPR2020-00343 Page 00032
`
`IPR2020-00343 Page 00032
`
`

`

`US 8,713,206 B2
`
`3
`image using a printer by readily operating a digital camera.
`An image output operation using the PictBridge will be
`described below.
`
`FIG. 14A is a schematic View showing an overview when a
`digital camera 94 is connected to a printer 96 to output an
`image. FIG. 14B is a block diagram showing the arrangement
`associated with a communication between the printer 96 and
`digital camera 94. FIG. 15 is a sequence chart showing the
`operation sequence when the digital camera 94 is connected
`to the printer 96 to output an image.
`As shown in FIG. 14A, the printer 96 has a discharge port
`9601 and USB connector 9602. The discharge port 9601
`discharges a paper sheet 9603 after image formation. To the
`USB connector 9602, the digital camera 94 is connected Via a
`USB cable 95. The digital camera 94 has a liquid crystal panel
`screen 9401, operation member 9402, and PictBridge button
`9403. The liquid crystal panel screen 9401 displays a preView
`of an image or the like transferred Via the PictBridge. The
`operation member 9402 accepts an image selection instruc-
`tion from the user. The PictBridge button 9403 is a button
`which accepts an instruction to start PictBridge transfer from
`the user. An image based on image data stored in the digital
`camera 94 is output onto a paper sheet in the printer 96 in such
`a manner that an image output instruction is output to the
`printer 96 by an operation on the digital camera 94 side, and
`image data to be output is transmitted from the digital camera
`94 to the printer 96.
`The operation sequence among the user, digital camera 94,
`and printer 96 will be described below. As shown in FIG. 15,
`the operation sequence by the user, digital camera 94, and
`printer 96 mainly includes steps $500 to $509, which are
`executed in turn. In step $500, the user connects the digital
`camera 94 and printer 96 Via the USB cable 95. In step $501,
`a USB communication is established based on the USB stan-
`
`dard between the digital camera 94 and printer 96 which are
`physically connected Via the USB cable 95. In this case, the
`printer 96 recognizes the digital camera 94 as a capture deVice
`of Imaging Class based on the USB standard.
`In step $502, a PictBridge connection is established
`between the digital camera 94 and printer 96. More specifi-
`cally, a connection is established in a PTP (Picture Transfer
`Protocol) layer, deVice information is exchanged, and so
`forth. Then, a communication state as a PictBridge sequence
`transits to an idle state, and the printer 96 waits for issuance of
`a print job by the digital camera 94.
`In step $503, the user issues a print instruction Via the
`PictBridge by operating the digital camera 94. More specifi-
`cally, this print instruction in step $503 is issued when the
`user presses the PictBridge button 9403. In step $504, the
`digital camera 94 transmits a PictBridge print job to the
`printer 96 based on the print instruction in step $503, and the
`printer 96 starts the operation of that print job.
`In step $505, the printer 96 requests the digital camera 94
`to transmit file information to be printed in accordance with
`the print job in step $504, and acquires that file information.
`Likewise, in step $506 the printer 96 requests the digital
`camera 94 to transmit a file image (image data) to be printed
`in accordance with the print job in step $504, and acquires
`that file image.
`In step $507, the printer 96 executes decoding, scaling,
`print processing, and the like of an image indicated by the file
`acquired in steps $505 and $506, and outputs the paper sheet
`9603 after image formation from the discharge port 9601. In
`step $508, the printer 96 notifies the digital camera 94 of an
`idle state upon completion of the print job. Note that the
`operations for accepting selection of an image to be printed
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`4
`
`from the user, and printing out the selected image can be
`repeated by repeating steps $503 to $508 bounded by the
`broken line in FIG. 15.
`
`In step $509, the user rem0Ves the USB cable 95 from the
`printer 96 or digital camera 94. Note that a deVice, which can
`control a communication session and logically disconnects a
`communication connection like the digital camera 94, often
`disconnects a communication like closing of a communica-
`tion session in addition to a physical communication discon-
`nection by, for example, rem0Val of the USB cable 95. For
`example, when the battery remaining amount lowers during
`the aforementioned PictBridge sequence, the digital camera
`94 side may execute control for disconnecting a USB com-
`munication so as to reduce consumption power.
`A communication disconnection on the digital camera 94
`side will be explained below by exemplifying the arrange-
`ment associated with a communication between the digital
`camera 94 and printer 96. As shown in FIG. 14B, a USB host
`controller 9604 on the printer 96 side is connected to a USB
`deVice controller 9407 on the digital camera 94 side Via the
`USB cable 95. The USB cable 95 includes four signal lines,
`that is, a VBUS line 9501, D+line 9502, D— line 9503, and
`GND line 9504.
`The D+ line 9502 and D— line 9503 are used to transmit
`
`differential signals required to make a USB data communi-
`cation, and also indicate a deVice connection state by a Volt-
`age in a steady state. The D+ line 9502 and D— line 9503 are
`respectiVely pulled down by resistors 9606 and 9605 on the
`printer 96 side, and indicate a Low Voltage when no USB
`cable is connected. Thus, the printer 96 recognizes a USB
`non-connection state. On the other hand, when the printer 96
`and digital camera 94 are connected, the D+ line 9502 is
`pulled up by a resistor 9406 Via a switch 9405 on the digital
`camera 94 side. Then, when the switch 9405 is in a connection
`state, the D+ line 9502 indicates a High Voltage. As a result,
`the printer 96 recognizes a USB connection state.
`A CPU 9404 controls the switch 9405 on the digital camera
`94 side. Note that the CPU 9404 executes the following
`processing for the purpose of, for example, reducing con-
`sumption power ofthe digital camera 94. For example, in step
`$508 in which the PictBridge sequence transits to an idle state
`upon completion of the print job, the CPU 9404 controls the
`switch 9405 on the digital camera 94 side to stop to pull up the
`D+ line 9502. In this case, the D+ line 9502 indicates a Low
`Voltage since it is pulled down on the printer 96 side. For this
`reason, the USB host controller 9604 recognizes a USB non-
`connection state and disconnects a USB communication,
`since this state is electrically equiValent to cable rem0Val in
`association with the D+ line 9502. That is, the communication
`session between the digital camera 94 and printer 96 is closed
`by the control on the digital camera 94 side for the purpose of,
`for example, reducing consumption power.
`When a communication disconnection is made on the digi-
`tal camera 94 side, as described ab0Ve, the user meets the
`same behaVior as that when the USB cable 95 is rem0Ved at
`
`the end of the print processing of the printer 96. That is, the
`PictBridge sequence reaches the same state as that when the
`process reaches step 8509.
`Note that the PictBridge that assumes printing has been
`exemplified, but the PictBridge is applicable to a display on a
`display apparatus such as a projector or teleVision. For
`example, when the digital camera 94 is connected to the
`projector 91 to display an image, as shown in FIG. 16, the
`PictBridge allows the projector 91 to project and display an
`image transmitted from the digital camera 94 by a simple
`operation on the digital camera 94 side. Like in the case in
`which the printer 96 and digital camera 94 are connected,
`
`IPR2020-00343 Page 00033
`
`IPR2020-00343 Page 00033
`
`

`

`5
`when a communication is disconnected on the digital camera
`94 side, the user meets the same behavior as that when the
`USB cable 95 is removed. That is, the projector 91 clears an
`image which was transmitted from the digital camera 94 and
`was displayed immediately before the communication dis-
`connection by displaying,
`for example,
`the connection
`request window.
`As a technique for disconnecting a USB communication
`from the device side, patent reference 2 is known. Patent
`reference 2 discloses a technique for disconnecting a com-
`munication by stopping to pull up a data line on the device
`side based on a disconnection instruction from the host side.
`
`Patent Reference
`7-123379
`
`1:
`
`Japanese Patent Laid-Open No.
`
`Patent Reference 2: Japanese Patent Laid-Open No. 2006-
`235993
`
`DISCLOSURE OF THE INVENTION
`
`Problems that the Invention is to Solve
`
`As described above, the conventional display apparatus
`can be connected to various devices, and can display image
`data stored in a connected device. However, independently of
`the device class to be connected, when a communication is
`disconnected, the display operation of an image transmitted
`from that device ends. For this reason, in addition to the image
`display end operation that the user intended by removing the
`flash memory or USB cable, the image display operation
`often ends without the intention of the user by the control on
`the device side that logically disconnects a communication
`connection.
`
`The present invention handles at least one of such conven-
`tional problems. That is, the present invention provides a
`display apparatus, which can control to continue or end a
`display operation according to a device class when a commu-
`nication connection with a device is disconnected during
`execution of the display operation based on data transmitted
`from the connected device, a control method thereof, and a
`program.
`
`Means of Solving the Problems
`
`According to the first invention of the present application,
`there is provided a display apparatus characterized by com-
`prising a display unit, a connection unit configured to connect
`an external device to be able to communicate with the external
`
`device, and a control unit configured to control the display
`unit to make a display based on data received from the exter-
`nal device with which a communication connection is estab-
`lished via the connection unit, characterized in that the con-
`trol unit acquires class information indicating a class of the
`external device from the external device via the connection
`
`35
`
`40
`
`45
`
`50
`
`unit, controls the display unit to continue the display based on
`the data received from the external device at the time of
`disconnection of the communication connection with the
`
`55
`
`external device ifthe class of the external device indicated by
`the class information is a predetermined class, and controls
`the display unit to end the display based on the data received
`from the external device at the time of disconnection of the
`communication connection with the external device if the
`
`class of the external device indicated by the class information
`is not the predetermined class.
`According to the second invention of the present applica-
`tion, there is provided a control method of a display apparatus
`which comprises a display unit, a connection unit configured
`to connect an external device to be able to communicate with
`
`60
`
`65
`
`US 8,713,206 B2
`
`6
`the external device, and a control unit configured to control
`the display unit to make a display based on data received from
`the external device with which a communication connection
`
`is established via the connection unit, the method character-
`ized by comprising the control step of acquiring class infor-
`mation indicating a class of the external device from the
`external device via the connection unit, controlling the dis-
`play unit to continue the display based on the data received
`from the external device at the time of disconnection of the
`communication connection with the external device if the
`
`class of the external device indicated by the class information
`is a predetermined class, and controlling the display unit to
`end the display based on the data received from the external
`device at the time of disconnection of the communication
`connection with the external device ifthe class ofthe ex