IPR No.: IPR2016-00500
`Patent No. 7,864,163
`
`EXHIBIT 1001
`
`

`
`USOO7864163B2
`
`(12) United States Patent
`Ording et al.
`
`(10) Patent N0.:
`(45) Date of Patent:
`
`US 7,864,163 B2
`Jan. 4, 2011
`
`(54) PORTABLE ELECTRONIC DEVICE,
`METHOD, AND GRAPHICAL USER
`INTERFACE FOR DISPLAYING
`STRUCTURED ELECTRONIC DOCUMENTS
`
`(58) Field of Classi?cation Search ....... .. 345/ 1734178;
`178/18.01*18.09, 18.11; 715/810, 8284831,
`715/234, 781, 700
`See application ?le for complete search history.
`
`(75) Inventors: Bas Ording, San Francisco, CA (US);
`Scott Forstall, Mountain View, CA
`(Us); Greg Christie, San Jose, CA (Us);
`Stephen O. Lemay, San Francisco, CA
`(US); Imran Chaudhri, San Francisco,
`CA (US); Richard Williamson, L05
`Gatos, CA (U S); Chris Blumenberg,
`San Francisco, CA (US); Marcel Van
`Os, San Francisco, CA (U S)
`
`(73) Assignee: Apple Inc., Cupertino, CA (US)
`
`( * ) Notice:
`
`Subject to any disclaimer, the term Ofthis
`patent is extended or adjusted under 35
`U_S_C_ 15403) by 688 days_
`
`(21) Appl.No.: 11/850,013
`
`(22) Filed:
`
`Sep. 4, 2007
`
`(65)
`
`Prior Publication Data
`US 2008/0094368 A1
`Apr. 24, 2008
`
`_
`_
`Related U's' Apphcatlon Data
`(60) Provisional application No. 60/937,993, ?led on Jun.
`29s 2007, provisional application No_ 60/946,715’
`?led on Jun 27, 2007, provisional application NO_
`60/879,469’ ?led on Jan 8’ 20073provisiona1 applica_
`tion NO_ 60/879,253, ?led on Jan 7, 2007aprovisiona1
`application NO 60/824,769, ?led on Sep 6’ 2006~
`
`51
`(
`)
`
`Int, Cl,
`(2006.01)
`G06F 3/041
`(52) US. Cl. ...................... .. 345/173; 715/234; 715/781
`
`56
`(
`)
`
`EP
`
`C't d
`R f
`e erences l 6
`US. PATENT DOCUMENTS
`6,025,842 A
`2/2000 Filetto et a1. .............. .. 345/345
`_
`(Commued)
`FOREIGN PATENT DOCUMENTS
`0476972 A2
`3/1992
`
`(Continued)
`
`OTHER PUBLICATIONS
`Milic-Frayling, N. et al., “Smartview: Enhanced Document Viewer
`for Mobile Devices,” Microsoft Technical Report, Nov. 15, 2002,
`URL:
`ftp://ftp.research.microsoft.com/pub/tr/tr-2002-ll4.pdf,
`retrieved Dec. 17,2007.
`
`(Continued)
`Primary ExamineriStephen G Sherman
`(74) Attorney, Agent, or FirmiMorgan, Lewis & Bockius
`LLP
`
`(57)
`
`ABSTRACT
`
`A computer-implemented method, for use in conjunction
`with a portable electronic device with a touch screen display,
`comprises displaying at lea“ a Portion Of a Strucmred 9199'
`tronic document on the touch screen display, wherein the
`structuredelectronic document comprises aplurality ofboxes
`of content, and detecting a ?rst gesture at a location on the
`displayed portion of the structured electronic document. A
`?rst box in the plurality of boxes at the location of the ?rst
`gesture is determined. The ?rst box on the touch screen dis
`la is enlar ed and substantiall centered.
`P y
`g
`y
`
`61 Claims, 29 Drawing Sheets
`
`Ponabla Multlluncllon Devlce
`100
`
`Speaksr?l
`
`3900A
`
`sensor 163
`
`Proximity
`Sensor 1.5.6
`
`4’ 492
`
`Current Time ADA
`
`n m
`
`<6 ago;
`
`Welcome 3% m \\
`
`http://www.oompany.comlstart m cm
`Web page
`m
`
`Block 3
`3914-3
`
`Block 1
`5913-1
`
`Block 7
`351-41
`
`Block4
`@444
`
`

`
`US 7,864,163 B2
`Page 2
`
`US. PATENT DOCUMENTS
`
`6/2000 Heikkinen et al. ........ .. 455/575
`6,073,036 A
`1/2001 Cragun ........ ..
`345/340
`6,177,936 B1
`3/2001 Ferrel et al. .
`707/522
`6,199,082 B1
`6/2001 Molne ......... ..
`345/173
`6,243,080 B1
`7/2001 Coleman et al
`345/348
`6,262,732 B1
`12/2001 MOtt et al
`345/439
`6,326,970 B1
`2/2002 LortZ ....... ..
`725/110
`6,349,410 B1
`3/2002 Singh
`345/173
`6,359,615 B1
`6/2002 Murphy
`345/173
`6,411,283 B1
`10/2002 Feinstein .
`345/158
`6,466,198 B1
`6,466,203 B2 10/2002 Van Ee
`345/173
`6,489,975 B1
`12/2002 Patil et al.
`345/781
`6,570,583 B1
`5/2003 Kung et al. .
`345/661
`6,613,100 B2
`9/2003 Miller ...... ..
`715/526
`6,639,584 B1
`10/2003 Li ...... ..
`345/173
`6,771,250 B1
`8/2004 Oh_'
`345/156
`6,928,461 B2
`800% Tull ~~~~~~ ~~
`709/203
`7,054,965 B2
`5/2006 Bell et ni
`-- 710/72
`7,075,512 B1
`7/2006 Fame et al'
`345/156
`7’149’549 Bl
`12/2006 OmZ_et al'
`455/566
`7’166’791 B2
`1/2007 RObbln et 31' ' ' ' ' '
`' ' ' ' " 84/477
`7,346,855 B2
`“008 Hellyar et ai ----- ~~
`715/783
`7,461,353 B2 12/2008 Rohrabaugh et al. .
`715/815
`
`6/2000
`2000181436
`JP
`9/2005
`2005 267049
`JP
`WO 99/54807 A1 10/1999
`W0
`WO 02/46903 A1
`6/2002
`W0
`W0 02/082418 A2 10/2002
`W0
`W0 02/093542 A1
`11/2002
`W0
`WO 02093542 Al * 11/2002
`W0
`W0 03/052626 A1
`6/2003
`W0
`W0 WO 2004/021166 A1
`3/2004
`W0 WO 2004/040481 A1
`5/2004
`W0 W0 Zoos/036416 A2
`4/2005
`W0 WO 2005/074268 A1
`8/2005
`W0 W0 Zoos/106684 A1 11/2005
`W0 WO 2006/003591 A2
`1/2006
`
`OTHER PUBLICATIONS
`Holmquist, L., “The Zoom Browser Showing Simultaneous Detail
`and Overview in Large Documents,” Human IT, 1998, URL : http://
`www.hb.se/bhs/ith/3-98/leh.htm, retrieved Dec. 17, 2007.
`Khella,A. et al., “Pocket PhotoMesa: AZoomable Image Browser for
`PDAs,” Proceedings of the 3rd International Conference on Mobile
`and Ubiquitous Multimedia, Oct. 29, 2004, pp. 19-24, URL: http://
`delivery.acm.org/10.1145/1060000/1052384/p19-khella.
`pmkeyl:1052384&key2:2419987911&001 IIGUIDE
`
`Dutta et
`
`. . . . . . . . ..
`
`retrieved
`
`707/513
`345/613
`345/864
`345/815
`345/786
`
`2/2003 Sena etal.
`2003/0033331 A1
`500% Kaaslla et al' '
`2003/0095135 A1
`5/2003 Johnson .......... ..
`2003/0095155 A1
`9/2003 Barbanson et al.
`2003/0164861 A1
`2003/0193524 A1 10/2003 Bates et al.
`52:11:23;
`.
`.
`'
`345/702
`9/2004 LinJama
`2004/0169674 A1
`345/649
`2004/0201595 A1 10/2004 Manchester .
`707/102
`Zoos/0071364 A1
`300%. Xie et al‘
`715/822
`Zoos/0071778 A1
`300% Tokkonen
`. 345/702
`2005/0079896 A1
`4/2005 Kokko etal.
`2005/0093826 A1
`5/2005 Huh ......................... .. 345/168
`2005/0114788 A1
`5/2005 Fabritius ................... .. 715/767
`
`"
`
`7/2005 Lamkin etal.
`725/43
`2005/0166232 A1
`8/2005 Agrawala etal. ......... .. 715/512
`2005/0177783 A1
`2005/0285880 A1 12/2005 Laietal. .................. .. 345/660
`2006/0026521 A1
`2/2006 Hotelling etal. ..
`2006/0033761 A1
`2/2006 Suen et al. ................ .. 345/660
`2006/0064647 A1
`3/2006 Tapuska etal. ........... .. 715/800
`2006/0085743 A1
`4/2006 Baudisch et a1. ..
`2006/0097991 A1
`5/2006 Hotelling etal. .......... .. 345/173
`2006/0101354 A1
`5/2006 Hashimoto et a1. ........ .. 715/863
`2006/0125799 A1* 6/2006 Hillisetal. ..... ..
`345/173
`2006/0143574 A1
`6/2006 Ito etal. ................... .. 715/800
`2006/0146016 A1
`7/2006 Chan et al. ................ .. 345/156
`2006/0146038 A1
`7/2006 Park etal.
`345/173
`2006/0197753 A1
`9/2006 Hotelling .................. .. 345/173
`2006/0277588 A1 12/2006 Harrington et a1. ........ .. 725/135
`2006/0284852 A1* 12/2006 Hofmeister etal. ..
`345/173
`2007/0038612 A1
`2/2007 Sull et al. .................... .. 707/3
`2007/0152984 A1
`7/2007 Ording et al. ............. .. 345/173
`2007/0155434 A1
`7/2007 Jobs et al. .... ..
`455/565
`2007/0157228 A1
`7/2007 Bayer et al. ................. .. 725/34
`2007/ 0250768 A1 * 10/ 2007 Funakami et al. ......... .. 715/ 521
`
`FOREIGN PATENT DOCUMENTS
`
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`EP
`JP
`
`0 651 544 A2
`0 701 220 A1
`0880090 A2
`0 990 202 A1
`1 049 305 A1
`1 517 228 A2
`1 632 874 A2
`1 752 880 A1
`11 143604
`
`5/1995
`3/1996
`11/1998
`4/2000
`11/2000
`3/2005
`3/2006
`2/2007
`5/1999
`
`Dec, 17, 2007‘
`Invitation to Pay Additional Fees for International Application PCT/
`USZOO7/077644, dated Jan, 23, 2008‘
`Cooper, A” “The Inmates Are Running the Asylum,” Sams Publish_
`ing, 1999,1311 138447,
`European Search Report dated Jan. 26, 2010, received in European
`Application No. 09171787.6-2212, which corresponds to US. Appl.
`
`NO' .11/850’013'
`.
`.
`.
`Versiontracker, “Photogatheri7.2.6. Hi-res Image Viewer & Editor
`forPalm, printedJun. 12,2006, 5pages,http://www.versiontracker.
`Convdymnlore‘nfO/PMHVMM'
`.
`.
`.
`Of?C? AFtlon dated SeP~ 28’ 2099i recelved “1 Austrahan Patent
`APPhCat‘On NO' 2009100760, Wh1°h corresponds to Us APPI' NO'
`
`“£50,013
`_
`_
`n
`_
`_
`_
`_
`Agnrwali A» lTuneSInllneVIdeoi Dlgltal InsplmtlonfThe Tech
`Gu‘dei
`27
`Pages,
`httP//Ilabn°1'blogspomon?
`200640941Liabnolemhlvehtml
`_
`_
`Ahniad L et all “Content-Based Iniage Retrieval on Mobile
`DevtcesziOQOfSPIE-IS&TEie°tr°n1°Imaging/vol 5684,2005,
`10 Pagen
`Alain, H- et n1» “Web Document Manipulation for Small Screen
`DevineSI A Review,” 4 Pages, httPI//WWW~°S°~1iV~a°~UW~Wda2003/
`Papers/SentiOnJI/PnperigPdf, 2001
`AppnrnON- etnl, “Level 1 DocumentObjeetMOdel Speci?cation,”
`W3C Working Draft Jul 20, 1998, 3 Pages, httPI//WWW~W3~Org/TIV
`WD-DOM/
`B08, B. et al., “3 Conformance: Requirements and Recommenda
`tions,” Cascading Style Sheets, level 2 C332 Speci?cation, W3C
`Recommendation, May 12, 1998, 6 pages, http://wwwwlorg/TIU
`CSSZl/conformhtm1#doctree
`Chen, L. et al., “DRESS: A Slicing Tree Based Web Representation
`for Various Display Sizes,” Microsoft Researach, Technical Report
`MSR-TR-2002-126, Nov. 16, 2002, 9 pages.
`Eyemodule, “TurnYour HandspringTM Handheld into a Digital Cam
`era,” User’s Manual, www.eyemodule.com, 9 pages, 2000.
`Fling, B., “Designing for Mobile, Bringing Design Down to Size,”
`Copyright© 2006 Blue Flavor.
`Hart, K., “Rewriting the Web for Mobile Phones,” washingtonpost.
`com, Jul. 26, 2006, 2 pages, http://www.washingtonpost.com/wp
`dyn/content/article/2006/07/25/AR2006072501517ipf.html.
`Hinckley et al., “Input/Output Devices and Interaction Techniques,”
`Microsoft Research, 79 pages, 2003.
`Laakko, T. et al., “Adapting Web Content to Mobile User Agents,”
`IEEE Internet Computing, vol. 9, Issue 2, Mar/Apr. 2005, 8 pages.
`Opera Software, “Download the Opera MobileTM Browser,” 5 pages,
`http://www.opera.com/products/mobile/products/, 2006.
`
`

`
`US 7,864,163 B2
`Page 3
`
`Opera Software, “Opera 7.60 for Series 60 Mobile,” http://jp.opera.
`com/support/tutorials/s60/760/O760manual.pdf, 2009.
`Palme, J. et al., “MIME Encapsulation of Aggregate Documents,
`such as HTML,” The Internet Society, 1999, 24 pages.
`Raman, B. et al., “Application-speci?c Workload Shaping in Multi
`media-enabled Personal Mobile Devices,” CODES + ISSS’ 06, Oct.
`22-25, 2006, Seoul, Korea, Copyright 2006 ACM, 6 pages.
`Robie, J ., “What is the Document Object Model?” Texcel Research,
`5 pages, http://www.w3.orgTR-DOM/introduction.htrnl, 2006.
`Rohrer, T., “Metaphors We Compute by: Bringing Magic into Inter
`face Design,” http://www.uoregon.edu/-uophil/metaphor/gui4web.
`htm, printed Jun. 13, 2006, 7 pages.
`Roto, V. et al. “Minimaij Web Page Visualization Method for
`Mobile Phones,” CHI 2006, Nokia Research Center, Apr. 22-27,
`2006, 10 pages.
`Salmre, 1., “Chapter 2, Characteristics of Mobile Applications,”
`Salmei02.fm, pp. 19-36, Dec. 20, 2004.
`Schreiner, T., “High DPI in IE: Tip & Mystery Solved,” Tony
`Schreiner’s Weblog, May 2004, 2 pages, http://blogs.msdn.com/
`tonyschr/ archive/ 2004/ 0 5/ 05/ 1 26305 .aspx.
`Stamp?i, T., “Exploring Full-Screen Mode in Flash Player 9,” Jan. 5,
`2007,
`http://web.archive.org/web20070105231635/http://www.
`adobe .com/devnet/?ashplayer/articles/fulll 3 screenimode .htrnl.
`Stanek, W. et al., “Chapter 9, Video and Animation Plug-Ins,” Web
`Publishing Professional Reference Edition, copyright 1997 by Sams.
`net Publishing, http://www.ssuet edu.pldtaimoor/books/1-57521
`198-X/index.htm.
`Stanek, W. et al., “Chapter 22, Adding Multimedia to Your Web Site,”
`Web Publishing Professional Reference Edition, copyright 1997 by
`Sams.net Publishing, http://www.ssuet.edu.pldtaimoor/books/1
`57521-198-X/index.htm.
`Sur?n’Safari, “XUL,” 7 pages, Oct. 2003, http://weblogs.mozil
`laZine.org/hyatt/archives/2003i10.htrnl.
`W3 schools.com, “Multimedia Video Formats,” www.w3sschools.
`com/media/mediaivideoformats.asp?output:print, 2006.
`w3schools.com, “Playing QuickTime Movies,” http://www.
`W3 schools.com/media/mediaiquicktime.asp?output?arint, 2006.
`w3schools.com, “Playing Videos On The Web,” www.w3schools.
`com/media/mediaibrowservideos.asp?out:print, 2006.
`Wave Technologies, “Certi?ed Internet Webmaster Foundations
`Study Guide,” Wave Technologies Internation, Inc., a Thomson
`Learning company, copyright 1988-2000.
`Warabino, T. et al., “Video Transcoding Proxy for 3Gwireless Mobile
`Internet Access,” IEEE Communications Magazine, vol. 38, Issue 10,
`Oct. 2000, 6 pages.
`weblogs, “Chapter 1: Downloading and Building WebCore,”
`WebCore documentation, 2 pages, http://weblogs.mozillazineorg/
`hyatt/WebCore/chapterl .htrnl, 2006.
`weblogs, “Chapter 2: An Overview of WebCore,” WebCore docu
`mentation, 3 pages, http://weblogs.mozillaZine.org/hyatt/WebCore/
`chapter2.html, 2006.
`webmasterworld.com, “Page Zooming with IE,” webmasterworld.
`com, Jul. 2004, 7 pages, http://www.webmasterworld.com/forum83/
`4179.htm.
`Wikipedia, “Comparison of Layout Engines,” Wikipedia, the free
`encyclopedia, 3 pages, http://en.wikipedia.org/wiki/Comparisoni
`offloyoutiengines, 2005.
`Wikipedia, “KDE,” Wikipedia, the free encyclopedia, 9 pages, http://
`en.wikipedia.org/wiki/KDE, 2004.
`Wikipedia, “KHTML,” Wikipedia, the free encyclopedia, 3 pages,
`http://en.wikipedia.org/wiki/KDHTML, 2004.
`Wikipedia, “List of Layout Engines,” 1 page, http://en.wikipedia.org/
`wiki/Listiofilayoutiengines, 2005.
`Wobbrock, J. et al., “WebThumb: Interaction Techniques for Small
`Screen Browsers,” Human Computer Interaction Institute and School
`of Design, Carnegie Mellon University, {jrock, forliZZi, scott.
`hudson, bam}@cs.cmu.edu, Oct. 27-30, 2002, 4 pages.
`Yin, X. et al., “Using Link Analysis to Improve Layout on Mobile
`Devices,” WWW2004, May 17-22, 2004, 7 pages, http://www.
`iw3c2.org/WWW2004/docs/1p338.pdf.
`Xiao, X. et al., “Slicing*-Tree Based Web Page Transformation for
`Small Displays,” CIKM’05, Oct. 31-Nov. 5, 2005, Bremen, Ger
`many, 2 pages.
`
`Xie, X. et al., “Ef?cient Browsing of Web Search Results on Mobile
`Devices Based on Block Importance Model,” Microsoft Research
`Asia, mgx03@ mails.tsinghua.edu.cn, 10 pages, 2005.
`Zhiwei et al., “Zoom Selector: A Pen-based Interaction Technique for
`Small Target Selection,” Transactions of the Information Processing
`Society of Japan, Aug. 2004, vol. 45, No. 8, pp. 2087-2097, Inf.
`Process. Soc. Japan, ISSN 0387-5806.
`International Search Report and Written Opinion for International
`Application No. PCT/US2007/088893, mailed Jul. 11, 2008.
`http://
`Designing
`Interfaces.com,
`“Animated Transition,”
`designinginterfaces.com/AnimatediTransition, printed Oct. 16,
`2006, 2 pages.
`Alejandre, S., “Graphing Linear Equations,” http://mathforum.org/
`alejandre/palm/timespalmhtml, printed Jun. 12, 2006, 3 pages.
`Baudisch, P, “Collapse-to-Zoom: Viewing Web Pages on Small
`Screen Devices by Interactively Removing Irrelevant Content,” Oct.
`24-27, 2004, 4 pages.
`Bitstream®, “ThunderHawk Pocket PC Edition for End Users,”
`http://www.bitstream.com/wireless/products/pocketpc/faqiusing.
`html, printed Jun. 12, 2006, 4 pages.
`Buyukkokten, O. et a1 ., “Power Browser: Ef?cient Web Browsing for
`PDAs,” Digital Libraries Lab (InfoLab), Stanford University,
`Stanford, CA, 8 pages, 2002.
`Chen, H. et al, “A Novel Navigation and Transmission Technique for
`Mobile Handheld Devices,” 8 pages, 2002.
`Chen, Y., “Detecting Web Pages Structure for Adaptive Viewing on
`Small
`Form
`Factor
`Devices,”
`Microsoft
`Research,
`i-yuchen@microsoft.com, May 20-24, 2003, 9 pages.
`Coolsmartphone, “Orange SPV C600 Review,” http://www.
`coolsmartphone.com/article569.html, Apr. 14, 2006, 58 pages.
`Getgreg, “Jeff Han’s Multiple Touch Point Display, the Stuff Dreams
`are
`Made
`of,”
`http ://www.theyshoulddothat.com2006/ 08/
`jeffihannsimultipleitouchipoin.html>, Aug. 16, 2006, 2 pages.
`Han, J ., “Talks Jeff Han: Unveiling the Genius of Multi-touch Inter
`face Design,” Ted Ideas Worth Spreading, http://www.ted.com/
`inhttp://www.ted.com/index.php/talks/view/id/65>, Aug. 6, 2006, 1
`page.
`Karlson et al., “AppLens and Lunch Tile: Two Designs for One
`handed Thumb Use on Small Devices,” http://heil.cs.umd.edu/trs/
`2004-37.html, printed Jun. 12, 2006, 11 pages.
`Landragin, F., “The Role of Gesture in Multimodal Referring
`Actions,” Proceedings of the Fourth IEEE Internaational Conference
`on Multimodal Interfaces, http://ieeexplore.iee.org/ie15/8346i/
`26309/01166988pdf7arnumber:116i6988>, 2002, 6 pages.I.
`Lie, H., “Cascading Style Sheets,” http://people.opera.com/
`howcome/2006/phd/css.pdf, 2005, pp. 243-247.
`Milic-Frayling, N. et al., “Smartview: FlexibleViewing of Web Page
`Contents,” The Eleventh International World Wide Web Conference,
`http://www2002.org/CDROM/poster/172/>, May 11, 2002, 4 pages.
`Opera Software, “Opera for Mobile, The Full Web Anytime, Any
`where,” www.opera.com/mobile, Jan. 2006, 7 pages.
`Opera Software, “Opera for S60 Tutorial,” http://www.opera.com/
`support/tutorials/260/, Apr. 5, 2006, 5 pages.
`OperaiPress Releases Database, “The New Opera Browser for
`Series 60 Features Zoom and Password Manager,” Nov. 14, 2005, 3
`pages.
`Opera Software, “Opera for Windows Mobile Smartphone 2003
`Tutorial,” http://www.opera.com/support/tutorials/winmobile, Apr.
`5, 2005, 4 pages.
`Opera Software, “Opera 8.5 Beta 2 forWindows Mobile, Pocket PC,”
`http://www.opera.com/products/mobile/products/winmobileppc,
`Apr. 5, 2006, 2 pages.
`Opera, “Opera 8.5 for S60 Phones-Get the Full Internet Experience
`onYour Mobile Phone,” http://www.symbian-freak.com/news/1105/
`opera.htm, Apr. 5, 2006, 3 pages.
`International Search Report and Written Opinion for International
`Application No. PCT/US2007/077644, mailed May 30, 2008.
`International Search Report and Written Opinion dated Jun. 30, 2008,
`received in International Application PCT/US2007/088879 which
`corresponds to US. Appl. No. 11/620,647.
`
`

`
`US 7,864,163 B2
`Page 4
`
`Of?ce Action dated Nov. 17, 2009, received in U.S. Appl. No.
`11/620,647.
`Of?ce Action dated Jun. 24, 2010, received in U.S. Appl. No.
`11/620,647.
`Examiner’ s Report dated Mar. 24, 2010, received in Australian Patent
`Application No. 2007292383, which corresponds to U.S. Appl. No.
`11/850,013, 2 pages.
`Of?ce Action dated Jun. 7, 2010, received in German Patent Appli
`cation No. 11 2007 002 107.1-53, which corresponds to U.S. Appl.
`No. 11/850,013.
`
`Of?ce Action dated Jun. 21, 2010, received in European Application
`No. 07 814 6909-2212, which corresponds to U.S. Appl. No.
`11/850,013.
`Of?ce Action dated Oct. 13, 2010, received in Chinese Patent Appli
`cation No. 200780041226, which corresponds to U.S. Appl. No.
`11/850,013.
`Of?ce Action dated Oct. 19, 2010, received in European Application
`No.07 814 690.9, which corresponds to U.S. Appl. No. 11/850,013.
`
`* cited by examiner
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 1 0f 29
`
`US 7,864,163 B2
`
`Mem°ry
`m
`
`.
`
`136
`
`Portable Multifunction Device
`M
`I148
`I 126 Applications (continued)
`Operating System
`I149
`f 128
`Calendar Module
`Communication Module
`I149 1
`f Widget Modules
`Contact/Motion Module
`I149 2
`f
`Weather Widget
`Graphics Module
`I149 3
`Stocks Widget
`Text Input Module
`Calculator Widget f 149 4
`I136
`GPS Module
`Alarm Clock Widget
`f14g_5
`I137
`Applications
`Dictionary Widget f
`I138
`Contacts Module
`=
`f
`Telephone Module
`'
`139
`_
`User-Created Widget(s) I150
`Video Conference Module I140
`Widget Creator Module f 151
`E-mail Client Module
`f 141
`Instant Messaging Module I142 Search Module
`f
`
`_
`
`149-6
`
`
`
`Blogging Module Camera Module
`
`Image Management Module
`_
`Video Player Module
`_
`Music Player Module
`Browsin M
`9 odule
`
`it
`
`I143 f
`
`I144
`145
`f
`146
`f
`I147
`118
`
`162
`Power I
`System
`
`External I124
`Port
`103
`
`RF Circuitry
`
`"
`1o4-f
`122 -/" C°""°"er
`_
`M
`103
`V: S
`: Perlpherals
`M
`Interface
`ll
`
`l 103 A d
`u lo
`41-5—> Circuitry
`110
`
`103
`5
`
`111
`
`Micro hone
`113
`Proximity
`Sensor M165
`
`120
`
`r'“
`
`Processor(s)
`
`106 J
`
`Display
`Controller
`
`._
`156 J it
`‘f‘103
`
`103
`* ‘k Accelerometer(s)
`1
`F103
`?
`158
`l/O Subsystem
`o tical /
`p
`Other Input
`sensor(s)
`Controller(s) ‘
`Controller
`it
`"‘“103
`
`160
`/
`
`it
`{‘103
`
`112 _f
`
`.
`.
`sesnzltg:
`y y
`
`Optical
`Sensor(s)
`M
`
`Other Input
`Control
`Devices
`
`f116
`
`Figure 1A
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 2 0129
`
`US 7,864,163 B2
`
`Portable Multifunction Device
`/ Wm” M
`M
`136
`f 126
`Operating System
`f 128 Applications (continued)
`I148
`Communication Module
`f Calendar Module
`I149
`Contact/Motion Module
`J—
`Widget Modules
`f14g_1
`Graphics Module
`f
`Weather Widget(s)
`I149 2
`Text Input Module
`I136
`Stocks Widget
`f 14%
`GPS Module
`I137
`Calculator Widget
`f14g_4
`Applications
`I138
`Alarm Clock Widget
`f14g_5
`Contacts Module
`I139
`Dictionary Widget
`I
`Telephone Module
`Video Conference Module f
`i
`140
`'
`E-mail Client Module
`I141
`User-Created Wldget(s) I150
`Instant Messaging Module I142 Widget Creator Module
`I151
`Blogging Module
`f 143
`Search Module
`f
`Camera Module
`I144
`5
`Image Management Module f
`-
`152
`Video and Musm Player Module J
`153
`f
`Notes Module
`External f
`Map Module
`f
`Port
`Browsing Module
`I147
`RF Circuitry
`103
`118
`\ n y m Speaker
`\ "
`, 103
`111
`Audio
`41-5—> Circuitry
`
`_
`
`149-6
`
`162
`Power I
`System
`
`\r
`
`ii
`V'\ 1
`"
`1o4—f
`122 -/" C°""°"e'
`
`M
`II D L)
`ll ‘
`ll
`
`_
`e Perlpherals
`Interface
`
`1Q3
`3
`
`110 =Ov}
`Micro hone
`Proximity
`113
`Sensor “165
`
`120 r- Processor(s)
`
`106 ‘f
`
`__
`156 —/
`
`Display
`Controller
`
`ll
`‘7‘103
`
`.
`.
`Touch-Sensitive
`112 _f Display system
`
`103
`‘L‘ Accelerometer(s)
`@
`
`M
`‘f‘103
`llO Subsystem/ 158
`Optical
`sensods)
`
`Other Input
`Controller(s) ‘
`
`f160
`
`ll
`"‘“103
`
`Other Input
`116
`Control I
`Devices
`
`Controller
`ll
`""‘103
`
`Optical
`Sensor(s)
`m
`
`Figure 1B
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 3 0f 29
`
`US 7,864,163 B2
`
`Portable Multifunction Device 100 \
`SIM Card Slot m
`
`\m
`\ head- \
`Optical
`Proximity
`Phone
`[Speaker m] [ Sensor ?) [ Sensor @ 130k
`
`E
`
`200
`S
`
`f
`
`f
`
`00
`3
`
`w
`0
`N
`
`2
`
`Touch Screen l
`
`c
`
`x
`
`(/’/ Home
`Microphone
`m 204 ,/
`
`Accelerometer(s)
`E
`
`External Port 1 4
`Figure 2
`
`J
`
`J
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 4 0f 29
`
`US 7,864,163 B2
`
`E
`
`r
`
`Portable Multifunction Device \
`100
`
`\
`
`300
`5
`
`8|
`
`§|
`
`[Speaker m) [ Sensor?) [ Sensor @
`
`Proximity
`
`Optical
`
`Current Time w 308
`310“ Day and Date“ 312
`
`f
`
`Wallpaper image
`
`E
`
`—>
`5
`302
`
`_
`
`Slide to unlock
`S
`306
`
`x
`
`p
`
`Touch Screen l
`J
`
`(// Home \1
`Microphone
`m \ 204 /
`
`Accelerometer(s)
`E
`
`7
`
`Figure 3
`
`j
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 5 0f 29
`
`US 7,864,163 B2
`
`m
`
`r
`
`Portable Multifunction Device \‘
`100
`
`\
`
`400A
`
`a f S
`
`,7
`
`Optical
`Proximity
`[Speaker m) [ Sensor M) [ Sensor @
`
`m
`
`.
`Current Tlme m
`
`\
`D M
`
`g
`N
`
`1/
`
`‘l
`
`"V'
`
`l
`
`\\\ /’ ///i//\\\\
`l
`\f///
`
`1/
`‘
`\\ /’ ‘
`©©© l
`r
`11
`p,
`\\
`/V/
`\ \
`\1
`// \\ \—‘//
`Camera
`Videos
`E 14—5
`
`//
`
`\\ 1/
`Photos
`Text
`m M
`
`\\
`
`x/
`750
`Weather
`149-1
`
`\‘
`
`//
`
`\\
`
`/
`
`\ d/
`Stocks
`149-2
`
`/
`
`Jan \
`
`L'A
`
`1 5 ,
`[\ t J [ t
`Calendar
`Blog
`E m
`
`l/?xx /,/?\\ f/?\ /,/W\\
`+ - X + ]
`[ ABC 1
`[ Created
`\\Widget/,/
`Widget
`149-6
`
`Alarm
`149-4
`
`Dictionary
`149-5
`
`Calculator
`149-3
`
`I”
`
`\\
`
`I,
`
`( x 6 J]
`
`l/
`
`\Q, , (E, [443), l, ?,
`
`\\
`
`//
`
`,\\
`
`\
`
`\
`
`\
`
`Phone
`@
`
`Mail
`E
`@
`
`Browser
`m
`
`Music
`M
`
`Touch Screen l
`J
`
`Home \\‘
`Microphone
`m \ 204 /
`
`Accelerometer(s)
`?
`
`Figure 4A
`
`J
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 6 0f 29
`
`US 7,864,163 B2
`
`f
`
`Portable Multifunction Device
`\ E r
`100
`\4
`[Speaker m) [ Sensor ?) [ Sensor ?]
`
`Optical
`
`Proximity
`
`\
`
`4008
`5
`
`8|
`
`N f
`
`A
`
`.
`
`Q Q Current Tlme m p 1::- M
`
`\
`
`w
`o
`
`“I
`
`l/ /
`\\\\
`'/ E \‘ /'/@\\ 1/,
`(1
`|M \)
`Jan i ’ T
`
`/
`
`15
`
`] [@ee
`
`\\\
`
`]
`
`<:
`
`>
`
`Text
`m
`
`Camera
`Photos
`Calendar
`E M m
`
`\
`
`,1
`
`Weather
`149-1
`
`/
`
`f* 414 A 410
`
`\\
`
`V
`
`E J
`
`Phone
`@
`
`\\
`
`Mail
`m
`
`I \
`
`<\<>,>
`
`v Browser
`
`M
`
`|:|
`
`@
`
`iPod
`E
`
`\
`
`\
`
`\
`
`?
`
`Touch Screen l
`
`/ Home \)
`m \ 204
`
`Accelerometer(s)
`?
`
`Figure 4B
`
`J
`
`J
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 7 0f 29
`
`US 7,864,163 B2
`
`r
`
`Portable Multifunction Device
`Q
`100
`\
`Optical
`Proximity
`(Speaker m] [ Sensor ?) [ Sensor @
`
`3900A
`
`\
`
`él r
`
`4 ?
`
`.
`Current Time %
`
`3
`I:- Q
`
`8|
`
`N
`
`3902
`
`W9|00me 3904
`
`3906
`
`/ >~
`
`http:/lww.company.com/start m
`
`3910
`
`Block 1
`3914-1
`
`(3555:,
`"
`B|OCk 2
`3914-2
`
`Web page
`3 2
`
`Block 3
`3914-3
`
`Block 7
`Block 4 M
`3914-4
`
`Block 5
`39.1:1-5
`(3923‘
`Q
`"'
`
`Block 6
`3914-6
`
`BIOCK 8
`3914-8
`
`<1
`
`\
`
`k
`
`I i m + [
`
`3920
`
`3922
`
`3V0
`
`3 a
`
`f/Homex\
`Microphone
`m m i)
`
`Accelerometer(s)
`E
`
`\v/
`
`Figure 5A
`
`J
`
`J
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 8 of 29
`
`US 7,864,163 B2
`
`2 6
`
`Portable Multifunction Device
`100
`
`Current Time M
`
`Welcome 3904
`
`Go to URL@
`
`Acce|erometer(s)
`
`1g
`
`Microphone
`
`m
`
`</Home\>
`
`\ 204
`
`,
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 9 0129
`
`US 7,864,163 B2
`
`E
`
`f
`
`Portable Multifunction Device \
`100
`
`\
`
`Optical
`Proximity
`(Speaker m] [ Sensor m) [ Sensor @
`
`?
`
`3902
`
`.
`Current Tlme %
`
`\
`D Q
`
`W6|00me 3904
`
`906
`
`i>
`
`39000
`5
`
`°°
`8| f
`
`3|
`
`N
`
`http://\m~w.company.com/start 903
`
`3910
`'
`
`(3557‘, Block 4 3914-4
`
`‘ _ . ’
`
`(3931‘;
`
`~ . . '
`
`(3933‘,
`
`\ D I '
`
`_ _
`
`'3941‘|
`'~_ , .
`\v
`
`' a Q ~
`I 3943 I
`~~ . '
`
`' ? _ ~
`
`232915)
`
`3922
`
`J
`
`' ' I ~
`
`.3929:
`
`D .’
`
`Block 5
`
`3914-5
`
`3937
`
`< 27, ,4
`,
`I
`I
`
`3939
`0 IV
`> 27’
`l ’
`
`Block 6 3914-6
`
`CD/
`
`6
`
`3 8
`
`
`
`92 (A) O
`
`
`
`/
`Home \\
`Microphone
`m \ 204 ,/
`/
`
`Accelerometer(s)
`?
`
`Figure 5C
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 10 0f 29
`
`US 7,864,163 B2
`
`E
`
`f
`
`Portable Multifunction Device \
`100
`
`\
`
`Optical
`Proximity
`[Speaker m] [ Sensor ?) [ Sensor @
`
`3900D
`
`w
`8| r
`
`/
`
`M
`
`I
`Current Tlme %
`
`\
`1::- Q
`
`8|
`
`N
`
`/
`\\
`‘?k \. \
`0) \\
`//
`\V/
`
`§
`
`00
`
`00
`
`(O IEA
`
`0,
`Ito
`8
`
`00
`l8
`“9 +
`
`1
`
`I“
`
`(O
`N
`N
`
`\
`
`Q, Q
`2 O
`4> g
`U“ 01
`
`4\
`If»
`I no I
`\2'0
`\ 4> 0
`
`0's
`: c4? :
`w
`\2'0
`
`'C)
`
`CD
`
`2
`l—|
`:0
`E
`E
`E
`.5
`8
`3
`%
`‘.<
`O 5
`E g
`m a
`'1
`O
`|%
`3
`C)
`CD
`s
`
`O
`
`4>
`
`O
`0-) |<2
`
`0
`
`)
`
`// Home
`Microphone
`m \ 204 /
`
`Accelerometer(s)
`E
`
`K
`
`v
`
`Figure 5D
`
`J
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 11 0129
`
`US 7,864,163 B2
`
`2 6 i
`
`r
`
`3900E
`
`Portable Multifunction Device
`100
`
`\
`
`\
`
`Optical
`Proximity
`[Speaker m] [ Sensor M) [ Sensor @
`
`§| r
`
`A @
`
`.
`Current Time %
`
`\
`
`go
`
`\
`II:- M
`
`3
`
`OJ
`
`/ »
`
`\ >F<<x[ E l
`N
`CD ]>
`
`/
`
`8
`i _
`
`|woo'Auedwoo'MMM//:d11q
`
`9268
`
`\
`
`\
`
`\\
`
`\
`
`\
`
`\\
`
`//
`
`\
`
`[ Q
`
`(JO
`
`6 ‘IEl? 01 OE)
`
`
`
`0868 1401999
`
`\\\\\
`/t
`Home \‘
`Microphone
`m m
`
`Accelerometer(s)
`m
`
`Figure 5E
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 12 0129
`
`US 7,864,163 B2
`
`m
`
`r
`
`Portable Multifunction Device x
`100
`
`\
`
`Optical
`Proximity
`[Speaker m) [ Sensor M) ( Sensor @
`
`3900F
`
`él f
`
`402
`_
`
`'
`C
`urrent Tlme M
`
`\
`IIb ?
`
`él
`
`g; \
`8
`(D
`
`/,_\\
`//_l_i\\
`
`
`Q a 2 Q. 2- (D
`
`
`
`(D
`
`(D
`
`. .
`
`3 m
`T‘.
`]>
`. .
`(I)
`(1)
`Q.
`:r
`‘U
`'0
`0 2 2 Q.
`5*
`v.
`'0
`Q o w
`3
`O
`O
`X
`3
`2
`Z
`
`'23
`U
`P
`O
`O
`3
`V V V
`
`g
`
`\ g m
`
`//—\\
`cn
`<
`(D
`
`x
`
`\
`
`(//Home\)
`Microphone
`m \\ M //
`
`Accelerometer(s)
`?
`
`\V/
`
`Figure 5F
`
`J
`
`J
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 13 0f 29
`
`US 7,864,163 B2
`
`M
`
`f
`
`Portable Multifunction Device \
`100
`
`\
`
`39006 [Speakermj [Sensor?] [Sensor?
`
`Proximity
`
`Optical
`
`8I f S
`N
`
`°°
`O
`
`(\ll
`
`m
`
`Current Time %
`
`N
`1::- ?
`
`0'\
`(:0
`
`Q ‘3
`‘2' CD
`*’
`
`00
`
`///A\\\ w (0
`Q, ></) i
`
`\~/' il\)
`
`I
`
`00
`
`01 —- '
`
`A CD
`2
`D g 2 Fe U a
`m --
`A8 Po ~
`§ 0 3
`'
`00 :5
`O.
`V Q)
`CD
`2
`LO
`
`00
`
`N
`
`\\
`
`,/
`
`|
`
`////\\\\ w
`/
`\(o
`\ ></%
`i °°
`CD
`°° ‘3
`I},
`o- w
`| '0
`Home \1
`Accelerometer(s)
`Microphone
`m 204 /
`m
`
`o'\
`
`\
`
`Figure 56
`
`J
`
`J
`
`k
`
`\
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 14 0129
`
`US 7,864,163 B2
`
`(
`
`Portable Multifunction Device
`E
`100
`\
`[speaker m] [Sensormj [ Sensor @
`
`Optical
`
`Proximity
`
`\
`
`3900H
`8| , 5
`\
`N
`A Q
`Current Time %
`1::- ?
`8I + http://www.company.com/start m '
`N
`2
`2
`3920
`3910
`Web page
`M
`
`Block 3
`3914-3 — 3962
`
`Block 1
`3914-1 — Block 7
`3914-7
`
`Block 4
`3914-4
`
`(3555‘,
`‘~-'
`
`Block 5
`3914-5
`Block 8
`(3923::
`Block 2 ‘—' 3914-8
`3914-2
`
`Block 6
`3914-6
`
`3964
`
`k — — — — J
`
`3902
`
`3 O6
`
`3 8
`
`3922
`
`Microphone //H0me\\
`m \ 204 /
`
`Accelerometer(s)
`w
`
`k
`
`\w/
`
`Figure 5H
`
`J
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 15 of 29
`
`US 7,864,163 B2
`
`206
`
`Portable Multifunction Device
`100
`
`Proximity
`Optical
`Speaker E Sensor @ Sensor @
`
`M
`
`Current Time M
`
`I]: w
`
`Share \}»396e
`
`Start
`
`‘: Cancel
`
`\ /
`
`X]/
`
`//
`
`/,
`
`[\%http://www.nyt|
`
`Saamh
`
`903
`
`3.912.
`
`www.n3¢imes.com
`
`www.n3a.u|ib.org
`
`(/Home
`
`204
`
`Acce|erometer(s)
`
`m
`
`m
`
`

`
`US. Patent
`
`Jan. 4, 2011
`
`Sheet 16 0f 29
`
`US 7,864,163 B2
`
`,
`
`E
`
`E
`
`Portable Multifunction Device
`m
`100
`\q
`[Speaker m) [Sensor m) [ Sensor @
`
`Optical
`
`Proximity
`
`3900J
`S
`
`r
`
`?
`
`'
`Current Tlme M
`
`\
`'1' 4 6
`
`Share 1:}w3966
`
`Start
`
`Cancel
`
`i/httpzllwwcompany.com| @918.
`
`\“
`
`k .?1 23
`
`space
`
`[ii/sea
`
`\\\
`,r/K/
`‘1” Home \
`Microphone
`m \ M /
`
`Accelerometer(s)
`@
`
`Figure 5J
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 17 of 29
`
`US 7,864,163 B2
`
`2 6
`
`Portable Multifunction Device
`100
`
`Email Content
`
`SMS Link
`
`A[S{DVFTGVHJJTKTL)
`
`\
`
`\ /'
`
`Cancel
`
`\\
`
`MiC|'0Dh0ne
`E
`
`(//Home
`\ 204 /
`
`Acce|erometer(s)
`@
`
`Figure 5K
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 18 of 29
`
`US 7,864,163 B2
`
`2 6
`
`Portable Multifunction Device
`100
`
`#23LUOO|3/\/\
`
`? 5 $ E E .
`
`5oO 3
`
`'0
`3
`‘.<
`
`0O 3c
`
`ol—I‘
`on
`:3-
`
`We
`
`Microphone
`m
`
`//
`<
`\\
`
`/
`
`Home
`204 /
`//
`
`\
`
`Figure 5L
`
`Acce|erometer(s)
`E
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 19 of 29
`
`US 7,864,163 B2
`
`206
`
`Portable Multifunction Device
`100
`
`1%W|woo"/(uedu1oo'MMM//zdutii
`
`W3‘oi,ft?:X:
`
`Microphone
`m
`
`(/ Home \\N
`204
`
`Acce|erometer(s)
`m
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 20 of 29
`
`US 7,864,163 B2
`
`II
`
`}
`:
`
`: are specified in a structured electronic document (e.g., a web page) (e.g.,
`:
`an HTML or XML document).
`
`Adjust the borders, margins, and/or paddings for the plurality of boxes for i
`display on a touch screen display of a portable electronic device.
`,
`
`r I
`
`:
`
`Display, on the touch screen display of the portable electronic device, at
`least a portion of the structured electronic document comprising the
`plurality of boxes of content.
`
`Scale the document width to fit within the touch screen display width
`independent of the document length.
`
`Detect a first gesture (e.g., a finger or stylus gesture) (e.g., a tap gesture)
`at a location on the displayed portion of the structured electronic
`document.
`
`Determine a first box in the plurality of boxes at the location of the first
`
`6006
`
`6008
`
`6010
`
`6012
`
`5014
`
`6016
`
`601 8
`
`6020
`
`6022
`
`6024
`
`‘
`
`In a render tree associated with the structured electronic document,
`traverse down the render tree to determine a first node that
`corresponds to the detected location of the first gesture.
`
`‘
`
`................................................................i...............................................................
`
`Traverse up the render tree from the first node to a closest parent
`node that contains a logical grouping of content.
`i
`ifiiaiéfiiiiyiiééfiiéfiiiEééiééifiiaifigESitii;E6;ééifiéiéiifiiéaiéiéiéiiiiéiiiéfi
`3
`box.
`l
`
`*
`
`Enlarge and substantially center the first box on the touch screen display.
`
`‘
`
`Expand the first box so that its width is substantially the same as the
`width of the touch screen display.
`
`Figure 6A
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 21 of 29
`
`US 7,864,163 B2
`
`Resize text in the enlarged first box or in the structured electronic
`I
`: document to meet or exceed a predetermined minimum text size on the
`:
`touch screen display.
`
`
`
`
`
`Divide the predetermined minimum text size by the scaling factor to
`determine a minimum text size.
`
`I 5030
`
`lfa text size is less than the determined minimum text size, increase
`the text size to at least the determined minimum text size.
`
`' 5032
`
`
`_________________________________________ _ _ I,6034
`Detect a second gesture (e.g., a finger or stylus gesture) (e.g., a tap
`II
`I
`
` gesture) on the enlarged first box.
`
` I
`'
`
`In response to detecting the second gesture, reduce in size the displayed
`portion of the structured electronic document.
`
`
`
`. While the first box is enlarged, detect a third gesture (e.g., a finger or
`:
`stylus gesture) (e.g., a tap gesture) on a second box other than the first
`I
`
`I
`:
`I
`
`r """"""""""" ' '
`
`'
`I
`
`In response to detecting the third gesture, substantially center the second :
`box on the touch screen display.
`
`
`
`Figure 6B
`
`

`
`U.S. Patent
`
`Jan. 4, 2011
`
`Sheet 22 of 29
`
`US 7,864,163 B2
`
`\
`
`\
`
`I
`
`Detect a swipe gesture (e.g., a finger or stylus gesture) on the touch
`screen display.
`
`K 6044
`II
`I
`
`[— 6046
`£
`I In response to detecting the swipe gesture, translate the displayed portion }
`:
`of the structured electronic document on th