USOO9423954B2
`
`(12) United States Patent
`(10) Patent N0.:
`US 9,423,954 B2
`Morris
`(45) Date of Patent:
`Aug. 23, 2016
`
`
`FOREIGN PATJNi DOCUMJNTS
`
`
`Adapterm
`
`Primary Examiner 7 Wesner Sajous
`(74) Attorney, Agent, or Firm 7 Patrick E. Caldwell, Esq.;
`The Caldwell Firm, LLC
`(57)
`ABSTRACT
`Methods, computer software, apparatuses, and systems are
`described in connection with a mobile device including at
`least one processor operatively coupled to a touchscreen and
`memory The memory stores a first application and a second
`application. The mobile device is configured for: presenting,
`utilizing the touchscreen, at least one menu including a plu—
`rality of interface elements including a first application inter-
`face element associated with the first application and a second
`application interface element associated with the second
`application; detecting, utilizing the touchscreen, a first user
`input in connection with the first application interface ele-
`ment associated with the first application; in response to the
`first user input, presenting, utilizing the touchscreen, a first
`Visual component forpresenting first data associated with the
`first application; detecting, utilizing the touchscreen, a sec—
`ond user input in cormection with the second application
`interface element associated with the second application; in
`response to the second user input, presenting, utilizing the
`touchscreen, a second Visual component for presenting sec-
`ond data associated with the second application, such that a
`first border of the first Visual component corresponds to a
`second border of the second Visual component; detecting,
`utilizing the touchscreen, a third user input; and in response to
`the third uscr input, automatically changing, utilizing the at
`least one processor and the touchscreen, the presentation of
`the first Visual component and the second Visual component,
`such that the first border of the first Visual component corre—
`sponds to the second border ofthe second Visual component.
`
`1030247
`339374
`
`12000
`1 1’2000
`
`(Continued)
`OTHER PUBLICATIONS
`
`First Alliance “Security Camera Systems for Your Business or
`Home,” available at https://Web.archive.org/Web/20100615200435/
`http://Www.fapscom’PCiDVRiH.2647.htm (’psoted on Jim. 15,
`2010).
`
`(Continued)
`
`GRAPHICAL USER INTERFACE METHODS,
`SYSTEMS, AND COMPUTER PROGRAM
`PRODUCTS
`
`Inventor:
`
`Applicant: SITTING MAN, LLC, Raleigh, NC
`(US)
`Robert Paul lVIorris, Raleigh, NC (US)
`Cypress Lake Software, Inc, WoodVille,
`TX (US)
`
`Assignee:
`
`Notice:
`
`Appl. No .:
`Filed:
`
`Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(1)) by 0 days.
`14/924..706
`Oct. 27, 2015
`Prior Publication Data
`
`US 2016/0048289 A1
`
`Feb. 18, 2016
`
`Related US. Application Data
`
`Continuation of application No. 14/331,096, filcd on
`Jul. 14, 2014, which is a continuation of application
`No. 12/956,008, filed on Nov. 30, 2010, now Pat. No.
`8,780,130.
`Int. Cl.
`G06F 3/048
`G06F 3/04]
`
`(2013.01)
`(2006.01)
`(Continued)
`
`US. Cl.
`CPC .......... .. 60611'3/04883 (2013.01); G0611'3/041
`(2013.01); 006F3/0481 (2013.01);
`(Continued)
`Field of Classification Search
`CPC combination set(s) only.
`See application file for complete search history.
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`4,839,853 A
`5,029,013 A
`
`6/1989 Deerwester
`7/1991 Hiratsuka et al.
`
`(Continued)
`
`20 Claims, 11 Drawing Sheets
`
`Executlon Envrmnmertm
`DevlcEr'NUde m
`
`
`
`,Apphcahons.
`
`
`
`|l| |
`
`I|
`
`|||I
`
`other Libraries and
`Subsystems m
`Opelatmg
`System 120
`|— — _ _ _ _ __.l
`
`01th Dawes
`M
`
`Output
`Device
`Adapter3
`
`Input Der/ire
`123
`
`Input Device
`
`lnSlflJCilOfl-
`Process ng
`
`P275157.th
`Secondary
`Storage m
`
`I
`
`MICROSOFT CORP. EX. 1001
`Page 1 of 30
`
`

`

`Fleming, 111
`Burns et al.
`Adar el al.
`Khan
`Nosohara
`Sidana
`Smith et a1.
`Mohler
`Wynn et al.
`Lee
`Jakobson
`Santoro et a1.
`Elgart
`Co trille et a1.
`Na<ano
`Lieberman ct a1.
`Lau
`Awada et al.
`Zil (a et al.
`Zil (a et al.
`Zil (a et a1.
`Sellers et a1.
`Holecek et al.
`Amadio et al.
`Ru lfield et a1.
`Flynt et al.
`Hart et a1.
`Zil (a
`Zhang
`Wi liarns et a1.
`Ishibashi
`Wang et a1.
`Holccck ct a1.
`Matthews et al.
`Kraut
`Singh et al.
`Fyke et al.
`Jarrett et al.
`Zaman et a1.
`Chiang et 31.
`Morris
`Rudolph et a1.
`Markiewicz et a1.
`Morris ................ .. GOGF 9/4443
`
`345/173
`
`
`
`6,473,752
`6,478,001
`6,493,702
`6,546,393
`6,571,241
`6.571.295
`6,578,078
`6,601,173
`6,667,751
`6,694,331
`6,697,838
`6,724,403
`6,973,456
`6,973,616
`7,010,515
`7,028,253
`7,080,088
`7,114,129
`7,117,443
`7,194,691
`7,305,625
`7,412,661
`7.552.397
`7,783,990
`7,818,677
`7,933,632
`8,010,900
`8,117,225
`8,166,411
`D665,405
`8.266.541
`8,302,026
`8,341,541
`8,356,258
`8,379,058
`8,381,127
`8,457,692
`8,490,019
`8,560,959
`8.600.446
`8,661,361
`8,667,415
`8,687,023
`8,780,130
`
`8,830,270
`8,869,027
`8.893.033
`8,922,575
`8,935,631
`8,954,871
`8,990,733
`8,992,323
`9,032,3 18
`9,043,712
`9,104,294
`2001/0047404
`2002/0007373
`2002/0019837
`2002/0032659
`2002/0035499
`2002/0042841
`2002/0059076
`2002/0070963
`2002/0077835
`2002/0082778
`2002/0093528
`2002/0111953
`2002/0147742
`2002/0169743
`2002/0184095
`2002/0196272
`2003/0016241
`2003/0018609
`2003/0033295
`2003/0036945
`2003/0046307
`2003/00763 52
`2003/0135820
`
`NmmwgwwwwmwucmwwwwwmN
`
`05105103021x.)t
`
`wwwmwmwwNr—NNNNN
`mwmwwwwwwwmmmwNNNNNNNNNNNNNN
`
`>>>>>>>>>3’>>>>>>>>>>>>>EEEEEEEEEEE
`
`10/2002
`11/2002
`12/2002
`4/2003
`5/2003
`5/2003
`6/2003
`7/2003
`12/2003
`2/2004
`2/2004
`4/2004
`12/2005
`12/2005
`3/2006
`4/2006
`7/2006
`9/2006
`10/2006
`3/2007
`12/2007
`8/2008
`6/2009
`8/2010
`10/2010
`4/201 1
`8/2011
`2/2012
`4/2012
`8/2012
`9/2012
`10/2012
`12/2012
`1/2013
`2/2013
`2/2013
`6/2013
`7/2013
`10/2013
`12/2013
`2/2014
`3/2014
`4/2014
`7/2014
`
`9/2014
`10/2014
`11/2014
`12/2014
`1/2015
`2/2015
`3/2015
`3/2015
`5/2015
`5/2015
`8/2015
`11/2001
`1/2002
`2/2002
`3/2002
`3/2002
`4/2002
`5/2002
`6/2002
`6/2002
`6/2002
`7/2002
`8/2002
`10/2002
`11/2002
`12/2002
`12/2002
`1/2003
`1/2003
`2/2003
`2/2003
`3/2003
`4/2003
`7/2003
`
`US 9,423,954 B2
`
`Page 2
`
`(51)
`
`(2006.01)
`(2006.01)
`(2013.01)
`(2013.01 )
`(2013.01 )
`(2013.01 )
`
`Int. Cl.
`G06F 9/44
`G06F 17/24
`G06F 3/0488
`G061" 3/0484
`G061" 3/0481
`G061" 3/0486
`US. Cl.
`CPC .......... .. 6061«'3/0484 (2013.01 ); G061" 3/0486
`(2013.01 ); G061" 3/0488 (2013.01 ), (£0613
`3/04842 (2013.01 ); G0611'3/04845 (2013.01 ),
`G06F 3/04886 (2013.01); G06F 9/4443
`(2013.01); G06F 17/24 (201301); (10617
`2203/04104 (2013.01); G06F 2203/04803
`(2013.01); G06F 2203/04808 (2013.01)
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
`
`5.159,334
`5,297,039
`5,487,143
`5,540,597
`5.577,187
`5.642,518
`5,671,295
`5696,962
`5712,995
`5737,560
`5,778,256
`5,794,233
`5,819,261
`5.877,765
`5.877,767
`5,895.465
`5.913215
`5.917,491
`5,918,237
`5,950,214
`5,974,409
`5.978,817
`5.991,751
`5.991,780
`5.999907
`6008,809
`6012,093
`6,014,663
`6,018,714
`6,018,749
`6028,602
`6037,934
`6,041.360
`6072,486
`6072,491
`6,081,829
`6,100,890
`6,108,651
`6.154,725
`6,173,251
`6,189.024
`6230,171
`6.243091
`6252,597
`6,263,314
`6,266,059
`6,275,862
`6.314,423
`6.339,767
`6,353.827
`6.381,651
`6.389,434
`6,434,580
`6,437,527
`6,460,058
`
`10/ 1992
`3/ l 994
`1/ 1996
`7/ 1996
`1 1/ 1996
`6/ 1997
`9/ 1997
`12/ 1997
`l/ 1998
`4/ 1998
`7/ 1998
`8/ 1998
`10/ 1998
`3/ 1999
`3/ 1999
`4/ 1999
`6/ 1999
`6/ 1999
`6/ l 999
`9/ 1999
`10/1999
`1 1/1999
`1 1/1999
`1 1/1999
`12/1999
`12/ 1999
`1/2000
`1/2000
`1/2000
`1/2000
`2/2000
`3/2000
`3/2000
`6/2000
`6/2000
`6/2000
`8/2000
`8/2000
`1 1/2000
`1/2001
`2/2001
`5/2001
`6/2001
`6/2001
`7/2001
`7/2001
`8/2001
`1 1/2001
`1/2002
`3/2002
`4/2002
`5/2002
`8/2002
`8/2002
`10/2002
`
`Baumert et a1.
`Kanaegami et a].
`Southgate
`Budrnan et al.
`Mariani
`Kiyama et a1.
`Miyake
`Kupiec
`Cohn
`Yohanan
`Darbee
`Rubinstein
`Takahashi et a1.
`Dickman et al.
`Yohanan
`Guha
`Rubinstein et al.
`Bauersfeld
`Montalbano
`Rivette et al.
`Sanu et al.
`Giannandrea et al.
`Rivette et al.
`Rivette et al.
`Donner
`Brooks
`Maddalozzo, Jr. et al.
`Rivette et al.
`Risen. Jr. et al.
`Rivelte el al.
`Weidenfeller et a1.
`Himmel et a1.
`Himmel et a1.
`Sheldon et a1.
`Yohanan
`Sidana
`Bates et al.
`Guha
`Donner
`Ito et al.
`Bauersfeld et al.
`Pacifici et a1.
`Bcrstis
`Lokuge
`Dormer
`Matthews, III et al.
`Shanna et a1.
`Himmel et a1.
`Rivette et al.
`Davies et al.
`Nishio ct a1.
`Rivette et a].
`Takano et al.
`Rhodes et a1,
`Koppolu et al.
`
`Zaman et a1.
`Louch et al.
`Donahue et a1.
`Garside et al.
`Leonard ct a1.
`Louch et al.
`Deutsch et a1.
`Kelly et a1,
`Lo uch et a1.
`Santoro et a1.
`Forstall et a1.
`Suda
`Blair ct a1.
`Balnaves
`Waters
`Germeraad et al.
`Nishio el al.
`Grainger et al.
`Odero et al.
`Hagelin
`Barnett et al.
`Graingcr
`Snyder
`Schroeder
`Arnold et a1.
`Scullard et a1.
`Ramos et al.
`Burke
`Phillips et a1.
`Adler et 211.
`Del Vecchio et a1.
`Rivette et a1.
`Uhlig ct al.
`Aasman
`
`MICROSOFT CORP. EX. 1001
`Page 2 of 30
`
`

`

`US 9,423,954 B2
`Page 3
`
`(56)
`
`References Cited
`
`US. PATENT DOCUMENTS
`
`W0
`W0
`W0
`W0
`W0
`W0
`W0
`W0
`W0
`W0
`W0
`
`W0 01/35277
`W0 01/54031
`W0 01/73657
`W0 01/84423
`W0 01/84424
`W0 01/84425
`WO 01/84426
`W0 02/05150
`W0 02/059147
`W0 02/0 86744
`W0 03/044718
`
`5/2001
`/2001
`10/2001
`11/2001
`11/2001
`11/2001
`11/2001
`1/2002
`8/2002
`10/2002
`/2003
`
`OTI IER PUBLICATIONS
`
`dows-visfltaspx (posted on Nov. 9, 2006).
`
`Richard Leadbetter. “Digital Foundry vs. Halo: Reach beta,” avail—
`able at http1//wvwv.eurogamer.net/articles/digitalfoundry—vs-halo—
`reach—beta—article7page:3 (posted on Jan. 5. 2010).
`Jason Fitzpatrick, “Split Screen Slices Your Chrome Window into
`'lwo Panes,” available at http://lifehackercom/SS 1 1986/split-screen-
`slices—your-chrome-window-into—two-panes
`(posted on Apr.
`8,
`2010).
`DonationCoder, “GridMove,” available at https://web.archive.org/
`web/20100208182814/hLLp:,ngpaiva.dcmembers.com/gridmove.
`html (posted on Feb. 8, 2010).
`“100 open source gemsipart 2,” available at http://wwwtuxradar.
`cenv’centent/ 100 -0pe11-source-gems-pait-Z (p0 sted on May 21,
`2009).
`Homepage from “Splilview” website, available at htlps://Web.
`archivc.org/wcb/2009031405 504 8/http://www.splitvicw. com’
`(posted Mar. 14, 2009).
`Homepage from “Soulid Studio” website, available at https://web
`archive.org/web/20100515190349/http://www.soulidstudio.com’
`(posted May 15, 2010).
`“Divvy for Mac OS X," available at https://web.archive.org/web/
`201005 l4l04937/hltp://mi7age.com/divvy (posted on May 14,
`2010).
`Nurgo Software, “AquaSnap,” available at https://wcb.archivc.org/
`web/20 10033 0083 810/http://www.nurg0-seftware.c01n/produets/
`aquasnap (posted on Mar. 30. 2010).
`IIompage to “Winsplit Revolution,” available at hltps://Web.archive
`org/web/200910O 102413 5/http: //www.winsplit-revolution .com/
`(posted on Oct. 1, 2009).
`Google, “What is bug.n?,” available at https://web.archiveorg/web/
`20100326203241/http://code.google.com/p/bugn (posted on Mar.
`26, 2010).
`ZaneA, “HashTWM,” available at https://web.archive.org/web/
`20100303233018/http:Ugithubcom/Zane/VHashTWM (published
`Oct. 25,2009).
`Homepage to “MaxTo,” available at https://web.archive.org/web/
`20090522042853/hl1p://www.maxto.net/ (posted May 22, 2009).
`“Use Aero Snap with Internet Explorer 9 Tabs in Windows 7,” avail-
`able
`at http://www.howtogcck.com’howto/29090/usc-aero-snap-
`with-ie-9-tabs-in-windews-7/ (posted Sep. 16, 2010).
`Neowin. “WindowSpace V2.0 Beta Snapping like in Windows 7.”
`available at http://wwwneowin.net/news/windowspace-V20-beta---
`snapping-like-in-windows-7 (posted Apr. 29, 2009).
`“Xerox
`Star,”
`available
`at
`https://wcb.archivc.org/wcb/
`20100101040301/http://t0astyteeh.corn/guis/starhtinl
`(posted on
`Jan. 1. 2010).
`Warren Teitelman, “Ten Years ofWindow System siA Retrospective
`View,” available at https://web.archive.org/web/20100316102701/
`http://www.Chilton-computing.org.ulo’infi/litcraturc/books/wm/
`p004.hLm (posted on Mar. 10, 2010).
`“Window tiling history.” available at https://web.archive.org/web/
`2010033001 l025/hltp:Nmnemonikk.org/talks/tiling-Wmenhtml
`(posted on Mar. 30, 2010).
`“Comparison of tiling window managers," available at https://wiki.
`archlinuxerg/index.php? Li lle:Comparisoniofitiling_windowi
`managers&oldid:112641 (posted on Jul. 26. 2010).
`Jim Allchin, “The Sounds of Windows Vista,” available at https://
`web.archive.org/web/20061 1 10152317/http://windowsvistablog.
`corm’blogs/windowsvism/archive/Z006/11/09/thc-sounds-of—win-
`
`2003/0172020
`2004/0181427
`2004/0193697
`2004/0205537
`2004/0243938
`2005/0010876
`200 5/0059076
`2005/0193330
`2005/0198584
`2006/0015246
`2006/0212795
`2006/0224992
`2006/0271853
`2006/0294130
`2006/0294470
`2007/0234221
`2008/0109753
`2009/0044138
`2009/0063178
`2009/0138819
`2009/0164936
`
`2009/0199128
`2009/0228824
`2009/02 54610
`2009/0300552
`2009/0303242
`2010/0037154
`2010/0169813
`2010/0169814
`2010/0281372
`2010/0299597
`2010/0302172
`2011/0078733
`
`2011/0219330
`2011/0231878
`2011/0246904
`
`2011/0302528
`2012/0011437
`2012/0023453
`2012/0036443
`2012/0072867
`2012/0081302
`
`2012/0084711
`2012/0154424
`2012/0167011
`2012/0304114
`2013/0047117
`2013/0063442
`2013/0063490
`2013/0198692
`2013/0326401
`2014/0136979
`2014/0245142
`2015/0020101
`2015/0040057
`2015/0128059
`2015/0227283
`2015/0331571
`
`A1
`A1
`A1
`A1
`A1
`Al
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`Al
`A1
`A1
`A1
`A1
`A1
`A1
`Al
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`Al
`A1
`A1
`
`A1
`A1
`A1
`
`Al
`A1
`A1
`A1
`A1
`A1“
`Al
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`A1
`Al
`A1
`A1
`
`9/2003 Davies et a1.
`9/2004 Stobbs et al.
`9/2004 Grosvenor et a1.
`10/2004 Graham et al.
`12/2004 Weise ct al.
`1/2005 Robertson et al.
`3/2005 Merkulov et 211.
`9/2005 Peters
`9/2005 Matthews et al.
`1/2006 Hui
`9/2006 Cottrille et a1.
`10/2006 Rossi et a1.
`11/2006 Marcos et al.
`12/2006 800 et a1.
`l2/2006 Marcos et al.
`10/2007 Ishibashi
`5/2008 Karslens
`2/2009 Rudolph et a1.
`3/2009 Pousti et a1.
`5/2009 Yu
`......... .. G06F 3/0481
`6/2009 Kawaguchi
`715/7 88
`8/2009 Matthews et al.
`9/2009 Forstall et al.
`10/2009 Arthur'sson
`12/2009 Bollman et a1.
`12/2009 Kraut
`2/2010 Marcos et a1.
`7/2010 Chang
`7/2010 Zhang
`11/2010 Lyons et a1.
`ll/20l0 Shin et al.
`12/2010 VVilairat
`3/2011 Lee ..................... .. G06F 3/0346
`725/39
`
`9/201 1 Ando
`9/2011 Hunter et a1.
`10/2011 Pinto ................... .. G06F 9/4445
`715/740
`
`l2/201 1 Starr
`1/2012 James
`1/2012 Wagner
`2/20 12 Ohmori et a1.
`3/2012 Schlegel
`4/2012 Gimpl
`................. .. G06F1/1616
`345/173
`4/2012 Duarte
`6/2012 Klolzer
`6/2012 Zaman et a1.
`11/2012 Wong et al.
`2/2013 Deutseh et a1.
`3/2013 Zaman et a1.
`3/2013 Zaman ct al.
`8/2013 Lin
`12/2013 van Os
`5/2014 Morotomi
`8/2014 Dresti
`1/2015 Brown
`2/2015 Smuga
`5/2015 Bakhash
`8/2015 Luna
`1 1/2015 Chaudhri
`
`FOREIGN PATENT DOCUMENTS
`
`08190572
`2002366797
`W'O 97/17662
`W'O 98/55945
`W'O 00/11575
`W0 00/52618
`W'O 00/60495
`W'O 00/60496
`W'O 00/75851
`
`7/1996
`12/2002
`5/1997
`12/1998
`3/2000
`9/2000
`10/2000
`10/2000
`12/2000
`
`MICROSOFT CORP. EX. 1001
`Page 3 of 30
`
`

`

`Long Zheng, “From Microsoft patent to Windows reality: “X-ray
`browsing”, circa 2005; Aero Peck, circa 2008," available at http://
`m’vwistartedsornething .conv’20081 13 0/frorn-rnicrosoft-patent-to-
`windows-reality-x—ray—browsing—aero-peek/ (posted on Nov. 30,
`2008).
`Steven Sinofsky, “Touching Windows 7,” available at http://blogs.
`msdn.conv'b/e7/archive/2009/03/25/touching-windows-7 .ast
`(posted on Mar. 25, 2009).
`Kiriaty and Goldshtein, “Inside Windows 7iIntroducing the
`Taskbar APIs,” available at https://msdn.microsoftcom/en-us/maga-
`zine/dd942846.aspx (posted Jul. 2009).
`Ina Fried, “Vista won’t show fancy side to pirates,” available at
`http //\va.cnet.com/news/vi sta-wont-show-fancy- side-to-pirates/
`(posted Apr. 14, 2006).
`Klint Finley, “Microsoft Rolls Out Office Web Apps,” available at
`http://readwritecorm’2010/06/0 8/microsoft-roll s-out-office-web
`(posted on Jun. 8, 2010).
`Microsoft, “Microsoft to Extend Office to the Browser,” available at
`http:/'/news.microsoftconv’2008/10/2S/microsoft-to—extend—office-
`to-the-browser/ (posted on Oct. 28, 2008).
`Microsoft, “Microsoft Web Apps: Office Goes to the Web,” available
`at
`http://ncws.microsoft.conv2009/09/17/microsoft-wcb-apps-0f-
`fice-goes-to-the-web/ (posted on Sep. 17, 2009)
`Microsoft. “Microsoft Office 2010 Hits Major Milestone and Enters
`Technical Preview,” available at http://news.microsoft.com/2009/07/
`13/micros0ft-office-2010-hits-major-milestone-and-enters-techni-
`cal-previcw/ (posted on Jul. 13, 2009.
`Ina Fried, “Next version of Office heads to the browser,” available at
`http:/'/\va.cnet.com/news/next-version—of-office-heads-to-the-
`hrowser/ (posted on Apr. 9, 2009).
`Sarah Perez, “Microsoft Office Web Applications: Your Burning
`Questions Answered,” available at https://channel9.msdn.com’
`blogs/coolstuff/microsoft-office-web-applications-your-burning-
`questions-answered (posted on Nov. 10, 2008).
`Microsoft Developer Network, “Object Binding Sample,” Jul. 15,
`2010, http://msdn.microsoft.com’en-us/library/Se36eeyx%28va7s.
`90%29.aspx, last accessed Mar. 20, 2014.
`Microsoft Developer Network, “Object Binding in Visual Studio,”
`2010,
`http://msdn.mierosoft.com/en-us/library/ms233815(Vfl’s.
`100).aspx, last accessed Mar. 20, 2014.
`Steven Sinofsky, “Designing Aero Snap,” Mar. 17, 2009, https://
`blogs.msdn.microsoft.com/c7/2009/03/17/designing-aero-snap/
`#comrnents (last accesed Mar. 25, 2016).
`Gina Trapani, “Snap Any Window to Half the Screen Size in Win-
`dows 7,”Nov. 5, 2008, http://lifel1acker.com/5077728/snap-any-win-
`dow-to-half-the-screen-size-in-windows-7 (last accessed Mar. 25,
`2016).
`Seth Rosenblatt, “First Look: Touch-screen features in Windows 7,”
`Jul. 17, 2009, http://www.cnet.com’videos/touch—screen-features-in-
`windows-7/ (last accessed Mar. 25, 2016.
`www.0pen-ideas.org70pen Ideas, retrieved Apr. 6, 2001.
`“Getting Started with PatentLab-II; a Sample Analysis Scenario
`Included”, Wisdomain, Inc., Version 1.1, May 6, 2000.
`Roberts, Bill, Solving the Value Equation, Knowledge management
`Magazine, Jan. 2001.
`Retrieved from the Internet Archive Waybaek Machine Nov. 8, 2004.
`Retrieved from the Internet Archive Waybaek Machine Nov. 22,
`2004.
`
`* cited by examiner
`
`
`
`gogogogogogogogogc
`
`US 9,423,954 B2
`Page 4
`
`(56)
`
`References Cited
`
`OTHER PUBLICATIONS
`
`
`
`Retrieved from the Internet Archive \Vayback Machine Dec. 19,
`2000.
`Retrieved from the Internet Archive Wayback Machine Jul. 6, 2000.
`Microsoft press Compu er Dictionary third Edition Microsoft Press,
`1997.
`Roberts, Ginger, Derwent Information Global Patent Sources, 1995.
`East Search Screen Showing Copyright Date of 1999.
`Dialog Pocket Guide, The Dialog Corporation, Copyright Date of
`1998.
`Dialog Pocket Guide, The Dialog Corporation, Copyright Date of
`2001.
`“Internet Explorer for Mac" screenshots http://en.wikipedia.org/
`Wiki/Internet.sub.--Explorer.sub.--for.sub.--Mac., 2001 .
`Microsoft Internet Explorer Ver. 6.0.2800, Copyright 1995—2001.
`Netscape Navigator v. 6.1, Released at least as early as Jun. 2001.
`Internet Explorer 5.x Basics Release Date for IE 55 Jul. 12, 2000.
`Internet Basics IE 5.5, p. 7: Release date for IE 5.5 Jul. 12, 2000.
`Patricia Pantel, Dekang Lin, “A Statistical Corpus-Based Term
`Extractor” 2001.
`Archived Webpages from Blinkcom. 74 pages. (Feb. 2, 2009).
`Archived Webpages from Clickmarkscom, 58 pages. (Oct. 5, 2008).
`Archived Webpages from SpotOn.com, 74 pages. (Oct. 14, 2008).
`Brs & West, Scientific and Technical information Center, USPTO,
`Jun. 1999, p. 4.
`Chakrabarti, S. et a1. (2000). “Using Memex to Archive and Mine
`Community Web Browsing Experience,” Computer
`I\etworks
`33:669-684.
`East 1.1 Enhancements, Scientific and Technical Information Center,
`USPTO, Jul. 2000, pp. 5-86.
`New Internet Explorer 5 .5 Technologies Designed to Support Richer,
`Interactive Web Application (Jul. 12, 2000).
`Pfaffenberger, B. (1995). Netscape Navigator 3.0, Surfing the Web
`and Exploring the Internet, AP Professional: Chestnut Hill, MA, pp.
`xv-xvi, 3, 5-12, 22, 76-84, 91-107, 201-209, 443.
`SurfSaver.com Archived Webpages, 66 pages. (Feb. 19. 2009).
`Underdahl, B. (2000). Opera Web Browser for Dummies, IDB Books
`Worldwide, Inc.: Foster City, CA, pp. 9-16, 28-32, 36-37, 40-42,
`46-53,67—93,97,152-153, 185-189.
`Freedman, Alan, The Computer Desktop Encycloedia, AMACOM
`1996.
`Ice Action Summary in US. Appl. No. l2/868,767 dated Dec. 31,
`2.
`ice Action Summary in US. Appl. No. 12/868,767 dated Jul. 19,
`3.
`ice Action Summary in US. Appl. No. 12/868.767 dated Jan. 16,
`4
`ice Action Summary in US. Appl. No. 14/173,806 dated Dec. 2,
`q
`
`ice Action Summary in US. Appl. No. 14/924,677, dated Feb. 3,
`lie Action Summary in US. Appl. No. 12/956,008, dated Jul. 31,
`lieAction Summaryin US. Appl. No. 12/956,008, datedMar. 27,
`“1:; Action Summary in US. Appl. No. 14/331,096, dated Jan. 15,
`“1:; Action Summary in US. Appl. No. 14/924,706, dated Jan. 20,
`LI.S.6Appl. No. 12/868,767, filed Aug. 26, 2010.
`
`MICROSOFT CORP. EX. 1001
`Page 4 of 30
`
`

`

`Aug. 23, 2016
`
`Sheet 1 of 11
`
`US 9,423,954 B2
`
`
`
`
`
`
`
`US. Patent
`‘E2“.\o._.‘womtEEbmvcooom
`
`{9,502Lmamu<wow$9on9:980
`:n:EELSaallllllll
`3IaE996
`
`
`Iaa$5mv<a“E:a30:52
`
`
`0:quQU<$O_>¢DOEwmeOLn——_®O_w>r_n_
`
`
`
`833:558:6059:0
`
`
`
`83mm5%:59:0-550:me
`
`cow_w._o
`
`
`
`x8352ag.n_flmEBgmnsm
`
`815%:
`
`
`
`NFEmEco.._>cm_cozsomxm
`
`fl$023250
`
`
`
`UCNwwtmgnjLwcu—O
`
`awcozmo=QQ<
`
`J
`
`MICROSOFT CORP. EX. 1001
`Page 5 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 2 of 11
`
`US 9,423,954 B2
`
`Detect a first visual component including a first presentation space for
`presenting first data by an operating first application
`
`Detect a first change to the first visual attribute
`
`Send change information automatically, in response to detecting the
`first change, to change the second visual attribute according to the
`
`Identify binding information, for the first application, that specifies a
`mapping between a first visual attribute of the first visual component
`and a second visual attribute of a second visual component including
`a second presentation space for presenting second data by a second
`application
`
`mapping
`
`MICROSOFT CORP. EX. 1001
`Page 6 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 3 of 11
`
`US 9,423,954 B2
`
`Ul Monitor fl
`
`Binding Monitor
`M
`
`Change Director
`
`Binding Director
`&
`
`fl
`
`MICROSOFT CORP. EX. 1001
`Page 7 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 4 of 11
`
`US 9,423,954 B2
`
`Execution Environment 401a
`
`Graphics Subsystem
`439a
`
`ubs
`
`Presentation Controller 435a
`
`Change Director
`
`Application 403a
`
`Ul Element
`Handler
`433a
`
`Network Stack 411a
`
`Binding Director - Binding Monitor
`
`404a
`
`Ul Monitor 4023
`
`Application Protocol Component 413a
`
`MICROSOFT CORP. EX. 1001
`Page 8 of 30
`
`

`

`GUI Subsystem
`437b
`
`Presentation Controller 435b
`
`Change
`Director
`408b
`
`Browser 4 3b
`
`Ul element
`
`handler
`fl
`
`Binding Director
`404b
`
`Binding Monitor
`4_06b
`
`' Network A lication
`
`.Agent 405b
`
`UI Monitor 4 2b
`
`'
`I
`
`Content :
`Handler:
`431b
`
`Content Manager
`415b
`
`Application Protocol Component 413b
`
`US. Patent
`
`Aug. 23, 2016
`
`Sheet 5 of 11
`
`US 9,423,954 B2
`
`Execution Environment 401 b
`
`Graphics Subsystem
`439b
`
`Network Stack 411b
`
`MICROSOFT CORP. EX. 1001
`Page 9 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 6 of 11
`
`US 9,423,954 B2
`
`Graphics Subsystem 439C
`
`GUI Subsystem 4 70
`
`Execution Environment 401C
`
`w
`
`Change
`Director
`408c
`
`M
`
`Ul Monitor 4020
`
`Input Driver
`fl
`
`Network Stack 41 1
`
`Ul Element
`Handler
`433-1c
`
`First Application 403-10
`
`Presentation Controller 435-2c
`
`Second Application 403-2c
`
`Presentation Controllerm
`
`Ul Element
`Handler
`
`m
`
`Application Protocol Component 4130
`
`MICROSOFT CORP. EX. 1001
`Page 10 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 7 of 11
`
`US 9,423,954 B2
`
`Network Stack 411d
`
`Application Protocol Component 413d
`
`Network Application Platform 4
`
`0 d
`
`Controller 417d
`
`Execution Environment 4 1d
`
`Model Database
`421d
`
`View Subsystem 4 9d
`
`Ul Monitor 402d
`
`Change
`Director
`408d
`
`Binding Monitor
`406d
`
`Binding Director
`404d
`
`Template Engine
`423d
`
`Template
`Database 425d
`
`Model Subsystem 419d
`
`Network Application 4 3d
`
`MICROSOFT CORP. EX. 1001
`Page 11 of 30
`
`

`

`US 9,423,954 B2
`
`User Node
`
`&
`
`US. Patent
`
`Aug. 23, 2016
`
`Sheet 8 of 11
`
`M
`
`Application
`Provider Node
`
`MICROSOFT CORP. EX. 1001
`Page 12 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 9 of 11
`
`US 9,423,954 B2
`
`Display Presentation Space 60 a
`
`Second App
`
`606_1a\\
`
`Tools
`
`Help
`
`61043 “\~
`
`\ FirstApp
`File
`Edit View
`Bookmarks
`http://mysite.OoOT.com
`
`Presentation Space 608-1a
`
`MICROSOFT CORP. EX. 1001
`Page 13 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 10 of 11
`
`US 9,423,954 B2
`
`Display Presentation Space 602b
`
`604-1 b
`
`First App
`File
`Edit View
`
`604—3b
`
`_\
`
`Bookmarks
`
`Tools
`
`Help
`
`Presentation Space 608-1 b
`
`2nd App
`604—2b
`
`3rd App
`
`MICROSOFT CORP. EX. 1001
`Page 14 of 30
`
`

`

`US. Patent
`
`Aug. 23, 2016
`
`Sheet 11 of 11
`
`US 9,423,954 B2
`
`/ 702
`
`/
`
`///
`<viéuaI-binding>
`
`708-1
`706-1
`7044 \
`704_2 \:\<application path=”c:\apps\editors\htm|Edit.exe” id="editor” \>
`“<application path="c:\uti|ities\search\filesearch_exe” id=”navigator“ \>
`706-2
`708-2
`
`718 4
`'
`
`71 6-5
`
`Fig. 7
`
`/ 714—1
`712—1
`710-1
`718-1 Tsattribute-binding id=”editor.h’1ain.state” op-id=”init” >
`<bind id="navigator.main.,state" op—\id=”init” param=”c:\\docs\\web” \>
`/
`'
`-
`'
`'
`7221
`\-
`—
`/
`< attribute blndlng7>20_1
`7122
`/ 7142 724 1/ 7162
`/
`/
`710-2 \.\
`/
`718-2 Sfattribute-binding id=”editor.main.size” op-id=”max” symmetric=”TRUE”>
`\<bind id="navigator.maingize" op-ig_="min” \>
`</attribute—binding>
`//
`\ 722-2
`/,
`716-3
`/712-3
`720—2/
`714'3
`,,
`,
`710-3
`,2
`718-3 :\<attribute-binding id="editorfmain.size” op-id=”change” symmetric=”TRUE”>
`\<bind id="navigator.main/,size” op-1d="opposite” \>
`</attribute—binding>
`/
`\\ 722—3
`//
`'/
`//
`_\\
`iattribute-binding id=”editor/.main.size” op-id=”resize” symfnetric=”FALSE”>
`\\'\<bind id="navigator.mainlocation” op-id=”empty-space” \>
`</attribute—binding>
`/
`\ 722-4
`712-5
`720-4 /
`710-5
`714_5 \ “‘<attribute-binding id=”editor.main.Iocation” op-id=”change“
`718 5
`symmetric=”TRUE”>
`' \\ <bind id="navigator.marinlocation" op-id="empty-space” \>
`</attribute—bindinn>
`\\ 722_5
`7166
`712—6
`720-5 /
`4/ 714-6
`710—6 \_
`71845 \_\ <attribute-binding id=”editor.fnain.state" op-ia=”on-focus“ symrfietric=”TRUE“>
`\ <bind id=”navigator.main.|pcation” op—id=”empty-space” \>
`</attribute—binding>
`/
`‘\ 722-5
`714-7
`712-7
`720-6
`710_7
`718_7 i‘fgttribute-binding id=”editor.f‘nain.transparency” op-’1d=”change” >
`<bind id=”navigator.main.transparency” op-1d=”match” \>
`</attribute—binding>
`/
`\“\- 722-7
`
`<visuaI-binding>
`
`720-7 /
`
`MICROSOFT CORP. EX. 1001
`Page 15 of 30
`
`

`

`scale. In the following description, for purposes of explana-
`
`invention will
`Obj ccts and advantages of the present
`become apparent to those skilled in the art upon reading this
`description in conjunction with the accompanying drawings,
`in which like reference nlunerals have been used to designate
`like or analogous elements, and in which:
`FIG. 1 is a block diagram illustrating an exemplary hard—
`ware device included in and/or otherwise providing an execu-
`tion environment in which the subject matter may be imple-
`mented;
`FIG. 2 is a flow diagram illustrating a method for binding
`attributes between visual components according to an aspect
`of the subjec ma er described herein;
`FIG. 3 is a block diagram illustrating an arrangement of
`componen s
`inding attributes be ween visual compo-
`nents accorc'
`0 another aspec of the sub'ec matter
`describec
`FIG. 4a "
`componen
`nents accorc'
`describec
`FIG. 4b " '
`componen
`nents accorc‘
`describec
`FIG. 40 '
`componen ‘
`nents accorc‘
`dcscribcc
`ock diagram illustrating an arrangement of
`FIG. 4d '
`componen ' for Jinding attributes be ween visual compo-
`nents accorcing 0 another aspec of the subjec matter
`describec herein;
`FIG. 5 is a ne work diagram illus rating an exemplary
`system for binding attributes between visual components
`according to another aspect of the subject matter described
`herein;
`FIG. 6a is a diagram illustrating a user interface presented
`via a display according to another aspect ofthe subject matter
`described herein;
`FIG. 6b is a diagram illustrating a user interface presented
`via a display according to another aspect ofthe subject matter
`described herein; and
`FIG. 7 is an illustration ofbinding infomiation according to
`another aspect of the subject matter described herein.
`
`ck diagram illustrating an arrangement of
`inding attributes be ween visual compo-
`0 another aspec of the sub‘ec matter
`
`
`
`
`
`
`
`
`
`DETAILED DESCRIPTION
`
`One or more aspects of the disclosure are described with
`reference to the drawings, wherein like reference numerals
`are generally utilized to refer to like elements throughout, and
`wherein the various structures are not necessarily drawn to
`
`US 9,423,954 B2
`
`2
`interface element associated with the second application; in
`response to the second user input, presenting, utilizing the
`touchscreen, a second visual component for presenting sec—
`ond data associated with the second application, such that a
`first border of the first visual component corresponds to a
`second border of the second visual component; detecting,
`utilizing the touchscreen, a third user input; and in response to
`the third user input, automatically changing, utili7ing the at
`least one processor and the touchscreen, the presentation of
`the first visual component and the second visual component,
`such that the first border of the first visual component corre-
`sponds to the second border ofthe second visual component.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`ck diagram illustrating an arrangement of
`inding attributes be ween visual compo-
`0 another aspec of the sub'ec matter
`
`'
`
`'
`
`'
`
`
`
`
`
`
`
`ck diagram illustrating an arrangement of
`inding attributes be ween visual compo-
`0 another aspec of the sub'ec matter
`
`1
`GRAPHICAL USER INTERFACE METHODS,
`SYSTEMS, AND COMPUTER PROGRAM
`PRODUCTS
`
`
`
`RELATED APPLICATIONS
`
`The present application is continuation of, and claims pri-
`ority to US. patent application Ser. No. 14/33 1,096, titled
`
`
`“METHODS, SYSTEMS, AND COMPUTER PROGRAM
`PRODUCTS FOR BINDING ATTRIBUTES BETWEEN
`VISUAL COMPONENTS,” filed Jul. 14, 2014, which, in
`turn, is a continuation of, anc claims priority to I .S. patent
`application Ser. No. 12/956,008, titlcd “METHODS, SYS-
`TEMS, AND COMPUTER PROGRAM PRODUCTS FOR
`BINDING ATTRIBUTES BETWEEN VISUAL COMPO-
`NENTS,” filed Nov. 30, 2010, now issued as US. Pat. No.
`8,780,130,
`the contents of all of which are incorporated
`herein by reference in their entirety for all purposes.
`BACKGROUND
`
`
`
`
`
`While some applications can be used alone, some applica-
`tions are used together. Often there is no integration and/or
`cooperation between or among applications used at the same
`time by a user. Even in application suites, cooperation is
`limited to features that ease data sharing between or among
`applications in a particular application suite. For example,
`documents often include both text and media such as images
`from pictures, graphs, and drawings. Word processors pro-
`vide rich feature sets for creating and editing text, but provide
`relatively weak or no features for creating and editing other
`forms of data. As a result, users work on text for a document
`in a word processor, images in an image editor, and drawings
`using a drawing tool such as a computer aided design (CAD)
`tool. Users spend significant time managing the user inter—
`faces of these various applications in order to access the data
`desired in the application desired.
`Accordingly, there exists a need for methods, systems, and
`computer program products for binding attributes between
`visual components.
`
`SUMMARY
`
`The following presents a simplified summary of the dis-
`closure in order to provide a ba sic understanding to the reader,
`This summary is not an extensive overview of the disclosure
`and it does not identify key/critical elements of the invention
`or delineate the scope of the invention. Its sole purpose is to
`present some concepts disclosed herein in a simplified form
`as a prelude to the more detailed description that is presented ,
`later.
`Methods, computer software, apparatuses, and systems are
`described in connection with a mobile device including at
`least one processor operativer coupled to a touchscreen and
`memory. The memory stores a first application and a second
`application. The mobile device is configured for: presenting,
`utilizing the touchscreen, at least one menu including a plu-
`rality of interface elements including a first application inter-
`face element associated with the first application and a second
`application interface element associated with the second
`application; detecting. utilizing the touchscreen, a first user
`input in connection with the first application interface ele-
`ment associated with the first application; in response to the
`first user input, presenting, utilizing the touchscreen, a first
`visual component for presenting first data associated with the
`first application; detecting, utilizing the touchscreen, a sec-
`ond user input in connection with the second application
`
`’
`
`r
`
`
`
`
`
`
`
`MICROSOFT CORP. EX. 1001
`Page 16 of 30
`
`

`

`a still camera, a document scanner, a fax, a phone, a modem,
`
`3
`tion, numerous specific details are set forth in order to provide
`a thorough understanding of one or more aspects of the dis-
`closure. It may be evident, however, to one skilled in the art,
`that one or more aspects of the disclosure may be practiced
`with a lesser degree of these specific details.
`In other
`instances, well—known structures and devices are shown in
`block