(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2008/0076637 A1
`(43) Pub. Date:
`Mar. 27, 2008
`Gilley et al.
`
`US 20080076637A1
`
`(54) DYNAMICALLY ADAPTIVE SCHEDULING
`SYSTEM
`
`Related U.S. Application Data
`
`(75)
`
`Inventors:
`
`Glenn Gregory Gilley, Los Altos,
`CA (US); Sarah A. Brody, Santa
`Clara, CA (US); Randall Hayes
`Ubillos, Los Altos, CA (US);
`Mihnea Calin Pacurariu, Los
`Gatos, CA (US); Jesse Lee
`Dorogusker, Los Altos, CA (US);
`Robert Edward Borchers,
`Pleasanton, CA (US); Donald
`Ginsburg, San Francisco, CA (US)
`
`Correspondence Address:
`ROPES & GRAY LLP
`PATENT DOCKETING 39/361
`1211 AVENUE OF THE AMERICAS
`NEW YORK, NY 10036-8704
`
`(73) Assignee:
`
`Apple Inc., Cupertino, CA (US)
`
`(21) Appl. No.:
`
`11/729,171
`
`(22)
`
`Filed;
`
`Mar, 27, 2007
`
`(60) Provisional application No. 60/846,414, filed on Sep.
`21, 2006.
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`A63B 71/00
`(52) U.S.Cl.
`......................................................... .. 482/9
`
`(57)
`
`ABSTRACT
`
`Methods and systems for providing a lifestyle companion
`system are provided. The lifestyle companion system can
`provide a platform to conduct a user interview. Based on the
`user interview responses, the system can suggest activities,
`references, and/or plug-in modules. During performance of
`activities, the system can provide audio and/or visual cues
`related to the activities and collect data indicative of the
`
`user’s performance. Based on the collected data, the system
`can dynamically adapt the user’s goals and/or activities the
`user is performing or will perform. In some embodiments of
`the present invention, the lifestyle companion system of the
`present invention can be applied to fitness, nutrition, and/or
`medical modules. The system also can be used to facilitate
`synchronous group activities.
`
`.
`7C,,¢
`Pfiwlclg 3 PM-l1“urvv(
`Comduchk
`"ml-q-~l'\&w$
`'
`
`loo
`
`'0‘
`g,AE.P(&M£,p,.
`U._»6v pvnfisg
`wfilrx 0+1/xcr
`V5“ (>mF\la(s)
`
`\eve\S
`Assiflh ga*<“jb()’
`_|R;.5e,g
`.,n’mAcmouu responses
`
`"'01
`
`6u3c]es+ ao1{v.+:cs_ re{%,u;—r1‘c—Ig,
`and/or Pwfl-in Maiutes bag;
`or/\ user \N-an/(’avJ
`'
`res;-;ow.e'=
`
`"'04
`
`.
`
`«« am to
`_ schedule, EtL*]u\-hya
`_._,_
`,
`Pruvtdc audro avd/or VlSut1i cues,
`11: user dUJ“"3 pufbymance oe
`/I08
`
`achvrhes
`
`
`
`‘EJe;T';.:gm..ue‘i"§;Ra’“’m;r
`user _duxWv€J
`4n1vv\av\ce_
`o( adov-H3 and/or ‘\'hv0u3\(\ou3(
`
`p
`dg_3($)
`
`/_“o
`
`am!/or
`DU"¢W~3(B“'3 3C‘ep+ goals
`?Ct'V'*‘-"es based on oo\\€o41tA_zL8ta.
`
`,_H«L
`
`11(€53
`
`y-QPDr)_5/_H4
`
`fi"3:~:.;,r.,
`fisirn Y
`cmaic
`'
`'4"
`aohw ‘es
`I05’
`
`@
`
`Dstribulc
`new 3-rds
`
`
`
`lof45
`
`FITBIT EXHIBIT 1004
`
`FITBIT EXHIBIT 1004
`
`1 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 1 of 26
`
`US 2008/0076637 A1
`
`.
`P
`Czmduchn miqvwvus
`
`‘
`
`loo
`
`\eW\S
`ge’«€“3b()’
`7\Ss¥fl‘r\
`_b9seel mxnwxau rarwses
`
`
`” '07’
`
`'0‘
`Hf‘: P\;f\ta
`USN \'>vu$1|e.(s.)
`
`w o
`
`cr
`
`Su3:.]es+ 3011-vthés, re.f},((;y:C;;1
`and/or pwfl-in W\Dc‘,uleS begeg
`on u$b( \v\¥uu.'wJ
`‘
`responses
`
`”'0£i
`
`A
`
`VDUIC
`
`""""_7—_
`-
`5
`
`\a+fi W\
`
`-(-‘o
`
`.(
`r.‘
`‘P
`Pm“ t
`_ Scheduc 8c:hv\-hes
`
`user Tu
`
`[mo
`
`p|a’r'Form {or
`user 11,
`ewe
`BCNVI ‘H es
`
`‘-——---—~--_
`Provldf, audio and/or v.su.a.| cue‘,
`+0 user durmj petfinmance 0*?
`/"03
`acrwrhes
`
`
`
`
`
`......_._. ...._..._ . .... ,_
`
`_,
`
`/_]‘o
`
`~......_....._._ .._..—..—---~
`Co\\ec+ a4d'.+wme\ cla-\a "Hm
`user _dt{-rmfj Fafivmamcc
`o( acfiov-H3 am‘/or +hvou.5ymuk
`c_\§__ (S)
`Duném\ca‘h3 ac‘ap+ 5oa\s ml/or
`’c"5““"’H€-S
`bB<»@c\ on oo\\ec+c¢LcLata
`
`
`
`
`
`
`
`
`»
`
`20f45
`
`2 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 2 of 26
`
`US 2008/0076637 A1
`
`Senwro
`Q08
`
`/1/
`
`/1
`/1 /
`// O
`
`$64/\5Or‘
`
`O
`‘$cn6o(
`
`W3
`
`F \q. 1
`
`30f45
`
`3 of 45
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 3 of 26
`
`US 2008/0076637 A1
`
`
`
`
`
`
`
`
`
`55:...,..1...._.._.H_.._....$.5E._..,...:.w...:u_a=3.u..._.
`
`
`
`
`
`
`
`
`
`W
`
`
`
`
`
`earn.“U532351.“=2,.6:325.5.
`
`
`
`
`
`Scumwco_unE.£c_._mcow_wm.—vs»3mEou_o>>.
`
`
`
`§>w_>._mu:_mmwcwm
`
`m,o..~Eau”
`
`....ov=oum22.mEEm>._Q:._—u_.wu=u.=...m
`
`.m:o.:nw:_u25»mmccwzficm3
`..m:om..ma50>33653no»
`
`
`
`.3>9359»o:E:E8uvSunnos.25=.
`
`
`
`.5553mane.32.5009:5303:
`
`
`
`.:5.fi0:.mUniwEEu3:”mm«#5203
`
`Emmmcw£u_.u..u:
`
`.33um.>3?
`
`mAVE
`
`
`
`_uo.o=32E5Eflmoa...nwcE.
`
`
`
`.m_momtammvmocS9»9.
`
`
`
`
`
`
`
`nmo.3:_._w>a..305$..o:...E.£5Iii......Iu..>...ur.._....o..:_LQ>_mF=.:3m
`
`
`
`
`
`
`
`........§...._.._....,._3.
`
`....._.......
`
`
`_.?....a,....._.._.».,..m,t...._...:.u."._,.m_._..
`
`40f45
`
`4 of 45
`
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 4 of 26
`
`US 2008/0076637 Al
`
`vOE
`
`Oo<
`
`1-
`
`:/V.EEmoE
`32.5vm..3u.::s:_vm.~n_u_:aa
`
`
`
`E3:_w>.:o>:2:2.35wn_u.wxo3262
`
`
`
`
`
`
`
`
`
`823.02“.25.>u_>=u<H.
`
`
`
`H_N>W.._mmmcuw.50>m=_=_e§8
`
`
`
`
`
`95so»1...:Emma.ouficmxm8u:_E=§.
`
`
`
`.509.3.03xzcuzauSc
`
`
`
`_m>w._mmwcxuEotau.~Em._mo._Qmmmcacmvww:30>.
`
`
`
`
`
`
`
`50>C.._O._..—asx..o_s3_um:m._mm_u
`
`
`
`
`
`Essae9._§_§.H_2s::s_....._w>w_mmmcucucw._._:uH.
`
`
`
`
`
`
`
`|L...|...r.Y.............G,...,,..m._,w.m:.g..$a
`
`50f45
`
`
`
`$a.£.E.Surf....:a..E_O..icoflwm
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`>.~EE:wflsuwzvm..$2.53nm._2c__u>u._nwaczu...o_«uE..£:_..
`
`
`
`
`
`
`
`..l.|-l£II|IlIluIln!I|uI..«.|u|.l.I':n.I:s||1l..|.Il|I:I.l.£0383.mnucfi..
`
`
`
`
`
`
`
`
`
`5 of 45
`
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 5 of 26
`
`US 2008/0076637 Al
`
`OV
`
`3
`
`2:\vum..E>uuso._onEvEn>=_.o.c:v:o>3<
`
`
`
`
`
`«to.va_0m.ES:5%>u_voam
`
`
`
`
`
` 23>Eu.._.__.:&Ea:_:_E._.Eu_.o3m35.52..U25:3E«$25W:.o_..=_PD
`:23...»:
`
`
`
`930_d0.5_u._._UEast»:0uc_E:..tsmE9__mm£m
`
`9._.§S.mE»v_no.u<mu
`
`H:8253925
`
`
`
`23...55..
`
`
`
`flmw..wuc_Sect“..m$mm._2c_nmwcu:=mxumzu
`
`
`
`
`
`
`
`fin..5...ll....
`
`
`
`acw=:u_._u:o:wa.
`
`.
`
`
`
`
`
`
`
`
`
`
`
`...:._......F..EL.nK...n....x..!.L.u.I..,.ui:!.r|a..1I3195!xr...hF.|....sl...x.1..«a|:v.0.!..............u.L..u>~7>u1;.$.242.H,
`
`
`.._....'fl—0I.§0_)aw...
`
`60f45
`
`
`
`
`
`8uE2c_..u>_m._Refitco_.mE.o..:_
`
`
`
`iIUIKMEBnwucgu
`
`6 of 45
`
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 6 of 26
`
`US 2008/0076637 A1
`
`
`'u2._om-c.o2..3U......H.....=30.3
`
`
`
`
`
`
`mn......w.V....l1........u.l...u.....|.....n.w«...r»,»..|..\..ru...£.k.HEb.I.L...»uu...|FI....“nlrrs......»E......l.....!h....r..........w.......4.........u.m:!rs:1
`
`
`
`
`
`
`...L._.2...._.....u...WimamJ
`
`So
`
`
`
` .35\“gamma29¢;$5.8
`
`3;2.:u_§uz
`
`
`
`meow"m...1.._uAo.uo.”3mD.um.Rh
`
`:80E925
`
`
`
`
`
`oucuctotono>EnE.UE3.305...
`
`£35m:Q2.2:E.238anE.
`cucflmunauE2:_m2Uur_D_w>>
`
`
`
`2.2ucaEmm5mm..o3023~53so.»2.
`
`
`
`.._a_5§3m.>_co.25E925.59».Bmu_vc__
`
`
`
`
`
`
`
`
`
`mfioumnmcum.v55m_mom«$5.:=mxumcu
`
`
`
`H0.:33.
`
`.>_nn.m
`
`
`
`
`
`
`_o__...vw..:u.m.........._m__§.§.._._c=ozaE._8:_
`
`
`
`
`
`
`
`
`
`
`».um5_u.._....Hm..,_Emtzu._mcom..mm.
`
`
`
`,....m...>h.m...?....._E.H
`
`70f45
`
`7 of 45
`
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 7 of 26
`
`US 2008/0076637 A1
`
`
`
`w_:_um;ummmwctu.m
`
`mmmcuc50>w__.._uw;um
`
`éemoa
`
`E5.
`
`0
`
`
`
`
`
`n.8>:_3m50>mcnmuficm.3.
`
`
`
`:3.:9»m_=uw:um>§_wm>>
`
`.
`
`dczzo.QCau_EEOU
`
`
`
`wEn.:mE_uu:..._.mw.oE3.33..
`
`\.:o>.83:03«B:
`
`
`
`
`
`w>mEum:3:o>>95...E._..
`
`
`
`.m«mE8c_...26..Swag“..co._:..E.£..__
`
`
`
`
`
`$.a5.E
`
`
`
`...host..£33...._a...3ca._..
`
`
`
`
`
`
`
`
`
`H._._.,.u..,_............_.v..._......@
`
`80f45
`
`8 of 45
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 8 of 26
`
`US 2008/0076637 A1
`
`
`
`
`
`
`
`
`
`
`
`
`
`_.mmm.5_..._.,__.mmw5._u...mmacui..Eatau..3,.icoflum
`
`
`
`
`
`
`
`
`
`..CmEE...m.a_:_um_._um.,.230...$8.2..._.._..>a.._nnwczm..mo_»nE.£:_
`
`
`
`
`
`
`
`
`
`
`
`
`
`awe»:5mm;ou_u_.So..=wz.ucmvw~._mco2oa50>mmmcucwnu£u_>>mcov0.530>
`
`
`
`
`
`
`
`
`
`
`
`
`E§:.=3.2...:32:£mv3=.§s§S:o2.m.._.._2sSufi:_uwuc:o._avan5:3;
`
`
`
`
`
`
`
`
`
`?¢..uc=§aaanmmstm£=_2»fimcuamUo>o__9:.3Awr::0..30»
`
`
`
`
`
`uxuov3::“.0SmucouEflmoiC3009um:.—m>.:o>.>>w_>..muc_
`
`
`
`
`
`?€v..Emmucmrfiumwcves.m>uucos=nmo>.mc_u_..o._mEc_m._u
`
`
`
`
`
` .£.uE...5wnn.m_.£mm_."ms?
`
`
`r5:8E25vanz.o_.:oE_aufitufium2:53.
`
`..§::E§u
`
`
`
`
`
`mumum_mOUE925wcov2»:0»=cozzn..m>nm..22xuzu
`
`
`
`
`
`
`
`
`
`umucgua9.:..:_>..u_.E_.cou:3:0»
`
`Sanmtoan3.50»2:5226.32:.2:.0cozuam
`
`E-...31o5c...9£:B.£cozanofmc_xu:u3mzouwm5.3:
`
`
`“$0.03
`
`.382
`
`
`
`
`
`
`
`
`
`.33»ao_a..3.u.¢.533‘$1.53boiu£43Evaouox57¢:uunflu3.mm;
`
`
`
`...........s.u|I.«|.r...a|l
`..1....%.w.W.
`
`
`
`
`>.mEE:mmmwctn..0_n:o:m_3m._m:ou
`
`
`....!.F.h.....I.|.|.1....u....,:..L;1:....,....7.1.1......2....:...............I.in:..l::l.lla.!Y|..».
`
`
`
`
`
`
`
`.lazsomfl.3:3.D...._u:sous;u3.c§u<swam.3u.>.:8.E....
`
`
`
`
`
`90f45
`
`9 of 45
`
`
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 9 of 26
`
`US 2008/0076637 A1
`
`
`n:o_._ucou_u::»3:_o:naUD9.63«E53W>u0Hm_S_MU._CUE
`3.53....JocunuooxWGzzu.mE£n<_U.
`
`
`
`:2;::.£._oD._.....E<DSo».0Eoum.Ecofioa
`
`
`
`
`
`
`
`..C3nENOID..uv.on_uu.=.EE_8:<D.
`
`
`
`a3.6§2_._o03.25.0m>_UEwE_._m_Ewu¢couucm
`
`
`
`
`
`
`
`
`
`
`
`_»>u.._=3».5V5.w>~:30>55ucofiucou=uxuuzuWufiuwmNm_ULOUUL£H—NW£530}.
`
`m_3..ono3uOQ.0230B
`
`
`
`
`
`..._..§.__m.._2:_§mncawmmcmcc.Bmo..uEU:9»
`
`0CE
`
`°l0
`
`ON
`
`
`
`..._.o_..._....._sic>_..a:3.22<Ecofiwa30>.mcm_u_&En
`
`39.co_unE..o..:_5.3;
`
`
`
`_uw~_._o5:o._:o>5:5Saga
`
`
`
`2o..3=..oz3:.n_=...m._:.>..=_....u.:2.55
`
`
`
`
`
`E._.
`
`22
`
`10 0f45
`
`
`
`
`
`>..¢E-tin......n.:o=an_.“:..EE.n.oAE=z.nu..._..n=o:_u..coU.30.2:.
`
`
`
`
`
`.........,..__._...a._€w
`
`
`
`......!&,s.
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`
`.Co»m_I5:31._.Eouwxfi_mm_._._:o>u30a<....
`
`10 of 45
`
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 10 of 26
`
`US 2008/0076637 A1
`
`
`
`..ln....w.....‘......mmm
`
`.
`
`110f45
`
`
`
`
`
`.V_..._._AHmm_u:_p...__......._:,.~..~.v.v%V38£5,a._...%_i;>.I
`
`
`
`
`
`
`
`82
`
`2.03
`
`
`
`
`
`s......ai...8»i3A..._.e...£9.12..........;..F.
`
`
`
`
`
`..H.:...:...x..._u..“....:.,....._?.....um
`
`
`
`
`
`11 of 45
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 11 of 26
`
`US 2008/0076637 A1
`
`
`
`_.9.-_o..c.v_3o..8_8£w__mu.m.c.m%___6...
`
`
`
`
`
`12 0f45
`
`12 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 12 of 26
`
`US 2008/0076637 A1
`
`8.2
`
`
`
`
`
`
`
`
`
`
`
`
`
`......._..._.x.:mHn:¢_5uA!.....“
`
`a.QB
`
`..
`
`u=o=¥:.»=.
`
`603709gm8Czdux.......ausofi8__...._a..8.3.32....~.2,
`
`«Eu3Essay33.ucu
`
`Ewan..§3.%_3fi35:
`
`...%.a._.35.__3a..9....2NHn3%
`
`
`
`
`
`¢.wa.._..w..
`
`a...m:.w..n~H.
`
`tau.oduu_m
`
`3.3
`
`
`
`Evan-.u:.uEa_:9o
`
`Hafiamam
`
`13 0f45
`
`13 of 45
`
`

`
`Patent Application Publication
`
`Mar. 27, 2008 Sheet 13 of 26
`
`US 2008/0076637 A1
`
`3.3u_::8.<385..5...:3an...E2.5.:
`:8.3oerE
`
`.§uo_a.u=eu.u..a
`
`na.=wm.uEvU.
`
`u:..3.B_3.G.u.mfl
`
`o:E«fl1B.u..:ifl.
`
`§uo=au.v8i.fi._..........m:.,s,M..M~»_
`
`
`
`
`
`..a.uo=ou:eu§a_m_.__..2W.._M........as€..w..I;...I5
`
`.a_:ux=...on<S”._.i_.2..._3Umam:
`
`
`
`
`
`
`RS2..o:n..vo2.naorfi.,....I..§..-.«.-.-.-x.:....i.|.-1|..l»I.
`3:3u=_uu1.S30
`
`..uouzzn
`
`..-...¢.%33
`
`3.3%
`
`
`
`239.5EuE3=vv
`
`ran.mH23221.!
`
`HnRU:_»»=.
`
`
`
`
`
`._...aucmcboa::33:25a._8m
`
`
`
`vane5u_3..%_._o€€52
`
`«Euum:53:33.EB
`
`2a_...__..ofi3=w€S3.3.mcan
`
`
`
`coaiontn.»8c._3o¢
`
`
`
`.?wSc._Emixumomc_:_m:.292$zmmm
`
`
`
`
`
`14 0f45
`
`14 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 14 of 26
`
`US 2008/0076637 A1
`
`1408
`
`1426
`
`1414
`
`1416
`
`1412
`
`FIG.14
`
`141o"
`
`1400
`
`1406
`
`1404
`
`1402
`
`14;4
`
`15 0f45
`
`15 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 15 of 26
`
`US 2008/0076637 A1
`
`L52
`
`16 0f45
`
`16 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 16 of 26
`
`US 2008/0076637 A1
`
`moofi
`
`moofi
`
`oov_
`
`170f45
`
`17 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 17 of 26
`
`US 2008/0076637 A1
`
`3.2u...m_m.2..
`
`mpaquam53
`
`mco_U:.:.m:_ZSo
`
`
`
`
`
`.._...wU:m.._Eva:__mn.mnuco—afim
`
`useroam..=u_2:wu_=o;mmucus
`
`ovaanm3on=m38.
`
`
`
`.&uu_:o:mOw.=mn_._mnmwfim
`
`~asm
`
`3:
`
`0:;
`
`E:
`
`8»_
`
`Now~
`
`021
`
`18 0f45
`
`18 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 18 of 26
`
`US 2008/0076637 A1
`
`mom:
`
`.I...m.._,_
`
`mp£5.m5%=.6m:3m%u_m
`
`3.2u._m_2s
`
`8.;
`
`19 0f45
`
`19 of 45
`
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 19 of 26
`
`US 2008/0076637 A1
`
`FIG.19
`
`\
`
`O
`3
`—«
`
`\©
`
`3
`F.
`
`\ v\
`
`\
`N
`8
`r—l
`
`G
`o
`3
`
`20 of 45
`
`20 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 20 of 26
`
`US 2008/0076637 A1
`
`FIG.20
`
`NOO0
`
`1
`
`210f45
`
`21 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 21 of 26
`
`US 2008/0076637 A1
`
`X:
`
`._Q:-...F_m>>5.2m
`
`29.3mmm._OBox.w>O«camxummCmmmi
`zucwmumwzuCwmsum$3
`
`.5Locum385Otaumn_wu_m..
`
`82.m9.4.2:X.
`
`_N.03
`
`
`
`/...il.t.n.ii.......
`
`«SN
`
`22 of 45
`
`22 of 45
`
`
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 22 of 26
`
`US 2008/0076637 A1
`
`23 of 45
`
`23 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 23 of 26
`
`US 2008/0076637 A1
`
`2...E2xmur:$22boom30>
`
`
`
`,$95.250:
`
`
`
`6o.__~o.a<
`
`
`
`
`
`xwvc_n...m_2xuom
`
`88
`
`<8CE
`
`.mxm.m.s.9E35.:awv=.m>>“_mou9.2.“
`
`..vc_..o.n.n..__.E..¢ma=ohc.,_.u>.,onso..~_o:<.
`
`SN
`
`
`
`
`
`EPv_..:...z.c...,&_o!....u..2u3.N3.
`
`
`
`.%mm..fi..o...m..m._fi.
`
`32.m:633.ONa
`
`
`
`akaav.33.:aZn‘?:9».
`
`
`
`uvcsonR..2:m_mm»ucm£9»;
`
`
`
`50».6.~95E92:>55:ac.»
`
`..
`
`88
`
`8.8
`
`33mE002925
`
`”oo._~u:<
`
`8%.mr.....U0.32..fl“E5ao_.Em_£s
`
`.=ou..mm..__o_uEu_..c>ua_-_"co.5U34.
`
`$89.4.4;:o.-..§u§@
`
`
`$.38:So»5mu;39.5:2.5:»23;>2WA
`
`._u8..n.i_-38...2....xaD
`
`
`
`59.1395...;E5»
`
`24 of 45
`
`24 of 45
`
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 24 of 26
`
`US 2008/0076637 A1
`
`9.;N..;Em:3.
`
`.80
`
`aomm\
`
`..§_.s§3.2.3m9m5°,»N3,958..8._.m£2
`
`
`muss?N.S.m~£D.u&.wmv:m.>>.._moJ®Eu:m>>/
`
`
`
`NoAN
`
`25 of 45
`
`25 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 25 of 26
`
`US 2008/0076637 A1
`
`
`
`'\rrFD
`Pmvxée QC‘:hi/rlflj
`Q40; A 10 mulfiple elechamlc
`
`
`devices '
`
`
`
`
`
`
`
`
`
`Send ovxc or move
`‘5)’VlCV1\fOn'I‘té‘ri'icv\ éfinai
`2404 ’ ‘ in one or more
`e‘ec~mn«c d€v\Cr
`
`
`
`
`
`
`
`
`
`
`Pvuvide audio and/of‘
`
`v‘uSua\ cues on me
`2405, /‘or more e\cch<>V\‘C—
`device
`
`
`
`Coiled’ data dwfmfl
`'Per$orW1a'V\£‘e 0?
`Scfiv \
`
`
`
`2408
`
`2410
`
`£36.24
`
`26 of 45
`
`
`
`
`
`Pmwde one or vnoéa
`
`
`e\ec'hro~MC CLb\nu_ WM“
`
`opmsfimai
`'CoY\‘h'\9.l
`0‘ one or more oF
`“We other elccrvmmc
`clavwces
`
`
`
`26 of 45
`
`

`
`Patent Application Publication Mar. 27, 2008 Sheet 26 of 26
`
`US 2008/0076637 A1
`
`
`
` PfDV§c\e glaifirm 9or
`
`Co‘nd.uQhv1fi
`ivflorvmvxl
`
`n;,L{-r'.{7',gy\
`
`SL136; gt nurtfvhnn
`amvuhes, re-(3:-.r£/168$,
`avxa/or
`. m - ms
`
`
`
`Or; am v\u;y;‘r.’cum
`saw. has
`
`
`
`
`
`F\5\.— 1'5
`
`Z620
`
`26%’
`
`27 of 45
`
`Div Sb‘: bate rewmq .
`baud on colleckcl,
`
`
`
`27 of 45
`
`

`
`US 2008/0076637 A1
`
`Mar. 27, 2008
`
`DYNAMICALLY ADAPTIVE SCHEDULING
`SYSTEM
`
`CROSS-REFERENCE TO RELATED
`APPLICATIONS
`
`[0001] This claims priority to U.S. Provisional Patent
`Application No. 60/846,414 to Gilley et al., filed on Sep. 21,
`2006 (referred to below as “the incorporated provisional
`patent application”), the entirety of which is incorporated
`herein by reference.
`[0002] This also is related to:
`to Gilley et
`[0003] U.S. patent application Ser. No.
`al., filed on Mar. 27, 2007, entitled “LIFESTYLE COM-
`PANION SYSTEM,” Attorney Docket No. 104677-0019-
`101/P4725US1 (referred to herein as “the incorporated
`LIFESTYLE COMPANION document”),
`the entirety of
`which is incorporated herein by reference;
`to Gilley et
`[0004] U.S. patent application Ser. No.
`al.,
`filed on Mar. 27, 2007, entitled “SYSTEMS AND
`METHODS FOR PROVIDING AUDIO AND VISUAL
`CUES VIA A PORTABLE ELECTRONIC DEVICE,”
`Attorney Docket No. 104677-0019-102/P4725US2 (referred
`to herein as “the incorporated AUDIO AND VISUAL CUES
`document”), the entirety of which is incorporated herein by
`reference;
`to Gilley et
`[0005] U.S. patent application Ser. No.
`al.,
`filed on Mar. 27, 2007, entitled “SYSTEMS AND
`METHODS FOR FACILITATING GROUP ACTIVITIES,”
`Attorney Docket No. 104677-0019-104/P4725US4 (referred
`to herein as “the incorporated GROUP ACTIVITIES docu-
`ment”),
`the entirety of which is incorporated herein by
`reference;
`to Gilley et
`[0006] U.S. patent application Ser. No.
`al.,
`filed on Mar. 27, 2007, entitled “VARIABLE I/O
`INTERFACE FOR PORTABLE MEDIA DEVICE,” Attor-
`ney Docket No. 104677-0025-101/P4732US1 (referred to
`herein as “the incorporated VARIABLE I/O document”), the
`entirety of which is incorporated herein by reference;
`[0007] U.S. patent application Ser. No.
`to Gilley et
`al.,
`filed on Mar. 27, 2007, entitled “REWARDS SYS-
`TEMS,” Attorney Docket No. 104677-0022-101/P4727US1
`(referred to herein as “the incorporated REWARDS SYS-
`TEMS document”), the entirety of which is incorporated
`herein by reference; and
`to Doro-
`[0008] U.S. patent application Ser. No.
`gusker et al.,
`filed on Mar. 27, 2007, entitled “INTE-
`GRATED SENSORS FOR TRACKING PERFORMANCE
`
`104677-0035-101/
`METRICS,” Attorney Docket No.
`P4768US1 (referred to herein as “the incorporated INTE-
`GRATED SENSORS document”), the entirety of which is
`incorporated herein by reference.
`
`BACKGROUND OF THE INVENTION
`
`invention can generally relate to a
`[0009] The present
`lifestyle companion system. More particularly, the present
`invention can relate to a system that coordinates multiple
`corridors of experiences in a person’s life.
`[0010] Conventional systems typically focus only on one
`aspect of a person’s experiences. Conventional systems
`typically do not intelligently integrate multiple aspects of a
`person’s experiences. For example, a typical piece of soft-
`ware may be implemented to measure a user’s heart rate
`during an exercise routine. But,
`that software typically
`
`28 of 45
`
`carmot coordinate the heart rate information to the user’s
`
`general fitness goals, nor intelligently use that information to
`assist the user in reaching his goals.
`[0011] Accordingly,
`it would be desirable to provide a
`system that can bridge numerous corridors of experiences in
`a person’s life and coordinate them for maximum efficiency
`and enjoyment.
`
`SUMMARY OF THE INVENTION
`
`In accordance with one embodiment of the present
`[0012]
`invention, a lifestyle companion system can be provided for
`coordinating multiple corridors of a user’s life. The lifestyle
`companion system can include devices and methods for
`providing a platform for conducting user interviews, sug-
`gesting activities and references based on interview
`responses, providing a platform for a user to schedule
`activities, collecting data about a user during performance of
`activities or throughout the user’s day, and/or providing
`progress reports. The method also can include assigning user
`category levels (e.g., activity levels) based on interview
`responses. In some embodiments of the present invention,
`the lifestyle companion system can coordinate a user’s
`fitness, nutrition, and medical experiences.
`[0013] The lifestyle companion system can integrate user-
`selectable plug-in modules that are focused on specialized
`topics. For example, plug-in modules can be specialized for
`particular periods in a child’s development, students, expect-
`ant parents, new parents, seniors, specific sports enthusiasts,
`food connoisseurs, geographical regions, health conditions,
`holidays, etc. Each module can have coordinating question-
`naires, suggested activities, suggested references, instruc-
`tions, logging tools, audiobooks, videos, podcasts and other
`types of activities or information tailored for the specialty of
`the module.
`
`In one embodiment of the present invention, user
`[0014]
`data can be collected using a tracking device that stores the
`data itself or transmits the data to a local server, a central
`server, a server dedicated to storage of user profile infor-
`mation, or any combination thereof. Tracking devices can
`include passive tracking devices that require the user and/or
`another authorized entity to manually enter user data, active
`tracking devices having sensors that automatically gather
`data about the user and/or activities performed by the user,
`or any combination thereof. In one embodiment of the
`present invention, sensors of the active tracking devices can
`be attached to the user (e.g., in clothing or accessories) or
`disposed in equipment used by the user.
`[0015]
`In one embodiment of the present invention, the
`tracking device also can provide a user interface for the user
`to, e.g., access the user’s profile. Information stored in the
`user’s profile can include medical information, the user’s
`goals and progress towards the goals, reference information,
`activity information, the user’s responses to the user inter-
`view, and any other information related to the user’s inter-
`action with the lifestyle companion system. Activity infor-
`mation can include, for example, media files and adjustable
`parameters associated with an activity.
`[0016]
`In one embodiment of the present invention, media
`(e.g., audio and/or visual) cues can be provided to the user
`during the user’s performance of activities. Audio and visual
`cues can include, for example, instructions for the activity,
`feedback on a user’s progress, motivational feedback, and/or
`entertainment information. The media cues can be played at
`predetermined points during an activity, based on perfor-
`
`28 of 45
`
`

`
`US 2008/0076637 A1
`
`Mar. 27, 2008
`
`mance metrics, or at the initiation of the user. Visual cues can
`include graphical information (e.g., text, still images, and/or
`videos).
`In one embodiment of the present invention, a
`[0017]
`user’s short-term and/or long-term goals and activities can
`be dynamically adapted in response to data collected about
`the user. The data can include that collected during a user’s
`performance of an activity (e.g., performance metrics),
`and/or collected about the user throughout the user’s day.
`[0018]
`In one embodiment of the present invention, the
`lifestyle companion system can be used to coordinate group
`activities. Each person in the group can be provided with a
`tracking device to facilitate their performance of predeter-
`mined group activities. A common activity file or comple-
`mentary activity files can be loaded onto each of the tracking
`devices and, in one embodiment of the present invention,
`synchronized by a synchronization signal. Audio and visual
`cues can be provided to the users in response to each user’s
`own performance metrics or the performance metrics of
`other group members. Data can be collected about each
`user’s performance, individually and as a group. Responsive
`to such data, the lifestyle companions system can adjust
`current or future activities of each user and/or the group.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`[0019] The above and other advantages of the present
`invention will be apparent upon consideration of the fol-
`lowing detailed description,
`taken in conjunction with
`accompanying drawings, in which like reference characters
`refer to like parts throughout, and in which:
`[0020]
`FIG. 1 illustrates a flowchart for implementing a
`lifestyle companion system in accordance with one embodi-
`ment of the present invention;
`[0021]
`FIG. 2 illustrates hardware for the lifestyle com-
`panion system in accordance with one embodiment of the
`present invention;
`[0022]
`FIG. 3 shows an illustrative graphic user interface
`of a fitness welcome screen in accordance with one embodi-
`
`ment of the present invention;
`[0023]
`FIG. 4 shows an illustrative graphic user interface
`of a current fitness level screen in accordance with one
`
`embodiment of the present invention;
`[0024]
`FIG. 5 shows an illustrative graphic user interface
`of a fitness interest screen in accordance with one embodi-
`
`ment of the present invention;
`[0025]
`FIG. 6 shows an illustrative graphic user interface
`of a fitness goals screen in accordance with one embodiment
`of the present invention;
`[0026]
`FIG. 7 shows an illustrative graphic user interface
`of a fitness schedule screen in accordance with one embodi-
`
`ment of the present invention;
`[0027]
`FIG. 8 shows an illustrative graphic user interface
`of a fitness summary screen in accordance with one embodi-
`ment of the present invention;
`[0028]
`FIG. 9 shows an illustrative graphic user interface
`of a health history screen in accordance with one embodi-
`ment of the present invention;
`[0029]
`FIG. 10 shows an illustrative graphic user interface
`of a workout review screen in accordance with one embodi-
`
`ment of the present invention;
`[0030]
`FIG. 11 shows an illustrative graphic user interface
`of an alternative workout review screen with a repetition
`feature in accordance with one embodiment of the present
`invention;
`
`29 of 45
`
`FIG. 12 shows an illustrative graphic user interface
`[0031]
`of a user workout composition screen in accordance with
`one embodiment of the present invention;
`[0032]
`FIG. 13 shows an illustrative graphic user interface
`of a user workout composition screen having a media
`playlist menu in accordance with one embodiment of the
`present invention;
`[0033]
`FIGS. 14-21 show illustrative graphic user inter-
`faces during playback of a workout compilation on a por-
`table electronic device in accordance with one embodiment
`
`of the present invention;
`[0034]
`FIG. 22 shows an illustrative fitness system for
`facilitating collection of data about a user’s fitness perfor-
`mance and adaptation of a fitness activity based on the
`collected data in accordance with one embodiment of the
`
`present invention;
`[0035]
`FIG. 23A shows an illustrative progress report in
`accordance with one embodiment of the present invention;
`[0036]
`FIG. 23B shows a portion of the illustrative
`progress report of FIG. 23A after it is adapted based on the
`user’s performance metrics in accordance with one embodi-
`ment of the present invention;
`[0037]
`FIG. 24 shows an illustrative flow chart for facili-
`tating synchronous group activities in accordance with one
`embodiment of the present invention; and
`[0038]
`FIG. 25 shows an illustrative flow chart for imple-
`menting a nutrition program with the lifestyle companion
`system in accordance with one embodiment of the present
`invention.
`
`DETAILED DESCRIPTION OF THE
`INVENTION
`
`[0039] The present invention can include a lifestyle com-
`panion system for coordinating multiple corridors of a user’s
`life. The lifestyle companion system can intelligently rec-
`ommend lifestyle choices and activities based on informa-
`tion and data collected about
`the user. As described in
`
`greater detail below with respect to FIG. 1, the lifestyle
`companion system can provide a platform for conducting
`user interviews, suggest activities and references based on
`interview responses, provide a platform for a user to sched-
`ule activities, collect data about a user during performance
`of activities or throughout the user’s day, and/or provide
`progress reports. The system also can assign user category
`levels (e.g., activity levels) based on interview responses.
`Responsive to the data collected about the user, the lifestyle
`companion system can adjust or adapt a user’s goals or
`activities.
`
`FIG. 1 illustrates a flowchart for implementing a
`[0040]
`lifestyle companion system in accordance with one embodi-
`ment of the present invention. In step 100,
`the lifestyle
`companion system can provide a platform for conducting
`user interviews.
`
`In one embodiment of the present invention, the
`[0041]
`lifestyle companion system can request that the user input
`information about the user’s physical and mental health.
`Physical health information can include information about
`the medications the user is taking,
`the user’s physical
`limitations, illnesses, medical conditions (e.g., pregnancy),
`and/or risk factors. A health interview also can address
`
`nutrition, weight, breathing metrics (e.g., breaths per minute
`or some other related metric), relaxation and/or sleep. Inter-
`view questions about nutrition and weight can address
`weight goals and the user’s current nutritional habits. Inter-
`
`29 of 45
`
`

`
`US 2008/0076637 A1
`
`Mar. 27, 2008
`
`View questions about illnesses and medical conditions can
`address, e.g., sexually transmitted diseases, allergies and
`sinus problems, asthma, arthritis, conditions related to the
`brain and nervous system, cancer, cerebral palsy, chronic
`diseases, chronic pain, diabetes, fatigue, fibromyalgia, head-
`aches and migraines, heart disease and cardiovascular
`issues, infections, joints and muscle problems, liver condi-
`tions, multiple sclerosis, Parkinson’s disease, respiratory
`conditions, surgery recovery, or any other medical condition.
`[0042]
`Interview topics also can be gender or age specific.
`A women’s health interview can address,
`for example,
`menopause, pregnancy, fertility, etc. A men’s health inter-
`view can address, e.g., fertility, impotence, prostate con-
`cerns, etc. A children’s health interview can be divided into
`sub-categories, e.g., issues related to infants and toddlers,
`children, and teenagers.
`for
`[0043] A mental health interview can address,
`example, anxiety, caregiving and coping, depression, and/or
`drug & alcohol addiction.
`[0044] The lifestyle companion system also can interview
`the user about non-health related topics, e.g., spirituality/
`religion, identity (e.g., sense of belonging), relationships,
`career, financial condition, environment, hobbies, interests,
`other personal information, and goals regarding the same.
`An identity (sense of belonging) interview may address, for
`example,
`the organizations to which the user belongs
`socially and/or professionally. A relationships interview can
`address, for example, the marital and/or familial status of the
`user. The relationship interview also can address the quality
`of the user’s relationships with his/her family. A career
`interview can address, for example, the length of time the
`user has worked in the present job,
`the user’s current
`occupational position, and/or the user’s level of enjoyment
`of the user’s occupation. A finance interview can address, for
`example, net wealth, credit situation, spending habits, etc.
`An environment interview can address, for example, the
`user’s home, office, clothing, transportation, fitness mem-
`berships, access to exercise equipment, etc.
`[0045] Once the user completes the user interview pro-
`vided in step 100,
`the lifestyle companion system can
`establish a user profile for the user based on the user’s
`interview responses. As the user’s lifestyle changes (e.g., the
`user’s goals change or the user’s familial status changes),
`this profile can be updated by the user at a later date by
`changing responses to the interview questions. In response
`to updates to the user profile, the lifestyle companion system
`can alter the activities, references, and plug-in modules
`suggested (e.g., as described below with respect to step 104)
`and/or adapt the user’s goals or scheduled activities (e.g., as
`described below with respect to step 112).
`[0046] The user profile also can store user-associated
`information generated by the lifestyle companion system in
`later steps. For example, the user profile can store informa-
`tion related to categories to which the user is assigned in step
`102, activities and references suggested by the lifestyle
`companion system in step 104, activities created by the user
`in step 105, data collected about the user in step 110, and/or
`rewards distributed to the user in step 111. The user profile
`can store information about activities in activity files. In one
`embodiment, an activity file can include, for example,
`adjustable parameters associated with an activity, media files
`associated with the activity for providing media cues to the
`user, and any other information related to the activity.
`
`30 of45
`
`In step 101, the lifestyle companion system can
`[0047]
`supplement the user’s profile with data from profiles of
`user-authorized entities (e.g., relatives, doctor,
`therapist,
`fitness trainer, etc.). For example, the user profile can be
`supplemented with data from the profiles of family members
`so that the lifestyle companion system can suggest medical
`activities (e.g., exams) and references in step 104 based on
`a more accurate profile of potential genetic health risks. The
`user’s profile also can be supplemented with data from the
`profiles of workout partners so that the lifestyle companion
`system can suggest, for example, fitness activities that are
`appropriate for the user and his workout partners. The user’ s
`profile also can be supplemented with the profiles of dining
`partners so that the lifestyle companion system can suggest,
`for example, nutritional activities (e.g., recipes, restaurants,
`etc.) that are appropriate for the user and his dining partners.
`Illustrative nutrition-based applications of the present inven-
`tion are described in greater detail with respect to FIG. 25.
`[0048] As used herein, an entity is authorized by the user
`when the user has granted the entity permission to obtain
`information from the user’s profile or transfer information
`into the user’s profile. For example, user-authorized entities
`can include a family member, employer, physical therapist,
`psychologist, doctor, physical trainer, coach, etc.
`[0049]
`In step 102, the lifestyle companion system can
`assign or associate certain categories to the user profile
`based on the user’s responses to the interview. For example,
`based on the user’s responses to fitness questions,
`the
`lifestyle companion system can assign an activity level to
`the user’s profile, e.g., beginner, intermediate, or advanced.
`Based on the assigned activity level, the lifestyle companion
`system can later suggest fitness activities in step 104 that are
`more suited to the fitness category assigned to the user
`profile, and, thus, more suited to the capabilities of the user.
`[0050]
`In step 104, the lifestyle companion system can
`suggest activities for the user based on the user’s responses
`to the user interview, either directly or indirectly (e.g., based
`on the category le