US 2008O137873A1
`(19) United States
`(12) Patent Application Publication (10) Pub. No.: US 2008/0137873 A1
`Goldstein (43) Pub. Date: Jun. 12, 2008
`(54) METHOD AND DEVICE FOR Publication Classification
`PERSONALIZED HEARNG (51) Int. Cl.
`(75) Inventor: Steven W. Goldstein, Delray HO3G 3/20 (2006.01)
`Beach, FL (US) (52) U.S. Cl. .......................................................... 381/57
`(57) ABSTRACT Correspondence Address:
`GREENBERG TRAURIG, LLP An earpiece is provided that can include an Ambient Sound
`1750 TYSONS BOULEVARD, 12TH FLOOR Microphone (ASM) to measure ambient sound, an Ear Canal
`MCLEAN, VA 22102 Receiver (ECR) to deliver audio to an ear canal, an Ear Canal Microphone (ECM) to measure a sound pressure level within
`(73) Assignee: PERSONICS HOLDINGS INC., the ear canal, and a processor to produce the audio from at
`Boca Raton, FL (US) least in part the ambient Sound, actively monitor a Sound exposure level inside the ear canal, and adjust a level of the
`(21) Appl. No.: 11/942,370 audio to within a safe and Subjectively optimized listening level range based on the Sound exposure level. An audio
`(22) Filed: Nov. 19, 2007 interface can deliver audio content from a media player. The processor can selectively mix the audio content with the
`ambient Sound to produce the audio in accordance with a Related U.S. Application Data personalized hearing level (PHL) to permit environmental
`(60) Provisional application No. 60/866.420, filed on Nov. awareness of at least one distinct sound in the ambient sound.
`18, 2006. Other embodiments are disclosed.
`16O
`\) DAC 203 130
`11 O
`Audio
`Interface 212
`Power Supply 210 Audio Content (e.g.,
`music, cellphone, 100
`voice mail)
`
`Exhibit 1010
`Page 01 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 1 of 6 US 2008/O137873 A1
`160
`\) DAC 203 130
`E 110
`22 O
`E O NOHADC
`Audio
`Interface 212
`Power Supply 21 O Audio Content (e.g.,
`music, cellphone, 100
`Voice mail)
`FIG.2
`
`Exhibit 1010
`Page 02 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 2 of 6 US 2008/O137873 A1
`LISTENING TEST TO ESTABLISH
`PERSONALIZED HEARNG LEVEL
`Earpiece 100 inserted in user's Processor generates a frequency
`ea 302 varying and loudness varying test
`signal (e.g. Earcon) 304
`Ear Canal Microphone (ECM)
`Captures a SOund pressure level
`in the ear canal (e.g., due to the Ear Canal Receiver (ECR) test signal and pass-through audibly delivers the test signal to
`ambient sound) O8 the uSer's ear Canal 306
`Processor generates an Ear Canal E. i. an ear Transfer Function (ECTF) based Sealing level of the earpiece
`on the test signal and sound based On the ECTF 312
`pressure level 310
`PrOCeSSOr receives user
`Processor generates a feedback indicating an personalized hearing level (PHL) audibility and preference for
`based on the user feedback, at least a portion of the test
`Sound pressure level, and ear signal and based on the
`Sealing ambient Sound 314
`Processor stores personalized Ambi Mi h hearing level (PHL) to memory mbient Sound Microphone (ASM) captures ambient sound
`in the environment 315
`Processor spectrally equalizes
`incoming audio based on the PHL
`320
`FIG. 3
`
`Exhibit 1010
`Page 03 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 3 of 6 US 2008/O137873 A1
`Ear Canal Transfer Personalized Hearing
`Function (ECTF) Level (PHL)
`PHL to 521 t 522 te 523
`c5
`... ar" FIG. 5 500
`
`Exhibit 1010
`Page 04 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 4 of 6 US 2008/O137873 A1
`Ambient Sound Microphone (ASM) captures ambient sound in Processor measures and
`the environment 6O2 monitors noise levels in the
`ambient sound
`Audio Interface delivers audio
`COntent to PrOCeSSOr 608 Processor selectively filters out
`noise from the ambient Sound
`ECR deliverS filtered audio to the 606
`user's ear Canal 610
`Processor Calculates an
`accumulated Sound Pressure
`Ear Canal Microphone (ECM) Level (SPL) Dose from the SPL Captures Sound pressure level 61
`(SPL) in the ear canal 612 o
`SPL DOSe
`threshold?
`630
`SPL & effective
`duiet?
`616
`Processor adjusts a level of the Processor decreases SPL
`(PHL) 632
`Processor monitors changes in
`Processor generates a visual or an Ear Canal Transfer Function
`audible notification of the SPL
`Dose 634 - - - - - - - - - - - - - - - - -
`- - - - - - - - - - - - - - - - - Processor determines an ear
`Processor Stroes SPL DOSe to I sealing profile from the ECTF 622
`memory as an SPL Exposure - - - - - - - - - - - - I
`History Processor updates the SPLDose
`based on the ear sealing profile
`624
`
`
`
`
`
`Exhibit 1010
`Page 05 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 5 of 6 US 2008/O137873 A1
`Managing Audio Delivery
`Audio Interface receives audio
`content from a media player 702
`Processor selectively mixes the
`Processor spectrally enhances audio Content with the ambient
`the audio content in view of the sound to permit audible
`ambient Sound 708 environmental awareness
`ECR delivers the audio Content
`to the user's ear Canal 704
`Processor maintains a Constant
`difference Or ratio audio Content
`level to ambient Sound level
`Ambient
`Sound increase.
`710
`Processor monitors sound
`Signature signatures in the environment
`Detected? from the ambient Sound received
`716 from ASM 714
`Processor selectively attenuates Processor presents an audible
`at least a portion of the audio notification to the user via the
`COntent 18 ECR
`Processor sends a message to a
`device operated by the user to
`visually display the notification
`722 FIG. 7
`
`
`
`
`
`
`Exhibit 1010
`Page 06 of 15
`
`
`
`
`
`
`
`Patent Application Publication Jun. 12, 2008 Sheet 6 of 6 US 2008/O137873 A1
`Processor
`C PHL Filtering
`Environmental
`SOUnds
`Audio Content
`Mixer
`Audio
`Interface
`156
`155 - FIG. 9
`t Incoming call
`Portable from a Mobile Media Device Device (e.g.,
`(e.g., music) voice)
`
`Exhibit 1010
`Page 07 of 15
`
`
`
`
`
`
`
`US 2008/O 137873 A1
`METHOD AND DEVICE FOR
`PERSONALIZED HEARNG
`CROSS REFERENCE TO RELATED
`APPLICATIONS
`0001. This application is a Non-Provisional and claims the priority benefit of Provisional Application No. 60/866,420
`filed on Nov. 18, 2006, the entire disclosure of which is
`incorporated herein by reference.
`FIELD
`0002 The present invention relates to a device that moni tors and adjusts acoustic energy directed to an ear, and more particularly, though not exclusively, to an earpiece and
`method of operating an earpiece that monitors and safely
`adjusts audio delivered to a user's ear.
`BACKGROUND
`0003. On a daily basis, people are exposed to potentially
`harmful noises in their environment, such as the Sounds from
`television, traffic, construction, radio, and industrial appli ances. Normally, people hear these sounds at safe levels that do not affect their hearing. However, when people are
`exposed to harmful noises that are too loud or of prolonged
`duration, hair cells in the inner ear can be damaged, causing
`noise-induced hearing loss (NIHL). The hair cells are small sensory cells in the inner ear that convert Sound energy into
`electrical signals that travel to the auditory processing centers
`of the brain. Once damaged, the hair cells cannot grow back.
`NIHL can be caused by a one-time exposure to an intense
`impulse or burst Sound, Such as an alarm, or by continuous exposure to loud sounds over an extended period of time. 0004. In the mobile electronic age, people are frequently exposed to noise pollution from cell phones (e.g., incoming
`phone call sounds), portable media players (e.g., message
`alert Sounds), and laptops (e.g., audible reminder prompts). Moreover, headphones and earpieces are directly coupled to
`the person's ear and can thus inject potentially harmful audio at unexpected times and with unexpected levels. Further
`more, with headphones, a user is immersed in the audio experience and generally less likely to hearing important
`Sounds within their environment. In some cases, the user may eventurn up the volume to hear the audio over the background noises. This can put the user in a compromising situation
`since they may not be aware of warning cues in their envi ronment as well as putting them at high sound exposure risk.
`0005. Although some headphones have electronic cir
`cuitry and software to limit the level of audio delivered to the ear, they are not generally well received by the public as a
`result. Moreover, they do not take into account the person's environment or the person's hearing sensitivity. A need there
`fore exists for enhancing the user's audible experience while preserving their hearing acuity in their own environment.
`SUMMARY
`0006 Embodiments in accordance with the present pro vide a method and device for personalized hearing.
`0007. In one embodiment, an earpiece, can include an Ambient Sound Microphone (ASM) to capture ambient
`sound, an Ear Canal Receiver (ECR) to deliver audio to an ear canal, an ear canal microphone (ECM) to measure a sound pressure level within the ear canal, and a processor to produce
`the audio from at least in part the ambient sound. The proces
`Jun. 12, 2008
`Sor can actively monitor a sound exposure level inside the ear canal, and adjust the audio to within a safe and Subjectively optimized listening Sound pressure level range based on the
`Sound exposure level. The earpiece can include an audio
`interface to receive audio content from a media player and deliver the audio content to the processor. The processor can
`selectively mix the audio content with the ambient sound to produce the audio in accordance with a personalized hearing
`level (PHL). The processor can also selectively filter the audio
`to permit environmental awareness of warning sounds, and compensate for an ear seal leakage of the device with the ear
`canal.
`0008. In another embodiment, a method for personalized hearing measurement can include generating a frequency
`varying and loudness varying test signal, delivering the test
`signal to an ear canal, measuring a Sound Pressure Level
`(SPL) in the ear canal, generating an Ear Canal Transfer
`Function (ECTF) based on the test signal and sound pressure level, determining an ear sealing level of the earpiece based
`on the ECTF, receiving user feedback indicating an audibility
`and preference for at least a portion of the test signal, and
`generating a personalized hearing level (PHL) based on the
`user feedback, Sound pressure level, and ear sealing. Further,
`the method can include measuring an otoacoustic emission (OAE) level in response to the test signal, comparing the OAE
`level to historical OAE levels, and adjusting a level of incom
`ing audio based on the OAE level, or presenting a notification
`of the OAE level.
`0009. In another embodiment, a method for personalized listening can include measuring an ambient Sound, selec tively filtering noise from the ambient sound to produce fil
`tered Sound, delivering the filtered sound to an ear canal, determining a Sound Pressure Level (SPL) Dose based on a Sound exposure level within the ear canal, and adjusting the
`filtered sound to be within a safe and subjectively optimized
`listening level range based on the SPL. Dose and in accor
`dance with a Personalized Hearing Level (PHL). The SPL
`Dose can include contributions of the filtered sound delivered
`to the ear and an ambient residual Sound within the ear canal.
`The method can include spectrally enhancing the audio con
`tent in view of a spectrum of the ambient Sound and in accor
`dance with the PHL.
`BRIEF DESCRIPTION OF THE DRAWINGS
`0010 FIG. 1 is a pictorial diagram of an earpiece in accor
`dance with an exemplary embodiment;
`0011 FIG. 2 is a block diagram of the earpiece in accor
`dance with an exemplary embodiment;
`0012 FIG. 3 is a flowchart of a method for conducting a listening test to establish a personalized hearing level (PHL)
`in accordance with an exemplary embodiment;
`0013 FIG. 4 illustrates an exemplary ear canal transfer
`function and an exemplary PHL in accordance with an exem plary embodiment;
`0014 FIG. 5 illustrates a plot of an exemplary Sound
`Pressure Level (SPL) Dose and corresponding PHL plots in
`accordance with an exemplary embodiment;
`0015 FIG. 6 is a flowchart of a method for audio adjust ment using SPL. Dose in accordance with an exemplary
`embodiment;
`0016 FIG. 7 is a flowchart for managing audio delivery in
`accordance with an exemplary embodiment;
`Exhibit 1010
`Page 08 of 15
`
`
`
`
`
`
`
`US 2008/O 137873 A1
`0017 FIG. 8 is a pictorial diagram for mixing environ
`mental Sounds with audio content in accordance with an
`exemplary embodiment; and 0018 FIG. 9 is a pictorial diagram for mixing audio con
`tent from multiple sources in accordance with an exemplary
`embodiment.
`DETAILED DESCRIPTION
`0019. The following description of at least one exemplary
`embodiment is merely illustrative in nature and is in no way
`intended to limit the invention, its application, or uses. 0020 Processes, techniques, apparatus, and materials as
`known by one of ordinary skill in the relevant art may not be
`discussed in detail but are intended to be part of the enabling description where appropriate, for example the fabrication
`and use of transducers. Additionally in at least one exemplary
`embodiment the sampling rate of the transducers can be var ied to pick up pulses of Sound, for example less than 50
`milliseconds.
`0021. In all of the examples illustrated and discussed herein, any specific values, for example the Sound pressure
`level change, should be interpreted to be illustrative only and non-limiting. Thus, other examples of the exemplary embodi
`ments could have different values.
`0022. Note that similar reference numerals and letters
`refer to similar items in the following figures, and thus once
`an item is defined in one figure, it may not be discussed for following figures.
`0023 Note that herein when referring to correcting or preventing an error or damage (e.g., hearing damage), a
`reduction of the damage or error and/or a correction of the damage or error are intended.
`0024. At least one exemplary embodiment of the invention is directed to measuring and adjusting the exposure of Sound
`to the ear over time. Reference is made to FIG. 1 in which an
`earpiece device, generally indicated as 100, is constructed in
`accordance with at least one exemplary embodiment of the
`invention. Earpiece 100 includes an Ambient Sound Micro phone (ASM) 110 to capture ambient sound, an Ear Canal
`Receiver (ECR) 120 to deliver audio to an ear canal 140, and an ear canal microphone (ECM) 130 to assess a sound expo
`sure level within the ear canal. The earpiece 100 can also
`include an Ear Receiver (ER) 160 to generate audible sounds external to the ear canal 140. The earpiece 100 can partially or
`fully occlude the ear canal 140 to provide various degrees of
`acoustic isolation.
`0025. The earpiece 100 can actively monitor a sound pres
`Sure level both inside and outside an ear canal and enhance
`spatial and timbral Sound quality while maintaining Supervi
`sion to ensure safe reproduction levels. The earpiece 100 in
`various embodiments can conduct listening tests, filter
`Sounds in the environment, monitor warning Sounds in the environment, present notification based on identified warning
`Sounds, maintain constant audio content to ambient Sound
`levels, and filter sound in accordance with a Personalized
`Hearing Level (PHL). The earpiece 100 is suitable for use with users having healthy or abnormal auditory functioning.
`0026. The earpiece 100 can generate an Ear Canal Trans
`fer Function (ECTF) to model the ear canal 140 using ECR
`120 and ECM 130, as well as an Outer Ear Canal Transfer
`function (OETF) using ER 160 and ASM 110. The earpiece
`can also determine a sealing profile with the user's ear to compensate for any leakage. In one configuration, the ear
`piece 100 can provide personalized full-band width general
`Jun. 12, 2008
`audio reproduction within the user's ear canal via timbral equalization using a multiband level normalization to account
`for a user's hearing sensitivity. It also includes a Sound Pres
`Sure Level Dosimeter to estimate sound exposure and recov ery times. This permits the earpiece to safely administer and
`monitor Sound exposure to the ear.
`0027. Referring to FIG. 2, a block diagram of the earpiece
`100 in accordance with an exemplary embodiment is shown. As illustrated, the earpiece 100 can further include a proces
`sor 206 operatively coupled to the ASM 110, ECR 120, ECM
`130, and ER 160 via one or more Analog to Digital Converters
`(ADC) 202 and Digital to Analog Converters (DAC) 203. The processor 206 can produce audio from at least in part the
`ambient sound captured by the ASM 110, and actively moni
`tor the sound exposure level inside the ear canal 140. The processor responsive to monitoring the Sound exposure level
`can adjust the audio in the ear canal 140 to within a safe and Subjectively optimized listening level range. The processor
`206 can utilize computing technologies such as a micropro
`cessor, Application Specific Integrated Chip (ASIC), and/or
`digital signal processor (DSP) with associated Storage
`memory 208 such a Flash, ROM, RAM, SRAM, DRAM or other like technologies for controlling operations of the ear
`piece device 100.
`0028. The earpiece 100 can further include a transceiver 204 that can Support singly or in combination any number of
`wireless access technologies including without limitation
`BluetoothTM, Wireless Fidelity (WiFi), Worldwide Interoper
`ability for Microwave Access (WiMAX), and/or other short or long range communication protocols. The transceiver 204 can also provide Support for dynamic downloading over-the
`air to the earpiece 100. It should be noted also that next generation access technologies can also be applied to the
`present disclosure.
`0029. The earpiece 100 can also include an audio interface 212 operatively coupled to the processor 206 to receive audio
`content, for example from a media player, and deliver the audio content to the processor 206. The processor can Sup
`press noise within the ambient Sound and also mix the audio content with filtered ambient sound. The power supply 210 can utilize common power management technologies such as replaceable batteries, Supply regulation technologies, and charging system technologies for Supplying energy to the
`components of the earpiece 100 and to facilitate portable
`applications. The motor 207 can be a single Supply motor
`driver to improve sensory input via haptic vibration. As an
`example, the processor 206 can direct the motor 207 to
`vibrate responsive to an action, such as a detection of a warn ing Sound or an incoming Voice call.
`0030 The earpiece 100 can further represent a single
`operational device or a family of devices configured in a
`master-slave arrangement, for example, a mobile device and
`an earpiece. In the latter embodiment, the components of the
`earpiece 100 can be reused in different form factors for the
`master and slave devices.
`0031 FIG.3 is a flowchart of a method 300 for conducting a listening test in accordance with an exemplary embodiment. The method 300 is also directed to establishing a personalized
`hearing level (PHL) for an individual earpiece 100 based on results of the listening test, which can identify a minimum
`threshold of audibility and maximum loudness comfort met
`ric. The method 300 can be practiced with more or less than
`the number of steps shown and is not limited to the order
`shown. To describe the method 300, reference will be made to
`Exhibit 1010
`Page 09 of 15
`
`
`
`
`
`
`
`US 2008/O 137873 A1
`components of FIGS. 1, 2 and 4, although it is understood that
`the method 300 can be implemented in any other manner
`using other suitable components. The method 300 can be implemented in a single earpiece, a pair of earpieces, or headphones.
`0032. The method 300 for conducting a listening test can
`start at step 302 at which the earpiece 100 is inserted in user's
`ear. The listening test can be a self-administered listening test
`initiated by the user, or an automatic listening test intermit tently scheduled and performed by the earpiece 100. For example, upon inserting the earpiece 100, the user can initiate
`the listening test. Alternatively, the earpiece, as will be
`described ahead, can determine when the earpiece is inserted and then proceed to commence operation. In one arrange
`ment, the earpiece 100 can monitor ambient noise within the environment and inform the user whetheran proper listening
`test can be conducted in the environment. The earpiece 100, can also intermittently prompt the use to conduct a listening
`test, if the earpiece 100 determines that it has dislodged or that
`a seal with the ear canal has been compromised.
`0033. At step 304, the processor 206 can generate a fre
`quency varying and loudness varying test signal. The test
`signal can a swept sinusoid, chirp signal, band-limited noise signal, band-limited music signal, or any other signal varying in frequency and amplitude. As one example, the test signal
`can be a pleasant Sounding audio clip called an EarCon that
`can include a musical component. The EarCon can be audibly presented to the user once the earpiece 100 has been inserted.
`0034. At step 306, the Ear Canal Receiver (ECR) can audibly deliver the test signal to the user's ear canal. The earpiece 100 can generate the test signal with sufficient fidel ity to span the range of hearing; generally 20 Hz to 20 KHZ.
`The Ear Canal Microphone (ECM) responsive to the test
`signal at step 308 can capture a sound pressure level (SPL) in
`the ear canal due to the test signal and a pass-through ambient
`Sound called ambient residual noise. The pass through ambi
`ent sound can be present in the ear canal if the earpiece 100 is not properly inserted, or does not inherently provide suffi
`cient acoustic isolation from ambient noise in the environ
`ment. Accordingly, the SPL measured within the earcanal can
`include both the test signal and a contribution of the ambient
`residual noise.
`0035. The processor 206 can then at step 310 generate an
`Ear Canal Transfer Function (ECTF) based on the test signal and sound pressure level. The ECTF models the input and
`output characteristics of the ear canal 140 for a current physi cal earpiece insertion. The ECTF can change depending on
`how the earpiece 100 is coupled or sealed to the ear (e.g.,
`inserted). (Briefly, FIG. 4 shows an exemplary ECTF 410. which the processor 206 can display, for example, to a mobile
`device 100 paired with the earpiece 100.) In one arrangement,
`the processor 206 by way of the ECR 120 and ECM 130 can perform in-situ measurement of a user's ear anatomy to pro
`duce an Ear Canal Transfer Function (ECTF) when the device is in use. The processor 206 can chart changes in amplitude
`and phase for each frequency of the test signal during the listening test. The ECTF analysis also permits the processor
`to identify between insertion in the left and right ear. The left
`and the right ear in addition to having different structural
`features can also have different hearing sensitivities.
`0036. At step 312, the processor 206 can determine an ear
`sealing level of the earpiece based on the ECTF. For instance, the processor 206 can compare the ECTF to historical ECTFs captured from previous listening tests, or from previous inter
`Jun. 12, 2008
`mittent ear sealing tests. An ear sealing test can identify
`whether the amplitude and phase difference of the ECTF are particular to a specific ear canal. Notably, the amplitude will
`be generally higher if the earpiece 100 is sealed within the ear
`canal 140, since the Sound is contained within a small Volume
`area (e.g. ~5 cc) of the ear canal. The processor 206 can continuously monitoring the ear canal SPL using the ECM
`130 to detect a leaky earpiece seal as well as identify the leakage frequencies. The processor 206 can also monitor a
`sound leakage from the ECR 120 using the ASM 110 to detect sound components correlated with the audio radiated by the
`ECR into the ear canal 140.
`0037. In another embodiment, the processor 206 can mea sure the SPL upon delivery of the test signal to determine an
`otoacoustic emission (OAE) level, compare the OAE level to historical OAE levels, and adjust a level of incoming audio
`based on the OAE level. OAEs can be elicited in the vast
`majority of ears with normal hearing sensitivity, and are gen
`erally absent in ears with greater than a mild degree of
`cochlear hearing loss. Studies have shown that OAES change
`in response to insults to the cochlear mechanism from noise and from ototoxic medications, prior to changes in the pure tone audiogram. Accordingly, the processor can generate a
`notification to report that the user may have temporary hear ing impairment if the OAE levels significantly deviate from
`their historical levels.
`0038. The processor 206 can also measure an ambient
`Sound level outside the ear canal for selected frequencies,
`compare the ambient sound with the SPL for the selected
`frequencies of the ambient Sound, and determine that the earpiece is inserted if predetermined portions of the ECTF are
`below a threshold (this test can be conducted when the test signal is not audibly present). As previously noted, the SPL
`within the ear canal includes the test signal and an ambient residual noise incompletely sealed out and leaking into the ear canal. Upon completion of the ear sealing test, the pro
`cessor 206 can generate an audible message identifying the sealing profile and whether the earpiece is properly inserted,
`thereby allowing the user to re-insert or adjust the earpiece
`100. The processor 206 can continue to monitor changes in the ECTF throughout active operation to ensure the earpiece
`100 maintains seal with the ear canal 140.
`0039. Upon presenting the test signal to the earpiece 100,
`the processor 206 at step 314 can receive user feedback indi cating an audibility and preference for at least a portion of the
`test signal. It should also be noted, that the processor can take
`into account the ambient noise measurements captured by the ASM 110, as shown in step 315. In such regard, the processor
`206 can determine the user's PHL as a function of the back
`ground noise. For instance, the processor 206 can determine masking profiles for certain test signal frequencies in the
`presence of ambient noise.
`0040. The processor 206 can also present narrative infor
`mation informing the user about the status of the listening test
`and ask the user to provide feedback during listening test. For example, a synthetic Voice can state a current frequency (e.g.
`“1KHZ') of the test signal and ask the user if they can hear the tone. The processor 206 can request feedback for multiple frequencies across the hearing range along a /3 frequency
`band octave scale, critical band frequency scale, or any other hearing scale and chart the user's response. The processor 206
`can also change the order and timing of the presentation of the test tones to minimize effects of psychoacoustic amplitude and temporal masking. Briefly, the EarCon is a specific test
`Exhibit 1010
`Page 10 of 15
`
`
`
`
`
`
`
`US 2008/O 137873 A1
`signal psychoacoustically designed to maximize the separa
`tion of audio cues and minimize the effects of amplitude and temporal masking to assess a user's hearing profile.
`0041. During the listening test, a minimum audible thresh
`old curve, a most comfortable listening level curve, and an
`uncomfortable listening level curve can be determined from the user's feedback. A family of curves or a parameter set can
`thus be calculated to model the dynamic range of the persons hearing based on the listening test. Accordingly, at Step 316,
`the processor 206 can generate a personalized hearing level
`(PHL) based on the user feedback, sound pressure level, and ear sealing. (Briefly, FIG. 4 also shows an exemplary PHL
`420, which the processor 206 can display, for example, to a
`mobile device 100 paired with the earpiece 100.) The PHL
`420 is generated in accordance with a frequency and loudness level dependent user profile generated from the listening test
`and can be stored to memory 208 for later reference as shown in step 318. Upon completion of the listening test, the pro
`cessor 206 can spectrally enhance audio delivered to the ear
`canal in accordance with the PHL 420, as shown in step 320. It should also be noted that a default PHL can be assigned to a user if the listening test is not performed.
`0042 FIG. 6 is a flowchart of a method 600 for audio adjustment using SPL. Dose in accordance with an exemplary
`embodiment. The method 600 is also directed to filtering environmental noise, measuring an SPL. Dose for a filtered audio, and adjusting the filtering in accordance with the SPL
`Dose and the PHL. The method 600 can be practiced with
`more or less than the number of steps shown, and is not
`limited to the order of the steps shown. To describe the method 600, reference will be made to components of FIGS.
`1, 2 and 5, although it is understood that the method 600 can be implemented in any other manner using other Suitable components. The method 600 can be implemented in a single earpiece, a pair of earpieces, or headphones.
`0043. The method 600 can begin in a state wherein the earpiece 100 is inserted in the ear canal and activated. At step
`602, the ASM 110 captures ambient sound in the environ ment. Ambient Sound can correspond to environmental noise
`Such as wind noise, traffic, car noise, or other Sounds includ
`ing alarms and warning cues. Ambient Sound can also refer to
`background voice conversations or babble noise. At step 604,
`the processor 206 can measure and monitor noise levels in the ambient Sound. In one arrangement, the processor 206 can
`include a spectral level detector to measure background noise energy over time. In another arrangement, the processor 206
`can perform Voice activity detection to distinguish between voice and background noise. At step 606, the processor 206
`can selectively filter out the measured noise from the ambient Sound. For instance, the processor 206 can implement a spec
`tral Subtraction or spectral gain modification technique to
`minimize the noise energy in the ambient sound. At step 608, the Audio Interface 212 can optionally deliver audio content such as music or voice mail to the processor 206. The proces
`sor 206 can mix the audio content with the filtered sound to
`produce filtered audio. The ECR can then deliver at step 610
`the filtered audio to the user's ear canal. The earpiece 100 which inherently provides acoustic isolation and active noise
`Suppression can thus selectively determine which Sounds are
`presented to the ear canal 140.
`0044. At step 612, the ECM 130 captures sound exposure
`level in the ear canal 140 attributed at least in part to pass through ambient Sound (e.g. residual ambient Sound) and the
`filtered audio. Notably, excessive sound exposure levels in the
`Jun. 12, 2008
`ear canal 140 can cause temporary hearing loss and contribute to permanent hearing damage. Moreover, certain types of
`Sound exposure Such as those due to high energy impulses or
`prolonged wide band noise bursts can severely affect hearing and hearing acuity. Accordingly, at step 614, the processor
`206 can calculate a sound pressure level dose (SPL. Dose) to quantify the Sound exposure over time as it relates to Sound exposure and sensorineural hearing loss. The processor 206
`can track the sound exposure over time using the SPL. Dose to assess an acceptable level of Sound exposure.
`0045 Briefly, SPL. Dose is a measurement, which indi cates an individual's cumulative exposure to Sound pressure
`levels over time. It accounts for exposure to direct audio inputs Such as MP3 players, phones, radios and other acoustic
`electronic devices, as well as exposure to environmental or background noise, also referred to as ambient noise. The SPL Dose can be expressed as a percentage of a maximum time weighted average for sound pressure level exposure. SPL
`Dose can be cumulative persisting from day to day. During
`intense Environmental Noise (above an Effective Quiet level), the SPL. Dose will increase. During time periods of
`negligible environmental noise, the SPL. Dose will decrease according to an Ear Recovery Function.
`0046. The Ear Recovery Function describes a theoretical recovery from potentially hazardous Sound exposure when
`sound levels are below Effective Quiet. As an example, Effec
`tive Quiet can be defined as 74 dB SPL for the octave band
`centered at 4000