a2 United States Patent
`
`Denton
`
`US010656906B2
`
`US 10,656,906 B2
`May 19, 2020
`
`(10) Patent No.:
`45) Date of Patent:
`
`(54) MULTI-FREQUENCY SENSING METHOD
`AND APPARATUS USING MOBILE-BASED
`
`CLUSTERS
`(71) Applicant: Levaughn Denton, Baisley Park, NY
`Us)
`(72) Inventor: Levaughn Denton, Baisley Park, NY
`Us)
`(*) Notice: Subject to any disclaimer, the term of this
`patent is extended or adjusted under 35
`U.S.C. 154(b) by 0 days.
`(21) Appl. No.: 16/421,141
`(22) Filed: May 23, 2019
`(65) Prior Publication Data
`US 2020/0073623 Al Mar. 5, 2020
`Related U.S. Application Data
`(63) Continuation-in-part of application No. 16/155,919,
`filed on Oct. 10, 2018, now abandoned, and a
`(Continued)
`(51) Imt. Cl
`HO04R 3/00 (2006.01)
`HO4R 29/00 (2006.01)
`GO6F 3/16 (2006.01)
`H04B 1/00 (2006.01)
`H04S 7/00 (2006.01)
`(Continued)
`(52) US. CL
`CPC .......... GO6F 3/165 (2013.01); HO4B 1/0003
`(2013.01); HO4L 67/12 (2013.01); HO4R
`27/00 (2013.01); H04S 7/40 (2013.01); HO4R
`2227/003 (2013.01); H04S 2400/15 (2013.01)
`(58) Field of Classification Search
`
`CPC ... HO4R 3/00; HO4R 3/04; HO4R 3/12; HO4R
`25/35; HO4R 25/48; HO4R 25/356; HO4R
`
`Stereo Output
`*Wired or wireless
`
`27/00; HO4R 27/003; HO4R 29/00; HO4R
`29/001; HO4R 29/002; HO4R 29/003;
`HO4R 29/004; HO4R 29/007; HO4R
`
`2227/003;
`(Continued)
`(56) References Cited
`U.S. PATENT DOCUMENTS
`5,668,884 A 9/1997 Clair, Ir. et al.
`7,991,171 Bl 8/2011 Snow
`(Continued)
`FOREIGN PATENT DOCUMENTS
`EP 1971035 B2 8/2014
`WO 2016/049130 Al 3/2016
`
`OTHER PUBLICATIONS
`
`International Search Report, dated Jan. 29, 2019, for PCT Appli-
`cation No. PCT/US15/51638, International Filing Date Sep. 23,
`2015, consisting of 2 pages.
`
`(Continued)
`
`Primary Examiner — Thang V Tran
`(74) Attorney, Agent, or Firm — Gearhart Law, LL.C
`
`(57) ABSTRACT
`
`The systems and methods described relate to the concept
`that smart devices can be used to 1) sense various types of
`phenomena like sound, blue light exposure, RF and micro-
`wave radiation, and 2) in real-time analyze, report and/or
`control outputs (e.g., displays or speakers). The systems are
`configurable and use standard computing devices, such as
`wearable electronics, tablet computers, and mobile phones
`to measure various frequency bands across multiple points,
`allowing a single user to visualize and/or adjust environ-
`mental conditions.
`
`20 Claims, 10 Drawing Sheets
`
`Reception
`
`102~/'C
`
`Air loss Distance . ]
`D | e g
`109
`102 )
`Samsung v. Zophonos QL
`IPR2026-00083 102
`
`Exhibit 1001
`
`Exhibit 1001
`
`Page 01 of 23
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`Page 2
`
`Related U.S. Application Data
`
`continuation-in-part of application No. 14/862,304,
`filed on Sep. 23, 2015, now Pat. No. 10,127,005.
`
`(60)
`
`23, 2014.
`
`(1)
`
`(58)
`
`Int. CL.
`
`HO4R 27/00
`HO4L 29/08
`Field of Classification Search
`
`Provisional application No. 62/054,286, filed on Sep.
`
`(2006.01)
`(2006.01)
`
`CPC ... HO4R 2430/01; HO4S 7/40; HO4S 2400/15;
`
`GOGF 3/165; HO4AL 67/12; HO4B 1/0003
`
`See application file for complete search history.
`
`(56)
`
`8,073,160
`8,315,398
`8,452,432
`8,594,319
`10,127,005
`2004/0076305
`2004/0240676
`2005/0160270
`2006/0067550
`
`Exhibit 1001
`Page 02 of 23
`
`Bl
`B2
`B2
`B2
`B2
`Al
`Al
`Al
`Al
`
`12/2011
`11/2012
`5/2013
`11/2013
`11/2018
`4/2004
`12/2004
`7/2005
`3/2006
`
`References Cited
`
`U.S. PATENT DOCUMENTS
`
`Classen
`Katsianos
`Transeau
`
`Ho et al.
`Denton
`Santiago
`Hashimoto et al.
`Goldberg et al.
`Puder et al.
`
`2006/0082458 Al 4/2006 Shanks et al.
`2007/0217623 Al 9/2007 Harada
`2009/0003620 Al 1/2009 McKillop et al.
`
`2009/0058611 Al
`2009/0076825 Al
`
`3/2009
`3/2009
`
`Kawamura et al.
`Bradford et al.
`
`2010/0329471 Al 12/2010 Dunn et al.
`2011/0087079 Al* 4/2011 Aarts ... A61B 7/003
`600/300
`2011/0134278 Al 6/2011 Chang et al.
`2011/0313555 Al* 12/2011 Shoham ............... G10L 25/48
`700/94
`2012/0189140 Al 7/2012 Hughes
`2013/0044131 Al 2/2013 Milad
`2013/0064380 Al 3/2013 Mahowald
`2013/0294618 Al 112013 Lyubachev
`2015/0358730 Al* 12/2015 Kirsch ..o HO4R 3/002
`381/71.1
`2016/0150338 Al* 52016 Kim ..o GO8B 1/08
`381/58
`
`OTHER PUBLICATIONS
`
`International Preliminary Report on Patentability, dated Mar. 28,
`2017, for PCT Application No. PCT/US15/51638, International
`Filing Date Sep. 23, 2015, consisting of 7 pages.
`Written Opinion of the International Searching Authority, dated Jan.
`29, 2016, for PCT Application No. PCT/US15/51638, International
`Filing Date Sep. 23, 2015, consisting of 6 pages.
`
`* cited by examiner
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 1 of 10 US 10,656,906 B2
`
`To]
`un
`~—
`
`0 102
`
`~
`=
`=
`
`FIG.1
`
`102
`170
`(
`(
`0
`=
`=
`
`101
`
`Exhibit 1001
`Page 03 of 23
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 2 of 10
`
`102
`
`Reception
`102
`
`Q&L
`
`G ©) D)
`Nt
`
`¥ Sum
`
`Transit
`Delay
`
`Distance
`Loss
`-dB
`
`o
`o
`
`Air loss
`—/\
`
`Stereo Qutput
`*Wired or wireless
`
`109
`
`Exhibit 1001
`Page 04 of 23
`
`US 10,656,906 B2
`
`FIG.2
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`Sheet 3 of 10
`
`May 19, 2020
`
`U.S. Patent
`
`Ay
`
`824n0S
`
`_o:coo oipny
`
`-
`
`@F
`
`ffo
`
`t ol ffiJJ
`
`oLl
`
`Exhibit 1001
`
`Page 05 of 23
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 4 of 10 US 10,656,906 B2
`
`‘ Start l
`
`Y
`Sense, measure/analyze
`
`/'201
`
`surrounding audio output signal(s)
`203
`202 \ A ..
`Any signals N _| Devices remain in
`
`sensed?
`
`'sleep mode’
`i
`
`204
`
`Signal threshold
`breached?
`
`200
`
`First device to detect breach
`communicates message to
`other devices within local | ~—205
`
`cluster (if present) to
`determine if other devices
`detected a similar breach.
`
`206
`
`Congruency across local
`cluster devices?
`
`Y
`
`Share data with other cluster(s) |/~ 207
`and audio control unit.
`
`Back to 'sleep mode’
`
`i
`
`Y
`
`Adjust audio (speaker)/in—ear
`output at specified cluster
`based on breached data info [™-208
`shared ond/appropriate
`thresholds/audio EQs.
`
`, FIG.4
`
`Exhibit 1001
`Page 06 of 23
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 5 of 10 US 10,656,906 B2
`
`300
`
`AUDIO SENSED BY ONE OR MORE AUDIO SENSING DEVICES
`303
`
`¥
`ONE OR MORE INSTRUMENTS ARE ISOLATED FROM THE SENSED AUDIO
`310
`
`h:
`
`SIGNAL AMPUTUDE OF EACH INSTRUMENT 15 MANIPULATED
`313
`
`¥
`
`DETERMINED WHETHER AUDIO IN HAZARDOUS RANGE
`328
`
`¥
`
`IF IN HAZARDOUS RANGE, USER NOTIFIED
`3a3
`
`DYNAMIC RANGE OF SENSED AUDIO IS CONTROLLED
`330
`
`AUDIO IS PANNED
`333
`
`EFFECTS THAT ADD DEPTH AND TEXTURE ARE ADDED
`340
`
`Exhibit 1001
`Page 07 of 23
`
`
`
`
`
`
`
`
`U.S. Patent
`
`May 19, 2020 Sheet 6 of 10
`
`US 10,656,906 B2
`
`EQUALIZATION IS ADDED
`345
`
`k4
`
`PREDICTIVE AUTOMATION I5 GENERATED
`354
`
`VOLUME CHANGES AND AUDIO EFFECTS AUTOMOMOUSLY PROGRAMMED
`
`353
`
`Exhibit 1001
`Page 08 of 23
`
`FIG.6
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 7 of 10 US 10,656,906 B2
`
`Audio Control Unit
`
`FIG.7A
`
`Exhibit 1001
`Page 09 of 23
`
`
`
`
`
`
`
`
`U.S. Patent May 19, 2020 Sheet 8 of 10 US 10,656,906 B2
`
`FIG.7B
`
`Exhibit 1001
`Page 10 of 23
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`Sheet 9 of 10
`
`May 19, 2020
`
`U.S. Patent
`
`L9l
`
`5
`
`pun joquey olpny
`
`Exhibit 1001
`
`Page 11 of 23
`
`
`
`
`
`
`
`
`Sheet 10 of 10 US 10,656,906 B2
`
`U.S. Patent May 19, 2020
`/o
`THRESHOLD
`
`\\aREACHEW v
`
`BACK TO 'SLEEP
`MODE’
`
`\462
`
`\/’“\_4
`
`403
`
`,/
`o HAS
`
`NA\/E{;A‘? o&_.
`
`UNIT?
`/
`
`41@
`
`BREACH SEVERI TY
`MEASUREMENT WITH
`DEVICE LOCATION
`
`DEVICE
`BREACH LOCATION
`4 LESSEN SEVERITY?
`AN N e
`(E.G., INDOORVS. 7
`ouTD
`
`\ f}fi/ 412
`
`ANALYSIS: FACTOR IN LOCATION
`& MACHINE LEARNING INSIGHTS
`INTQ THRESHOLD BREACH CALC,
`
`A
`
`. N 433
`
`//S/REACH STK
`
`\\ AN ISSUE? 7
`
`\\//’
`
`BREACH SEVERITY
`MEASUREMERNT? \ 404
`405
`¥
`ONSET y 406
`S
`
`ISSUIE?
`
`\/'
`
`ra
`¥
`
`REPORT AND/OR
`DISPLAY
`407 DATA/FINDING{S)
`\"3 : 2
`
`CALCULATE TIME
`WINDOW AT WHICH
`SENSED DATALS
`UNACCEPTABLE
`
`408
`
`¥ T
`
`COLLECT/ANALYZE
`BREACHES WITHIN
`
`TIME WINDOW
`
`Al
`
`BACK TO "SLEEP MODE
`
`¥
`
`Exhibit 1001
`Page 12 of 23
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`1
`
`MULTI-FREQUENCY SENSING METHOD
`AND APPARATUS USING MOBILE-BASED
`CLUSTERS
`
`CLAIM OF PRIORITY
`
`This application is a Continuation-In-Part of U.S. Non-
`Provisional patent application Ser. No. 16/155,919, filed
`Oct. 10, 2018, which is a Continuation of U.S. Non-
`Provisional patent application Ser. No. 14/862,304, filed
`Sep. 23, 2015, which claims priority from U.S. Patent
`Provisional Application No. 62/054,286, filed on Sep. 23,
`2014, the contents of which are hereby fully incorporated by
`reference.
`
`FIELD OF THE EMBODIMENTS
`
`The invention and its embodiments relate to audio
`manipulation and sound management systems, particularly
`for home audio systems, public address systems, sound
`reinforcement systems, vehicle audio systems, ultrasonic
`transducers, infrasonic transducers, electro-optical transduc-
`ers, microwave transducers, and associated software for
`these applications.
`
`BACKGROUND OF THE EMBODIMENTS
`
`Each year sound companies spend billions of dollars on
`audio technologies and audio research to find new ways to
`improve audio quality in performance settings. Very often
`sound systems are designed to be used in a specific envi-
`ronment. For example, in a vehicle or private room setting,
`audio manipulation and output quality techniques and tech-
`nologies are either prescriptive or adaptive—neither of
`which require the need for audio engineering professionals.
`However, in other situations such as at a concert venue, a
`wide array of audio professionals must be employed. This
`can include monitor engineers, system technicians, and
`front-of-house engineers. These professionals operate mix-
`ing consoles and audio control units to produce desirable,
`high-quality audio output.
`
`Whether prescriptive or adaptive, manned or unmanned,
`perceived sound quality is a function of complex transducer-
`based technologies and acoustic treatment that are typically
`controlled, managed and manipulated by humans, and/or
`audio software and hardware. As such, both human and
`physical capital are required to produce first-rate sound
`quality. However, even when the necessary human and
`capital has been spent, it can still be very difficult to
`effectively manage audio outputs in real-time. This is due to
`improper calibrations of signal propagation and signal deg-
`radation, as well as unwanted harmonics and soundwave
`reflections.
`
`Particularly in an outdoor setting, single-source sound
`systems typically produce an intermittent mix of unintelli-
`gible sounds and echoes due to a given venue’s size and
`openness. A popular solution for addressing the echo issue
`is to utilize distributed sound systems. Traditional distrib-
`uted sound systems are less susceptible to sound variance
`than single source systems. However, even when these
`distributed systems are used, temperature gradients and
`wind can still steer sound in undesirable ways.
`
`Another issue related to the size of a performance venue
`is when audio and video fall out of sync. As live musical
`performances become more and more elaborate by including
`digital art and screens on-stage, it is becoming increasingly
`
`Exhibit 1001
`Page 13 of 23
`
`15
`
`20
`
`25
`
`30
`
`40
`
`45
`
`55
`
`2
`
`difficult to reliably sync audio and video in large venues, due
`to highly reverberant surfaces and long decay times.
`
`Also impacting audio intelligibility during a live perfor-
`mance is crowd noise. At a live event, it is not uncommon
`for crowds to generate noise approaching 105 dB. When this
`occurs, audio engineers must manipulate the supporting
`sound system output so that the performance audio remains
`5-8 decibels higher than the noise generated by crowd. This
`action results in performance sound being broadcast above
`110 dB, the range where the volume of sound begins to pose
`danger to human listeners. Frequently, audio system opera-
`tors find it difficult to granularly control the loud perception
`of a given individual listener while managing loudness
`perception for the remainder of the audience. In a case where
`an audio quality trade-off decision has to be made, a
`common industry practice is to execute a remediation plan
`that favors the majority of listeners while the minority of
`listeners are forced to suffer through it.
`
`In other instances, when various pieces of audio equip-
`ment are slightly, or completely out-of-phase, it can be
`difficult for audio system operators to correct these out-of-
`phase issues in a short period of time.
`
`A myriad of audio functions are necessary to provide a
`dynamic range of audio playback and fidelity. To meet
`heightened demands and address new challenges, the
`devices of today will not only have to handle traditional
`telephony voice communication and low-fidelity voice
`recording, but also, these devices must be capable of incor-
`porating new hardware and software to create new functions
`and applications such as sensing infrasonic, ultrasonic, blue
`light and millimeter wave exposure and reporting, and in
`some cases, autonomous manipulation of audio outputs.
`Further, such demands create the need to process signals
`using ‘low-loss’ methods by moving much of the processing
`function away from hardware and into software optimized to
`do so.
`
`Review of related technology:
`
`Line 6, Inc. has created a ‘smart mixing system’ for
`non-wearable ubiquitous computing devices that enables
`wireless and touchscreen control of live sound system
`components. This is accomplished via a wired connection
`between standard audio hardware and a proprietary physical
`interface. While this system integrates and controls live
`sound system components via touchscreen devices, it unfor-
`tunately relies on audio engineers to operate it, and does not
`incorporate a listener-centric way to autonomously solve
`audio issues experienced by an audience.
`
`U.S. Pat. No. 5,668,884 pertains to an audio enhancement
`system and method of use with a sound system for producing
`primary sound from at least one main loudspeaker located at
`a main position. The audio enhancement system comprises
`at least one wireless transmitter, time delay circuitry, and
`plural augmented sound producing subsystems. Each sound
`subsystem is a portable unit arranged to be carried by a
`person located remote from the main loudspeaker and
`includes a wireless receiver and an associated transducer
`device, e.g., a pair of stereo headphones. The transmitter
`broadcasts an electrical signal which is representative of the
`electrical input signal provided to the main loudspeaker. The
`broadcast signal is received by the receiver and is demodu-
`lated and amplified to drive the transducer so that it produces
`augmented sound substantially in synchronism with the
`sound arriving from the main loudspeaker. To achieve that
`end the time delay circuitry delays the electrical signal
`which is provided to the transducer for a predetermined
`period of time corresponding generally to the time period it
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`3
`
`takes for the primary sound to propagate through the air
`from the main loudspeaker to the remote location at which
`the person is located.
`
`U.S. Pat. No. 7,991,171 pertains to a method and appa-
`ratus for processing an audio signal in multiple audio
`frequency bands while minimizing undesirable changes in
`tonal qualities of the audio signal by determining an initial
`gain adjustment factor for each audio frequency band result-
`ing from the application of an audio processing technique. A
`final gain adjustment factor for each band is selected from a
`corresponding set of weighted or unweighted initial gain
`adjustment factors. The set of initial gain adjustment factors
`from which the final gain adjustment factor for a specified
`audio frequency band is obtained is derived from other audio
`frequency bands that have the frequency of the specified
`band as a harmonic frequency. Changes in audio signal level
`within one audio frequency band thereby affect the signal
`level of harmonic frequencies to decrease relative changes in
`volume between a fundamental frequency and its harmonics.
`
`U.S. Pat. No. 8,315,398 pertains to a method of adjusting
`a loudness of an audio signal may include receiving an
`electronic audio signal and using one or more processors to
`process at least one channel of the audio signal to determine
`a loudness of a portion of the audio signal. This processing
`may include processing the channel with a plurality of
`approximation filters that can approximate a plurality of
`auditory filters that further approximate a human hearing
`system. In addition, the method may include computing at
`least one gain based at least in part on the determined
`loudness to cause a loudness of the audio signal to remain
`substantially constant for a period of time. Moreover, the
`method may include applying the gain to the electronic
`audio signal.
`
`U.S. Pat. No. 8,452,432 pertains to a user-friendly system
`for real time performance and user modification of one or
`more previously recorded musical compositions facilitates
`user involvement in the creative process of a new compo-
`sition that reflects the user’s personal style and musical
`tastes. Such a system may be implemented in a small
`portable electronic device such as a handheld smartphone
`that includes a stored library of musical material including
`original and alternative versions of each of several different
`components of'a common original musical composition, and
`a graphic user interface that allows the user to select at
`different times while that original composition is being
`performed, which versions of which components are to be
`incorporated to thereby create in real time a new perfor-
`mance that includes elements of the original performance,
`preferably enhanced at various times with user selected
`digital sound effects including stuttering and filtering. The
`system may also optionally comprise a visualizer module
`that renders a visual animation that is responsive to at least
`the rhythm and amplitude of the system’s audio output, not
`only for entertainment value but also to provide visual
`feedback for the user.
`
`U.S. Pat. No. 8,594,319 pertains to methods and appara-
`tuses for adjusting audio content when more multiple audio
`objects are directed toward a single audio output device. The
`amplitude, white noise content, and frequencies can be
`adjusted to enhance overall sound quality or make content of
`certain audio objects more intelligible. Audio objects are
`classified by a class category, by which they can be assigned
`class specific processing. Audio objects classes can also
`have a rank. The rank of an audio object’s class is used to
`give priority to or apply specific processing to audio objects
`in the presence of other audio objects of different classes.
`
`Exhibit 1001
`Page 14 of 23
`
`20
`
`40
`
`45
`
`4
`
`United States Patent Publication No.: 2007/0217623 per-
`tains to a real-time processing apparatus capable of control-
`ling power consumption without performing complex arith-
`metic processing and requiring a special memory resource.
`The real-time processing apparatus includes an audio
`encoder that performs a signal processing in real time on an
`audio signal, a second audio encoder that performs the signal
`processing with a smaller throughput in real time on the
`audio, an audio execution step number notification unit that
`measures step number showing a level of the throughput in
`the signal processing by operating the 1st audio encoder or
`second audio encoder, and an audio visual system control
`unit that executes control so that the first audio encoder
`operates when the measured step number is less than a
`threshold value provided beforehand and the second audio
`encoder operates when the step number is equal to or greater
`than the threshold value.
`
`United States Patent Publication No.: 2011/0134278 per-
`tains to an image/audio data sensing module incorporated in
`a case of an electronic apparatus. The image/audio data
`sensing module comprises: at least one image sensor, for
`sensing an image datum; a plurality of audio sensors, for
`sensing at least one audio datum; a processor, for processing
`the image datum and the audio datum according to a control
`instruction set to generate a processed image data stream and
`at least one processed audio data stream, and combining the
`processed image data stream and the processed audio data
`stream to generate an output data stream following a trans-
`ceiver interface standard; a transceiver interface, for receiv-
`ing the control instruction set and transmitting the output
`data stream via a multiplexing process; and a circuit board,
`wherein the image sensor, the audio sensors and the trans-
`ceiver interface are coupled to the circuit board, and the
`processor is provided on the circuit board.
`
`United States Patent Publication No.: 2013/0044131 per-
`tains to a method for revealing changes in settings of an
`analog control console, the method comprising: receiving a
`captured image of the analog control console; creating a
`composite image by superimposing the captured image and
`a live image of the analog control console; and displaying
`the composite image.
`
`United States Patent Publication No.: 2013/0294618 per-
`tains to a method and devices of sound volume management
`and control in the attended areas. According to the proposed
`method and system variants the sound reproducing system
`comprises: sounding mode appointment device, central sta-
`tion for audio signal transmittance; one or more peripheral
`stations for audio signal reception and playback; appliance
`for listener’s location recognition; computing device for
`performing calculation concerning sounding parameters at
`the points of each listener’s location and for performing
`calculation of controlling parameters for system tuning. The
`system can be operated wirelessly and can compose a local
`network.
`
`Various devices are known in the art. However, their
`structure and means of operation are substantially different
`from the present invention. Such devices fail to provide a
`device that can help develop a participant’s knowledge in a
`multitude of different subject areas, while simultaneously
`engaging the participant physically. At least one embodi-
`ment of this invention is presented in the drawings below
`and will be described in more detail herein.
`
`SUMMARY OF THE EMBODIMENTS
`
`According to an aspect of the present invention, a system
`is provided. The system includes an audio control source; at
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`5
`
`least one cluster of at least one computing device, the at least
`one computing device including: a sound sensing mecha-
`nism, configured to sense a noise; and a wireless transceiver,
`configured to wirelessly transmit and receive data from the
`audio control source. The system further includes at least
`one output device, including: a power source for operating
`the output device; a speaker for outputting sound; and a
`communication mechanism, for receiving electronic infor-
`mation from the audio control source. The system addition-
`ally includes the audio control source, in electronic com-
`munication the at least one cluster and the at least one output
`device, the audio control source including: a memory, con-
`taining computer-executable instructions for connecting to
`the at least one cluster, and varying an output of the at least
`one output device, providing an interface; and a processor,
`for executing the computer-executable instructions, wherein
`the computer-executable instructions include: identifying
`one or more sounds within the noise; isolating the one or
`more sounds; determining is one or more of the one or more
`sounds includes a frequency outside of a predetermined
`threshold; if one or more of the one or more sounds includes
`the frequency outside of the predetermined threshold, alter-
`ing the one or more of the one or more sounds so that the
`frequency does not fall outside of the predetermined thresh-
`old; and outputting the one or more sounds on the at least
`one output device.
`
`It is an object of the present invention to provide the
`system, wherein the system further includes an interfacing
`mechanism, the interfacing mechanism including: a network
`adapter, configured to transmit and receive electronic infor-
`mation through both wired and wireless communication; and
`at least one input mechanism, configured to: manipulate the
`interfacing mechanism; and vary the output of the at least
`one output device.
`
`It is an object of the present invention to provide the
`system, wherein the sound-sensing mechanism is an omni-
`directional transducer.
`
`It is an object of the present invention to provide the
`system, wherein the sound-sensing mechanism is selected
`from the group consisting of an ultrasonic transducer and an
`infrasonic transducer.
`
`It is an object of the present invention to provide the
`system, wherein energy sensing mechanisms is selected
`from the group consisting of a microwave transducer; and an
`electro-optical transducer.
`
`It is an object of the present invention to provide the
`system, wherein the sensed noise includes infrasonic or
`ultrasonic soundwaves.
`
`It is an object of the present invention to provide the
`system, wherein the predetermined threshold equates to a
`frequency determined to pose a risk of harm to a human’s
`body (e.g. a retina and blue lights from screens, loud noise
`and a user’s hearing capabilities, RF exposure limits and
`electrosensitivity, millimeter waves and cell growth or heart
`variability.
`
`It is an object of the present invention to provide the
`system, wherein the computer-executable instructions fur-
`ther include: if one or more of the one or more sounds
`includes the frequency outside of the predetermined thresh-
`old, notifying a user, via a notification, that one or more of
`the one or more sounds includes the frequency outside of the
`predetermined threshold.
`
`It is an object of the present invention to provide the
`system, wherein the notification is an audible notification.
`
`It is an object of the present invention to provide the
`system, wherein the system further includes an in-ear
`
`Exhibit 1001
`Page 15 of 23
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`6
`
`device, wherein an audio output of the in-ear device auto-
`adjusts based on signal energy sensed within a cluster or
`surrounding clusters.
`
`It is an object of the present invention to provide the
`system, wherein the computer-executable instructions fur-
`ther include panning the sensed noise.
`
`It is an object of the present invention to provide the
`system, wherein the computer-executable instructions fur-
`ther include adding one or more audio effects to the sensed
`noise.
`
`It is an object of the present invention to provide the
`system, wherein the computer-executable instructions fur-
`ther include equalizing the sensed noise.
`
`It is an object of the present invention to provide the
`system, wherein the altering the one or more of the one or
`more sounds so that the frequency does not fall outside of
`the predetermined threshold is performed automatically.
`
`It is an object of the present invention to provide the
`system wherein the system is further configured to sense
`and/or analyze infra/ultra-sonic waves (e.g., mm waves),
`visible light (e.g. smart devices that have sensors that sense
`blue light from electronic screens and/or analyze and report
`prolonged exposure to the blue light) and radio waves.
`
`According to another aspect of the present invention, a
`method of altering sensed noise prior to outputting the
`sensed noise is provided. The method includes providing at
`least one audio control source and providing at least one
`cluster of at least one computing device, the at least one
`computing device including: a sound sensing mechanism,
`configured to sense a noise; and a wireless transceiver,
`configured to wirelessly transmit and receive data from the
`audio control source; at least one output device, including:
`a power source for operating the output device; a speaker for
`outputting sound; and a communication mechanism, for
`receiving electronic information from the audio control
`source; and the audio control source, in electronic commu-
`nication the at least one cluster and the at least one output
`device, the audio control source including: a memory, con-
`taining computer-executable instructions for connecting to
`the at least one cluster, and varying an output of the at least
`one output device, providing an interface; and a processor,
`for executing the computer-executable instructions. The
`method further includes identifying one or more sounds
`within the noise; isolating the one or more sounds; deter-
`mining is one or more of the one or more sounds includes a
`frequency outside of a predetermined threshold; if one or
`more of the one or more sounds includes the frequency
`outside of the predetermined threshold, altering the one or
`more of the one or more sounds so that the frequency does
`not fall outside of the predetermined threshold; and output-
`ting the one or more sounds on the at least one output device.
`
`It is an object of the present invention to provide the
`method, wherein the at least one computing device further
`includes: an interfacing mechanism, the interfacing mecha-
`nism including: a network adapter, configured to transmit
`and receive electronic information through both wired and
`wireless communication; and at least one input mechanism,
`configured to: manipulate the interfacing mechanism; and
`vary the output of the at least one output device.
`
`It is an object of the present invention to provide the
`method, wherein the sound-sensing mechanism is an omni-
`directional transducer.
`
`It is an object of the present invention to provide the
`method, wherein the predetermined threshold equates to a
`frequency determined to pose a risk of harm to a user’s
`hearing capabilities.
`
`
`
`
`
`
`
`
`US 10,656,906 B2
`
`7
`
`It is an object of the present invention to provide the
`method, wherein the method further includes, if one or more
`of the one or more sounds includes the frequency outside of
`the predetermined threshold, notifying a user, via a notifi-
`cation, that one or more of the one or more sounds includes
`the frequency outside of the predetermined threshold.
`
`It is an object of the present invention to provide the
`method, wherein the notification is an audible notification.
`
`It is an object of the present invention to provide the
`method, wherein the method further includes panning the
`sensed noise.
`
`It is an object of the present invention to provide the
`method, wherein the method further includes adding one or
`more audio effects to the sensed noise.
`
`It is an object of the present invention to provide the
`method, wherein the method further includes equalizing the
`sensed noise.
`
`It is an object of the present invention to provide the
`method, wherein the altering the one or more of the one or
`more sounds so that the frequency does not fall outside of
`the predetermined threshold is performed automatically.
`
`BRIEF DESCRIPTION OF THE DRAWINGS
`
`FIG. 1 shows a schematic view of an embodiment of one
`cluster of the present invention with some interfaced
`devices.
`
`FIG. 2 shows a schematic view of how interfaced devices
`create a sound fingerprint.
`
`FIG. 3 shows an illustration of an embodiment of the
`system of the present invention engaging in inter-cluster,
`cluster-to-audio control source; and cluster-to-cluster data
`sharing.
`
`FIG. 4 shows a flow chart outlining an embodiment of the
`method of the present invention.
`
`FIGS. 5-6 show a flow chart outlining an embodiment of
`the method of the present invention.
`
`FIG. 7A shows an illustration showing an embodiment of
`the present invention located in an automobile.
`
`FIG. 7B shows an illustration showing an embodiment of
`the present invention located in an indoor theatre.
`
`FIG. 7C shows an illustration showing an embodiment of
`the present invention located in an outdoor stadium.
`
`FIG. 8 shows a flow chart outlining an embodiment of the
`method of the present invention.
`
`DESCRIPTION OF THE PREFERRED
`EMBODIMENTS
`
`The preferred embodiments of the present invention will
`now be described with reference to the drawings. Identical
`elements in the various figures are identified with the same
`reference numerals.
`
`Reference will now be made in detail to each embodiment
`of the present invention. Such embodiments are provided by
`way of explanation of the present invention, which is not
`intended to be limited thereto. In fact, those of ordinary skill
`in the art may appreciate upon reading the present specifi-
`cation and viewing the present drawings that various modi-
`fications and variations can be made thereto.
`
`As a threshold matter, it should be noted that whenever
`the phrases “microphone” or “microphone-equipped” are
`used, it is intended to mean any device that is capable of
`detecting sound, not merely microphones. For example, a
`high-performance low frequency antenna connected to a
`software-defined radio may be used to input sound obser-
`vations into the system, or a piezo-electric diagraph may be
`
`Exhibit 1001
`Page 16 of 23
`
`10
`
`15
`
`20
`
`25
`
`30
`
`35
`
`40
`
`45
`
`50
`
`55
`
`60
`
`65
`
`8
`
`used to measure the vibrations the correspond to a given
`sound. These examples are provided to give greater clarity
`as to what the term “microphone” should be interpreted as,
`and not construed as a limiting example.
`
`The system of the present invention operates by integrat-
`ing clusters of various computing devices and wearable
`computers with sound management techniques and methods
`so that various