as) United States
`a2) Patent Application Publication co) Pub. No.: US 2008/0170716 Al
`
`(43) Pub. Date: Jul. 17, 2008
`Zhang
`
`US 20080170716A1
`
`(54) SMALL ARRAY MICROPHONE APPARATUS
`AND BEAM FORMING METHOD THEREOF
`
`(75)
`
`Inventor:
`
`Ming Zhang, Cupertino, CA (US)
`
`Correspondence Address:
`THOMAS, KAYDEN, HORSTEMEYER & RIS-
`LEY, LLP
`600 GALLERIA PARKWAY, S.E., STE 1500
`ATLANTA, GA 30339-5994
`
`(73) Assignee:
`
`FORTEMEDIA,INC., Cupertino,
`CA (US)
`
`(21) Appl. No.:
`
`11/622,058
`
`(22)
`
`Filed:
`
`Jan. 11, 2007
`
`Publication Classification
`
`(51)
`
`Int. Cl.
`(2006.01)
`HOAR 5/027
`(52) US. CMe cccsecssssssssssssssveseessessssssssssssssssnnesesseees 381/92
`
`(57)
`
`ABSTRACT
`
`The invention provides a beam forming method for a small
`array microphone apparatus to generate cone beam pattern by
`processing a combined bi-directional beam pattern of two
`virtual bi-directional microphones formed through at least
`three omni-directional microphones arranged in an L-shape.
`The invention also provides a small array microphone appa-
`ratus using the beam forming method accordingto the inven-
`tion to suppress noise by processing a combined bi-direc-
`tional beam pattern oftwo virtual bi-directional microphones
`formed through at least three omni-directional microphones
`arranged in an L-shape, thereby outputting a clear audio
`signal with cone beam pattern.
`
`device
`
`Adaptive
`channel
`decoupling
`device
`
`Suppression
`unit
`
`Microphone
`calibration
`
`Directional
`microphone
`forming
`
`Combining
`
`Exhibit 1010 Samsung Exhibit 1010
`
`Samsung v. Jawbone
`IPR2022-00213
`
`Page 01 of 21
`
`Samsung Exhibit 1010
`Page 01 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 1 of 14
`
`US 2008/0170716 Al
`
` FIG.1(RELATEDART)
`
`
`Samsung Exhibit 1010
`Page 02 of 21
`
`Samsung Exhibit 1010
`Page 02 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 2 of 14
`
`US 2008/0170716 Al
`
`Arrangeat least a first, second and third omni-directional
`;
`;
`microphones on a commonplane but not on a commonline
`
`Sl
`
`Formafirst bi-directional microphone byusingthefirst
`. .
`.
`S2
`and second omni-directional microphones
`
`Form a second bi-directional microphone by using second
`and third omni-directional microphones
`
`
`
`Combinethe first and second directional microphone
`signals to generating a combineddirectional microphone
`
`
`signal Z with a combined beam pattern
`
`
`
`
`
`Take the combined directional microphonesignal as a
`reference channel signal, and one or sum ofthefirst to
`
`
`third electrical signals as a main channelsignal
`
`
`
`
`
`Process the main and reference channelsignals to
`suppress noise and to generate a clear voice signal with
`
`
`a cone beam pattern
`
`
`83
`
`S4
`
`S5
`
`S6
`
`FIG. 2
`
`Samsung Exhibit 1010
`Page 03 of 21
`
`Samsung Exhibit 1010
`Page 03 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 3 of 14
`
`US 2008/0170716 Al
`
`FIG.3B
`
`FIG.3A
`
`Samsung Exhibit 1010
`Page 04 of 21
`
`Samsung Exhibit 1010
`Page 04 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 4 of 14
`
`US 2008/0170716 Al
`
`FIG.4
`
` Y
`
`
`
`Samsung Exhibit 1010
`Page 05 of 21
`
`Samsung Exhibit 1010
`Page 05 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 5 of 14
`
`US 2008/0170716 Al
`
`
`
`
`FIG.5
`
`Samsung Exhibit 1010
`Page 06 of 21
`
`Samsung Exhibit 1010
`Page 06 of 21
`
`

`

`US 2008/0170716 Al
`
`Jul. 17, 2008 Sheet 6 of 14
`
`Patent Application Publication
`
`Samsung Exhibit 1010
`Page 07 of 21
`
`Samsung Exhibit 1010
`Page 07 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 7 of 14
`
`US 2008/0170716 Al
`
`FIG.7B
`
`rm
`
`A||
`
`Pea A
`way Via
`re-UWS?
`
`FIG.7A
`
`e-od- sn
`|
`_
`ae _4j-~.
`
`~
`
`7~\
`
`Oe a
`
`
`Samsung Exhibit 1010
`Page 08 of 21
`
`Samsung Exhibit 1010
`Page 08 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 8 of 14
`
`US 2008/0170716 Al
`
`|||||
`
`988
`
`
`
`
`
`OOIADpUorssoiddnsosioN,
`
`[euonsoIGsuoydosorur|oandepy |||dOIAapSUTULIOF!jouueysd01Aap
`
`
`
`
`
`sutjdnosap
`
`
`
`8Old
`
`uolyesqreo
`
`SOIAOp
`
`Samsung Exhibit 1010
`Page 09 of 21
`
`Samsung Exhibit 1010
`Page 09 of 21
`
`
`
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 9 of 14
`
`US 2008/0170716 Al
`
`cP
`
`IP
`
`
`
`yuowysn{peoseyg
`
`(zd)yon
`
`juowlysnipeoseugtx
`
`(qd)yon
`
`
`
`
`
`Samsung Exhibit 1010
`Page 10 of 21
`
`
`
`juowysnipeoseygLx
`
`yun
`
`Samsung Exhibit 1010
`Page 10 of 21
`
`
`
`
`

`

`US 2008/0170716 Al
`
`FIG.10B
`
`Jul. 17, 2008 Sheet 10 of 14
`
`FIG.10A
`
`Patent Application Publication
`
`Samsung Exhibit 1010
`Page 11 of 21
`
`Samsung Exhibit 1010
`Page 11 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 11 of 14
`
`US 2008/0170716 Al
`
`
`
`Arrangeat least a first, second, third and fourth
`omni-directional microphones on a commonplane but
`not on a commonline
`
`S11
`
`Formafirst bi-directional microphoneby usingthefirst sD
`
`
`and third omni-directional microphones
`
`513
`
`$14
`
`S15
`
`S16
`
`
`
`Form a second bi-directional microphone by using second
`and fourth omni-directional microphones
`
`
`
`
`
`
`
`
`Combine the first and second directional microphone
`signals to generating a combineddirectional microphone
`
`signal Z with a combined beam pattern
`
`
`
`
`Take the combined directional microphone signal as a
`reference channelsignal, and one or sum ofthefirst to
`
`
`
`third electrical signals as a main channel signal
`
`
`
`
`Process the main and reference channel signals to
`suppress noise and to generate a clear voice signal with
`
`
`a cone beam pattern
`
`
`FIG. 11
`
`Samsung Exhibit 1010
`Page 12 of 21
`
`Samsung Exhibit 1010
`Page 12 of 21
`
`

`

`US 2008/0170716 Al
`
`clOld
`
`988
`
`sul[dnosep
`
`dO1Aap
`
`oAndepy
`
`jouueyo
`
`[euonool1q
`
`suoydoso1w
`
`SUTULIOT
`
`Sd1Aap
`
`uoryeiqieo
`
`QOIAOP
`
`suoydorsIyy
`
`Patent Application Publication
`
`Jul. 17,2008 Sheet 12 of 14
`
`
`
`
`
`SolAapUoIssoiddnsaston,
`
`Samsung Exhibit 1010
`Page 13 of 21
`
`Samsung Exhibit 1010
`Page 13 of 21
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 13 of 14
`
`US 2008/0170716 Al
`
`cP
`
`IP
`
`
`
`
`
`justysnipeoseyg
`
`
`
`(cd)yon
`
`Pcl
`
`
`
`juowysn{[peoseyg
`
`
`
`(ed)yun
`
`(14)
`
`
`
`quowysnipeoseyg
`
`
`
`
`
`jUSUIIsn[peoseug
`
`
`
`(7d)yun
`
`Samsung Exhibit 1010
`Page 14 of 21
`
`Samsung Exhibit 1010
`Page 14 of 21
`
`
`
`
`

`

`Patent Application Publication
`
`Jul. 17, 2008 Sheet 14 of 14
`
`US 2008/0170716 Al
`
`FIG.14
`
`fi
`LIU mY“aiyeH
`
`
`Samsung Exhibit 1010
`Page 15 of 21
`
`Samsung Exhibit 1010
`Page 15 of 21
`
`

`

`US 2008/0170716 Al
`
`Jul. 17, 2008
`
`SMALL ARRAY MICROPHONE APPARATUS
`AND BEAM FORMING METHOD THEREOF
`
`BACKGROUND OF THE INVENTION
`
`are arranged on a commonplane but not on a commonline to
`convert received sound into a first, second, third and fourth
`electrical signals. Second, make the first and third omni-
`directional microphones form a first bi-directional micro-
`phone which outputs a first directional microphone signal
`1. Field of the Invention
`[0001]
`withafirst bi-directional pattern. Third, make the second and
`[0002] The invention relates to a microphone apparatus,
`fourth omni-directional microphones form a secondbi-direc-
`and in particular to a small array microphone apparatus and
`tional microphonewhich outputs a second directional micro-
`beam forming methodthereof.
`phonesignal with a secondbi-directional pattern. Finally, the
`[0003]
`2. Description of the Related Art
`first and seconddirectional microphonesignals are combined
`[0004]
`InFIG.1, two omni-directional microphones 10 and
`for generating a combined directional microphone signal
`12 are put approximately on a line (X coordinate) and a
`with a combined beam pattern correlated to the first and
`near-end talker 14 vertically faces to the line formed by the
`second bi-directional patterns for noise suppression. Note
`two omni-directional microphones 10 and 12.
`that the first to fourth omni-directional microphones are
`[0005] The bi-directional microphone outputs signals with
`arranged in quadrilateral shape or square shape.
`a bi-directional pattern 16 as depicted in FIG. 1. The bi-
`[0010]
`To achieve the object, the invention provides a small
`directional pattern 16 has two lobes 16a and 166 pointingleft
`array microphoneapparatus comprising: atleasta first, sec-
`and right on line X. Because beam forming using the bi-
`ond and third omni-directional microphones, arranged on a
`directional pattern 16 for noise suppression can only form a
`common plane but not in a line, respectively converting
`so-called “pie” beam,the bi-directional pattern 16 is appro-
`received soundinto a first, second and thirdelectrical signals;
`priate for suppressing noise from left and right directions, but
`a directional microphone forming device receivingthefirst to
`not for noise from up and down directions. Therefore, bi-
`third electrical signals, to make the first and second omni-
`directional pattern 16 is not adequate for many applications
`directional microphones form a first bi-directional micro-
`such as cell phones, smart phones and other portable commu-
`phone which outputs a first directional microphone signal
`nication devices, etc. due to their inability to suppress noise
`with a first bi-directional pattern and make the second and
`from the bottom of such communications devices.
`third omni-directional microphones form a second bi-direc-
`tional microphonewhich outputs a second directional micro-
`phonesignal with a secondbi-directional pattern; a combin-
`ing device receiving the first and second directional
`[0006] An object of the invention is to provide a beam
`microphone signals and outputting a combined directional
`forming method for a small array microphone apparatus to
`microphonesignal with a combined beam pattern correlated
`generate a cone beam pattern by processing a combinedbi-
`to the first and second bi-directional patterns for noise sup-
`directional beam pattern of two bi-directional microphones
`pression.
`formed through at least three omni-directional microphones
`To achieve the described object, the invention pro-
`[0011]
`arranged in an L-shapeora triangular shape.
`vides another small array microphone apparatus comprises:
`[0007] Another object ofthe invention is to provide a small
`at least a first, second, third and fourth omni-directional
`array microphoneapparatus using the beam forming method
`microphones, arranged on a commonplane butnot in a line,
`of the invention to suppress noise by processing a combined
`respectively converting received sound into a first, second
`bi-directional beam pattern of two bi-directional micro-
`third and fourth electrical signals; a directional microphone
`phones formed throughat least three omni-directional micro-
`forming device receiving thefirst to fourth electrical signals,
`phonesarranged in an L-shapeora triangular shape, thereby
`to make the first and third omni-directional microphones
`outputting a clear audio signal with cone beam pattern.
`formafirst bi-directional microphone which outputsafirst
`[0008]
`To achieve the described object, the invention pro-
`directional microphonesignal with a first bi-directional pat-
`vides a beam forming method for a small array microphone
`tern and make the second and fourth omni-directional micro-
`apparatus, comprising the following steps. At least a first,
`phones form a secondbi-directional microphone which out-
`second and third omni-directional microphonesare arranged
`puts a second directional microphone signal with a second
`on a common plane but not on a common line to convert
`bi-directional pattern; and a combining device receiving the
`received soundinto first, second and thirdelectrical signals. A
`first and second directional microphonesignals and output-
`first bi-directional microphone, which outputs a first direc-
`ting a combined directional microphone signal with a com-
`tional microphone signal with a first bi-directional pattern,
`bined beam pattern correlated to the first and second bi-
`comprising first and second omni-directional microphonesis
`directional patterns for noise suppression.
`then formed. A second bi-directional microphone outputting
`[0012] A detailed description is given in the following
`a second directional microphone signal with a second bi-
`embodiments with reference to the accompanying drawings.
`directional pattern and comprising second and third omni-
`directional microphonesis then formed. Finally, the first and
`second directional microphonesignals are combinedfor gen-
`erating a combined directional microphone signal with a
`[0013] Theinvention can be morefully understoodby read-
`combined beam pattern correlated to the first and second
`ing the subsequent detailed description and examples with
`bi-directional patterns for noise suppression. Note that the
`references made to the accompanying drawings, wherein:
`first to third omni-directional microphonesare arranged in an
`
`[0014] FIG. 1 showsasmall array microphone apparatus of
`L-shapeor a triangular shape.
`two omni-directional microphones, and its beam pattern.
`[0009]
`To achieve the described object, the invention pro-
`vides another beam forming method for small array micro-
`[0015]
`FIG. 2 is a flow chart showing a beam forming
`phone apparatus comprising the following steps. At least a
`method of small array microphone apparatus according to an
`embodimentofthe invention.
`first, second, third and fourth omni-directional microphones
`
`BRIEF SUMMARY OF INVENTION
`
`BRIEF DESCRIPTION OF DRAWINGS
`
`Samsung Exhibit 1010
`Page 16 of 21
`
`Samsung Exhibit 1010
`Page 16 of 21
`
`

`

`US 2008/0170716 Al
`
`Jul. 17, 2008
`
`d2 with a secondbi-directional pattern 42 as depicted in FIG.
`[0016] FIGS.3A and 3B show arrangementsofthree omni-
`directional microphones of small array microphone appara-
`4. Note that steps S2 and S3 can be exchangedorcarried out
`tuses installed in cell phones.
`simultaneously. Then, (In step S4)thefirst and seconddirec-
`[0017]
`FIG. 4 shows two bi-directional patterns of two
`tional microphonesignals d1 and d2 are combined to generate
`directional microphones formed from two omni-directional
`acombineddirectional microphonesignal Z with a combined
`microphones.
`beam pattern correlated to the first and second bi-directional
`[0018]
`FIG. 5 shows a combined(entire) beam pattern of
`patterns 41 and 42for noise suppression.In this embodiment,
`the two bi-directional patterns in FIG.4.
`the combineddirectional microphonesignal Z is generated by
`[0019]
`FIGS. 6A and 6B shows another combined beam
`linearly combining the first and second directional micro-
`pattern of the two bi-directional patterns in FIG.4 withafirst
`phonesignals d1 and d2 whichare digitized signals (d1(7),
`weighting valueset.
`d2(z)), using a first and second weight values « and 8, i.e.,
`[0020]
`FIGS. 7A and 7B shows another combined beam
`Z=axd1+$xd2. Finally, (in step S5) the combineddirectional
`pattern of the two bi-directional patterns in FIG. 4 with a
`microphonesignal Z are taken as a reference channel signal,
`second weighting valueset.
`and one or the sum ofthe first to third electrical signals are
`[0021]
`FIG. 8 shows a small array microphone apparatus
`taken as a main channelsignal; and (in step S6) the main and
`according to an embodimentofthe invention.
`reference channel signals are processed to suppress noise and
`[0022]
`FIG. 9 shows an example of the directional micro-
`to generate a clear voice signal with a cone beam pattern.
`phone forming device 84 in FIG.8.
`[0030]
`In FIG.4, the first bi-directional pattern 41 has two
`[0023]
`FIGS. 10A and 10B show arrangements of four
`lobes pointing to the left and right directions of the line
`omni-directional microphones of small array microphone
`(coordinate) X, and the second bi-directional pattern 42 has
`apparatusesinstalled in cell phones.
`twolobes pointing to the up and downdirections on the line
`[0024]
`FIG. 11 isa flow chart showing another beam form-
`(coordinate) Y. FIG. 5 shows the combined (entire) beam
`ing method of small array microphoneapparatus according to
`another embodimentof the invention.
`pattern 50 of the first and second bi-directional patterns 41
`and 42 corresponding to the combined directional micro-
`[0025]
`FIG. 12 shows a small array microphone apparatus
`phone signal Z. Comparing the combined beam pattern 50
`according to another embodimentofthe invention.
`and the pattern 16 of FIG.1, the up and downdirections ofthe
`[0026]
`FIG. 13 shows an exampleofthe directional micro-
`beam pattern 50 are enhanced. Consequently, the combined
`phone forming device 124 in FIG. 12.
`directional microphone signal Z with the combined beam
`[0027] FIG.14 shows the beam pattern formedbythe small
`pattern 50 can used as the reference channel signal to cancel
`array microphone apparatus with omni-directional micro-
`noise or sound from the up or down directions.
`phonesarranged in an L-shape or a square shape.
`[0031] The proportion of a to B for combiningthefirst and
`second directional microphonesignals d1 and d2 can be used
`to adjust the amount of cancellation for the left and right
`[0028] The following description is of the best-contem-
`directions as well as the up and downdirections. In FIG.5, the
`plated modeof carrying out the invention. This descriptionis
`proportion of the combination is 1, 1e., a and 6 equal 1,
`madefor the purposeofillustrating the general principles of
`Z=d1+d2. Some applications, however, require more flexibil-
`the invention and should notbe taken in a limiting sense. The
`ity rather than a narrow beam to obtain a clear audio signal.
`scope ofthe invention is best determined by reference to the
`The proportion of a to 6 can be adjusted to achieve this
`appendedclaims.
`purpose. FIGS. 6A and 6B show examples of the combined
`[0029]
`FIG. 2 is a flow chart showing a beam forming
`beam patterns corresponding to the combined directional
`methodof a small array microphone apparatus according to
`microphonesignals 71(=d1+0.6xd2) and 72(=d1+0.2xd2).
`an embodimentof the invention. First, (in step $1) at least a
`[0032] Also, the proportion of a to 6 for combiningthefirst
`first, second and third omni-directional microphones 21, 22
`and second directional microphone signals d1 and d2 can be
`and 23 are arranged on acommonplane but not on acommon
`used to adjust the amountof cancellationforthe left and right
`line to convert received sound into a first, second and third
`directions. For examples, FIGS. 7A and 7B show the com-
`electrical signals. In this embodiment, the first to third omni-
`bined beam patterns corresponding to the combined direc-
`directional microphones21 to 23 are arranged on a surface of
`tional microphone signals Z73(=0.6xd1+d2) and 74(=0.2x
`a cell phone 20 in an L-shape as depicted in FIG. 3A. The
`d1+d2).
`L-shape arrangement can be extended to any other similar
`FIG. 8 showsa small array microphone apparatus 80
`[0033]
`shape, such as thetriangular shape shownin FIG.3B. In step
`using the beam forming method described above. The small
`S82, the first and second omni-directional microphones 21 and
`array microphone apparatus 80 comprisesa first, second and
`22 are used to jointly output a first directional microphone
`third omni-directional microphones (21, 22 and 23), a micro-
`signal d1 withafirst bi-directional pattern 41 as depicted in
`phonecalibration device 82, a directional microphone form-
`FIG. 4. Also, the first and second omni-directional micro-
`ing device 84, a combining device and a noise suppression
`phones 21 and 22 can be deemed to form a virtual first bi-
`device 88. In this embodiment, the small array microphone
`directional microphone which outputs a first directional
`apparatus 80 is assumedto beinstalled in the cell phone 20 as
`microphonesignal d1 with a first bi-directional pattern 41 as
`depicted in FIG. 3A or 31B.
`depicted in FIG. 4. Next, in step S3, the second and third
`[0034]
`Thefirst, second and third omni-directional micro-
`omni-directional microphones 22 and 23 are used to jointly
`output a second directional microphone signal d2 with a
`phones 21, 22 and 23 are arranged on acommonplanebut not
`second bi-directional pattern 42 as depicted in FIG.4. Also,
`in a commonline, for receiving sound.Here,thefirst to third
`the second and third omni-directional microphones 22 and 23
`omni-directional microphones 21, 22 and 23 are arranged in
`can be deemed to form a virtual second bi-directional micro-
`an L-shape as shown in FIG. 3A or in a triangular shape as
`shown in FIG. 3B.
`
`DETAILED DESCRIPTION OF INVENTION
`
`phone which outputs a second directional microphonesignal
`
`Samsung Exhibit 1010
`Page 17 of 21
`
`Samsung Exhibit 1010
`Page 17 of 21
`
`

`

`US 2008/0170716 Al
`
`Jul. 17, 2008
`
`Thefirst, second and third omni-directional micro-
`[0035]
`phones 101, 102, 103 and 104 are arranged on a common
`plane but not on acommonline to convert received soundinto
`phones 21, 22 and 23 receive sound and send received sound
`a first, second, third and fourth electrical signals. The first to
`to the microphonecalibration device 82 to carry out calibra-
`fourth omni-directional microphones 101 to 104 are arranged
`tion on gains and phases. Therefore, thefirst, second and third
`ona surface of a cell phone 100 in a square-shape as depicted
`omni-directional microphones (21, 22 and 23) receive and
`convert the received sound to a first, second andthird electri-
`in FIG. 10A or 10B. The arrangement can be extended to any
`other quadrilateral shape. (in step S12) Use the first and third
`cal signals X1, X2 and X3 in conjunction with the micro-
`
`phonecalibration device 82. omni-directional microphones 101 and 103 to formafirst
`bi-directional microphone which outputs a first directional
`[0036] The directional microphone forming device 84
`microphonesignal d1 with a first bi-directional pattern 41 as
`receives the first to third electrical signals X1, X2 and X3, to
`depicted in FIG. 4, or to jointly output the first directional
`the first and second omni-directional microphones 21 and 22
`microphonesignal d1. Next, (in step $13) use the second and
`formafirst bi-directional microphone which outputsafirst
`fourth omni-directional microphones 102 and 104 to form a
`directional microphonesignal d1 with a first bi-directional
`second bi-directional microphone which outputs a second
`pattern 41 (as shown in FIG. 4) and the second andthird
`directional microphonesignal d2 with a second bi-directional
`omni-directional microphones 22 and 23 form a secondbi-
`pattern 42 as depicted in FIG.4, or to jointly output the second
`directional microphone which outputs a second directional
`directional microphonesignal d2. Then,(In step $14)thefirst
`microphonesignal d2 with a secondbi-directional pattern 42
`and second directional microphone signals d1 and d2 are
`(as shownin FIG.4).
`combined to generate a combined directional microphone
`[0037]
`FIG. 9 shows an example of the directional micro-
`signal Z with a combined beam pattern correlatedto the first
`phone forming device 84. Thefirst, second andthirdelectrical
`and second bi-directional patterns 41 and 42 for noise sup-
`signals X1, X2 and X3are respectively sent to three phase
`pression.
`In this embodiment,
`the combined directional
`adjustment units 84a, 845 and 84c to perform phase shift p1
`microphonesignal Z is generated by linearly combining the
`to X1, p2 to X2 and p3 to X3 to obtain three phase shifted
`first and second directional microphone signals d1 and d2
`signals Xp1, Xp2 and Xp3. The phase shifted signal Xp2 is
`whichare digitalized signals, using a first and second weight
`then subtracted from the phase shifted signal Xp1 and the
`values a and , 1.e., Z=axd1+pxd2. Finally, (in step $15) the
`phase shifted signal Xp3 is subtracted from the phase shifted
`combined directional microphone signal Z are taken as a
`signal Xp2, thereby obtaining the first directional micro-
`reference channel signal, and one or the sum ofthefirst to
`phonesignals d1 and d2. The first and second bi-directional
`third electrical signals are taken as a main channel signal; and
`microphone can be formed byother sophisticated devices or
`methodsandis not limited to the described method.
`(in step S16) the main and reference channel signals are
`processed to suppress noise and to generate a clear voice
`signal with a cone beam pattern.
`[0042]
`FIG. 5 shows the combined(entire) beam pattern 50
`of the first and second bi-directional patterns 41 and 42 cor-
`responding to the combineddirectional microphonesignalZ.
`The proportion of a to B for combiningthe first and second
`directional microphone signals d1 and d2 can be used to
`ond directional microphonesignals d1 and d2 usingafirst and
`adjust the cancellation amount for the up and down direc-
`second weight values a and B such that the combined direc-
`tions. In FIG. 5, the proportion of the combinationis 1, i.e., a
`tional signal Z equals axd1+$xd2. In this embodiment, for
`and B equal 1, Z=d1+d2. Someapplications, however, require
`example a and £ are 1 to provide a combined beam pattern 50
`more flexibility rather than a narrow beam for obtaining a
`as shown in FIG. 5 to enhance noise suppression in up and
`down directions.
`clear audio signal. The proportion of a to B can be adjusted to
`achieve this purpose.
`[0043]
`FIG. 12 shows a small array microphone apparatus
`120 using the beam forming method described above. The
`small array microphone apparatus 120 comprisesa first, sec-
`ond,third and fourth omni-directional microphones (101, 102
`103 and 104), a microphonecalibration device 122, a direc-
`tional microphone forming device 124, a combining device
`126 and a noise suppression device 128. In this embodiment,
`the small array microphone apparatus 120 is assumed to be
`installedin the cell phone 120 as depictedin FIG. 10A or 10B.
`[0044]
`Thefirst, second, third and fourth omni-directional
`microphones 101, 102, 103 and 104 are arranged on a com-
`monplaneofthe cell phone 120 but not on a commonline, for
`receiving sound. Here, the first to fourth omni-directional
`microphones 101, 102, 103 and 104 are arranged in square-
`shape as shown in FIG. 10A or 10B.
`[0045]
`Thefirst, second, third and fourth omni-directional
`microphones101, 102, 103 and 104 receive sound and send
`received sound to the microphone calibration device 122 to
`carry out calibration on gains and phases. Thus, the first to
`fourth omni-directional microphones (101 to 104) receive
`and convert the received sound to a first, second, third and
`
`[0039] The noise suppression device 88 receives the com-
`bined directional microphonesignal d1 as a reference channel
`signal rl and one or the sum ofthe first to third electrical
`signals (X1 to X3) as a main channel signal m1 to output a
`clear audio signal Sc with a cone beam pattern. To choose X1,
`X2, X3 or the sum of X1 to X3 dependson practical applica-
`tion. Here, thefirst electrical signal X is input to the noise
`suppression device 86 to serve as the main channelsignal m1.
`[0040] The noise suppression device 88 may comprise an
`adaptive channel decoupling device 88a to receive thefirst
`and second directional microphone signals (d1, d2) and one
`or the sum ofthefirst to third electrical signals (here is X1) to
`generate the reference channelsignal r1 and the main channel
`signal m1. The noise suppression device 88 further comprises
`a suppression unit 885 receiving and processing the main
`channel signal m1 and the reference channel signal r1 to
`estimate and suppress all the noise from the main channel
`signal to output the clear audio signal Sc.
`[0041]
`FIG. 11 is a flowchart showing a beam forming
`method of small array microphone apparatus according to
`another embodimentof the invention. First, (in step $11) at
`least a first, second, third and third omni-directional micro-
`
`[0038] The combining device 86 receivesthe first and sec-
`ond directional microphone signals d1 and d2 and outputs a
`combined directional microphone signal Z with a combined
`beam pattern for noise suppression correlatedto the first and
`second bi-directional patterns 41 and 42. The combining
`device 86 carries out linear combination of the first and sec-
`
`Samsung Exhibit 1010
`Page 18 of 21
`
`Samsung Exhibit 1010
`Page 18 of 21
`
`

`

`US 2008/0170716 Al
`
`Jul. 17, 2008
`
`modifications and similar arrangements (as would be appar-
`ent to those skilled in the art). Therefore, the scope of the
`appended claims should be accorded the broadestinterpreta-
`tion so as to encompassall such modifications and similar
`arrangements.
`
`Whatis claimedis:
`
`fourth electrical signals X1, X2, X3 and X4 in conjunction
`with the microphone calibration device 122.
`[0046] The directional microphone forming device 124
`receives the first to fourth electrical signals X1, X2, X3 and
`X4, to the first and third omni-directional microphones 101
`and 103 form a first bi-directional microphone which outputs
`a first directional microphone signal d1 with a first bi-direc-
`1. A small array microphoneapparatus, comprising:
`tional pattern 41 (as shown in FIG. 4) and the second and
`at least a first, second and third omni-directional micro-
`fourth omni-directional microphones 102 and 104 form a
`phones, arranged on a commonplane but notin a line,
`second bi-directional microphone which outputs a second
`respectively converting received soundintoa first, sec-
`directional microphonesignal d2 with a second bi-directional
`ondandthird electrical signals;
`pattern 42 (as shown in FIG.4).
`a directional microphone forming device receiving thefirst
`[0047]
`FIG. 13 shows an exampleofthe directional micro-
`to third electrical signals, to makethe first and second
`phone forming device 124. Thefirst, second, third and fourth
`omni-directional microphones jointly output a first
`electrical signals X1, X2, X3 and X4are respectively sent to
`directional microphonesignal witha first bi-directional
`four phase adjustment units 124a@, 1246, 124c and 124d to
`pattern and make the second andthird omni-directional
`perform phaseshift p1 to X1, p2 to X2, p3 to X3 and p4 to X4
`microphonesjointly output a seconddirectional micro-
`to get four phase shifted signals Xp1, Xp2, Xp3 and Xp4.
`phonesignal with a secondbi-directional pattern; and
`Then, the phase shifted signal Xp3 is subtracted from the
`a combining device receiving the first and second direc-
`phase shifted signal Xp1 andthe phase shifted signal Xp4is
`tional microphone signals and outputting a combined
`subtracted from the phase shifted signal Xp2, thereby obtain-
`directional microphone signal with a combined beam
`ing the first directional microphone signals dl and d2. The
`pattern correlated to the first and second bi-directional
`first and second bi-directional microphone can be formed by
`patterns for noise suppression.
`other sophisticated devices or methods, not limited to this.
`2. The small array microphone apparatus as claimed in
`[0048] The combining device 126 receives the first and
`claim 1, wherein the first to third omni-directional micro-
`second directional microphonesignals d1 and d2 and outputs
`phones are approximately arranged in an L-shape.
`acombineddirectional microphonesignal Z with a combined
`3. The small array microphone apparatus as claimed in
`beam pattern for noise suppression correlatedto the first and
`claim 2, wherein thefirst bi-directional pattern comprises two
`second bi-directional patterns 41 and 42. The combining
`device 126 carries out linear combination to the first and
`lobes inafirst line, the two lobes thereofrespectively pointing
`to the left and rightin thefirst line, and the second bi-direc-
`second directional microphonesignals d1 and d2 usingafirst
`tional pattern comprises two lobes in a second line substan-
`and second weight values a and 6 such that the combined
`tially perpendicular to the first line, the two lobes thereof
`directional signal Z equals axd1+Pxd2. In this embodiment,
`respectively pointing to the left and right in the secondline.
`for example a and f are 1 to provide a combined beam pattern
`4. The small array microphone apparatus as claimed in
`50 as shownin FIG.5 to enhance noise suppression in up and
`down directions.
`claim 1, wherein the combining device carries out linear
`combination to the first and second directional microphone
`signals using a first and second weight value.
`5. The small array microphone apparatus as claimed in
`claim 1, further comprising a noise suppression device receiv-
`ing the combined directional microphonesignalas a refer-
`ence channel signal and one or the sum ofthe first to third
`electrical signals as a main channel signal to output a clear
`voice signal with a cone beam pattern.
`6. The small array microphone apparatus as claimed in
`claim 5, wherein the noise suppression device comprises an
`adaptive channel decoupling device receiving the first and
`second directional microphone signals and oneor the sum of
`the first to third electrical signals to generate the reference
`channel signal the main channelsignal.
`7. The small array microphone apparatus as claimed in
`claim 6, wherein the noise suppression device further com-
`prises a suppression unit receiving the main channelsignal
`and the reference channel signal to estimate an entire noise
`and suppress the entire noise from the main channel signal to
`output the clear voice signal.
`8. The small array microphone apparatus as claimed in
`claim 1