Get insider access
Preferred store
Your browser is not supported or outdated so some features of the site might not be available.
We've recently released our Test Bench 1.8 update for Headphones! Read the R&D Article to learn more about our new direction. As we ramp up and retest products, expect delays in testing new and updating preexisting reviews. Sorry for the inconvenience and thank you for your patience!

Frequency Response Consistency

Updated
What it is: The amount of deviation of each frequency response pass, from the average frequency response.
When it matters: Shows how consistently the headphones perform after re-positioning them.
Score components:
Score distribution

Frequency Response Consistency describes the variations in a headphones' frequency response due to their fit on your head. Headphones will sound slightly different depending on the size and shape of your head, how they interact with your ears and whether you wear glasses.

Frequency response is the most important part of good audio reproduction. So although most listeners naturally compensate for variations in frequency response caused by their unique features, such as the shape and size of their heads, other factors like their preferred headphone position, and how the ear cups' acoustics interact with their ears may cause additional variations in the response. An inconsistent headphone may have a drastically different sound from listener to listener. This means a headphone that will sound bass-heavy for most could lack a lot of bass for listeners who wear glasses. The ideal headphone should consistently reproduce the same response whether open or closed-back and regardless of positioning or head/ear shape.

We evaluate the consistency of the frequency response of our over/on-ear headphones by measuring them 5 times on the HMS (Head Measurement System) and 5 times on 5 human subjects. For in-ears, we measure them 5 times only on the HMS. We then calculate the deviation of each response compared to the average frequency response.

Test results

When it matters

Frequency Response Consistency is important if you're a critical listener who wants the most accurate listening experience from your headphones. Bass and treble are often dependent on how the headphones interact with your unique features. Therefore, some headphones will sound drastically different, especially in the bass range, from listener to listener. Typically, inconsistency is more an issue for closed-back models due to the ear cups' acoustics being strongly affected by the quality of the seal they create around your ears.

The ideal headphones should have the same frequency response regardless of head size or ear shape, but depending on the use case, it may not be as significant. For example, sports headphones may not need to be as consistent as critical listening headphones.

Our Tests

Average Standard Deviation

What it is: The average amount of deviation in frequency response of five re-seats, from the average frequency response.
When it matters: Shows how consistently the headphones perform after re-positioning them.
Good value: <0.5
Noticeable difference: 0.1
Score distribution

Since variations in positioning preference and head/ear shape have a significant impact on the measured frequency response of headphones, and also because of the consistency and reliability issues with the HMS, we decided to measure the low-end of our over/on-ear headphones on 5 human subjects, 5 times each. And the result of those 25 measurements will be averaged-out to get the final bass response. Since for in-ears, we don't have the ability to measure them on humans, we only do 5 re-seats on our HMS instead.

The human measurements are performed using a pair of blocked ear canal (BEM) microphones. Since these microphones don't have the same frequency response as the ear simulator inside the HMS, we have calibrated our mics against the ear simulator of our HMS so that they perform the same.

Pre-calibration
Sennheiser HD 800 S | Red: HMS, Green: BEM on HMS

Post-calibration
Sennheiser HD 800 S | Red: HMS, Green: BEM on HMS

For over/on-ear headphones, we merge the results of human measurements and HMS measurements by crossfading between them from 350Hz-450Hz. Below 350Hz, we only use human subject results and above 450Hz, only the HMS results. This is done in two steps: level matching and crossfading. During level-matching, the level of the human measurements is matched to the HMS measurement, and over the crossfading range, the human measurements are slowly faded out as being replaced by the HMS measurement.

  • We level-match the human/HMS measurements where their measurements meet, which is always limited to somewhere between 200Hz-900Hz depending on the leakage/HRTF interaction of headphones (open and deep cups do it closer to 200Hz, shallow and closed cups tend to do it a bit higher).
  • The crossfading is always done from 350Hz-450Hz since we have noticed HRTF variances start to creep in above 450Hz (at the moment we only have the HRTF information of the HMS and not our humans subjects).

Average Standard Deviation is calculated by comparing the difference between each frequency response pass, against the average of all passes.

Additional Information

A number of factors influence the measured frequency response of a headphone on a human subject. The main 3 that we have encountered so far are:

  • Head shape/size
  • Hair length/hairstyle
  • If the subject wears glasses, the shape/size of their glasses.

Note that the influence of these factors decreases on open-back headphones since compared to closed-back variants, they don't rely on fit/seal as much for creating their bass.

We noticed that humans with bigger/wider heads tend to get more bass:

frequency response on Philips SHP9500

Philips SHP9500 (Open-back)
Black: HMS | Colored: 2 Humans (each cluster is one subject)

frequency response on Audio Technica M50x

Audio Technica M50x (Closed-back)
Black: HMS | Colored: 5 Humans

Hair length and hairstyle also affects the measured bass response of headphones. We have noticed that women tend to measure less bass, especially on closed-back headphones, probably because they usually have longer hair.

Frequency response consistency on closed back headphones - male vs female subject

Sennheiser 598Cs (Closed-back)
Black: HMS | Blue: Male Subject | Red: Female Subject

Frequency response consistency on open back headphones - male vs female subject

Sennheiser 599 (Open-back)
Black: HMS | Blue: Male Subject | Red: Female Subject

We also noticed that different glasses affect the frequency response differently. Glasses with arms that were not flush to the temple (probably on skinnier humans), tend to break the seal and cause a big drop in bass. Again, this effect is much smaller with open-back headphones.

frequency response on open-back headphones: with glasses vs without glasses

Sennheiser RS 185 (Open-back)
Black: HMS | Blue: Male1 with no glasses | Red: Male2 with glasses

frequency response on closed-back headphones: with glasses vs without glasses

Sennheiser RS195 (Closed-back)
Black: HMS | Blue: Male1 with no glasses | Red: Male2 with glasses

For more information, check out our video on measurement inconsistencies and target curves: