Obi_Uno

Hello,

Thanks for taking the time to share what you would like to see added! There is definitely room for us to expand on the air quality aspect and measure particle count during operation for example. While we do not have any immediate plan to expand on this, your request is noted and we will definitely consider it in the future.

Hi neercs, there is no news to report on that front since last time. Rest assure that it is still on our radar and we know that the test is important to some of you. With the different priorities in the audio team at the moment, we didn’t get the chance to progress on this test as of now.

Hi Eiglow_, thanks for the feedback. Our battery test is definitely on our radar and near the top of our list for future improvement.

• Playback time per time charged could be an interesting metric, although it might get tricky if the time charged per playback time is not linear from 0 to 100% battery, but I understand what you would like to see based on this suggestion and we’ll see what could end up be clear and comparable.
• Our score definitely seems to have a low bar with the constant improvements made on that front since we launched the test. We will adjust it in our next iteration, but louder volume could also be considered to highlight the strength of those larger speakers.

I’ve compiled your ideas in our list of suggestions and we’ll definitely consider implementing something in line with your expectations in future iteration of this test. Thanks for reaching out!

Hi Reerden,

While we do not currently have plans to test video latency for a 120Hz signal that is passed through a soundbar, from what we measured in this article, the video passthrough capability of a soundbar does not add latency to the video stream. You can expect the same video lag as if you connected your console directly to a TV. In other words, if a TV offer 5ms video latency with 120Hz, it is safe to assume that a soundbar with 120Hz passthrough capabilities would still offer a video Latency of 5ms when connected to this TV.

Of course this will add a slightly larger delay between audio and video if the video stream comes even earlier, but the added delay would be negligeable considering that the A/V sync error is in most cases mostly due to audio delay and not video delay.

Hi Moonsammy,

Thanks for reaching out. In order to highlight the strength of workshop robot vacuums, our current test coverage could definitely be expanded to better cover even larger debris pick-up. I’ve taken note of your request, although we do not currently have plans to add this test in the future. Rest assured that if we were to review the Makita, we would go the extra mile to provide detailed information on its capabilities that fall outside of our current test bench, including large debris clogging. Again, thanks for sharing what you would like to see, this definitely helps us set priorities for future improvements!

Hi CheneyQWER,

Thanks for reaching out with what you would like to see added! You’re right, the first iteration of our air purifier test bench is focused around CADR and final particle concentration. While this test coverage is a good start we are aware that there is a lot of expansion possible to make our reviews even more in depth. Since we want to improve them over time, I’ve taken note of your suggestions and we will definitely consider them once we start expanding our air purifier reviews. Thanks again for reaching out and do not hesitate if you have other suggestions you would like to see added.

Hi Dolphinado,

Thanks for sharing your experience and suggestion. While we will mention when lids are hard to remove in the build quality and, in this case, the lid section of our reviews it is true that the jar usability is not playing a significant role in the final scores of our reviews. We will keep an eye out for other jar usability issue and consider adding a dedicated test/evaluation for this. Thanks again and do not hesitate if you have any other suggestions!

Hi amargarit,

While we do not currently plan to add a test for this in the near future, I’ve taken note of your idea and we will consider implementing it in the future. This is not something I had on my radar and we will look into the benefit of such feature. Thanks for reaching out and do not hesitate if you have any other comments or feedback!

Hi neercs,

Like mentioned in the other post, a headphone temperature/breathability test rework is planned to be worked on in 2025. To make sure we have accurate and repeatable data it is more productive for us to revisit this test from zero instead of focusing on fixing issues with our current setup. This new approach will ensure we consider properly the accuracy and uncertainty of infrared camera. Thanks for the suggestion we will look into it!

Hi neercs,

Like mentioned in the other post, a headphone temperature/breathability test rework is planned to be worked on in 2025. To make sure we have accurate and repeatable data it is more productive for us to revisit this test from zero instead of focusing on fixing issues with our current setup. This new approach will ensure we consider properly the accuracy and uncertainty of infrared camera. Thanks for reaching out and for the great information!

Hi neercs,

While I can’t promise any specific dates, a headphone temperature/breathability test rework is planned to be worked on in 2025. To make sure we have accurate and repeatable data it is more productive for us to revisit this test from zero instead of focusing on fixing issues with our current setup.

As for our in-ear microphone, we are currently using the soundprofessionals MS-TFB-2 but are currently in the process of implementing the MS-TFB-2-Mark2 for better ear protection of our volunteers.

Thanks for reaching out!

Hi Nyarlathotep, We currently only test for Bluetooth speakers and we do not have a clear timeline just yet to add bookshelf speakers, but there is a non zero chance of us starting to work on this product category in 2025. In the meantime, do not hesitate to share what you would like to see tested from us for this product category. Thanks for reaching out!

Bonjour PauldeMontreal,

Merci de partager avec nous ce que vous souhaitez voir testé plus en profondeur. Nous avions envisagé couvrir cet aspect, mais les matériaux utilisés dans tous les Air Fryers sont très similaires, même dans les modèles plus dispendieux.

Selon nos recherches et produits testés, la chambre de cuisson est très souvent composée de métal, avec un revêtement extérieur et des poignées faites de plastique.

Il existe des modèles avec une chambre de cuisson en verre, mais la partie supérieure de ces modèles est également faite de plastique. Par ailleurs, plusieurs Air Fryers de la marque Ninja possèdent un type de revêtement intérieur en céramique, tandis que la plupart des autres modèles sur le marché utilisent un revêtement en PTFE, qui pourrait contribuer à la toxicité.

Si la toxicité des appareils de cuisson en plastique est une préoccupation majeure, nous recommandons de considérer un four grille-pain avec fonction Air Fryer. Nous sommes activement en train de développer notre banc de tests pour ces produits!

Merci encore et n'hésitez surtout pas si vous avez des idées pour addresser cet aspect convenablement.

Hi SCP-343,

We do not have a clear timeline just yet, but there is a non zero chance of us starting to work on this product category in 2025. In the meantime, do not hesitate to share what you would like to see tested from us for this product category. Thanks for reaching out!

Hi eldakka,

You can now find what you are looking for in our soundbars reviews. The test is called HDMI 2.1 Class bandwidth. Here is a table with all the soundbars we’ve tested that support HDMI 2.1

Hi Berg22, thanks for taking the time to share your issue and suggestion with us. While I can’t promise we will be able to cover or provide interference warnings with specific bars in the near future, this is definitely something we can keep an eye on moving forward and maybe investigate what make some Soundbars more at risk of interference. If you have any additional details that could help us dive deeper into this issue, feel free to share them with us!

Hi Matigag, thanks for taking the time to share what you would like to see added in our reviews. I’ve taken note of your suggestion and we will definitely consider it in our future speaker improvements as Codec support is definitely something I could see more people interested in.

Hi Tim1992, the difference between the score and what is shown in the graph can be explained by the fact that we measure phase mismatch across 5 different passes. In the case of the Razer Kraken V3 X, the Phase mismatch we measured was very inconsistent across passes. 2 of our 5 passes had acceptable phase matching while the 3 other passes had very high phase mismatch. This results in a very high average phase mismatch. The issue you’ve identified comes from the fact that the graph is only showing 1 of the 5 passes and the one that is displayed in the review is coming from a good phase mismatch pass.

Thanks for flagging this discrepancy. we definitely do not want our results to not match the graphs we are providing so I’ve taken note of this example to improve our approach to this specific case in a future update.

Thanks for reaching out! I’ve taken note of you suggestion and while I cannot give any specific time frame, we will consider it for future improvements.

Jul 16, 2024 03:20 PM By lexxy

4

The old format of noise cancelling sound samples you provided was better than the new one. The old one have had all environments in one file. The new files are so quiet, you must turn the volume knob of amplifier to 100% to hear anything. Also no comparision is possible to the older headphones. And the old sound files were accessable from the big noise cancelling table directly, to switch A/B fastly.

Hi lexxy,

Thank you for your feedback. Our updated ANC test is not intended to be A/B testing, but we are always open to suggestions that can improve our tests. To give a bit more context, our previous ANC noise sample where simulated samples that were reducing the frequencies of an audio sample based on the measurement done with sine sweeps. Our new audio sample are recorded using multi-channel real life recording that are closer to the real experience which can lead to very quiet samples when the headphone attenuates a lot. We are hard at work to bring recent and popular headphones to this new test methodology to be able to compare more and more headphones with this updated methodology. Sound sample should be accessible in our table tool to quickly compare, but let us know if you have any details about the issue. We would be happy to help!

Hi Tim1992, Thanks for reaching out. Let me investigate this specific comparison and come back to you with more information. I agree that the graph do not seem to justify the Phase mismatch score of 0 of the Razer Kraken V3 X.

Hi, We do not have immediate plans to update the methodology of speaker latency with the methodology used for headphones, but we are definitely not against it if there is enough interest for it. Is there any specific use cases you have in mind that could benefit from this improved test?

Hey Matigag,

We currently already test in an indoor environment. Is there anything specific you would like to see tested indoors? Thanks for reaching out!

Hi iopq, One of the benefit of combining both of those headphone design in the same category of product is to better highlight the compromises that are being made when choosing one design over the other. While more knowledgeable people might fully be aware of the pros and cons of each design, someone that is only looking for a new pair of headphones might benefit from seeing what he his sacrificing on and whether he would benefit from considering different pair for different uses. I hope this help understand our reasoning and do not hesitate if you have any potential ideas to improve our approach!

Hi rufus210,

Thanks for reaching out. It could definitely be interesting to compare headphone noise isolation to standard earplugs/earmuff in our graph tool. If you are not yet aware we have written an article that compares the performance of noise isolation of modern ANC headphones to earmuffs that you could find interesting. I’ve taken note of your suggestion and we will look into what can be done to provide some sort of comparisons to earplugs/earmuffs.

Thanks again for taking the time to share what you would like to see!

Jun 17, 2024 08:03 PM By RtingsUser8718904

18

I stumbled upon 990c WiFi connection to my samsung qn 90c and am surprised how little information is available on it in general. It seems to work fine and it is clearly the future as both Dolby and dts are working on it. I hope rtings will introduce a separate test item on this soon as manufacturers such as Samsung and LG are very vague on exactly how good the connection is, such as lossless/lossy quality vs hdmi. Atoms is now advertised as possible thru WiFi connection to recent year same brand tv, but 990c only shows WiFi on display without indicating exact format as hdmi connection does. Some objective test results would be welcome.

Hi RtingsUser8718904,

While we do not currently test features that require multiple part of an ecosystem, I can definitely understand the benefit of knowing more about the added value and limitation of committing to one. Although I cannot say when this could be considered, I’ve taken note of your suggestion and we will consider expanding on this aspect in the future. Thanks for taking the time to share what you would like to see added!

Hi Clip, while we do not currently plan to test brand specific features that require a complete ecosystem, this could be something we would be open to test if a specific feature generate a lot of curiosity from the community. I’m taking note of your suggestion, but do not hesitate to let us know what you would like to learn or see tested with this specific feature.

Hi Baldemy, thanks for reaching out. Adding wind conditions to our noise handling test is definitely an interesting idea. We’ve recently implemented a test that evaluate the sensitivity of the ANC when there is wind and adding a similar test for the main microphone could be an interesting addition. While I can’t promise any timeline, I’ve taken note of your feedback and we’ll make sure to consider it for future improvements. Thanks again!

Hi DreSand, Thanks for taking the time to share what you would like to see, Improving our evaluation of the surround and height experience is something we have on our radar and virtual surround, for some soundbars are definitely playing a role in improving the immersion. While I cannot provide any timeframe, this is something we are open to look into. Thanks again and do not hesitate if you have any additional details you would like to see related or unrelated to this aspect.

Apr 12, 2024 07:35 PM By Belsuonox

3

breathability?

Hey Belsuonox,

Our breathability test rig has been providing inconsistent results for a while and we currently do not feel comfortable publishing results with it. We are aware of the interest of such test results and while we are currently working on other improvements to provide better headphone reviews, we do plan to address this test in the future. At this time, I cannot confirm that we will be able to provide breathability measurements in the near future. Thanks for reaching out!

Hi senseivita,

Thanks for taking the time to share with us what you would like to see added to our review. We can definitely consider adding more details about the specifics around the app. While we currently do not have plan to adapt the score based on this information as of now, I’ve taken note of your suggestion as well as your request to look for usability while being charged. Thanks again!

Hi AROD,

Thanks for reaching out. Dynamic range of headphone could definitely be worth looking into, I’ve taken note of your idea and we’ll keep it in mind as we continue to look into different ways of improving our headphone reviews. Thanks again and do not hesitate if you have any other suggestions!

Hi farticus,

Testing for dust is definitely something we could consider in the future and I’ve taken note of your idea. Thanks for taking the time to reach out with what you would like to see covered!

Hi FriendlyAudio,

Thanks for taking the time to reach out to us. I can definitely see the benefit of making available .csv files of our results. While we do not have any immediate plan to include such feature, we do plan to improve our graphs tool with new features in the future that would also fix curves being cut off. I’ve taken note of the interest, and we’ll definitely consider adding something like this in the future. If you have any other improvements you would like to see, do not hesitate to reach out again!

Hi flygineer,

Thanks for taking the time to reach out. Adding wired latency in our speakers review is definitely something we could consider adding in the future. I’ve taken note of your suggestions and we’ll consider it. Do not hesitate if you have any other suggestions!

Hi,

Thanks for taking the time to reach out to us. Improving our evaluation of the microphone and the noise suppressions features is definitely something we want to tackle in upcoming improvements to our headphone review. Feel free to reach out again If you have any other suggestions or specific improvements you would like to see!

Hi DreSand,

You’re right, we currently do not evaluate the capabilities of the virtual surround features. In the future, we definitely plan to expand our methodology and evaluation of the surround/ height experience offered by soundbars. Evaluating the virtual surround features might definitely be worth covering either objectively or subjectively and is not off the table for future improvements at this time. Thanks for taking the time to reach out with what you would like to see added. This definitely help plan our future improvements.

Hi machnone,

Thanks for reaching out. Improving how we evaluate microphone quality is definitely something we want to tackle in multiple ways in the future and I can definitely understand why it would be hard to find which headphones provide a microphone that allow for natural and clear voice. I’ve taken note of your feedback and do not hesitate if you have any other feedback about this!

Hi ssss,

Thanks for reaching out, we’ll definitely consider adding earpads measurements in the future. Do not hesitate if you have any other ideas!

The 10kHz notch is caused by phase cancellation at the concha (Part of the outer ear). A direct and noticeable impact of the sound interacting with the outer ear.

Hi ccastell, it would definitely be interesting to look more into the longevity aspect of batteries. The challenges with those kind of tests is the time required on our end to perform multiple charges and discharges cycle for a long period before being able to publish a review, but I have written down your suggestion for future consideration in the case where such test results grows in interest. Thanks again for taking the time to share your ideas and do not hesitate if you have any other suggestions!

Thanks for reaching out! We definitely want to improve our methodology when it comes down to the maneuverability of the vacuums. Diving more in depth on the subject of obstacle avoidance and the capabilities of the vacuum to traverse all kind of common obstacles is definitely one of our priorities for future improvements to our vacuum reviews. If you have any example of obstacles you think would be helpful to cover beside cords, please let us know!

Hi Matigag,

Thanks for reaching out. While our current test methodology would not be suitable for those type of speakers, I’ve taken note of your suggestions and we will definitely keep ceiling speakers in mind when we’ll lay out our plan to expand our speakers product coverage. Thanks again and do not hesitate if you have other suggestions!

Hi Taci,

Thanks for reaching out! Adding harmonic distortion and multitone distortion measurements is definitely something we will consider adding for future improvements to our reviews. If you have any other suggestions or things you would like to see added to our speaker reviews do not hesitate to reach out again.

As you can see in our PRTF Measurement done in the article, the pinna doesn’t impact the frequency below 1khz by much and only have significant impact starting at 2kHz.

Jan 29, 2024 01:00 PM By Jadegrsx

110

Can anyone explain why the scores for this soundbar just recently changed and went down on this site?

Hi Jadegrsx,

We’ve recently launched our new soundbar test bench update 1.3 that led us to retest multiple aspects on multiple soundbars like stereo frequency response, stereo dynamics and audio Latency. Since the changes implemented in this update directly impact the results, some scores have been readjusted on multiple soundbars.

Hi RobotOverlord,

Thanks for taking the time to reach out to us about what you would like us to cover in the future. Repairability, longevity and warranty are definitely aspects we are aware a lot of consumers are weighting in their purchasing decision.

As we speak, we do not have straightforward solutions that could be easily implemented in our review process to cover those aspects thoroughly. For example, while our current ongoing longevity test of for TV can be used to identify the most common failure of those products, having only one of each unit is not enough to create solid conclusions on a specific model or brand. Of course, identifying the most common point of failure is already something valuable we can bring with this test and we are not closed to the idea of expanding this concept to other products we tested.

Warranty is also a tricky one. A longer number of year on a warranty is not an indication of a better warranty due to all the different condition they may require or whether the seller/manufacturer will respect their warranty or not over the years. Country/region differences would be important to keep in mind also.

Repairability is definitely something we could explore in the future since potential solutions varies a lot in terms of complexity and depth (from looking at the availability of parts on a manufacturer website to fully document and evaluate the repairing process of a product), but we would need to find the right balance to make sure those extra tests and research would have a positive impact on the final buying decision of the consumer.

To be clear, I’m not exposing those limitations to dismiss the idea of covering those topics, but to expose the challenges associated with the implementation of such tests so that we can gather interesting ideas and feedback about those important subjects. we are also following closely different initiative like the reparability index from the French government to see how it perform and if it is something that we can learn from. If you have any ideas, opinions and recommendations on how you would like us to cover those aspects do not hesitate!

Hi LeoT,

Sorry to hear about this. You’re right, at this time we do not cover the durability of products passed the regular maintenance required on the vacuum. I’ve taken note of your suggestion to allow end user review about those topics, but in the meantime, using our forums like you just did is the best way to make us and other aware of those durability issues. Thanks for taking the time to share your experience with this product with us.

Hi, Thanks for reaching out. I just want to start out to mention that we are definitely aware of this limitation in our measurement and we would like to eliminate it in future update. While we have nothing to share at this time, the acquisition of a Klippel Near Field Scanner System is something we have on our radar, but we are definitely open to any other kind of feedback about this limitation. As for Total harmonic Distortion measurements, this is definitely not off the table for future addition to our reviews. Thanks again for taking the time to share your concerns and do not hesitate for any other questions or comments on this subject.

Hey LadyAlphecca,

Yes, a flat frequency response measured without pinna would be different when measured with the pinna.

Knowing the “with pinna” frequency response of an headphone with a flat response when measured without Pinna would be difficult. This is one of the reason the industry is using head simulator when measuring headphone frequency response and why a lot of research as been made to accurately represent the ear canal and outer ear on those devices.

If a flat response is what someone would consider ideal for them then yes the frequency response measurement they should look at should come from a measurement that used a head simulator with a pinna to be truly helpful in their selection process. All of our headphones sound Profile measurements are done with a pinna to account for this.