What are you going on about? I’m so confused about your rant

Hello Xii-Nyth, and thank you for all the feedback. I’m the Test Dev who designed the scoring for monitor test bench 1.1 and the soon-to-be-released monitor test bench 1.2. I’m also currently working on our TV scoring that will be updated in the near future.

User feedback is the core to many of the changes we make, and you’ve provided a lot of it here, which is much appreciated. I’ll make sure to consider this feedback for the TV scoring I’m currently working on. In the meantime, I’ll try to address all of the points you’ve brought up.

There’s definitely flaws in our current scoring, which many users have pointed out since test bench 1.6 launched, and we hope to address many of these flaws in the coming updates. As you mentioned, it can result in some TVs scoring higher or lower than they should.

The Hisense H9G is particularly tricky, because it excels in some areas, but also has some pretty big weaknesses that we may not be accounting for in our scoring. In this sense, the H9G can kind of “game” the score, because it performs well in many of the areas we test. Generally, we try to test aspects of TVs that users care about, so if a TV scores well in our testing, then it should reflect how users feel about it. However, there could be flaws or gaps in our testing that may not account for aspects that users care about.

According to our measurements, the H9G only really performs worst than the X85J and the M7 Quantum for pre-calibration accuracy. For everything else we test, it either outperforms the other 2 TVs or scores similarly well. But as you brought up, we aren’t accounting for things like 120Hz support, which is becoming increasingly important to users. Also, our current scoring for BFI only looks at the supported refresh rates, and not the actual performance of the BFI. So even though the X85J has more square-like strobing, it scores worst than the H9G because it can’t do BFI at 60Hz. We will be addressing both of these issues in the coming updates.

Similar to BFI, you also brought up the point that we don’t account for image processing capabilities. We’re aware of this and we’re working on addressing it. In the coming updates, we plan on doing more thorough testing of motion interpolation and gradient processing. Hopefully then the strengths of the Sony can be more apparent.

Lastly, it’s difficult to account for things such as user interface (UI), since that can come down to personal taste, and most TVs have generally good performance in this area. Likewise, long term reliability is something we can’t test for, since it’d require buying multiple units and testing all of them long term, which we don’t have the resources to do. We are aware that certain brands have notorious reliability issues, and we do our best to point that out in the written text, but there’s no easy approach at the moment to account for this in the scoring.

Although our new scoring isn’t final, the X85J and the H9G do score much closer to each other, as the Sony went up in score and the Hisense went down in score. We hope that this new score is more representative of user experience and user feedback.

Thank you again, and if you have any more questions, please feel free to let me know. 🙂

Apr 05, 2022 10:16 AM By  Brandon Dickerson

Hello Xii-Nyth, and thank you for all the feedback. I’m the Test Dev who designed the scoring for monitor test bench 1.1 and the soon-to-be-released monitor test bench 1.2. I’m also currently working on our TV scoring that will be updated in the near future. User feedback is the core to many of the changes we make, and you’ve provided a lot of it here, which is much appreciated. I’ll make sure to consider this feedback for the TV scoring I’m currently working on. In the meantime, I’ll try to address all of the points you’ve brought up. There’s definitely flaws in our current scoring, which many users have pointed out since test bench 1.6 launched, and we hope to address many of these flaws in the coming updates. As you mentioned, it can result in some TVs scoring higher or lower than they should. The Hisense H9G is particularly tricky, because it excels in some areas, but also has some pretty big weaknesses that we may not be accounting for in our scoring. In this sense, the H9G can kind of “game” the score, because it performs well in many of the areas we test. Generally, we try to test aspects of TVs that users care about, so if a TV scores well in our testing, then it should reflect how users feel about it. However, there could be flaws or gaps in our testing that may not account for aspects that users care about. According to our measurements, the H9G only really performs worst than the X85J and the M7 Quantum for pre-calibration accuracy. For everything else we test, it either outperforms the other 2 TVs or scores similarly well. But as you brought up, we aren’t accounting for things like 120Hz support, which is becoming increasingly important to users. Also, our current scoring for BFI only looks at the supported refresh rates, and not the actual performance of the BFI. So even though the X85J has more square-like strobing, it scores worst than the H9G because it can’t do BFI at 60Hz. We will be addressing both of these issues in the coming updates. Similar to BFI, you also brought up the point that we don’t account for image processing capabilities. We’re aware of this and we’re working on addressing it. In the coming updates, we plan on doing more thorough testing of motion interpolation and gradient processing. Hopefully then the strengths of the Sony can be more apparent. Lastly, it’s difficult to account for things such as user interface (UI), since that can come down to personal taste, and most TVs have generally good performance in this area. Likewise, long term reliability is something we can’t test for, since it’d require buying multiple units and testing all of them long term, which we don’t have the resources to do. We are aware that certain brands have notorious reliability issues, and we do our best to point that out in the written text, but there’s no easy approach at the moment to account for this in the scoring. Although our new scoring isn’t final, the X85J and the H9G do score much closer to each other, as the Sony went up in score and the Hisense went down in score. We hope that this new score is more representative of user experience and user feedback. Thank you again, and if you have any more questions, please feel free to let me know. 🙂

Yeah, sorry if I wasn’t being particularly helpful as to thinking of actual solutions. As for the backlight which I was particularly concerned about, theres really no good way to test long term effects, and no way to do so with the initial review without time travel. Maybe some type of brand credibility score could be implemented? That could also apply to other things such as sony’s tvs often not having certain features working on launch and receiving firmware updates to fix them later.

Apr 05, 2022 10:02 AM By CFRTim

27

What are you going on about? I’m so confused about your rant

ah sorry not really concise about anything here, and some of it is entirely speculatory as theres no way to know the real cause of the backlight failing on some people’s tvs. The leds might handle the power fine and theres a zener diode that dies, causing the leds to receive triple the voltage or something