As a result, these benchmarks have been given the label across the industry as "inaccurate or inappropriate benchmarks" that don’t accurately represent a user’s experience.
Many of them simply load up all of the cores to their maximum frequency, which phones never operate at other than benchmarks. These benchmarks are simply run to see the fastest theoretical performance that the system could be tested at, without regard to battery life, operating systems, applications or real world use cases. Some of these benchmarks and the people who use them in reviews have been responsible for proliferating the 8-core myth, too. Most importantly, it impacts consumers and I'll give examples why. It also impacts handset makers like Apple, HTC, Lenovo-Motorola, LG, Sony and Samsung Electronics and the decisions they make. This impacts companies like chipmakers or chip designers Apple, ARM Holdings, Huawei, Intel, MediaTek, NVIDIA, Qualcomm and Samsung Electronics. Over the course of the past few years, there has been a proliferation of inappropriate or misunderstood benchmarks in the mobile world, and those benchmarks serve to do nothing other than help users generate a single number, a benchmark score, that is supposed to quantify the performance and by proxy, the experience of that device. There are hybrids as well, like manufacturer-led consortiums, too. Benchmarks cycle between manufacturer, consortium, benchmark company and industry standard- led formations. Benchmarks have been on a cyclical nature for years and the cycle is fairly predictable. I have been in and around the benchmarking and benchmarketing scene for 25 years in the PC, server, and now smartphone and tablet markets.