Published: Sun, September 09, 2018
Electronics | By Shannon Stone

Huawei & UL Benchmarks Issues Joint Statement

Huawei & UL Benchmarks Issues Joint Statement

Team 3DMark app for tablets and phones has removed a new phone from your list of the best smartphones after AnandTech found that the manufacturer manipulating the test results.

As a result of their benchmarking tests, UL has chose to blacklist Huawei's devices, specifically the P20, P20 Pro, Nova 3, and the Honor Play.

On the heels of an in-depth analysis at Anandtech, UL Benchmarks (formerly Futuremark) has delisted Huawei's P20, P20 Pro, Nova 3, and Honor Play devices from its public 3DMark Sling Shot Extreme benchmark database. The models that were found to be trying to fool the system and failing at it were P20, P20 Pro, Nova 3 and Honor Play. However, in an impromptu interview with AnandTech at IFA 2018, Dr. Wang Chenglu, Huawei's President of Software, admitted, "Others do the same testing, get high scores, and Huawei can not stay silent".

Huawei has deceived the expectations of users.

There's still no direct admission from Huawei that it had meant to deliberately cheat the benchmarking test, but using AI to to optimise resource allocation in that way could be considered cheating from a certain point of view. However, testing done by UL shows that a private version of 3DMark application experienced no such spikes in performance, throwing shade over Huawei's claims of using an AI that is smart enough to recognize hardware usage to tweak performance automatically. UL rules require the device to run the benchmark as if it were any other application.

Huawei has admitted to using AI to increase their performance based on certain intensive tasks which might explain how the benchmarking app experienced artificially increased performance.

Funnily enough, Huawei - who have in the past made a big deal about the AI capabilities of its handsets - tried to spin it as a positive, telling us in a statement that the phone will "intelligently" switch to a high-performance mode when it detects a benchmarking app.

Huawei respects consumers' right to choose what to do with their devices. This is not what the folks at UL (the makers of 3D Mark) want to happen with their benchmark test. Therefore, Huawei will provide users with open access to "Performance Mode" in EMUI 9.0, so that the user can choose when to use the maximum power of their device. Huawei smartphones use advanced technologies such as AI to optimize the performance of hardware, including the CPU, GPU and NPU.

In a statement to Android Authority, Huawei said its phones are created to adjust their performance based on the app that's running.

Like this: