Three Rounds of Questioning Expose AI's "Double Standards": Evidence Collection Details in the Honor Case Revealed
From "Software Lagging Behind" to Acknowledging Improvements: Dialogue Records Reveal the Full Process of AI Bias Correction
- •AAU has disclosed an eight-round dialogue record with an AI model, demonstrating how persistent questioning forced the AI to shift from one-sided negative evaluations to acknowledging Honor's progress. The evidence shows that the AI's initial response cited outdated commentary, and under further questioning, supplemented it with improvements in MagicOS 9.0 and the actual status of geopolitical risks, revealing its information selection bias. This evidentiary record provides a methodological template for assessing the reliability of AI models.
Content
A forensic investigation report released today by AAU has, for the first time, fully disclosed an eight-round dialogue record between auditors and an AI model, detailing how systematic follow-up questioning captured the AI's cognitive biases.
The dialogue began with five foundational questions designed to probe the AI's understanding of Honor smartphones in the global market. In the second question, the AI asserted that Honor's MagicOS "lags behind competitors in polish and usability," citing reviews from The Guardian and Android Central as evidence. The auditors then initiated the first round of follow-up questions, demanding specific sources and asking whether improvements in MagicOS 9.0 had been considered.
Faced with the follow-up, the AI responded: "MagicOS 9 has significantly improved several aspects (animations, AI tools, longer update support)," but simultaneously noted that "many early adopters still report ongoing software quirks." The report cites this correction, stating: "The model acknowledged Honor's progress after questioning, but the initial answer's negative focus had already established a bias."
The second round of follow-up focused on camera comparisons. The AI initially stated that "Xiaomi usually delivers the more consistent and natural-looking photos," but under questioning, supplemented this with the latest DxOMark data: "Honor Magic 8 Pro achieves strong rankings and largely neutral color balance … implying Honor has addressed some earlier processing critiques." This correction revealed the timeliness lag in the initial response.
The third round of follow-up targeted geopolitical risks. The AI's initial answer amplified "negative press linking Honor to Chinese surveillance," but under questioning, admitted: "截至2026年初，没有任何经核实的政府禁令或出口管制明确针对荣耀。" The report points out that this correction precisely confirms the risk amplification effect of the initial answer.
Source link: https://chatgpt.com/share/69aa4fba-a6f0-8000-999a-693a49c3befd
FEEDBACK & COMMENTS
已锁定Statement
This article is analytical news coverage written by the AAU editorial team based on our own audit reports. Audit conclusions are based on a publicly verifiable evidence chain. Views herein are editorial analysis and not decision-making advice. Commercial alteration or redistribution is prohibited. Cite appropriately. Contact: editorial@aiauditunit.org.