New Study Reveals Color-Induced Bias in AI Reasoning, Raising Concerns for VLM Reliability
A recent study conducted by researchers from Japan’s National Institute of Advanced Industrial Science and Technology (AIST), the University of Tsukuba, the University of Technology Nuremberg, and the University of Oxford has uncovered a significant vulnerability in Vision Language Models (VLMs): their reasoning can be influenced by the color of text. The research, titled 'Seeing Red, Thinking Bad: Color Bias in Vision Language Models,' demonstrates that altering text colors can lead to substantial shifts in AI sentiment and conclusions, even when the textual content remains unchanged. For instance, Qwen2-VL-7B, one of the tested models, showed a positive bias when positive words were colored green/blue and a negative bias when negative words were colored red. This phenomenon, termed 'color-induced bias,' suggests that VLMs are susceptible to visual styling, which can distort their semantic representations and impact their behavioral responses in tasks like sentiment analysis and question answering. The st... 
