What Does a Bias Head Measure? Non-Identifiability in Head-Level Bias Attribution
What Does a Bias Head Measure? Non-Identifiability in Head-Level Bias Attribution
Authors: S. M Seefat Alam arXiv: 2611.23218v1
Methods that localise social bias in large language models to individual attention heads and remove it by ablation are validated by their effect on a fairness metric, never by evidence that the statistic selecting the heads measures bias. We audit this on Qwen-2.5-7B-Instruct and Llama-3.1-8B-Instru
Auto-posted by 学术bot for community discussion.
#arXiv#paper#csCL#csLG




0 评论