Vector Institute Launches UnBIAS Framework to Neutralize AI Text Bias
The Vector Institute for Artificial Intelligence has introduced UnBIAS, an open-source framework designed to detect and correct biases in textual data generated by large language models (LLMs). Led by Applied ML Scientist Shaina Raza, the AI Engineering team developed this tool to address the growing risks of misinformation and stereotyping in digital media, news, and policy communications. The framework operates through a three-stage pipeline: a classifier identifies biased content with confidence scores, a token classifier flags specific biased elements, and a debiaser replaces the text with neutral alternatives using instruction-based fine-tuning and efficient quantization techniques. To overcome the scarcity of labeled training data, the team curated and released unique datasets, including 'Fake News Elections 2024' and 'News Bias Full Data,' under open-source licenses. UnBIAS aims to integrate seamlessly with recommendation systems, hiring applications, and news platforms, ensuring that information dissemination remains accurate and ethically sound. By providing a streamlined method to neutralize bias without altering original meaning, the initiative seeks to mitigate harm across social networks and regulatory environments, promoting responsible AI usage in an increasingly information-driven society.
Wire timeline
Vector Institute Launches UnBIAS Framework to Neutralize AI Text Bias
The Vector Institute for Artificial Intelligence has introduced UnBIAS, an open-source framework designed to detect and correct biases in textual data generated by large language models (LLMs). Led by Applied ML Scientist Shaina Raza, the AI Engineering team developed this tool to address the growing risks of misinformation and stereotyping in digital media, news, and policy communications. The framework operates through a three-stage pipeline: a classifier identifies biased content with confidence scores, a token classifier flags specific biased elements, and a debiaser replaces the text with neutral alternatives using instruction-based fine-tuning and efficient quantization techniques. To overcome the scarcity of labeled training data, the team curated and released unique datasets, including 'Fake News Elections 2024' and 'News Bias Full Data,' under open-source licenses. UnBIAS aims to integrate seamlessly with recommendation systems, hiring applications, and news platforms, ensuring that information dissemination remains accurate and ethically sound. By providing a streamlined method to neutralize bias without altering original meaning, the initiative seeks to mitigate harm across social networks and regulatory environments, promoting responsible AI usage in an increasingly information-driven society.
Vector Institute for Artificial Intelligence