skip to content
← (hackathons)

gender-bias-detector.gif

[Un]Cancelled – Gender Bias Detector

Chrome extension that uses a custom-trained AI model to detect and explain sexist content.

gender-bias-detector.gif[01]

[Un]Cancelled – Gender Bias Detector: uncancelled-demo.gif

Context

[Un]Cancelled — "Cancel Bias. Uncancel Equality." — was built at the TUM.ai Makeathon in spring 2023 (Devpost entry started 1 May 2023).

What we built

A Chrome extension that tells you whether a selected piece of text is gender-biased:

  • Select text anywhere on the web — Twitter/X, ChatGPT answers, news articles.
  • The team's own AI classifier detects gender bias.
  • An LLM explains why the text is biased, so the tool educates instead of just flagging.

Tech

JavaScript · HTML/CSS · Chrome Extension APIs · Python (classifier) · Microsoft Azure · Node.js (node-fetch, axios)

Challenges and learnings

  • Tight time, and setting up Azure.
  • None of the team were backend developers, so building and deploying the backend was a big stretch — and they got it set up. The remaining step for the live demo was wiring all the interfaces together.
  • First time building a Chrome extension and working with Azure; learned a lot about time management, teamwork and the problem of bias itself.

Result

🏆 Winner, TUM.ai Makeathon 2023.

Links