
Transversal Design for Social Impact
@ Massachusetts Institute of Technology
Project Type
Designing a harm detection algorithm to combat gender-based violence
Date
Fall 2024
Poster 1: Problem Interrogation


Design for Social Impact @ MIT
While design is frequently deployed as a problem-solving instrument, it can unintentionally result in ethical dilemmas and unanticipated outcomes. This course uniquely combined the critical lens of art with the innovation framework of DesignX, promoting introspection and thoughtful deliberation before diving into design interventions.
Social Issue Identification
Technology-Facilitated Gender-Based Violence
Problem Statement
Digital platforms lack proactive measures to prevent abusive behaviours before they escalate, placing the burden on victims to report incidients after the harm has occurred with limited support from platforms to ease this emotional burden.
Consequences of the Problem Not Being Solved
Emotional and psychological harm for primarily women in the form of threats, doxxing, cyber-harassment etc. Toxic online environments. Normalization of online abuse. Increase risk of physical violence.
How Might We Statements
-
How might we design proactive/preventative moments of pause and reflection on digital platforms for perpetrators of GBV to engage in empathetic disruption?
-
How might we alleviate the burden of reporting online harms from the victim?
-
How might we hold users accountable for their actions online?
-
How might we expand channels of support on digital platforms?
Proposed Solution
An AI-detected harm reduction pop-up on the sender's screen that forces the user to pause for 60 seconds, locking the content, in hopes of forcing empathy and reflection. A solution grounded in behavioural sciences.
Solution Features
-
ML algorithm to detect harmful language & imagery in real time
-
Educational content integrated into the reflection pop-up
-
Ability to customize the sensitivity of the harm detection algorithm
-
Direct connection to support services after a flagged incident
-
Integration with existing online platforms
-
Secure data storage/encryption
-
Support multiple languages and accessibility features
Poster 2: The Solution


Presentation Day
@ MIT Media Lab
Fall 2024