#algorithmicstatesofexception — Public Fediverse posts

VioGen is a risk prediction system for gender-based violence. But
- users (police) don't challenge the algo's predictions
- unrealistic assumptions (traumatised women can give binary responses to 35 questions!)
- not transparent, evaluated by creators
Even worse, it only assigns the number of 'extreme' risk scores that the police budget allows, and undervalues non-physical forms of violence.
All this collateral damage is typical of algorithmic/machine learning systems applied to social problems.
#AlgorithmicStatesOfException
https://eticasfoundation.org/gender/the-external-audit-of-the-viogen-system/
#viogen #genderbased #violence #algorithms #police #riskassessment #predictivepolicing

VioGen is a risk prediction system for gender-based violence. But
- users (police) don't challenge the algo's predictions
- unrealistic assumptions (traumatised women can give binary responses to 35 questions!)
- not transparent, evaluated by creators
Even worse, it only assigns the number of 'extreme' risk scores that the police budget allows, and undervalues non-physical forms of violence.
All this collateral damage is typical of algorithmic/machine learning systems applied to social problems.
#AlgorithmicStatesOfException
https://eticasfoundation.org/gender/the-external-audit-of-the-viogen-system/
#viogen #genderbased #violence #algorithms #police #riskassessment #predictivepolicing

VioGen is a risk prediction system for gender-based violence. But
- users (police) don't challenge the algo's predictions
- unrealistic assumptions (traumatised women can give binary responses to 35 questions!)
- not transparent, evaluated by creators
Even worse, it only assigns the number of 'extreme' risk scores that the police budget allows, and undervalues non-physical forms of violence.
All this collateral damage is typical of algorithmic/machine learning systems applied to social problems.
#AlgorithmicStatesOfException
https://eticasfoundation.org/gender/the-external-audit-of-the-viogen-system/
#viogen #genderbased #violence #algorithms #police #riskassessment #predictivepolicing

VioGen is a risk prediction system for gender-based violence. But
- users (police) don't challenge the algo's predictions
- unrealistic assumptions (traumatised women can give binary responses to 35 questions!)
- not transparent, evaluated by creators
Even worse, it only assigns the number of 'extreme' risk scores that the police budget allows, and undervalues non-physical forms of violence.
All this collateral damage is typical of algorithmic/machine learning systems applied to social problems.
#AlgorithmicStatesOfException
https://eticasfoundation.org/gender/the-external-audit-of-the-viogen-system/
#viogen #genderbased #violence #algorithms #police #riskassessment #predictivepolicing

VioGen is a risk prediction system for gender-based violence. But
- users (police) don't challenge the algo's predictions
- unrealistic assumptions (traumatised women can give binary responses to 35 questions!)
- not transparent, evaluated by creators
Even worse, it only assigns the number of 'extreme' risk scores that the police budget allows, and undervalues non-physical forms of violence.
All this collateral damage is typical of algorithmic/machine learning systems applied to social problems.
#AlgorithmicStatesOfException
https://eticasfoundation.org/gender/the-external-audit-of-the-viogen-system/
#viogen #genderbased #violence #algorithms #police #riskassessment #predictivepolicing