“I know how models are built, because I build them myself, so I know that I'm embedding my values into every single algorithm I create and I am projecting my agenda onto those algorithms.” KnowsValuesKnow HowModelsBuiltAgendasAlgorithmsEmbedding Author:Cathy O'Neil
“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that it's not meaningful. That it's almost a random number generator.” PeopleProblemJobsUsedValuesNumbersCitiesWorryTeacherNew YorkExamplePersonalityModelsTestsMental HealthMeaningfulOutcomesScoreRacistNew York CityHiringAlgorithmsHealth ProblemsGeneratorRecidivism Author:Cathy O'Neil
“I think there's inherently an issue that models will literally never be able to handle, which is that when somebody comes along with a new way of doing something that's really excellent, the models will not recognize it. They only know how to recognize excellence when they can measure it somehow.” ThinkingKnowsWayAbleKnow HowIssuesModelsExcellenceHandleExcellentNew Ways Author:Cathy O'Neil