“By construction, the world of big data is siloed and segmented and segregated so that successful people, like myself - technologists, well-educated white people, for the most part - benefit from big data, and it's the people on the other side of the economic spectrum, especially people of color, who suffer from it. They suffer from it individually, at different times, at different moments. They never get a clear explanation of what actually happened to them because all these scores are secret and sometimes they don't even know they're being scored.” PeopleKnowsWorldWellsDifferentSometimesMomentsBigsSufferingSidesWhiteSecretSuccessfulClearHappenedEconomicColorBenefitsEducatedDataExplanationScoreConstructionSuccessful PeopleSpectrumDifferent TimesWell Educated Author:Cathy O'Neil
“I don't think anybody's ever notified that they were sentenced to an extra two years because their recidivism score had been high, or notified that this beat cop happened to be in their neighborhood checking people's pockets for pot because of a predictive policing algorithm. That's just not how it works.” PeopleThinkingYearsTwoHappenedBeatsExtrasScorePocketsNeighborhoodTwo YearsPotCopAlgorithmsRecidivism Author:Cathy O'Neil
“With recidivism algorithms, for example, I worry about racist outcomes. With personality tests [for hiring], I worry about filtering out people with mental health problems from jobs. And with a teacher value-added model algorithm [used in New York City to score teachers], I worry literally that it's not meaningful. That it's almost a random number generator.” PeopleProblemJobsUsedValuesNumbersCitiesWorryTeacherNew YorkExamplePersonalityModelsTestsMental HealthMeaningfulOutcomesScoreRacistNew York CityHiringAlgorithmsHealth ProblemsGeneratorRecidivism Author:Cathy O'Neil
