🔖 Computational Social Scientist Beware: Simpson’s Paradox in Behavioral Data by Kristina Lerman

Bookmarked Computational Social Scientist Beware: Simpson's Paradox in Behavioral Data by Kristina Lerman (arxiv.org)
Observational data about human behavior is often heterogeneous, i.e., generated by subgroups within the population under study that vary in size and behavior. Heterogeneity predisposes analysis to Simpson's paradox, whereby the trends observed in data that has been aggregated over the entire population may be substantially different from those of the underlying subgroups. I illustrate Simpson's paradox with several examples coming from studies of online behavior and show that aggregate response leads to wrong conclusions about the underlying individual behavior. I then present a simple method to test whether Simpson's paradox is affecting results of analysis. The presence of Simpson's paradox in social data suggests that important behavioral differences exist within the population, and failure to take these differences into account can distort the studies' findings.
Syndicated copies to:

📺 Are University Admissions Biased? | Simpson’s Paradox Part 2 | YouTube

Watched Are University Admissions Biased? | Simpson's Paradox Part 2 by Henry Reich from youtube.com

Simpson's Paradox Part 2. This video is about how to tell whether or not university admissions are biased using statistics: aka, it's about Simpson's Paradox again!

REFERENCES:
Original Berkeley Grad Admissions Paper
Interactive Simpson’s Paradox Explainer
No Lawsuit, But Yes, Berkeley Study on Gender Bias

Statistics on college majors by gender:
https://nces.ed.gov/programs/digest/2016menu\_tables.asp
http://www.npr.org/sections/money/2014/10/28/359419934/who-studies-what-men-women-and-college-majors
http://www.randalolson.com/2014/06/14/percentage-of-bachelors-degrees-conferred-to-women-by-major-1970-2012/

Earnings by college major

Wall Street Journal Article on Simpson’s Paradox

Syndicated copies to: