Authors:	Hauptmann, Tony Fellenz, Sophie Nathan, Laksan Tüscher, Oliver Kramer, Stefan
Title:	Discriminative machine learning for maximal representative subsampling
Online publication date:	20-Dec-2023
Year of first publication:	2023
Language:	english
Abstract:	Biased population samples pose a prevalent problem in the social sciences. Therefore, we present two novel methods that are based on positive-unlabeled learning to mitigate bias. Both methods leverage auxiliary information from a representative data set and train machine learning classifiers to determine the sample weights. The first method, named maximum representative subsampling (MRS), uses a classifier to iteratively remove instances, by assigning a sample weight of 0, from the biased data set until it aligns with the representative one. The second method is a variant of MRS – Soft-MRS – that iteratively adapts sample weights instead of removing samples completely. To assess the effectiveness of our approach, we induced artificial bias in a public census data set and examined the corrected estimates. We compare the performance of our methods against existing techniques, evaluating the ability of sample weights created with Soft-MRS or MRS to minimize differences and improve downstream classification tasks. Lastly, we demonstrate the applicability of the proposed methods in a real-world study of resilience research, exploring the influence of resilience on voting behavior. Through our work, we address the issue of bias in social science, amongst others, and provide a versatile methodology for bias reduction based on machine learning. Based on our experiments, we recommend to use MRS for downstream classification tasks and Soft-MRS for downstream tasks where the relative bias of the dependent variable is relevant.
DDC:	004 Informatik 004 Data processing
Institution:	Johannes Gutenberg-Universität Mainz
Department:	FB 08 Physik, Mathematik u. Informatik
Place:	Mainz
ROR:	https://ror.org/023b0x485
DOI:	http://doi.org/10.25358/openscience-9834
Version:	Published version
Publication type:	Zeitschriftenaufsatz
License:	CC BY
Information on rights of use:	https://creativecommons.org/licenses/by/4.0/
Journal:	Scientific reports 13
Pages or article number:	20925
Publisher:	Macmillan Publishers Limited, part of Springer Nature
Publisher place:	London
Issue date:	2023
ISSN:	2045-2322
Publisher DOI:	10.1038/s41598-023-48177-3
Appears in collections:	DFG-491381577-G