Linear regression is among the most popular statistical model in social sciences research. Linear probability models (LPMs), which are linear regression models applied to a binary outcome, are commonly used for various reasons, despite criticisms of such usage. We carry out an extensive study to evaluate the use of LPMs in the realm of "Big Data", where large samples and many variables are available. We evaluate performance in terms of coefficient estimation as well as predictive power. We compare performance to alternatives suggested in the literature. We find that the LPM is beneficial for descriptive modeling when the outcome is naturally binary, whereas it is beneficial for predictive modeling when the outcome is binary by discretization. We motivate and illustrate our study through an application to modeling price in online auctions, using real data from the online auction site eBay. The competing title for the paper is "Everything you wanted to know about LPMs and were afraid to ask". To read more, download the SSRN working paper.