Wisdom of crowds: much ado about nothing. REIA, Sandro Martinelli; FONTANARI, José Fernando.
Abstract: The puzzling idea that the combination of independent estimates of the magnitude of a quantity results in a very accurate prediction, which is superior to any or, at least, to most of the individual estimates is known as the wisdom of crowds. Here we use the federal reserve bank of Philadelphia's survey of professional forecasters database to confront the statistical and psychophysical explanations of this phenomenon. Overall we find that the data do not support any of the proposed explanations of the wisdom of crowds. In particular, we find a positive correlation between the variance (or diversity) of the estimates and the crowd error in disagreement with some interpretations of the diversity prediction theorem. In addition, in opposition to the predictions of the psychophysical augmented quincunx model, we find that the skew of the estimates offers no information about the crowd error. More importantly, we find that the crowd beats all individuals in less than 2% of the forecasts and beats most individuals in less than 70% of the forecasts, which means that there is fair chance that an individual selected at random will perform better than the crowd. These results contrast starkly with the performance of non-natural crowds composed of unbiased forecasters which beat most individuals in practically all forecasts. The moderate statistical advantage of a real-world crowd over its members does not justify the ado about its wisdom, which is most likely a product of the selective attention fallacy.
Journal of Statistical Mechanics
v. 2021, n. 5, p. 053402-1-053402-25 - Ano: 2021
Fator de Impacto: 2,215
@article={003029413,author = {REIA, Sandro Martinelli; FONTANARI, José Fernando.},title={Wisdom of crowds: much ado about nothing},journal={Journal of Statistical Mechanics},note={v. 2021, n. 5, p. 053402-1-053402-25},year={2021}}
We use cookies on this site for a better browsing experience. By accessing the website, you agree to our policy on the use of cookies. More information about our Privacy Policy.
This website uses cookies to improve your experience while you navigate through the website. Out of these, the cookies that are categorized as necessary are stored on your browser as they are essential for the working of basic functionalities of the website. We also use third-party cookies that help us analyze and understand how you use this website. These cookies will be stored in your browser only with your consent. You also have the option to opt-out of these cookies. But opting out of some of these cookies may affect your browsing experience.
Necessary cookies are absolutely essential for the website to function properly. These cookies ensure basic functionalities and security features of the website, anonymously.
Cookie
Duration
Description
cookielawinfo-checkbox-analytics
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Analytics".
cookielawinfo-checkbox-functional
11 months
The cookie is set by GDPR cookie consent to record the user consent for the cookies in the category "Functional".
cookielawinfo-checkbox-necessary
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookies is used to store the user consent for the cookies in the category "Necessary".
cookielawinfo-checkbox-others
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Other.
cookielawinfo-checkbox-performance
11 months
This cookie is set by GDPR Cookie Consent plugin. The cookie is used to store the user consent for the cookies in the category "Performance".
viewed_cookie_policy
11 months
The cookie is set by the GDPR Cookie Consent plugin and is used to store whether or not user has consented to the use of cookies. It does not store any personal data.
Functional cookies help to perform certain functionalities like sharing the content of the website on social media platforms, collect feedbacks, and other third-party features.
Performance cookies are used to understand and analyze the key performance indexes of the website which helps in delivering a better user experience for the visitors.
Analytical cookies are used to understand how visitors interact with the website. These cookies help provide information on metrics the number of visitors, bounce rate, traffic source, etc.
Advertisement cookies are used to provide visitors with relevant ads and marketing campaigns. These cookies track visitors across websites and collect information to provide customized ads.
Abstract: The puzzling idea that the combination of independent estimates of the magnitude of a quantity results in a very accurate prediction, which is superior to any or, at least, to most of the individual estimates is known as the wisdom of crowds. Here we use the federal reserve bank of Philadelphia's survey of professional forecasters database to confront the statistical and psychophysical explanations of this phenomenon. Overall we find that the data do not support any of the proposed explanations of the wisdom of crowds. In particular, we find a positive correlation between the variance (or diversity) of the estimates and the crowd error in disagreement with some interpretations of the diversity prediction theorem. In addition, in opposition to the predictions of the psychophysical augmented quincunx model, we find that the skew of the estimates offers no information about the crowd error. More importantly, we find that the crowd beats all individuals in less than 2% of the forecasts and beats most individuals in less than 70% of the forecasts, which means that there is fair chance that an individual selected at random will perform better than the crowd. These results contrast starkly with the performance of non-natural crowds composed of unbiased forecasters which beat most individuals in practically all forecasts. The moderate statistical advantage of a real-world crowd over its members does not justify the ado about its wisdom, which is most likely a product of the selective attention fallacy.
@article={003029413,author = {REIA, Sandro Martinelli; FONTANARI, José Fernando.},title={Wisdom of crowds: much ado about nothing},journal={Journal of Statistical Mechanics},note={v. 2021, n. 5, p. 053402-1-053402-25},year={2021}}