Thursday, April 13, 2023

Not only devastatingly wrong, but systematically wrong.

Factfulness by Hans Rosling, Ola Rosling, and Anna Rosling Ronnlund.  Page 8, in reference to a twelve question test about the condition of the world in terms of income, population, conservation, education, etc.  

In 2017 we asked nearly 12,000 people in 14 countries to answer our questions. They scored on average just two correct answers out of the first 12. No one got full marks, and just one person (in Sweden) got 11 out of 12. A stunning 15 percent scored zero.

Perhaps you think that better-educated people would do better? Or people who are more interested in the issues? I certainly thought that once, but I was wrong. I have tested audiences from all around the world and from all walks of life: medical students, teachers, university lecturers, eminent scientists, investment bankers, executives in multinational companies, journalists, activists, and even senior political decision makers. These are highly educated people who take an interest in the world. But most of them—a stunning majority of them—get most of the answers wrong. Some of these groups even score worse than the general public; some of the most appalling results came from a group of Nobel laureates and medical researchers. It is not a question of intelligence. Everyone seems to get the world devastatingly wrong.

Not only devastatingly wrong, but systematically wrong. By which I mean that these test results are not  random. They are worse than random: they are worse than the results I would get if the people answering my questions had no knowledge at all.

Imagine I decide to head down to the zoo to test out my questions on the chimpanzees. Imagine I take with me huge armfuls of bananas, each marked either A, B, or C, and throw them into the chimpanzee enclosure. Then I stand outside the enclosure, read out each question in a loud, clear voice, and note down, as each chimpanzee’s “answer,” the letter on the banana she next chooses to eat.

If I did this (and I wouldn’t ever actually do this, but just imagine), the chimps, by picking randomly, would do consistently better than the well-educated but deluded human beings who take my tests. Through pure luck, the troop of chimps would score 33 percent on each three-answer question, or four out of the first 12 on the whole test. Remember that the humans I have tested get on average just two out of 12 on the same test.

What’s more, the chimps’ errors would be equally shared between the two wrong answers, whereas the human errors all tend to be in one direction. Every group of people I ask thinks the world is more frightening, more violent, and more hopeless—in short, more dramatic—than it really is.

No comments:

Post a Comment