From 771efaa4413df7c46ef578c8cbb499fbe587a618 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?Nu=C3=B1o=20Sempere?= Date: Tue, 20 Nov 2018 17:03:25 +0100 Subject: [PATCH] Update Analysis.md --- rat/EA-predictions/Analysis.md | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/rat/EA-predictions/Analysis.md b/rat/EA-predictions/Analysis.md index a0bbaf6..1ef29c4 100644 --- a/rat/EA-predictions/Analysis.md +++ b/rat/EA-predictions/Analysis.md @@ -100,11 +100,15 @@ I got this answers using R from the data released by the EA survey people, avail For the 35 people who took part in the original prediction making, their results can be seen in the following graphics: ![](https://nunosempere.github.io/rat/EA-predictions/Scatterplot3.jpeg) + + +The average accuracy is 55.12%, that is, the average participant got 13.22 out of 24 questions right. If it had been reached, a target credence of 80% would imply an average of 19.2 correct answers. In other words, in this limited domain, when these people say 80%, the thing happens 55% of the time. If they bet, they'd be replacing ~1:1 bets with 1:4 bets. + +### Other ways to break down the data: ![](https://nunosempere.github.io/rat/EA-predictions/Scatterplot2.jpeg) ![](https://nunosempere.github.io/rat/EA-predictions/histogram.jpeg) ![](https://nunosempere.github.io/rat/EA-predictions/Brier-scores.jpeg) -The average accuracy is 55.12%, that is, the average participant got 13.22 out of 24 questions right. If it had been reached, a target credence of 80% would imply an average of 19.2 correct answers. In other words, in this limited domain, when these people say 80%, the thing happens 55% of the time. If they bet, they'd be replacing ~1:1 bets with 1:4 bets. ## Is this an spurious result because a small number of questions were really, really hard? No. See the following scatterplot: @@ -119,7 +123,6 @@ Questions for further analysis: I expect to answer those questions in the near future. - ## Code. You can find [Predictions.csv](https://nunosempere.github.io/rat/EA-predictions/Predictions.csv) and [answers.csv](https://nunosempere.github.io/rat/EA-predictions/answers.csv) by following the links.