quantified.uncertainty/metaforecast
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
f4d007f954
metaforecast/data/givewellopenphil-questions.json
NunoSempere f4d007f954 Added smarkets
2021-02-16 17:14:53 +01:00

344 lines
74 KiB
JSON
Raw Blame History

This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

[
{
"Title": "One for the World — General Support",
"URL": "https://www.givewell.org/about/impact/one-for-the-world/july-2018-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>25%</td> <td>OFTW moves more than &dollar;2.5 million to GiveWell top charities in 2020.</td> <td>End of 2020</td> </tr><tr><td>15%</td> <td>Conditioned on it still being active, OFTW moves more than &dollar;5 million to GiveWell top charities in 2023.</td> <td>End of 2023</td> </tr><tr><td>75%</td> <td>We renew our support to OFTW after one year.</td> <td>September 2019</td> </tr><tr><td>50%</td> <td>We renew our support to OFTW after two years.</td> <td>September 2020</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Georgetown University Initiative on Innovation, Development, and",
"URL": "https://www.givewell.org/charities/gui2de/january-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, Josh Rosenberg, our senior research analyst who led GiveWell's investigation of <em>Zusha!</em>, records the following forecasts: </p><ul><li><em>Zusha!</em> is recommended as a top charity by year-end 2017: 35%, broken down into: <ul><li><em>Zusha!</em> appears more cost-effective than AMF: 10% </li><li><em>Zusha!</em> appears roughly as cost-effective as AMF: 15% </li><li><em>Zusha!</em> appears less cost-effective than AMF (but is still a top charity recommendation): 10% </li></ul></li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Charity Science: Health — General Support",
"URL": "https://www.givewell.org/charities/charity-science/charity-science-health/november-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:</p> <ul><li>Good Ventures gives additional funding to Charity Science: Health in one year: 80% </li><li>Charity Science: Health becomes (or creates) a GiveWell top charity by giving season 2019: 15% </li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Charity Science Health — SMS Reminders for Immunization",
"URL": "https://www.givewell.org/charities/charity-science/charity-science-health/july-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>: </p><ul><li>80% chance that we will recommend another GiveWell Incubation Grant to Charity Science Health by August 2018. </li><li>15% chance that Charity Science Health will be a <a href=\"https://www.givewell.org/charities/top-charities\">GiveWell top charity</a> by the end of 2019.</li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Results for Development — Childhood Pneumonia Treatment Scale-Up",
"URL": "https://www.givewell.org/charities/results-for-development/may-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:</p> <ul><li>Good Ventures gives R4D a second grant of approximately the same size in 12 months: 70%</li> <li>R4D is a top charity by the end of 2019: 25%</li> </ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support (November 2017)",
"URL": "https://www.givewell.org/charities/new-incentives/november-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The purpose of this exercise is to record the implicit predictions that inform our decisions and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the forecasts below, all of which we consider to be fairly rough. Except where otherwise noted, the end date for all predictions is the end of 2020.</p> <ul><li>New Incentives increases vaccination rates by &gt;17 percentage points and this is detected by the RCT: 15% </li><li>New Incentives increases vaccination rates by &gt;17 percentage points and this is <em>not</em> detected by the RCT: small probability, close to 0% </li><li>New Incentives increases vaccination rates by between 6 and 17 percentage points and this is detected by the RCT: 55% </li><li>New Incentives increases vaccination rates by between 6 and 17 percentage points and this is either not detected by the RCT or is unclear: 15% </li><li>New Incentives increases vaccination rates by &lt;6 percentage points and we either conclude as much or are uncertain enough that we choose not to pursue New Incentives further: 15% </li><li>New Incentives increases vaccination rates by &lt;6 percentage points and we falsely believe it is higher and do pursue New Incentives further: 5% </li><li>After seeing the RCT results, we are significantly uncertain about whether or not to recommend New Incentives as a top charity: 20% </li><li>GiveWell estimates that New Incentives is &gt;3x as cost-effective as GiveDirectly: 50% </li><li>GiveWell estimates that New Incentives is &gt;2x as cost-effective as AMF: &lt;10% </li><li>New Incentives becomes a top charity by November 2020: 50% </li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support (2016)",
"URL": "https://www.givewell.org/charities/new-incentives/march-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate our past predictions were. For this grant, we are recording the following forecasts (made during our decision process):</p> <p><b> Top charity predictions</b></p> <ul><li> New Incentives is a top charity in 2016: 10%</li> <li> New Incentives is a top charity in 2017: 12.5%</li> <li> New Incentives is a top charity in 2018: 15%</li> </ul><p><b>Cost-effectiveness predictions</b></p> <ul><li> Our 2017 cost-effectiveness estimate for New Incentives is at least twice as good as our 2017 estimate for unconditional cash transfers: 67%</li> <li> Our 2017 cost-effectiveness estimate for New Incentives is at least five times as good as our 2017 estimate for unconditional cash transfers: 15%</li> <li> Our 2017 cost-effectiveness estimate for New Incentives is at least ten times as good as our 2017 estimate for unconditional cash transfers: 5%</li> </ul><p><b> Charity predictions</b></p> <ul><li> New Incentives brings in at least &dollar;250,000 from a funder other than Good Ventures and the Lampert Family Foundation by the end of 2018: 25%</li> <li>New Incentives still operates in 2019: 40%</li> </ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support",
"URL": "https://www.givewell.org/charities/new-incentives/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The purpose of this exercise is to record the implicit predictions that inform our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:</p> <ul><li>70% chance that we provide funding for an RCT of New Incentives' program</li> <li>50% chance that New Incentives is a top charity at the end of 2019</li> </ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — No Lean Season (December 2016 grant)",
"URL": "https://www.givewell.org/charities/evidence-action/december-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecast:</p> <ul><li>65% chance that No Lean Season is a top charity at the end of giving season 2017</li> </ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — Strengthen Operations",
"URL": "https://www.givewell.org/charities/evidence-action/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <ul><li>15% chance that we find a significant error in Evidence Action's financial documents in 2018</li> <li>25% chance that an Evidence Action Beta program other than No Lean Season becomes a top charity by the end of 2021</li> <li>60% chance that the Deworm the World Initiative's room for more funding (including <a href=\"http://blog.givewell.org/2016/11/28/updated-top-charities-giving-season-2016/#Sec2a\">execution levels 1 and 2</a>) exceeds &dollar;10 million as of November 2018</li> <li>60% chance that GiveWell Incubation Grants provides at least &dollar;250,000 to an Evidence Action Beta program other than No Lean Season by the end of 2018</li> </ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — No Lean Season (March 2016 grant)",
"URL": "https://www.givewell.org/evidence-action/march-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecasts:</p> <ul><li>Top charity predictions:</li> <ul><li>No Lean Season (or a related organization) is a top charity in 2017: 15%.</li> <li>No Lean Season (or a related organization) is a top charity in 2018: 20%.</li> <li>No Lean Season (or a related organization) is a top charity in 2019: 25%.</li> </ul><li>Cost-effectiveness predictions:</li> <ul><li>Our 2016 cost-effectiveness estimate for No Lean Season is at least five times as good as cash transfers: 50%.</li> <li>Our 2016 cost-effectiveness estimate for No Lean Season is less than twice as good as cash transfers: 15%.</li> <li>Our 2016 cost-effectiveness estimate for No Lean Season is at least ten times as good as cash transfers: 15%.</li> </ul><li>Implementation predictions:</li> <ul><li>Evidence Action is running a No Lean Season program at the end of 2017: 80%.</li> </ul></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Innovations for Poverty Action — Mindset Engagement in Cash Transfers",
"URL": "https://www.givewell.org/international/charities/ipa/may-2016-grant#Risks_of_the_grant_and_internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Risks_of_the_grant_and_internal_forecasts\">Risks of the grant and internal forecasts</h2> <p>This grant could fail to have the effects we hope for in a number of ways:</p> <ol><li>The study detects an effect that is too small relative to the cost of implementing the intervention for it to be worth scaling up. We believe this is reasonably likely (~50% chance). </li><li>The study yields a result that we're not confident in. We think there is a moderate chance (~25%) of this (given the number of potential problems that can arise with any study). </li><li>The study detects an effect that would be worth scaling up, but we are unable to find an implementer interested in doing so (for instance, if GiveDirectly were to decide not to incorporate the intervention because it is too time-intensive or diverts attention from other activities, or because GiveDirectly interprets the study's results differently than we do). We think this scenario is fairly unlikely (~7.5%). </li><li>The intervention has no measurable effect, and we could have predicted this prior to the study by surveying the existing literature more thoroughly. We think this is fairly unlikely (~7.5%), especially given Sedlmayr's interest in attempting the intervention.</li></ol><p>(We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking, especially grantmaking. The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are.)</p> <div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action Beta — Iron and Folic Acid Supplementation (&quot;Phase 2&quot;)",
"URL": "https://www.givewell.org/research/incubation-grants/december-2018-evidence-action-beta-iron-folic-acid-phase-2#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>60%</td> <td>GiveWell’s best guess is that Evidence Action’s intervention increases coverage relative to the counterfactual in the first year of Phase 2 of the program by at least 4 percentage points</td> <td>December 2021</td> </tr><tr><td>50%</td> <td>GiveWell’s best guess is that Evidence Action’s intervention increases coverage relative to the counterfactual in the second year of Phase 2 of the program by at least 8 percentage points (cumulatively)</td> <td>December 2021</td> </tr><tr><td>75%</td> <td>Evidence Action requests funding for Phase 3 of this program because it believes Phase 2 to have been successful</td> <td>December 2021</td> </tr><tr><td>80%</td> <td>Estimates of anemia rates from the India National Family Health Survey in an average of 5 randomly chosen non-Evidence Action-supported states do not show anemia declining by more than 2 percentage points per year over the last 5 years (e.g., due to iron fortification or other changes)</td> <td>January 2024</td> </tr><tr><td>35%</td> <td>Evidence Action ultimately spends at least &dollar;15 million total on IFA technical assistance that we retrospectively model as 10x as effective (or more) than cash transfers (using our <a href=\"https://docs.google.com/spreadsheets/d/1IEjUQN5Ac78N3zqVe_Y9lqSUb5MZCm956TrDb4PXHzM/edit#gid=1034883018\">January 2018 CEA</a> as a baseline)</td> <td>January 2025</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "UC Berkeley — KLPS-4 Survey",
"URL": "https://www.givewell.org/research/incubation-grants/uc-berkeley/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Plans_for_follow-up\">Plans for follow-up</h2> <p>We plan to follow up with the gift recipient roughly every six months to check in on the timeline for receiving results from this study. At this stage, our understanding is that Wave 1 results will be available by mid-2018 and Wave 2 results will be available by mid-2019. We are uncertain when results will be able to be shared publicly, but aim to write publicly about the results as soon as we are able to.</p> <p>We also plan to follow up with the recipient to share their pre-analysis plan publicly and, when the study is completed, to share data publicly. </p> <div class='toc-back-to-top'><a href='#toc'></a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3> <p>We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this gift, we are recording the following forecasts:</p> <ul><li>25% chance that the KLPS-4 survey significantly positively updates us on deworming, i.e. finds a result that increases our estimated cost-effectiveness for deworming by at least 2x. </li><li>5% chance that the KLPS-4 survey significantly negatively updates us on deworming, i.e. finds a result that decreases our estimated cost-effectiveness for deworming by at least 2x. </li></ul><ul class=\"footnotes\"><li class=\"footnote\" id=\"footnote1_x8hx8my\"><a class=\"footnote-label\" href=\"#footnoteref1_x8hx8my\">1.</a> <p>Professor Miguel told us the following about the power of the study:</p> <p>\"We assume the same distribution of consumption per capita as in KLPS-3 (the data we shared with your group), and the same intra-cluster correlation (0.037). In the full proposed sample of 5-6k, the MDE (with standard 80% power and 5% significance level) is 14 log points, i.e., roughly a 14% gain in consumption per capita.\"</p> <p></p></li>\n</ul> </div>\n </div>\n </div>\n </div>\n</div>\n </div> <!-- /content -->\n\n \n <div class=\"links\">\n </div> <!-- /links -->\n \n </article> <!-- /article #node --> </div>\n</div>\n </div>\n </div>\n </div>\n\n \n \n </section>\n\n </div>\n\n <footer id=\"footer\">\n <div class=\"container\">\n <div class=\"region region-footer\">\n <div id=\"block-menu-menu-footer-menu\" class=\"block block-menu footer-menu\">\n\n \n <div class=\"content\">\n <ul class=\"menu\"><li class=\"first leaf\"><a href=\"/about/contact\">Contact</a></li>\n<li class=\"leaf\"><a href=\"/updates\">Stay updated</a></li>\n<li class=\"leaf\"><a href=\"/about/FAQ\">FAQ</a></li>\n<li class=\"leaf\"><a href=\"/apply-for-consideration\">For Charities</a></li>\n<li class=\"leaf\"><a href=\"/sitemap\">Site map</a></li>\n<li class=\"leaf\"><a href=\"/about/official-records/privacy-policy\">Privacy Policy</a></li>\n<li class=\"last leaf\"><a href=\"/about/jobs\">Jobs</a></li>\n</ul> </div>\n</div>\n<div id=\"block-block-36\" class=\"block block-block social\">\n\n \n <div class=\"content\">\n <div class=\"social\">\n ",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action Beta — Incubator Program",
"URL": "https://www.givewell.org/research/incubation-grants/beta-incubator-2018#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>30%</td> <td>This grant does not lead to any new top charities.</td> <td>December 2023</td> </tr><tr><td>55%</td> <td>The Beta incubator leads to a new top charity that is 1-2x the cost-effectiveness of our marginal spending on current top charities.</td> <td>December 2023</td> </tr><tr><td>10%</td> <td>The Beta incubator leads to a new top charity that's &gt;2x as cost-effective as our marginal spending on current top charities</td> <td>December 2023</td> <td></td></tr><tr><td>5%</td> <td>The Beta incubator program has impacts that lead us to make a public case that it was extremely cost-effective overall (i.e., it resulted in at least &dollar;10 million in spending at 15x the cost-effectiveness of cash transfers or more).</td> <td>December 2023</td> </tr><tr><td>15%</td> <td>Our marginal spending on top charities will be 2.5x as cost-effective as cash or less (using our <a href=\"https://docs.google.com/spreadsheets/d/1kQJRvHehD9iEkKWnb0rrsZ5sxeeqyeaZ20KcQVf8r98/edit#gid=1680005064\">current cost-effectiveness estimate for cash</a>)</td> <td>December 2023</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "IDinsight — Embedded GiveWell Team (2018)",
"URL": "https://www.givewell.org/research/incubation-grants/IDinsight-embedded-givewell-team-2018#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>65%</td> <td>Following its RCT, we estimate that New Incentives is at least 5x as cost-effective as 2018 cash transfers via GiveDirectly.</td> <td>August 2020</td> </tr><tr><td>30%</td> <td>Following its RCT, we estimate that Charity Science Health is at least 5x as cost-effective as 2018 cash transfers via GiveDirectly.</td> <td>End of 2020</td> </tr><tr><td>10%</td> <td>We model the marginal cost-effectiveness of giving to our top charities at roughly 2x cash.</td> <td>End of 2018</td> </tr><tr><td>70%</td> <td>We publish a blog post on IDinsight's work on AMF's monitoring.</td> <td>February 2019</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — Strengthen Operations (2019)",
"URL": "https://www.givewell.org/research/incubation-grants/march-2019-evidence-action#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following forecasts: </p> <ul><li>50% chance that Evidence Action raises a total of &dollar;6,120,000 in donations from institutional donors by the end of 2022. </li><li>50% chance that Evidence Action raises a total of &dollar;40,800,000 in donations from institutional donors by the end of 2024. </li><li>75% chance that the Indian government will allow Evidence Action to accept foreign donations to the Evidence Action India Foundation by the end of 2023. </li><li>75% chance that Evidence Action will have hired a Chief Program Officer and at least one other leader by the end of 2019. </li><li>25% chance that Evidence Action will have hired all new full-time positions for the fundraising function and senior leadership by the end of 2020. </li><li>50% chance that Evidence Action will have finalized a strategy on its approach to compensation by the end of 2020. </li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "IDinsight — Endline Evaluation of New Incentives RCT",
"URL": "https://www.givewell.org/research/incubation-grants/IDinsight-new-incentives-august-2019#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By time</th> </tr><tr><td>65%</td> <td>New Incentives is a top charity and is ≥ 3x as cost-effective as cash</td> <td>November 2020</td> </tr><tr><td>50%</td> <td>New Incentives is a top charity and is ≥ 5x as cost-effective as cash</td> <td>November 2020</td> </tr><tr><td>22.5%</td> <td>New Incentives is a top charity and is ≥ 7.5x as cost-effective as cash</td> <td>November 2020</td> </tr><tr><td>5%</td> <td>New Incentives is a top charity and is ≥ 10x as cost-effective as cash</td> <td>November 2020</td> </tr><tr><td>15%</td> <td>The RCT results are inconclusive, such that after seeing them we have significant uncertainty about whether to make New Incentives a top charity</td> <td>November 2020</td> </tr><tr><td>25%</td> <td>We cite our learning experience from the New Incentives RCT as part of our reasoning for funding a future RCT (including any RCTs related to current GiveWell Incubation Grant recipients, such as Evidence Action's <a href=\"https://www.givewell.org/research/incubation-grants/july-2018-evidence-action-beta-incubator\">Beta Incubator</a>)</td> <td>December 2024</td> </tr><tr><td>5%</td> <td>The New Incentives RCT results are cited by another funder or agency when making a recommendation for or against pursuing CCTs for immunization, or as a reference in future research</td> <td>December 2024</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action Beta — Iron and Folic Acid Supplementation",
"URL": "https://www.givewell.org/research/incubation-grants/march-2018-evidence-action-beta-iron-folic-acid#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>50%</td> <td>We believe direct funding of IFA in India is no more than 2x less cost-effective than we believe it is now (as discussed <a href=\"#costeffective\">above</a>, we currently estimate it's roughly 9x as cost-effective as cash transfers, using our <a href=\"https://docs.google.com/spreadsheets/d/1IEjUQN5Ac78N3zqVe_Y9lqSUb5MZCm956TrDb4PXHzM/edit#gid=1034883018\">January 2018 CEA</a> as a baseline).</td> <td>March 2019</td> </tr><tr><td>75%</td> <td>Evidence Action believes that it can add substantial value to India's IFA program and requests over &dollar;500,000 for a follow-up grant to move past scoping.</td> <td>March 2019</td> </tr><tr><td>40%</td> <td>Conditional on Evidence Action getting funding to do technical assistance past the scoping stage, Evidence Action ultimately spends at least &dollar;6 million total on IFA technical assistance that GiveWell models as 10x as effective (or more) than cash transfers (using our <a href=\"https://docs.google.com/spreadsheets/d/1IEjUQN5Ac78N3zqVe_Y9lqSUb5MZCm956TrDb4PXHzM/edit#gid=1034883018\">January 2018 CEA</a> as a baseline).</td> <td>January 2023</td> </tr><tr><td>20%</td> <td>Conditional on Evidence Action getting funding to do technical assistance past the scoping stage, Evidence Action ultimately spends at least &dollar;15 million total on IFA technical assistance that we model as 10x as effective (or more) than cash transfers (using our <a href=\"https://docs.google.com/spreadsheets/d/1IEjUQN5Ac78N3zqVe_Y9lqSUb5MZCm956TrDb4PXHzM/edit#gid=1034883018\">January 2018 CEA</a> as a baseline).</td> <td>January 2023</td> </tr><tr><td>~10%</td> <td>Implied from other calculations: Evidence Action ultimately spends at least &dollar;15 million total on IFA technical assistance that we model as 10x as effective (or more) than cash transfers (using our <a href=\"https://docs.google.com/spreadsheets/d/1IEjUQN5Ac78N3zqVe_Y9lqSUb5MZCm956TrDb4PXHzM/edit#gid=1034883018\">January 2018 CEA</a> as a baseline).</td> <td>January 2023</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Nick Otis — Forecasting Research",
"URL": "https://www.givewell.org/research/incubation-grants/may-2018-forecasting-research-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>90%</td> <td>Nick produces a paper summarizing his work on this project.</td> <td>End of 2019</td> </tr><tr><td>60%</td> <td>Nick collects forecasts from at least 10 academics on at least four studies.</td> <td>End of 2019</td> </tr><tr><td>65%</td> <td>The academics' pooled forecast of the probability that New Incentives' intervention increases vaccine coverage by 15 percentage points differs from GiveWell's internal forecast by at least 10 percentage points (for instance, the academics give a 45% chance while we give a 60% chance).</td> <td>End of 2019</td> </tr></table> </div>\n </div>\n </div>\n </div>\n</div>\n </div> <!-- /content -->\n\n \n <div class=\"links\">\n </div> <!-- /links -->\n \n </article> <!-- /article #node --> </div>\n</div>\n </div>\n </div>\n </div>\n\n \n \n </section>\n\n </div>\n\n <footer id=\"footer\">\n <div class=\"container\">\n <div class=\"region region-footer\">\n <div id=\"block-menu-menu-footer-menu\" class=\"block block-menu footer-menu\">\n\n \n <div class=\"content\">\n <ul class=\"menu\"><li class=\"first leaf\"><a href=\"/about/contact\">Contact</a></li>\n<li class=\"leaf\"><a href=\"/updates\">Stay updated</a></li>\n<li class=\"leaf\"><a href=\"/about/FAQ\">FAQ</a></li>\n<li class=\"leaf\"><a href=\"/apply-for-consideration\">For Charities</a></li>\n<li class=\"leaf\"><a href=\"/sitemap\">Site map</a></li>\n<li class=\"leaf\"><a href=\"/about/official-records/privacy-policy\">Privacy Policy</a></li>\n<li class=\"last leaf\"><a href=\"/about/jobs\">Jobs</a></li>\n</ul> </div>\n</div>\n<div id=\"block-block-36\" class=\"block block-block social\">\n\n \n <div class=\"content\">\n <div class=\"social\">\n ",
"Stars": "★★★☆☆"
},
{
"Title": "Results for Development — Childhood Pneumonia Treatment Program (2019)",
"URL": "https://www.givewell.org/research/incubation-grants/results-for-development/january-2019-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By time</th> </tr><tr><td>40%</td> <td>R4D or an R4D program is a top charity</td> <td>December 2023</td> </tr><tr><td>35%</td> <td>R4D or an R4D program is a top charity and we estimate that donations to that program are at least half as cost-effective as the most cost-effective unfunded giving opportunity among top charities (i.e. where we recommend donors give on the margin)</td> <td>December 2023</td> </tr><tr><td>5%</td> <td>R4D or an R4D program is a top charity and we estimate that donations to that program are at least twice as cost-effective as the most cost-effective unfunded giving opportunity among top charities (i.e. where we recommend donors give on the margin)</td> <td>December 2023</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Charity Science Health — Exit Grant",
"URL": "https://www.givewell.org/research/incubation-grants/charity-science-exit-grant-july-2019#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecast</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By time</th> </tr><tr><td>65%</td> <td>Charity Science Health receives enough funding from other donors to continue its operations through the end of 2020.</td> <td>End of 2020</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Innovations for Poverty Action — Randomized Controlled Trial on the",
"URL": "https://www.givewell.org/research/incubation-grants/innovations-for-poverty-action-masks-rct-july-2020#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>We made a number of <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a> related to this grant. These forecasts were made by the lead grant investigator and were informed by the material contained in this grant page, as well as intuitive reasoning. Because of the uncertainty around how this grant will resolve, we felt that making explicit forecasts would help us to determine the extent to which we exercised good judgment in making this grant after the fact. The resolution dates listed below are the dates by which we expect to evaluate the predictions associated with them.</p> <table><tr><th>Prediction</th> <th>Credence</th> <th>Resolution date</th> </tr><tr><td>The RCT will NOT find a statistically significant<a class=\"see-footnote\" id=\"footnoteref32_srwir9s\" title=\" Statistically significant = p &lt; 0.05. See more on p-values and statistical significance in our blog post. \" href=\"#footnote32_srwir9s\">32</a> result on self-reported respiratory symptoms, AND it will not find a statistically significant result on COVID-19.<a class=\"see-footnote\" id=\"footnoteref33_dr7t0fh\" title=\" The COVID-19 measure is currently intended to refer to the combination of respiratory disease symptoms and a positive serology test: &quot;In the mouza experiment, serological tests will be conducted 12 weeks after baseline for individuals who reported respiratory disease symptoms during our intervention. We will follow-up with these individuals using household interviews and conduct serology tests using blood spots obtained from finger pricks. The number of positive serology tests in this population will tell us rates of “symptomatic COVID-19”.&quot; Masks RCT Proposal, July 6, 2020, Pg. 9. If this changes, then this prediction refers to the primary outcome involving an objective test. \" href=\"#footnote33_dr7t0fh\">33</a></td> <td>15%</td> <td>June 1, 2021</td> </tr><tr><td>The RCT will find a statistically significant result on self-reported respiratory symptoms, but NOT COVID-19.</td> <td>20%</td> <td>June 1, 2021</td> </tr><tr><td>The RCT will NOT generate a statistically significant result on AT LEAST ONE of the outcomes, and the authors will say in their first preprint that an important reason was lower than expected incidence of COVID-19 or self-reported respiratory symptoms.</td> <td>25%</td> <td>June 1, 2021</td> </tr><tr><td>The RCT will NOT generate a statistically significant result on AT LEAST ONE of the outcomes, and the authors will say in their first preprint that an important reason was a failure to increase mask-wearing.</td> <td>20%</td> <td>June 1, 2021</td> </tr><tr><th colspan=\"3\"><em>Results on respiratory symptoms (Conditional on a paper being published in a <a href=\"https://www.scimagojr.com/journalrank.php?page=4&amp;total_size=30891\">top 200 academic journal</a>)</em></th> </tr><tr><td>The RCT will NOT find a statistically significant (p&gt;0.05) impact on self-reported respiratory symptoms.</td> <td>13%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in respiratory symptoms of 0-10%.</td> <td>5%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in respiratory symptoms of 10-20%.</td> <td>20%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in respiratory symptoms of 20-30%.</td> <td>30%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in respiratory symptoms of 30-40%.</td> <td>22%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in respiratory symptoms of &gt;40%.</td> <td>10%</td> <td>June 1, 2021</td> </tr><tr><th colspan=\"3\"><em>Results on COVID-19 outcome (Conditional on a paper being published in a <a href=\"https://www.scimagojr.com/journalrank.php?page=4&amp;total_size=30891\">top 200 academic journal</a>)</em></th> </tr><tr><td>The paper will not report an objectively measured disease outcome confirmed with diagnostic tests.</td> <td>10%</td> <td>June 1, 2021</td> </tr><tr><td colspan=\"3\"><em><strong>Conditional on a COVID-19 outcome being reported in the published paper</strong></em></td> </tr><tr><td>The RCT will NOT find a statistically significant (p&gt;0.05) impact on preferred measure of COVID-19.</td> <td>25%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in COVID-19 of 0-10%.</td> <td>5%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in COVID-19 of 10-20%.</td> <td>14%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in COVID-19 of 20-30%.</td> <td>28%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in COVID-19 of 30-40%.</td> <td>20%</td> <td>June 1, 2021</td> </tr><tr><td>Statistically significant result and reduction in COVID-19 of &gt;40%.</td> <td>8%</td> <td>June 1, 2021</td> </tr><tr><th colspan=\"3\"><em>Attention as a path to impact</em></th> </tr><tr><td>At least one academic paper will be published in a <a href=\"https://www.scimagojr.com/journalrank.php?page=4&amp;total_size=30891\">top 200 academic journal</a> on the basis of this RCT.</td> <td>85%</td> <td>June 1, 2021</td> </tr><tr><td>Conditional on the study getting a statistically significant result on EITHER respiratory symptoms OR COVID-19, it will be mentioned in over 50,000 tweets according to <a href=\"https://pnas.altmetric.com/details/83863073/twitter\">altmetrics</a>.</td> <td>80%</td> <td>June 1, 2021</td> </tr><tr><td>Conditional on a preprint being published (i.e., a draft paper is published on the internet), the study will receive justified criticism (as bad as <a href=\"https://metrics.stanford.edu/PNAS%20retraction%20request%20LoE%20061820\">this</a>; determined by a panel of three GiveWell researchers if it's not obvious) questioning its conclusions.</td> <td>1%</td> <td>June 1, 2021</td> </tr><tr><th colspan=\"3\"><em>Impact</em></th> </tr><tr><td>Conditional on the study getting a statistically significant result on EITHER respiratory symptoms OR COVID-19, the WHO will publish an update to its <a href=\"https://www.who.int/publications/i/item/advice-on-the-use-of-masks-in-the-community-during-home-care-and-in-healthcare-settings-in-the-context-of-the-novel-coronavirus-(2019-ncov)-outbreak\">guidance on masks</a> mentioning this study.</td> <td>65%</td> <td>June 1, 2021</td> </tr><tr><td>Conditional on the study getting a statistically significant result on EITHER respiratory symptoms OR COVID-19, we will see at least one country with a population &gt;20 million update its guidance on mask-wearing, explicitly referring to EITHER this evidence OR updated WHO guidance that refers to this evidence.</td> <td>60%</td> <td>June 1, 2021</td> </tr><tr><td>Conditional on the study getting a statistically significant result on EITHER respiratory symptoms OR COVID-19, it will be mentioned in the <a href=\"https://www.gov.uk/government/news/government-publishes-sage-minutes\">minutes</a> of the UK's SAGE discussions.</td> <td>40%</td> <td>June 1, 2021</td> </tr><tr><th colspan=\"3\"><em>Timing</em> </th><th></th></tr><tr><td>A preprint is published (i.e., a draft paper is published on the internet) on the basis of this RCT by October 1, 2020.</td> <td>20%</td> <td>October 1, 2020</td> </tr><tr><td>A preprint is published (i.e., a draft paper is published on the internet) on the basis of this RCT by December 1, 2020.</td> <td>55%</td> <td>December 1, 2020</td> </tr><tr><td>A preprint is published (i.e., a draft paper is published on the internet) on the basis of this RCT by February 1, 2021.</td> <td>65%</td> <td>February 1, 2021</td> </tr><tr><td>A preprint is published (i.e., a draft paper is published on the internet) on the basis of this RCT by April 1, 2021.</td> <td>75%</td> <td>April 1, 2021</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Center for Effective Global Action at UC Berkeley — Scoping RCTs for",
"URL": "https://www.givewell.org/research/incubation-grants/cega-uc-berkeley/july-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this project, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>. Note that these forecasts assume two postdoctoral researchers assigned to the project by CEGA. </p><ul><li>40% chance that by the end of 2019 we will fund at least one long-term follow-up study because of this project. </li><li>20% chance that by the end of 2019 we will fund at least two long-term follow-up studies because of this project. </li><li>35% chance that by the end of 2019 we renew the grant to fund further research into intervention areas where we could potentially fund long-term follow-up studies. </li><li>5% chance that by the end of 2020 we will fund at least five long-term follow-up studies because of this project. </li><li>40% chance that by the end of 2020 non-GiveWell funder(s) will fund at least three long-term follow-up studies because of this project. </li><li>5% chance that by the end of 2020 a long-term follow-up study funded because of this project (by us or another funder) will affect how we allocated more than &dollar;10 million in funding from 2018-2020. </li><li>25% chance that by the end of 2025 a long-term follow-up study funded because of this project (by us or another funder) will affect how we allocate more than &dollar;10 million in funding from 2018-2025. </li><li>10% chance that by the end of 2025 a long-term follow-up study funded because of this project (by us or another funder) will affect how we allocate more than &dollar;40 million in funding from 2018-2025.</li></ul><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action Beta — Incubator Program",
"URL": "https://www.givewell.org/research/incubation-grants/july-2018-evidence-action-beta-incubator#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>30%</td> <td>This grant does not lead to any new top charities.</td> <td>December 2023</td> </tr><tr><td>55%</td> <td>The Beta incubator leads to a new top charity that is 1-2x the cost-effectiveness of our marginal spending on current top charities.</td> <td>December 2023</td> </tr><tr><td>10%</td> <td>The Beta incubator leads to a new top charity that's &gt;2x as cost-effective as our marginal spending on current top charities</td> <td>December 2023</td> <td></td></tr><tr><td>5%</td> <td>The Beta incubator program has impacts that lead us to make a public case that it was extremely cost-effective overall (i.e., it resulted in at least &dollar;10 million in spending at 15x the cost-effectiveness of cash transfers or more).</td> <td>December 2023</td> </tr><tr><td>15%</td> <td>Our marginal spending on top charities will be 2.5x as cost-effective as cash or less (using our <a href=\"https://docs.google.com/spreadsheets/d/1kQJRvHehD9iEkKWnb0rrsZ5sxeeqyeaZ20KcQVf8r98/edit#gid=1680005064\">current cost-effectiveness estimate for cash</a>)</td> <td>December 2023</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Centre for Pesticide Suicide Prevention — General Support",
"URL": "https://www.givewell.org/research/incubation-grants/centre-pesticide-suicide-prevention/august-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>Elie: 67%; James: 65%</td> <td>We recommend a second grant to CPSP</td> <td>July 1, 2019</td> </tr><tr><td>Elie: 33%; James: 55%</td> <td>Conditional on CPSP entering Nepal, Nepal will pass legislation to ban at least one of the three pesticides most commonly used in suicide.</td> <td>July 1, 2020</td> </tr><tr><td>Elie: 5%; James: 10%</td> <td>Conditional on CPSP entering India, India will pass legislation to ban at least one of the three pesticides most commonly used in suicide.</td> <td>July 1, 2020</td> </tr><tr><td>Elie: 15%; James: 35%</td> <td>Conditional on CPSP entering India, a state in India will pass legislation to ban at least one of the three pesticides most commonly used in suicide.</td> <td>July 1, 2020</td> </tr><tr><td>James: 85% for each</td> <td>Conditional on legislation to ban pesticides used in suicide being passed in Nepal / India, the pesticide suicide rate is lower in the combined three years after the ban than it is in the three years before the ban (as determined by national level data or representative survey data)</td> <td>3 years after legislation passed</td> </tr><tr><td>James: 40% for each</td> <td>Conditional on legislation to ban pesticides used in suicide being passed in Nepal / India, the pesticide suicide rate is &gt;10% lower in the combined three years after the ban than it is in the three years before the ban (as determined by national level data or representative survey data)</td> <td>3 years after legislation passed</td> </tr><tr><td>James: 20% for each</td> <td>Conditional on legislation to ban pesticides used in suicide being passed in Nepal / India, the pesticide suicide rate is &gt;15% lower in the combined three years after the ban than it is in the three years before the ban (as determined by national level data or representative survey data)</td> <td>3 years after legislation passed</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Innovation in Government Initiative — General Support",
"URL": "https://www.givewell.org/research/incubation-grants/innovation-in-government-initiative/december-2018-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>35%</td> <td>GiveWell makes another grant to IGI</td> <td>January 1, 2021</td> </tr><tr><td>60%</td> <td>IGI is able to raise more than &dollar;1 million in funding from other sources</td> <td>January 1, 2021</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "IDinsight — Beneficiary Preferences Survey (2019)",
"URL": "https://www.givewell.org/research/incubation-grants/IDinsight-beneficiary-preferences-march-2019#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecast</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By time</th> </tr><tr><td>35%</td> <td>At least four GiveWell staff members with inputs in our <a href=\"https://docs.google.com/spreadsheets/u/1/d/1_bNbnVaAUQSq4fIzGBU_wVWojmwZrvQKzjSRx92y6wc/edit#gid=1362437801\">cost-effectiveness model</a> change their moral weights for either valuing health vs. income or age-weighting by at least 25%, and they attribute that change to this research</td> <td>End of 2020</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Fortify Health — General Support (2019)",
"URL": "https://www.givewell.org/research/incubation-grants/fortify-health/august-2019-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By time</th> </tr><tr><td>25%</td> <td>Fortify Health becomes a top charity.</td> <td>November 2022</td> </tr><tr><td>75%</td> <td>Fortify Health has successfully signed agreements to install equipment with at least an additional 8 mills.</td> <td>July 2020</td> </tr><tr><td>25%</td> <td>Fortify Health has successfully signed agreements to install equipment with at least an additional 16 mills.</td> <td>July 2020</td> </tr><tr><td>33%</td> <td>Fortify Health has successfully installed equipment in at least 8 additional partner mills.</td> <td>July 2020</td> </tr><tr><td>10%</td> <td>Fortify Health has successfully installed equipment in at least 16 additional partner mills.</td> <td>July 2020</td> </tr><tr><td>90%</td> <td>Fortify Health successfully maintains its four existing miller partnerships.</td> <td>July 2020</td> </tr><tr><td>60%</td> <td>Laboratory tests from random samples of atta produced by Fortify Health's partner mills do not fall more than 1mg below the target (21.25 mg of iron per kilogram of wheat flour) in more than 25% of cases.</td> <td>July 2020</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Fortify Health — General Support",
"URL": "https://www.givewell.org/research/incubation-grants/fortify-health/june-2018-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecasts</a>:</p> <table><tr><th>Confidence</th> <th>Prediction</th> <th>By Time</th> </tr><tr><td>35%</td> <td>GiveWell makes another grant to Fortify Health to work on iron fortification in India</td> <td>May 1, 2019</td> </tr><tr><td>50%</td> <td>Fortify Health completes installation of fortification equipment in at least one mill</td> <td>May 1, 2019</td> </tr><tr><td>20%</td> <td>Fortify Health completes installation of fortification equipment in at least five mills</td> <td>May 1, 2019</td> </tr><tr><td>10%</td> <td>Fortify Health becomes a GiveWell top charity</td> <td>May 1, 2022</td> </tr><tr><td>60%</td> <td>GiveWell models Fortify Health as more than 10x as cost-effective<a class=\"see-footnote\" id=\"footnoteref8_y3c4ixc\" title=\" Note: This prediction concerns only our cost-effectiveness estimate of the direct intervention at a scale of &gt;20 mills or their equivalent output (roughly 233,600 metric tons of flour per year), not taking into account e.g. implementation risk or the benefits of supporting state efforts. \" href=\"#footnote8_y3c4ixc\">8</a> as cash after updating our CEA based on the Cochrane review of iron fortification that is scheduled to be released in 2018</td> <td>May 1, 2019</td> </tr></table><div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support (April 2020)",
"URL": "https://www.givewell.org/research/incubation-grants/new-incentives/april-2020-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2> <p>For this grant, we are recording the following <a href=\"https://www.givewell.org/research/internal-forecasts\">forecast</a>:</p> <p>75% chance that GiveWell will make a decision by September 30, 2020, about whether to recommend that Open Philanthropy and other donors continue to fund New Incentives.</p> <div class='toc-back-to-top'><a href='#toc'></a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Harvard University — Solar Geoengineering Research Program",
"URL": "https://www.openphilanthropy.org/focus/global-catastrophic-risks/miscellaneous/harvard-university-solar-geoengineering-research-program",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Internal_forecasts\">Internal forecasts</h2>\n<p>We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following public forecast:</p>\n<ul>\n<li>80% chance that we will consider this grant a success in 10 years.\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "UC Berkeley — Center for Human-Compatible AI (2016)",
"URL": "https://www.openphilanthropy.org/focus/global-catastrophic-risks/potential-risks-advanced-artificial-intelligence/uc-berkeley-center-human-compatible-ai",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"About_the_grant\">About the grant</h2>\n<p>This grant will support the establishment of the Center for Human-Compatible AI at UC Berkeley, led by Professor Russell with the following co-Principal Investigators and collaborators:</p>\n<ul>\n<li>Pieter Abbeel, Associate Professor of Computer Science, UC Berkeley</p>\n<li>Anca Dragan, Assistant Professor of Computer Science, UC Berkeley\n<li>Tom Griffiths, Professor of Psychology and Cognitive Science, UC Berkeley\n<li>Bart Selman, Professor of Computer Science, Cornell University\n<li>Joseph Halpern, Professor of Computer Science, Cornell University\n<li>Michael Wellman, Professor of Computer Science, University of Michigan\n<li>Satinder Singh Baveja, Professor of Computer Science, University of Michigan</ul>\n<p>Research topics that the Center may focus on include:</p>\n<ul>\n<li>Value alignment through, e.g., inverse reinforcement learning from multiple sources (such as text and video).\n<li>Value functions defined by partially observable and partially defined terms (e.g. “health,” “death”).\n<li>The structure of human value systems, and the implications of computational limitations and human inconsistency.\n<li>Conceptual questions including the properties of ideal value systems, tradeoffs among humans and long-term stability of values.</ul>\n<p> We see the creation of this center as an important component of our efforts to help build the field of AI safety for several reasons:\n<ul>\n<li>We expect the existence of the Center to make it much easier for researchers interested in exploring AI safety to discuss and learn about the topic, and potentially consider focusing their careers on it. Ideally this will result in a larger number of researchers ending up working on topics related to AI safety than otherwise would have.\n<li>The Center may allow researchers already focused on AI safety to dedicate more of their time to the topic and produce higher-quality research.\n<li>We hope that the existence of a well-funded academic center at a major university will solidify the place of this work as part of the larger fields of machine learning and artificial intelligence.</ul>\n<p>Based on our in-progress investigation of field-building, our impression is that funding the creation of new academic centers is a very common part of successful philanthropic efforts to build new fields. </p>\n<p>We also believe that supporting Professor Russell&#8217;s work in general is likely to be beneficial. He appears to us to be more focused on reducing potential risks of advanced artificial intelligence (particularly the specific <a href=\"/blog/potential-risks-advanced-artificial-intelligence-philanthropic-opportunity#Importance\">risks we are most focused on</a>) than any comparably senior, mainstream academic of whom we are aware. We also see him as an effective communicator with a good reputation throughout the field.</p>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Budget_and_room_for_more_funding\">Budget and room for more funding</h3>\n<p>Professor Russell estimates that the Center could, if funded fully, spend between $1.5 million and $2 million in its first year and later increase its budget to roughly $7 million per year.</p>\n<p>Professor Russell currently has a few other sources of funding to support his own research and that of his students (all amounts are approximate):\n<ul>\n<li>$340,000 from the Future of Life Institute\n<li>$280,000 from the Defense Advanced Research Projects Agency\n<li>$1,500,000 from the Leverhulme Trust (spread over 10 years)</ul>\n<p>Our understanding is that most of this funding is already or will soon be accounted for, and that Professor Russell would not plan to announce a new Center of this kind without substantial additional funding. Professor Russell has also applied for a National Science Foundation Expedition grant, which would be roughly $7 million to $10 million over ten years. However, because we do not expect that decision to be made until at least a few months after the final deadline for proposals in January 2017, and because we understand those grants to be very competitive, we decided to set our level of funding without waiting for that announcement.</p>\n<p>We are not aware of other potential funders who would consider providing substantial funding to the Center in the near future, and we believe that having long-term support in place is likely to make it easier for Professor Russell to recruit for the Center.</p>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3>\n<p>We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecast:\n<ul>\n<li>50% chance that, two years from now, the Center will be spending at least $2 million a year, and will be considered by one or more of our relevant technical advisors to have a reasonably good reputation in the field.\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Compassion in World Farming USA — General Support (2016)",
"URL": "https://www.openphilanthropy.org/focus/us-policy/farm-animal-welfare/CIWF-USA-general-support",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Plans_for_learning_and_follow-up\">Plans for learning and follow-up</h2>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Goals_and_expectations_for_this_grant\">Goals and expectations for this grant</h3>\n<p>We hope this grant will enable CIWF USA to:</p>\n<ol>\n<li>Grow into a role similar to that which we see organizations like the Humane Society of the United States (HSUS) filling, working cooperatively with U.S. corporations to achieve farm animal welfare reforms.\n<li>Persuade at least one major poultry producer (e.g. Perdue Foods, Tyson Foods, Pilgrim&#8217;s Pride Corporation) to adopt a meaningful broiler welfare policy, thereby setting a precedent in the industry.\n<li>Continue the existing trend toward cage-free eggs and begin securing broiler chicken welfare policies at major companies.\n</ol>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3>\n<p>We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecasts:</p>\n<ul>\n<li>50% chance that CIWF USA will persuade at least one major poultry company to adopt a meaningful broiler chicken welfare policy.</p>\n<li>75% chance that CIWF USA will play a major role in securing five or more new corporate cage-free pledges. </ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Impact Justice — Restorative Justice Project",
"URL": "https://www.openphilanthropy.org/focus/us-policy/criminal-justice-reform/impact-justice-restorative-justice-project",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Plans_for_follow-up\">Plans for follow-up</h2>\n<p>After the first year of the grant period, we plan to begin evaluating the progress of the grant by looking for the following markers of success:</p>\n<ul>\n<li>Attempts by criminal justice officials to bring in practitioners from other places to work with them on further developing the concept of restorative justice.\n<li>Public statements of support for restorative justice.\n<li>Increasing use of language related to restorative justice.\n<li>Political partners on restorative justice work stepping forward as champions or allies on other types of local criminal justice reform.\n<li>Public recognition by federal-level system leaders that restorative justice is a viable and desirable alternative to incarceration.\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Goals_for_the_grant\">Goals for the grant</h3>\n<p>We have two main goals for this grant:</p>\n<ol>\n<li>To advance restorative justice as a potential alternative to incarceration in the long term. In particular, we believe that restorative justice could be a useful alternative in the types of cases that are unlikely to benefit from the current political consensus on the need for drug law and mental health reform. Our understanding is that restorative justice has been shown to work best in the serious and violent cases for which most other criminal justice reform efforts have failed.\n<li>To change the political culture in the targeted jurisdictions to be more open to criminal justice reform in general.\n</ol>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Key_questions_for_follow-up\">Key questions for follow-up</h3>\n<ul>\n<li>How many key stakeholders is Impact Justice engaging in each location? How far along are they in the process of accepting restorative justice as a viable alternative?\n<li>Has Impact Justice observed spillover effects from its local restorative justice work?\n<li>What progress has been made on national advocacy?\n<li>What progress has been made on interactions with the federal government?\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3>\n<p>We&#8217;re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecasts:</p>\n<ul>\n<li>10% chance that we will consider this grant a cost-effective success in one year.\n<li>70% chance that this grant will play an important role in getting traction for the concept of restorative justice on a national level over the next three years.\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Deciding_whether_to_renew_the_grant\">Deciding whether to renew the grant</h3>\n<p>By the end of the three-year grant period, we expect to have good information on the success of the grant. It is likely that we will want to renew the grant if:</p>\n<ol>\n<li>Ms. baliga has built a strong platform for restorative justice work and is gaining traction and attention.\n<li>Stakeholders in the targeted jurisdictions are signing on to support the restorative justice programs.\n</ol>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "Efforts to Improve the Accuracy of Our Judgments and Forecasts",
"URL": "https://www.openphilanthropy.org/blog/efforts-improve-accuracy-our-judgments-and-forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 undefined",
"Stars": "★★★☆☆"
},
{
"Title": "80,000 Hours — General Support",
"URL": "https://www.openphilanthropy.org/giving/grants/80000-hours-general-support",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Plans_for_follow-up\">Plans for follow-up</h2>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Key_questions_for_follow-up\">Key questions for follow-up</h3>\n<p>Key questions that we intend to ask when following up on 80,000 Hours’ progress include:</p>\n<ul>\n<li>How much progress has 80,000 Hours made on hiring?\n<li>How much progress has it made on fundraising?\n<li>How many IASPCs does 80,000 Hours believe it has caused since the beginning of the grant period?\n<li>Did 80,000 Hours provide plausible evidence that marketing funds were used to increase proxies for outcomes we care about, such as newsletter subscriptions, workshop attendance, or, ideally, plan changes?\n<li>Did 80,000 Hours produce written material that we think is high-quality and useful?\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3>\n<p>For this grant, we are recording the following <a href=\"/giving/grants/internal-forecasts\">forecasts</a> (though note that these forecasts are rougher than usual):</p>\n<ul>\n<li>80,000 Hours claims at least 1,500 impact-adjusted plan changes in 2017: 66%\n<li>80,000 Hours claims at least 2,400 impact-adjusted plan changes in 2017: 33%\n<li>80,000 Hours hires at least two staff members in 2017: 60%\n<li>80,000 Hours raises at least $750,000 by February 1, 2017, not including funding from the Open Philanthropy Project: 70%\n<li>80,000 Hours raises at least $1,250,000 by February 1, 2017, not including funding from the Open Philanthropy Project: 35%\n</ul>\n<p>(The above predictions were made on December 16, 2016. In fact, 80,000 Hours raised about $1 million between February 1, 2016 and February 1, 2017.)</p>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
},
{
"Title": "University of Pennsylvania — Philip Tetlock on Forecasting",
"URL": "https://www.openphilanthropy.org/giving/grants/university-pennsylvania-philip-tetlock-forecasting",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "<h2 id=\"Plans_for_follow-up\">Plans for follow-up</h2>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Goals_and_expectations_for_this_grant\">Goals and expectations for this grant</h3>\n<p>We do not have settled expectations for this grant. We expect that there is a large range of possible outcomes that we would be happy with, and that would be hard to predict in advance.</p>\n<p>We think that it is reasonable to expect that this grant enables Professor Tetlock’s future projects to launch, and perhaps to become more ambitious than they otherwise would have been. We would be pleased if these projects improve our understanding of forecasting and prediction-making in general, or if they provide a platform for Professor Tetlock to bring his existing findings to a more mainstream audience. </p>\n<p>An example of a very positive outcome, from our perspective, would be if this grant contributes to a shift towards a world in which comparing policy claims to the best available forecasts becomes a standard component of evaluating such claims. We consider it very unlikely that this will be a direct outcome of this grant, but we would be excited if the grant laid some groundwork for further work in this direction.</p>\n<p>An example of the kind of impact we would consider a moderate success for this type of effort in the longer term is the effect that Nate Silver’s statistical modeling at <a href=\"http://fivethirtyeight.com\">FiveThirtyEight</a><a class=\"see-footnote\" id=\"footnoteref11_30uihdt\" title=\" Archived copy of link: FiveThirtyEight Website \" href=\"#footnote11_30uihdt\">11</a> has had on the analysis of presidential elections. We would not characterize this impact as revolutionary, but we believe that it has been notable, and that his analyses and models are well-known and respected among people who think seriously about elections. </p>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Internal_forecasts\">Internal forecasts</h3>\n<p>We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking), in part in connection with our interest in the topic of this grant. The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecast:\n<ul>\n<li>The Alpha Pundit Challenge, or something like it, will have converted five or more vague predictions from pundits into numerical predictions, beyond those described in <a class=\"source-definition\" href=\"/files/Grants/Tetlock/Revolutionizing_the_interviewing_of_alpha-pundits_nov_10_2015.pdf\">Tetlock, Alpha Pundit Challenge Proposal</a>, by December 31, 2016: 50%</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Key_questions_for_follow_up\">Key questions for follow up</h3>\n<p>Questions we anticipate asking Professor Tetlock as part of our follow-up on this grant include:</p>\n<ul>\n<li>How was the funding spent?</p>\n<li>What progress has been made on Adversarial Collaboration Tournaments, the Alpha Pundit Challenge, and any other relevant projects?\n<li>Did interesting or high profile people become involved with either project?\n<li>Was he able to attract significant public attention to either project?\n</ul>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div><h3 id=\"Follow_up_expectations\">Follow up expectations</h3>\n<p>We plan to speak to Professor Tetlock about these projects roughly every six months. We anticipate producing a written update on this grant after one or two years. If we decide at some point to make a follow up grant, we expect that we would produce a written update at that time. </p>\n<div class='toc-back-to-top'><a href='#toc'>Back to Top</a></div>",
"Stars": "★★★☆☆"
}
]
Reference in New Issue View Git Blame Copy Permalink