[
{
"Title": "One for the World — General Support",
"URL": "https://www.givewell.org/about/impact/one-for-the-world/july-2018-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "
Internal forecasts
For this grant, we are recording the following forecasts:
Confidence | Prediction | By Time |
---|
25% | OFTW moves more than $2.5 million to GiveWell top charities in 2020. | End of 2020 |
15% | Conditioned on it still being active, OFTW moves more than $5 million to GiveWell top charities in 2023. | End of 2023 |
75% | We renew our support to OFTW after one year. | September 2019 |
50% | We renew our support to OFTW after two years. | September 2020 |
",
"Stars": "★★★☆☆"
},
{
"Title": "Georgetown University Initiative on Innovation, Development, and",
"URL": "https://www.givewell.org/charities/gui2de/january-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, Josh Rosenberg, our senior research analyst who led GiveWell's investigation of Zusha!, records the following forecasts:
- Zusha! is recommended as a top charity by year-end 2017: 35%, broken down into:
- Zusha! appears more cost-effective than AMF: 10%
- Zusha! appears roughly as cost-effective as AMF: 15%
- Zusha! appears less cost-effective than AMF (but is still a top charity recommendation): 10%
",
"Stars": "★★★☆☆"
},
{
"Title": "Charity Science: Health — General Support",
"URL": "https://www.givewell.org/charities/charity-science/charity-science-health/november-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:
- Good Ventures gives additional funding to Charity Science: Health in one year: 80%
- Charity Science: Health becomes (or creates) a GiveWell top charity by giving season 2019: 15%
",
"Stars": "★★★☆☆"
},
{
"Title": "Charity Science Health — SMS Reminders for Immunization",
"URL": "https://www.givewell.org/charities/charity-science/charity-science-health/july-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
For this grant, we are recording the following forecasts:
- 80% chance that we will recommend another GiveWell Incubation Grant to Charity Science Health by August 2018.
- 15% chance that Charity Science Health will be a GiveWell top charity by the end of 2019.
",
"Stars": "★★★☆☆"
},
{
"Title": "Results for Development — Childhood Pneumonia Treatment Scale-Up",
"URL": "https://www.givewell.org/charities/results-for-development/may-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:
- Good Ventures gives R4D a second grant of approximately the same size in 12 months: 70%
- R4D is a top charity by the end of 2019: 25%
",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support (November 2017)",
"URL": "https://www.givewell.org/charities/new-incentives/november-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The purpose of this exercise is to record the implicit predictions that inform our decisions and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the forecasts below, all of which we consider to be fairly rough. Except where otherwise noted, the end date for all predictions is the end of 2020.
- New Incentives increases vaccination rates by >17 percentage points and this is detected by the RCT: 15%
- New Incentives increases vaccination rates by >17 percentage points and this is not detected by the RCT: small probability, close to 0%
- New Incentives increases vaccination rates by between 6 and 17 percentage points and this is detected by the RCT: 55%
- New Incentives increases vaccination rates by between 6 and 17 percentage points and this is either not detected by the RCT or is unclear: 15%
- New Incentives increases vaccination rates by <6 percentage points and we either conclude as much or are uncertain enough that we choose not to pursue New Incentives further: 15%
- New Incentives increases vaccination rates by <6 percentage points and we falsely believe it is higher and do pursue New Incentives further: 5%
- After seeing the RCT results, we are significantly uncertain about whether or not to recommend New Incentives as a top charity: 20%
- GiveWell estimates that New Incentives is >3x as cost-effective as GiveDirectly: 50%
- GiveWell estimates that New Incentives is >2x as cost-effective as AMF: <10%
- New Incentives becomes a top charity by November 2020: 50%
",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support (2016)",
"URL": "https://www.givewell.org/charities/new-incentives/march-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate our past predictions were. For this grant, we are recording the following forecasts (made during our decision process):
Top charity predictions
- New Incentives is a top charity in 2016: 10%
- New Incentives is a top charity in 2017: 12.5%
- New Incentives is a top charity in 2018: 15%
Cost-effectiveness predictions
- Our 2017 cost-effectiveness estimate for New Incentives is at least twice as good as our 2017 estimate for unconditional cash transfers: 67%
- Our 2017 cost-effectiveness estimate for New Incentives is at least five times as good as our 2017 estimate for unconditional cash transfers: 15%
- Our 2017 cost-effectiveness estimate for New Incentives is at least ten times as good as our 2017 estimate for unconditional cash transfers: 5%
Charity predictions
- New Incentives brings in at least $250,000 from a funder other than Good Ventures and the Lampert Family Foundation by the end of 2018: 25%
- New Incentives still operates in 2019: 40%
",
"Stars": "★★★☆☆"
},
{
"Title": "New Incentives — General Support",
"URL": "https://www.givewell.org/charities/new-incentives/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The purpose of this exercise is to record the implicit predictions that inform our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecasts:
- 70% chance that we provide funding for an RCT of New Incentives' program
- 50% chance that New Incentives is a top charity at the end of 2019
",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — No Lean Season (December 2016 grant)",
"URL": "https://www.givewell.org/charities/evidence-action/december-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We are experimenting with recording explicit numerical forecasts of the probability of events related to our decision-making (especially grant-making). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and to make it possible for us to look back on how well-calibrated and accurate those predictions were. For this grant, we are recording the following forecast:
- 65% chance that No Lean Season is a top charity at the end of giving season 2017
",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — Strengthen Operations",
"URL": "https://www.givewell.org/charities/evidence-action/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
For this grant, we are recording the following forecasts:
- 15% chance that we find a significant error in Evidence Action's financial documents in 2018
- 25% chance that an Evidence Action Beta program other than No Lean Season becomes a top charity by the end of 2021
- 60% chance that the Deworm the World Initiative's room for more funding (including execution levels 1 and 2) exceeds $10 million as of November 2018
- 60% chance that GiveWell Incubation Grants provides at least $250,000 to an Evidence Action Beta program other than No Lean Season by the end of 2018
",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action — No Lean Season (March 2016 grant)",
"URL": "https://www.givewell.org/evidence-action/march-2016-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this grant, we are recording the following forecasts:
- Top charity predictions:
- No Lean Season (or a related organization) is a top charity in 2017: 15%.
- No Lean Season (or a related organization) is a top charity in 2018: 20%.
- No Lean Season (or a related organization) is a top charity in 2019: 25%.
- Cost-effectiveness predictions:
- Our 2016 cost-effectiveness estimate for No Lean Season is at least five times as good as cash transfers: 50%.
- Our 2016 cost-effectiveness estimate for No Lean Season is less than twice as good as cash transfers: 15%.
- Our 2016 cost-effectiveness estimate for No Lean Season is at least ten times as good as cash transfers: 15%.
- Implementation predictions:
- Evidence Action is running a No Lean Season program at the end of 2017: 80%.
",
"Stars": "★★★☆☆"
},
{
"Title": "Innovations for Poverty Action — Mindset Engagement in Cash Transfers",
"URL": "https://www.givewell.org/international/charities/ipa/may-2016-grant#Risks_of_the_grant_and_internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Risks of the grant and internal forecasts
This grant could fail to have the effects we hope for in a number of ways:
- The study detects an effect that is too small relative to the cost of implementing the intervention for it to be worth scaling up. We believe this is reasonably likely (~50% chance).
- The study yields a result that we're not confident in. We think there is a moderate chance (~25%) of this (given the number of potential problems that can arise with any study).
- The study detects an effect that would be worth scaling up, but we are unable to find an implementer interested in doing so (for instance, if GiveDirectly were to decide not to incorporate the intervention because it is too time-intensive or diverts attention from other activities, or because GiveDirectly interprets the study's results differently than we do). We think this scenario is fairly unlikely (~7.5%).
- The intervention has no measurable effect, and we could have predicted this prior to the study by surveying the existing literature more thoroughly. We think this is fairly unlikely (~7.5%), especially given Sedlmayr's interest in attempting the intervention.
(We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking, especially grantmaking. The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are.)
",
"Stars": "★★★☆☆"
},
{
"Title": "Evidence Action Beta — Iron and Folic Acid Supplementation ("Phase 2")",
"URL": "https://www.givewell.org/research/incubation-grants/december-2018-evidence-action-beta-iron-folic-acid-phase-2#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Internal forecasts
For this grant, we are recording the following forecasts:
Confidence | Prediction | By Time |
---|
60% | GiveWell’s best guess is that Evidence Action’s intervention increases coverage relative to the counterfactual in the first year of Phase 2 of the program by at least 4 percentage points | December 2021 |
50% | GiveWell’s best guess is that Evidence Action’s intervention increases coverage relative to the counterfactual in the second year of Phase 2 of the program by at least 8 percentage points (cumulatively) | December 2021 |
75% | Evidence Action requests funding for Phase 3 of this program because it believes Phase 2 to have been successful | December 2021 |
80% | Estimates of anemia rates from the India National Family Health Survey in an average of 5 randomly chosen non-Evidence Action-supported states do not show anemia declining by more than 2 percentage points per year over the last 5 years (e.g., due to iron fortification or other changes) | January 2024 |
35% | Evidence Action ultimately spends at least $15 million total on IFA technical assistance that we retrospectively model as 10x as effective (or more) than cash transfers (using our January 2018 CEA as a baseline) | January 2025 |
",
"Stars": "★★★☆☆"
},
{
"Title": "UC Berkeley — KLPS-4 Survey",
"URL": "https://www.givewell.org/research/incubation-grants/uc-berkeley/april-2017-grant#Internal_forecasts",
"Platform": "GiveWell",
"Binary question?": false,
"Percentage": "none",
"Description": "Plans for follow-up
We plan to follow up with the gift recipient roughly every six months to check in on the timeline for receiving results from this study. At this stage, our understanding is that Wave 1 results will be available by mid-2018 and Wave 2 results will be available by mid-2019. We are uncertain when results will be able to be shared publicly, but aim to write publicly about the results as soon as we are able to.
We also plan to follow up with the recipient to share their pre-analysis plan publicly and, when the study is completed, to share data publicly.
Internal forecasts
We’re experimenting with recording explicit numerical forecasts of events related to our decisionmaking (especially grantmaking). The idea behind this is to pull out the implicit predictions that are playing a role in our decisions, and make it possible for us to look back on how well-calibrated and accurate those are. For this gift, we are recording the following forecasts:
- 25% chance that the KLPS-4 survey significantly positively updates us on deworming, i.e. finds a result that increases our estimated cost-effectiveness for deworming by at least 2x.
- 5% chance that the KLPS-4 survey significantly negatively updates us on deworming, i.e. finds a result that decreases our estimated cost-effectiveness for deworming by at least 2x.
\n \n \n \n\n \n\n \n \n
\n \n \n\n \n \n \n\n \n \n \n\n \n\n