nunosempere.com/blog/2022/08/04/usd1-000-squiggle-experimentation-challenge/index.md

59 lines
5.0 KiB
Markdown
Raw Normal View History

2022-08-10 12:21:51 +00:00
$1,000 Squiggle Experimentation Challenge
==============
<p> <img src="https://i.imgur.com/aCnDHbw.jpg" class="img-medium-center"></p>
## Motivation
The team at QURI has [recently released Squiggle,](https://forum.effectivealtruism.org/posts/TfPdb2aMKzgWXFvc3/announcing-squiggle-early-access) a very new and experimental programming language for probabilistic estimation. Were curious about what promising use cases it could enable, and we are launching a prize to incentivize people to find this out.
## Prize
We offer a $600 first-place prize, a $300 second-place prize, and a $100 third-place prize. The prize will be paid for by the [Quantified Uncertainty Research Institute](https://quantifieduncertainty.org/) (QURI).
## Rules
To enter, first make a public post online between now and September 1, 2022. We encourage you to either post directly or make a link post to either the EA Forum or to LessWrong. Second, complete [this form](https://airtable.com/shrEMU0EEeEFgsBTJ), also before September 1, 2022.
Well aim to make decisions by October 1, 2022.
More specifically:
1. Experiment with Squiggle. Make an interesting model with it or develop a tech prototype or integration using it.
2. Make a (short is fine) blog post about your experiment. If you post to the EA Forum or LessWrong, others can more easily share their opinions. In your post, if you could include some honest feedback on how you found working with Squiggle, that would be appreciated, but it's not required.
3. Submit [this form](https://airtable.com/shrEMU0EEeEFgsBTJ) with the key details. Submit it by September 1, 2022. 
## Support & Feedback
If youd like feedback or would like to discuss possible projects, please reach out! (via direct message or [email](mailto:ozzie@quantifieduncertainty.org).) Well invite you to our Slack and can give feedback and advice. Also, feel free to file issues or comments/questions/suggestions on the [Squiggle Github page](https://github.com/quantified-uncertainty/squiggle).
## Judges
The judges will be [](https://forum.effectivealtruism.org/users/alexrjl)[Nuño Sempere](https://forum.effectivealtruism.org/users/nunosempere), [Ozzie Gooen](https://forum.effectivealtruism.org/users/oagr), and [Quinn Dougherty](https://forum.effectivealtruism.org/users/quinn). The rest of the Squiggle team will also consult. Well select winners for their importance, novelty, and presentation.
## Ideas
Some ideas, any of which could be taken from the [recent post](https://forum.effectivealtruism.org/posts/TfPdb2aMKzgWXFvc3/announcing-squiggle-early-access):
**Software Ideas**
* Build integrations with other tools. Google Docs, Airtable, Roam Research, Obsidian, Python, other forecasting platforms, etc.
* Integrate Squiggle in other software platforms or tools. Maybe use it to power an online calculator to return probability distributions instead of numbers.
* Make open-source [React](https://reactjs.org/) components around probability distributions better visualize the outputs of Squiggle models.
* Build neat tools on top of Squiggle. For example, Squiggle could help power a node-based graphical editor or a calendar-based time estimation tool. Users might not need to know anything about Squiggle; it would just be used for internal math.
* Make [Observable](https://observablehq.com/) dashboards that take in real-time data from the web, and use Squiggle to do some simple math on them and return probability distributions or functions. (For instance, see [this post](https://observablehq.com/@hazelfire/givewells-givedirectly-cost-effectiveness-analysis) that uses Squiggle in Observable.)
**Research Ideas**
* Estimate the entire value of the far future over time.
* Estimate EA funding over time.
* Convert several of the AI timelines estimates into Squiggle, then use Squiggle to help aggregate them, e.g. [Cotras report](https://www.lesswrong.com/posts/KrJfoZzpSDpnrv9va/draft-report-on-ai-timelines), or [Carlsmiths](https://www.alignmentforum.org/posts/HduCjmXTBD4xYTegv/draft-report-on-existential-risk-from-power-seeking-ai). Carlsmiths report mostly uses probabilities, but one could try to use distributions over probabilities representing the range of expert opinion instead.
**Some existing tools that use Squiggle (for inspiration)**
* [This tool](https://recursing.github.io/guesstimate_to_squiggle/) converts Guesstimate models into Squiggle models, by [Lorenzo](https://forum.effectivealtruism.org/users/lorenzo-buonanno-1).
* [Google Sheets integration](https://docs.google.com/spreadsheets/d/1uKtQDlOQ0UYJznlzDNAwSdvwIB6bYv4tT8Z5gIQi7Fc/edit#gid=1407581126) by Nuño Sempere
* [An API to interact with Squiggle](https://metaforecast.org/api/squiggle) by Nuño Sempere
* [A work-in-progress interactive tool for making hierarchical estimates](https://github.com/quantified-uncertainty/hierarchical-estimates-visualizer) by Nuño Sempere
* [An experimental Squiggle CLI for allowing imports](https://www.npmjs.com/package/squiggle-cli-experimental), by QURI.