Shapley Maximizers is a niche estimation, evaluation and impact auditing consultancy run by myself, Nuño Sempere, but increasingly also with support from collaborators. This page presents our core competencies, consulting rates, description of ideal clients, two testimonials, and a few further thoughts. In short, we are looking to support smallish people and projects who are already producing value, and who want to add clarity and improve their prioritization through estimation, measure and good judgment. You can reach out to to nuno.semperelh@protonmail.com. ### Core competencies #### Research Some past research outputs: - [Incentive Problems With Current Forecasting Competitions.](https://forum.effectivealtruism.org/posts/ztmBA8v6KvGChxw92/incentive-problems-with-current-forecasting-competitions) - [Real-Life Examples of Prediction Systems Interfering with the Real World (Predict-O-Matic Problems)](https://www.lesswrong.com/posts/6bSjRezJDxR2omHKE/real-life-examples-of-prediction-systems-interfering-with) - [A prior for technological discontinuities](https://www.lesswrong.com/posts/FaCqw2x59ZFhMXJr9/a-prior-for-technological-discontinuities) - [Better scoring rules](https://github.com/SamotsvetyForecasting/optimal-scoring) - [Prediction Markets in The Corporate Setting](https://forum.effectivealtruism.org/posts/dQhjwHA7LhfE8YpYF/prediction-markets-in-the-corporate-setting) - [A concern about the “evolutionary anchor” of Ajeya Cotra’s report on AI timelines.](https://forum.effectivealtruism.org/posts/FHTyixYNnGaQfEexH/a-concern-about-the-evolutionary-anchor-of-ajeya-cotra-s). See [here](https://forum.effectivealtruism.org/users/nunosempere?sortedBy=top) for more past projects. #### Red-teaming Do you want my most disagreeable self to poke holes in your proposal or idea? I'm happy to do this. #### Programming Do you want me to build a website or tool? This is something I'd be excited to do more of. For a larger project, see [metaforecast](https://metaforecast.org/), for smaller projects see [this EA forum frontend](https://forum.nunosempere.com), [shapleyvalue.com](https://shapleyvalue.com/), this [tool to fit a beta distribution to a confidence interval](https://nunosempere.com/blog/2023/03/15/fit-beta/), or [this tool to compute proportional approval voting results for cases with more than one candidate](https://nunosempere.github.io/ea/ProportionalApprovalVoting.html). You might also want to check out [my Github](https://github.com/NunoSempere/). #### Evaluation and estimation Do you want me to evaluate a project, estimate its value, and suggest ways you could do better? I am very happy to do this. Some past examples are: - [A Critical Review of Open Philanthropy’s Bet On Criminal Justice Reform](https://forum.effectivealtruism.org/posts/h2N9qEbvQ6RHABcae/a-critical-review-of-open-philanthropy-s-bet-on-criminal) - [Shallow evaluations of longtermist organizations](https://forum.effectivealtruism.org/posts/xmmqDdGqNZq5RELer/shallow-evaluations-of-longtermist-organizations) - [2018-2019 Long-Term Future Fund Grantees: How did they do?](https://forum.effectivealtruism.org/posts/Ps8ecFPBzSrkLC6ip/2018-2019-long-term-future-fund-grantees-how-did-they-do) - [External Evaluation of the EA Wiki](https://forum.effectivealtruism.org/posts/kTLR23dFRB5pJryvZ/external-evaluation-of-the-ea-wiki). - [An experiment eliciting relative estimates for Open Philanthropy’s 2018 AI safety grants](https://forum.effectivealtruism.org/posts/EPhDMkovGquHtFq3h/an-experiment-eliciting-relative-estimates-for-open). For a smaller example, in the past I've really enjoyed doing subjective estimates of the value of different career pathways ([1](https://docs.google.com/spreadsheets/d/1QHBaCjf17C1VF_-su-7xHqz1UCwFrlPyCojiN1xzCi0/edit#gid=0), [2](https://docs.google.com/spreadsheets/d/1qvNGkpt9ztOfIYEPXAXJT62wiPQFG9CKm8yGlSHO1Yo/edit#gid=0)). #### Forecasting I am happy to host workshops, or advise on tournament or forecasting platform design. If you are looking for specific forecasts, you probably want to hire [Samotsvety](https://samotsvety.org/) instead, which can be reached out at info@samotsvety.org. ### Management as a service Here is a service that I've enjoyed providing: - I meet up with someone for around one hour once a week. - We talk about what that person has done for the past week, and we schedule what the person is going to be doing next week. - We talk about what they could have done better, how they could do better in the future, and through any important decisions that the person is making. I've enjoyed providing this service to a few entrepreneurial-minded people who are doing projects independently, or who are managing their own organizations independently. They seem to value having someone who keeps track of what they're doing and keeping them accountable, someone to bounce ideas off, and the opportunity to take some time each week to reflect on what they've been doing. They also appreciate me in particular being incisive. If the above sounds interesting, I'm happy to be reached out to. ### Rates I value getting hired for more hours, because each engagement has some negotiation, preparation and administrative burden. Therefore, I am discounting buying a larger number of hours. | # of hours | Cost | Example | |------------|-------|------------------------------------------------------------------------------------------------| | 1 hour (discounted) | $100 | You, an early career person, talk with me for an hour about a career decision you are about to make, about a project you want my input on, etc. | | 2 hours | $500 \|\| 10% chance of $4k | You, a titan of industry, talk with me for an hour about a project you want my input on, before which I spend an hour thinking about it. Or, you have me organize a forecasting workshop for your underlings, etc. | | 10 hours | $2k | Research that draws on my topics of expertise, where I have already thought about the topic, and just have to write it down. For example, [this Bayesian adjustment to Rethink Priorities](https://nunosempere.com/blog/2023/02/19/bayesian-adjustment-to-rethink-priorities-welfare-range-estimates/) | | 100 hours | $15k | An [evaluation of an organization](https://forum.effectivealtruism.org/posts/kTLR23dFRB5pJryvZ/external-evaluation-of-the-ea-wiki), an early version of [metaforecast](https://metaforecast.org), two editions of the [forecasting newsletter](https://forecasting.substack.com/) | | 1000 hours | reach out | Large research project, an ambitious report on a novel topic, the current iteration of [metaforecast](https://metaforecast.org) | ### Description of client My ideal client would be someone or some organization who is producing value in the world, and which wants me to identify ways they could do even better in an open-ended way. Because this context would be assumed to be highly collaborative, they would have a high tolerance for disagreeableness. A close second would be someone who is making an important decision commissioning me to estimate the value of the different options they are considering. My anti-client on the other hand would be someone who has already made up their mind, and who wants me to rubber-stamp their decisions, like a grifty crypto project[^1] asking for help writting up a grant to an EA grantmaker, or someone commissioning an evaluation that they will ignore, or a forecast that doesn't feed into any decisions. ### Testimonials > I reached out to Nuño in mid-2021 because I was impressed by his "Shallow evaluation of longtermist organizations", and wanted him to conduct an evaluation of the EA Wiki, of which I was at the time the editor. I was very pleased with the rigour and thoroughness of the analysis he produced, and would recommend his services as a project evaluator and forecaster unreservedly. Indeed, I can think of very few other people in this area whom I would endorse as enthusiastically as I do Nuño. > > —Pablo Stafforini
> Nuño has depth of knowledge and a track record to prove it. His work spans AI, nuclear risk and a myriad other topics, which I have consistently found insightful. A generalist of the highest calibre. > We hired Nuño to review a complex article about AI and forecasting. He delivered promptly, and we found his work insightful. > > —Jaime Sevilla ### Further details - I am very amenable to taking on projects that would require more than one person, because I am able to bring in collaborators. I would discuss this with the potential client beforehand. [^1]: Note that I don't think all crypto projects are grifty, and I in fact view crypto as a pretty promising area of innovation. It's just that for the last couple years if you wanted to grift, crypto was a good place to do so. And in fact a crypto project that wanted to figure out how to produce more value in the world and capture some fraction of it could be a great client.