Commit Graph

286 Commits

Author SHA1 Message Date
68a7feb6e6 chore: Deprecate outdated or inaccessible platforms, but keep the code 2022-02-04 13:33:39 -05:00
ba24ef7722 fix: recalculate manifold markets stars 2022-02-04 11:14:17 -05:00
a7c09e14ae chore: Cleanup.
- Deleted foretold community on astralcodexten questions
  - because now they are managed by Metaculus/Manifold
- fixed small mistake for good judgment
- recalculated scores for manifold markets
  - avoid low-quality markets.
2022-02-04 10:42:03 -05:00
9159af7ece tweak: Consolidate the extra field as distinct from the quality indicators field. Replace tabs with spaces. 2022-01-12 14:03:31 +01:00
884cfb2463 fix: less verbose log 2022-01-12 13:08:50 +01:00
379269a2a1 fix: metaculus fetch 2022-01-12 13:06:29 +01:00
07f30f57a2 fix: further Manifold Market tweaks 2022-01-11 23:25:32 +01:00
eb2bbe5551 fix: Manifold Markets liq. 2022-01-11 23:14:34 +01:00
08715357fd feat: Added Manifold Markets 2022-01-11 22:55:46 +01:00
62b0f8e210 tweak: Found some bugs, added some convenience options 2021-12-05 13:30:06 +01:00
ee0ee3ca16 feat: regiggled metaculus predictions to deal with new interface 2021-12-02 13:30:16 +01:00
36e3d4af46 tweak: Pull predictions to frontpage 2021-11-05 15:14:45 +00:00
1462580d44 fix: Keeping up with cultivate labs 2021-11-05 13:45:55 +00:00
7ec50c599d feat: Download questions more conveniently 2021-10-22 18:43:56 +02:00
e074b934a5 fix: Wildeford tweaks 2021-10-15 11:57:19 +02:00
d1c41f4c01 feat: Added predictions from Peter Wildeford
- Wildeford, née Hurford
- Also removed node_modules from tracking
2021-10-15 11:40:05 +02:00
c573c1a2a6 fix: Update polymarket endpoint 2021-09-22 19:29:23 +02:00
c08ee19479 tweak: Improvements to PredictIt fetcher 2021-09-14 12:25:28 +02:00
d9b654d19e fix: Changed units of Kalshi volume to shares traded
- Previously was in dollars
- Also some tweaks to stars
- Also some tweaks too Good Judgment fetching1
2021-09-03 23:00:07 +02:00
50224cbb88 fix: Update polymarket endpoint 2021-08-31 22:06:28 +02:00
6f87f8bc43 fix: Streamlined Polymarket code; removed sports markets 2021-08-31 21:55:57 +02:00
f7a324cce0 feat: Deal with new CSET-Foretell question types.
Per https://www.cset-foretell.com/blog/rolling-question-formats,
CSET-Foretell has added new question types.
They appear to be fairly hard to parse, so I'm not doing that yet.
However, I'm still incorporating them into the database
2021-08-31 21:23:08 +02:00
d836e7c26f feat: Added the correct urls to Kalshi markets. 2021-08-31 21:14:55 +02:00
6593b48553 fix: Added timeout before trying again after an error
in the doEverything function at doEverything.js
2021-08-31 21:14:14 +02:00
682ea25615 fix: Throttle Metaculus requests. 2021-08-26 15:32:09 +02:00
b3678df9cd feat: Adapted metaforecast to work with the new Metaculus frontend. 2021-08-25 23:42:03 +02:00
b6b4252c72 fix: Light csetforetell-fetch modifications 2021-08-22 20:08:04 +02:00
45deb7abe2 feat: Improved star ratings
- Deprecated some star ratings which I now think are not coarse enough
2021-08-21 13:59:23 +02:00
a97e1986b1 fix: Renamed manualDownloadFromMongo.js to manualDownload.js to make less confusing to newcomers.
Based on feedback by Ozzie
2021-08-16 20:18:15 +02:00
68648880c3 fix: Added timestamps to Hypermind predictions which didn't have them 2021-08-15 18:25:54 +02:00
08267e790b fix: Minor tweaks
Kalshi doesn't print so many messages, algolia uses more efficient version
2021-08-15 17:07:57 +02:00
255af85b39 fix: Fix js memory/garbage collecting problems by not fetching as much information in the 1st place.
Turns out that the Hypermind request just has a parameter I can switch.
2021-08-13 18:35:39 +02:00
140184cd64 fix: Fix JavaScript memory/garbage collecting problems by deleted unwanted objects sooner.
In more context, when fetching Hypermind predictions, questions for the AI in 2030 challenge
have a really large crowdFcstHist property. I'm seeing if deleting it right after fetching
the items for the challenge makes js problems go away.
2021-08-13 18:18:36 +02:00
3c0a01db95 fix: Better markdown conversion for Hypermind questions 2021-08-11 23:06:46 +02:00
1fd3b29def fix: Cosmetic tweaks to Hypermind forecasts 2021-08-11 22:01:31 +02:00
8e47215e6e fix: Added fix to nasty bug which was inflating the number of coup cast predictions
Also made algolia code slightly more robust
2021-08-11 21:00:13 +02:00
6144675a41 feat: Added missing Hypermind tournament
- Also made the Hypermind code more maintainable.
2021-08-11 20:21:48 +02:00
ec28944178 chore: Updated README 2021-08-11 01:25:10 +02:00
b8d2823d2b feat: Deal correctly in markdown with links that contain parenthesis. 2021-08-08 21:06:43 +02:00
1980ac53e3 chore: tweaks 2021-08-08 19:42:21 +02:00
e2adcf95f4 feat: Added Algolia to search
Also some light cleanup necessary to Algolia, e.g., numforecasts is now guaranteed to be a Number() (or a NaN, in case something goes very wrong)
2021-08-08 15:24:56 +02:00
b1d8c3cba9 fix: Kalshi and Betfair stars are now 3 2021-08-06 04:05:38 +02:00
66b024bd38 feat: Added Betfair 2021-08-01 01:55:08 +02:00
d3d41d94e1 chore: commit before npm audit fix 2021-08-01 00:34:41 +02:00
ec29825d56 fix: Do not update database if signed out 2021-07-27 23:50:31 +02:00
6833849fa6 feat: Added Kalshi
Also some fixes, and I think some functionality to get randomly selected forecasts
2021-07-27 23:44:43 +02:00
4247af47c6 fix: Do not update database if signed out 2021-07-09 19:09:22 +02:00
d9390faeec fix: Reworked logic to better deal with being logged out in CultivateLabs platforms 2021-07-09 18:33:37 +02:00
87db98ec45 fix: Added more detection of whether I'm not logged in to CSET-foretell; it turns out that the first page of questions is shown even if not logged in. 2021-07-05 00:01:09 +02:00
c46c0242a2 fix: Case where GJO/CSET-foretelll cookies are outdated and the program enters an infinite loop is now fixed. 2021-07-04 23:37:08 +02:00
843d69d937 Added evaluations community to foretold fetcher. Fixed small bug in wrapper 2021-07-03 15:09:04 +02:00
216be068a9 Reinstated history functionality. This is for all platforms except for Metaculus (and Estimize). I'll see how it goes, and i particular, if I exceed the limit for July. If I do, the thing to do is to have a history for every platform for every month, rather than a history for all platforms for every month. It would make things slightly messier, though 2021-06-27 23:54:10 +02:00
c5bf99cee8 Rootclaim tweak 2021-06-27 20:12:46 +02:00
5b92f73747 Rootclaim formatting tweak 2021-06-27 19:56:39 +02:00
35a2a3c1f2 Rootclaim tweak 2021-06-27 19:32:50 +02:00
13481b8b0b Added Rootclaim to backend 2021-06-27 19:22:54 +02:00
d733804a72 Fixed annoying cset bug 2021-06-25 18:00:00 +02:00
d66d4b43c9 Removed Good Judgment because they imposed restrictions 2021-06-22 16:22:50 +02:00
afaea9106a Fixed error which broke CSET predictions 2021-06-11 21:13:28 +02:00
ffbd09416d Added more throtlling when fetching from metaculus 2021-06-08 15:00:11 +02:00
2ca3815de1 Updated CSET-foretell logs; updated coupcast month 2021-05-10 16:54:27 +02:00
9831c86674 Fixed problem with cset-foretell probabilities 2021-05-02 16:30:02 +02:00
f69814d8e7 New commit; shouldn't produce history 2021-04-29 18:11:45 +02:00
f45e302208 Stopped adding to history as MongoDB total size was exceeded 2021-04-29 12:42:34 +02:00
3d406ac919 Minor updates to cset, added new cookies 2021-04-25 20:10:36 +02:00
0490783289 Testing cset foretell cookies 2021-04-25 14:53:37 +02:00
f092c800ab Updated database explanations 2021-04-14 18:49:05 +02:00
025c983374 Minor gj bug 2021-04-12 20:56:49 +02:00
bb93a65043 Minor metaculus typo 2021-04-12 20:54:19 +02:00
ff91af4183 Tweaks to persist good judgment superforecaster commentary at the suggestion of MichaelA 2021-04-11 21:40:21 +02:00
965336bf9d Small tweaks to make the log more manageable 2021-04-11 20:08:59 +02:00
6346565a1c Trying out cookie system 2021-04-10 20:28:19 +02:00
cf795eb90e Added somewhat more complicated cookie functionality 2021-04-10 20:18:22 +02:00
abc4f61432 Fixed bug in addToHistory function 2021-04-10 15:49:20 +02:00
3841dbfd1a Added history state 2021-04-10 12:49:05 +02:00
0ae360a1d7 Made small change to xriskdatabase, and prepared for the creation of a history database 2021-04-10 12:28:32 +02:00
787bac7efe Cleanup 2021-04-09 17:03:04 +02:00
112f56b6a3 Fixed problem with inactive polymarket markets 2021-04-09 16:53:57 +02:00
6f70199f60 Cleanup after debugging 2021-04-09 16:33:23 +02:00
0254aa03ea Added code to deal with an edge case 2021-04-09 16:31:13 +02:00
2f6c8daaca Continuing to integrate netlify 2021-04-09 00:17:10 +02:00
b86d95778c Added netlify hook 2021-04-09 00:01:50 +02:00
d15a234399 Changed old password to correct new process variable 2021-04-08 23:29:08 +02:00
89c29053d4 Test loop hypothesis 2021-04-08 22:51:02 +02:00
3774ce55d4 Simplified prints 2021-04-08 21:32:03 +02:00
fff8470b8f Changed process type to a worker 2021-04-08 19:38:06 +02:00
c8b1e3d28d created a replaceAll method for strings 2021-04-08 19:32:44 +02:00
834d0dcad9 Added print statement to debug 2021-04-08 19:27:12 +02:00
5e0457d051 Added procfile 2021-04-08 19:19:56 +02:00
448864a695 Added doEverything at the beginning to see errors. 2021-04-08 19:17:51 +02:00
9ffe42ccf7 Small change 2021-04-08 18:59:24 +02:00
7aebda5e0d Removed running of command line interface 2021-04-08 18:53:58 +02:00
8e2d68191e Use process.env variable instead of a file 2021-04-08 18:52:03 +02:00
799a683d88 Refactored application to use a mongodb database 2021-04-08 18:42:48 +02:00
5006c976c4 Changed foretold/williamwill 2021-04-08 10:45:12 +02:00
590d747b6f New structure, with a history 2021-04-08 10:21:26 +02:00
c83f2a747f Added timestamp + quality indicators 2021-04-07 22:29:21 +02:00
01788da517 Daily commit 2021-04-07 12:45:01 +02:00
083a2620d8 Daily commit 2021-04-04 18:37:04 +02:00
04d639455f Daily commit 2021-04-03 00:33:41 +02:00
4598ae7fbc Daily commit 2021-03-28 19:45:02 +02:00
9dd9247437 Daily commit 2021-03-27 21:53:57 +01:00
085a8b02cc Daily commit 2021-03-27 12:21:06 +01:00
8fbfa86337 Added estimize stars 2021-03-18 03:35:45 +01:00
d9a2cb3956 Added estimize 2021-03-18 03:13:34 +01:00
eebc3a8335 Daily commit 2021-03-16 17:55:45 +01:00
8120cceaf7 Daily commit 2021-03-16 12:14:54 +01:00
66e4ac335d Daily commit 2021-03-16 11:57:49 +01:00
7b7212df17 Daily commit 2021-03-16 11:52:13 +01:00
1a279ff70d Daily commit 2021-03-15 19:35:24 +01:00
1e7c883b6a Daily commit 2021-03-13 18:49:29 +01:00
a83abd61ca Changed ladbrokes and williamhill code to pull all probabilities, not just those above 2% 2021-03-13 18:16:35 +01:00
32b09d8134 Daily commit; also added WilliamHill and Ladbrokes, and started adding a skeleton for betfair 2021-03-13 17:46:22 +01:00
e6496be35b Daily commit x2 2021-03-11 18:49:41 +01:00
ca81d1e014 Metaculus question edit 2021-03-09 10:50:14 +01:00
d6fc431e71 Changed metaculus fetcher to also pull closed but not yet resolved questions 2021-03-08 22:17:29 +01:00
2e8110d276 Daily commit 2021-03-07 20:27:07 +01:00
756cd45cd9 Added foretold to the mix 2021-03-05 20:54:40 +01:00
a98d500b14 Changed polymarket endpoint 2021-03-03 22:48:00 +01:00
4adf97b504 Daily update 2021-03-02 14:31:15 +01:00
678785f3b9 Daily commit, also fixed a bug for PredictIt predictions 2021-03-01 16:35:08 +01:00
f13a2b23bc Added url to GiveWell/OpenPhil questions 2021-02-28 20:25:49 +01:00
2de3f88eda Addedded code to better search options with Fuse 2021-02-25 17:56:27 +01:00
701a7630a5 Change readme to point to the website as well 2021-02-23 15:19:31 +01:00
cc7771d898 Fixeed mistake where cset and gjopen markets were formtted wrong 2021-02-19 19:57:44 +01:00
52950ccd39 Changed stars as unicode to their numeric value 2021-02-18 20:55:26 +01:00
9ab4a21ff6 Updated code to fetch and save all options, not just yes/no for binary questions 2021-02-18 17:12:55 +01:00
f4d007f954 Added smarkets 2021-02-16 17:14:53 +01:00
2eb1816897 Added an explanation of stars 2021-02-04 13:53:55 +01:00
ed290b52d2 Added descriptions, updated webpage 2021-02-03 18:35:38 +01:00
8906eae584 Added various good judment (Superforecaster) dashboards 2021-02-02 19:01:34 +01:00
e8bb18a6a6 Only 2 decimal places for hypermind probabilities 2021-02-02 13:25:42 +01:00
0a414a4490 Added Hypermind at the request of lukeprog 2021-02-02 12:54:16 +01:00
a63bf373b6 Changed API endpoint 2021-02-01 23:36:43 +01:00
9d70812fb9 Updated polymarket & elicit fetchers so that they now run without human input. Added Omen 2021-01-28 15:28:01 +01:00
3c76badc10 Initial commit 2021-01-12 13:43:41 +01:00