Commit Graph

217 Commits

Author SHA1 Message Date
Vyacheslav Matyukhin
244f02b3af
refactor: monorepo 2022-03-22 03:30:25 +03:00
2df73b4933 fix: Deal with Metaculus throttling
Parse the error messages and wait for the indicated amount.
2022-03-20 10:46:58 -04:00
941fecc36e feat: Added to-do list 2022-03-14 23:39:55 -04:00
1e2562ba3f fix: smarkets bug-ish 2022-03-08 01:59:30 -05:00
2138c0c642 fix: also save year 2022-03-05 19:03:22 -05:00
896e48efaa feat: Workable history on postgres
Still has to be optimized. In particular, I could paste
one table into another one, rather than have them
pass through node.
2022-03-05 18:21:55 -05:00
20b22ab75a fix: pg timestamp problems 2022-03-05 10:28:09 -05:00
81eb03e029 feat: Migration from mongo to pg 2022-03-03 16:55:32 -05:00
6043f56a1b tweak: Change Manifold markets url 2022-03-03 12:18:41 -05:00
62f77071f5 fix: database bug 2022-02-28 11:50:40 -05:00
83e50e7349 fix: pg url 2022-02-26 13:36:19 -05:00
752a5b2cfe fix: weird problem with GiveWell dates 2022-02-14 15:39:30 -05:00
927114a8cc feat: save changes to show Cole &co 2022-02-14 13:58:36 -05:00
e280b36e20 tweak: switch infer debug mode off 2022-02-12 16:55:20 -05:00
7d0293a013 fix: reorder prompt items 2022-02-12 16:53:31 -05:00
7bd1fc50c5 fix: Too much logging 2022-02-12 16:27:18 -05:00
3a901077c9 fix: upsert logic 2022-02-12 16:24:16 -05:00
8b6f648c08 fix: pg client logic 2022-02-12 16:13:51 -05:00
29c51a13ed fix: change cookie to env variable 2022-02-12 16:09:26 -05:00
6a257c2152 feat: Read pg database 2022-02-12 16:04:31 -05:00
6bb3da0e32 feat: Added postgres database in parallel to the mongo one 2022-02-12 01:27:56 -05:00
65fbddf0cf feat: Make code somewhat database independent, and reorganized old
data.
2022-02-11 14:15:09 -05:00
2dcea149d1 feat: code reorganization 2022-02-11 12:19:33 -05:00
3d43aa3b6e feat: Markets now have unique ids in preparation for dashbards. 2022-02-11 09:21:36 -05:00
d760532e95 tweak: just use the backup proxy 2022-02-04 16:49:20 -05:00
76325bcc48 tweak: add hardcoded proxy as backup 2022-02-04 16:42:49 -05:00
9bda1c2558 fix: add proxy 2022-02-04 16:42:49 -05:00
e0bc00d6e9 feat: add proxy 2022-02-04 16:41:52 -05:00
108da329d5 tweak 2022-02-04 16:41:52 -05:00
c064b23c9e tweak: change user agent for good judgment forecasts 2022-02-04 16:41:47 -05:00
20c9c820fb feat: Added infer 2022-02-04 14:54:04 -05:00
68a7feb6e6 chore: Deprecate outdated or inaccessible platforms, but keep the code 2022-02-04 13:33:39 -05:00
ba24ef7722 fix: recalculate manifold markets stars 2022-02-04 11:14:17 -05:00
a7c09e14ae chore: Cleanup.
- Deleted foretold community on astralcodexten questions
  - because now they are managed by Metaculus/Manifold
- fixed small mistake for good judgment
- recalculated scores for manifold markets
  - avoid low-quality markets.
2022-02-04 10:42:03 -05:00
9159af7ece tweak: Consolidate the extra field as distinct from the quality indicators field. Replace tabs with spaces. 2022-01-12 14:03:31 +01:00
884cfb2463 fix: less verbose log 2022-01-12 13:08:50 +01:00
379269a2a1 fix: metaculus fetch 2022-01-12 13:06:29 +01:00
07f30f57a2 fix: further Manifold Market tweaks 2022-01-11 23:25:32 +01:00
eb2bbe5551 fix: Manifold Markets liq. 2022-01-11 23:14:34 +01:00
08715357fd feat: Added Manifold Markets 2022-01-11 22:55:46 +01:00
62b0f8e210 tweak: Found some bugs, added some convenience options 2021-12-05 13:30:06 +01:00
ee0ee3ca16 feat: regiggled metaculus predictions to deal with new interface 2021-12-02 13:30:16 +01:00
36e3d4af46 tweak: Pull predictions to frontpage 2021-11-05 15:14:45 +00:00
1462580d44 fix: Keeping up with cultivate labs 2021-11-05 13:45:55 +00:00
7ec50c599d feat: Download questions more conveniently 2021-10-22 18:43:56 +02:00
e074b934a5 fix: Wildeford tweaks 2021-10-15 11:57:19 +02:00
d1c41f4c01 feat: Added predictions from Peter Wildeford
- Wildeford, née Hurford
- Also removed node_modules from tracking
2021-10-15 11:40:05 +02:00
c573c1a2a6 fix: Update polymarket endpoint 2021-09-22 19:29:23 +02:00
c08ee19479 tweak: Improvements to PredictIt fetcher 2021-09-14 12:25:28 +02:00
d9b654d19e fix: Changed units of Kalshi volume to shares traded
- Previously was in dollars
- Also some tweaks to stars
- Also some tweaks too Good Judgment fetching1
2021-09-03 23:00:07 +02:00
50224cbb88 fix: Update polymarket endpoint 2021-08-31 22:06:28 +02:00
6f87f8bc43 fix: Streamlined Polymarket code; removed sports markets 2021-08-31 21:55:57 +02:00
f7a324cce0 feat: Deal with new CSET-Foretell question types.
Per https://www.cset-foretell.com/blog/rolling-question-formats,
CSET-Foretell has added new question types.
They appear to be fairly hard to parse, so I'm not doing that yet.
However, I'm still incorporating them into the database
2021-08-31 21:23:08 +02:00
d836e7c26f feat: Added the correct urls to Kalshi markets. 2021-08-31 21:14:55 +02:00
6593b48553 fix: Added timeout before trying again after an error
in the doEverything function at doEverything.js
2021-08-31 21:14:14 +02:00
682ea25615 fix: Throttle Metaculus requests. 2021-08-26 15:32:09 +02:00
b3678df9cd feat: Adapted metaforecast to work with the new Metaculus frontend. 2021-08-25 23:42:03 +02:00
b6b4252c72 fix: Light csetforetell-fetch modifications 2021-08-22 20:08:04 +02:00
45deb7abe2 feat: Improved star ratings
- Deprecated some star ratings which I now think are not coarse enough
2021-08-21 13:59:23 +02:00
a97e1986b1 fix: Renamed manualDownloadFromMongo.js to manualDownload.js to make less confusing to newcomers.
Based on feedback by Ozzie
2021-08-16 20:18:15 +02:00
68648880c3 fix: Added timestamps to Hypermind predictions which didn't have them 2021-08-15 18:25:54 +02:00
08267e790b fix: Minor tweaks
Kalshi doesn't print so many messages, algolia uses more efficient version
2021-08-15 17:07:57 +02:00
255af85b39 fix: Fix js memory/garbage collecting problems by not fetching as much information in the 1st place.
Turns out that the Hypermind request just has a parameter I can switch.
2021-08-13 18:35:39 +02:00
140184cd64 fix: Fix JavaScript memory/garbage collecting problems by deleted unwanted objects sooner.
In more context, when fetching Hypermind predictions, questions for the AI in 2030 challenge
have a really large crowdFcstHist property. I'm seeing if deleting it right after fetching
the items for the challenge makes js problems go away.
2021-08-13 18:18:36 +02:00
3c0a01db95 fix: Better markdown conversion for Hypermind questions 2021-08-11 23:06:46 +02:00
1fd3b29def fix: Cosmetic tweaks to Hypermind forecasts 2021-08-11 22:01:31 +02:00
8e47215e6e fix: Added fix to nasty bug which was inflating the number of coup cast predictions
Also made algolia code slightly more robust
2021-08-11 21:00:13 +02:00
6144675a41 feat: Added missing Hypermind tournament
- Also made the Hypermind code more maintainable.
2021-08-11 20:21:48 +02:00
ec28944178 chore: Updated README 2021-08-11 01:25:10 +02:00
b8d2823d2b feat: Deal correctly in markdown with links that contain parenthesis. 2021-08-08 21:06:43 +02:00
1980ac53e3 chore: tweaks 2021-08-08 19:42:21 +02:00
e2adcf95f4 feat: Added Algolia to search
Also some light cleanup necessary to Algolia, e.g., numforecasts is now guaranteed to be a Number() (or a NaN, in case something goes very wrong)
2021-08-08 15:24:56 +02:00
b1d8c3cba9 fix: Kalshi and Betfair stars are now 3 2021-08-06 04:05:38 +02:00
66b024bd38 feat: Added Betfair 2021-08-01 01:55:08 +02:00
d3d41d94e1 chore: commit before npm audit fix 2021-08-01 00:34:41 +02:00
ec29825d56 fix: Do not update database if signed out 2021-07-27 23:50:31 +02:00
6833849fa6 feat: Added Kalshi
Also some fixes, and I think some functionality to get randomly selected forecasts
2021-07-27 23:44:43 +02:00
4247af47c6 fix: Do not update database if signed out 2021-07-09 19:09:22 +02:00
d9390faeec fix: Reworked logic to better deal with being logged out in CultivateLabs platforms 2021-07-09 18:33:37 +02:00
87db98ec45 fix: Added more detection of whether I'm not logged in to CSET-foretell; it turns out that the first page of questions is shown even if not logged in. 2021-07-05 00:01:09 +02:00
c46c0242a2 fix: Case where GJO/CSET-foretelll cookies are outdated and the program enters an infinite loop is now fixed. 2021-07-04 23:37:08 +02:00
843d69d937 Added evaluations community to foretold fetcher. Fixed small bug in wrapper 2021-07-03 15:09:04 +02:00
216be068a9 Reinstated history functionality. This is for all platforms except for Metaculus (and Estimize). I'll see how it goes, and i particular, if I exceed the limit for July. If I do, the thing to do is to have a history for every platform for every month, rather than a history for all platforms for every month. It would make things slightly messier, though 2021-06-27 23:54:10 +02:00
c5bf99cee8 Rootclaim tweak 2021-06-27 20:12:46 +02:00
5b92f73747 Rootclaim formatting tweak 2021-06-27 19:56:39 +02:00
35a2a3c1f2 Rootclaim tweak 2021-06-27 19:32:50 +02:00
13481b8b0b Added Rootclaim to backend 2021-06-27 19:22:54 +02:00
d733804a72 Fixed annoying cset bug 2021-06-25 18:00:00 +02:00
d66d4b43c9 Removed Good Judgment because they imposed restrictions 2021-06-22 16:22:50 +02:00
afaea9106a Fixed error which broke CSET predictions 2021-06-11 21:13:28 +02:00
ffbd09416d Added more throtlling when fetching from metaculus 2021-06-08 15:00:11 +02:00
2ca3815de1 Updated CSET-foretell logs; updated coupcast month 2021-05-10 16:54:27 +02:00
9831c86674 Fixed problem with cset-foretell probabilities 2021-05-02 16:30:02 +02:00
f69814d8e7 New commit; shouldn't produce history 2021-04-29 18:11:45 +02:00
f45e302208 Stopped adding to history as MongoDB total size was exceeded 2021-04-29 12:42:34 +02:00
3d406ac919 Minor updates to cset, added new cookies 2021-04-25 20:10:36 +02:00
0490783289 Testing cset foretell cookies 2021-04-25 14:53:37 +02:00
f092c800ab Updated database explanations 2021-04-14 18:49:05 +02:00
025c983374 Minor gj bug 2021-04-12 20:56:49 +02:00
bb93a65043 Minor metaculus typo 2021-04-12 20:54:19 +02:00