Vyacheslav Matyukhin
a1ba23e340
feat: data in public schema; merge history tables
2022-03-31 13:00:09 +03:00
e9f0c66ca2
tweak: only show first three options of sample when inserting
2022-03-30 22:02:52 -04:00
Vyacheslav Matyukhin
4eeab9c861
WIP: no schemas
2022-03-30 20:21:38 +03:00
Vyacheslav Matyukhin
838fecd556
feat: faster upserts
2022-03-30 20:15:01 +03:00
Vyacheslav Matyukhin
6dfbe0c05e
cleanup: logs for algolia
2022-03-30 20:14:56 +03:00
Vyacheslav Matyukhin
f9e8f320a0
feat: xrisk and givewellopenphil backend platforms
2022-03-30 19:53:22 +03:00
Vyacheslav Matyukhin
49d8140784
feat: algolia settings in .env
2022-03-30 19:52:43 +03:00
Vyacheslav Matyukhin
0c9e577319
fix: forgot await
2022-03-29 21:47:28 +03:00
Vyacheslav Matyukhin
a3eea5a98e
feat: cli improvements
2022-03-29 20:54:20 +03:00
Vyacheslav Matyukhin
4a58389976
Merge remote-tracking branch 'origin/master' into refactor-platforms
2022-03-29 20:46:05 +03:00
Vyacheslav Matyukhin
89fc5ec8b6
refactor: reorganize platforms code further
2022-03-29 18:10:28 +03:00
4c1376f170
fix: small bugs on new polymarket fetcher
2022-03-28 22:38:14 -04:00
b7409b23f2
feat: make polymarket fetcher more efficient
2022-03-28 22:24:44 -04:00
27652407fd
fix: fix cookies script to apply to heroku, not netlify
2022-03-28 22:24:15 -04:00
Vyacheslav Matyukhin
4a8377704d
comment: draft for future Platform type
2022-03-29 05:10:49 +03:00
Vyacheslav Matyukhin
8553dfa93f
fix: godjudmentopen spelling matches db
2022-03-29 05:10:34 +03:00
Vyacheslav Matyukhin
efae18600f
feat: separate fetchers from upserts
2022-03-29 04:34:27 +03:00
Vyacheslav Matyukhin
066eb0302a
style: bring back double quotes from prettier
...
One large commit to avoid dealing with messy patches later on.
Turns out I had
https://marketplace.visualstudio.com/items?itemName=amatiasq.sort-imports
installed with single quotes which messed up all double quotes from
prettier.
2022-03-28 20:59:07 +03:00
63e77bcd04
Merge branch 'master' into no-mongo
2022-03-27 22:46:35 -04:00
5b9b36d2ed
Merge pull request #23 from QURIresearch/more-typescript
...
feat: More typescript & cleanups
2022-03-27 22:45:25 -04:00
Vyacheslav Matyukhin
a1c3f03d7d
feat: remove mongodb support
...
also:
- refactor and significantly simplify database-wrapper code
- rename manualSendToMongo to manualSendToDb
2022-03-28 02:09:34 +03:00
8a40676b7b
fix: change goodjudment script
2022-03-27 17:53:29 -04:00
Vyacheslav Matyukhin
806ec3ee51
feat: fix mongodb call in databaseReadWithReadCredentials (unused)
2022-03-28 00:32:47 +03:00
Vyacheslav Matyukhin
164f996f41
feat: convert all js to ts
...
allowJs is set to false in tsconfig.json now; please write all future
code with typescript.
cleanups:
- removed platforms/deprecated
- removed flow/history/old
- see https://github.com/QURIresearch/metaforecast/issues/22
- commented some invalid axios options
- minor fixes with mismatching function arguments
- commented invalid mongo call in databaseReadWithReadCredentials
- {encoding: 'utf-8'} in readFileSync calls
2022-03-28 00:32:47 +03:00
Vyacheslav Matyukhin
41b314b84a
cleanup: more ts, delete unused api endpoints
2022-03-28 00:32:27 +03:00
698a11c28f
feat: add plausible.io script
2022-03-27 17:19:06 -04:00
1ac56a3ee6
tweak: Change about page
2022-03-27 11:34:25 -04:00
Vyacheslav Matyukhin
8cfdaddd7a
feat: cli exits properly; disable excessive db logging
2022-03-27 02:03:48 +03:00
Vyacheslav Matyukhin
7565540f8a
feat: repo renamed
2022-03-27 00:33:13 +03:00
Vyacheslav Matyukhin
d662572bcd
feat: don't update progress bar on searches
2022-03-26 14:42:13 +03:00
Vyacheslav Matyukhin
bb846068f3
feat: shallow: true on router.replace
2022-03-26 14:33:22 +03:00
Vyacheslav Matyukhin
d921885f1b
feat: nprogress bar
2022-03-26 14:23:38 +03:00
Vyacheslav Matyukhin
f2745d713c
feat: useNoInitialEffect in CommonDisplay ( fix #14 )
2022-03-26 14:21:36 +03:00
Vyacheslav Matyukhin
1b1c0f4228
refactor: move layout.tsx to web/display
...
https://metaforecast.org/layout is not a real page, so it shouldn't be
in src/pages.
2022-03-26 04:15:07 +03:00
Vyacheslav Matyukhin
9c586c6ec1
refactor: commonDisplay -> CommonDisplay
2022-03-26 03:57:18 +03:00
Vyacheslav Matyukhin
b481212721
feat: more ts, fix tailwind
...
- rename more files to .ts/.tsx
- update tailwind config to use .tsx files from all dirs
- merge css files into a single main.css to avoid import order
dependencies
- minor cleanups due to ts complaints
2022-03-26 03:36:50 +03:00
Vyacheslav Matyukhin
42c0f0967b
feat: back to frontpage-in-db approach
2022-03-26 02:51:55 +03:00
Vyacheslav Matyukhin
80ee4c4055
fix: content jumps due to vertical scrollbar
2022-03-26 01:57:40 +03:00
Vyacheslav Matyukhin
f056d257b2
feat: /capture and / are static
2022-03-25 02:45:21 +03:00
Vyacheslav Matyukhin
98c7c31a0f
feat: always search on client side
2022-03-25 01:51:20 +03:00
Vyacheslav Matyukhin
c92d131ae3
feat: reactive search with useEffect
2022-03-25 01:23:07 +03:00
Vyacheslav Matyukhin
23a4003f31
feat: refactor commonDisplay and related code
...
- more typescript
- fix https://github.com/QURIresearch/metaforecast-frontend/issues/15
- simplify hasDisplayBeenCaptured code
- various cleanups
2022-03-25 01:22:26 +03:00
Vyacheslav Matyukhin
9714e4cd0a
fix: frontpage json serialization
2022-03-24 21:41:23 +03:00
Vyacheslav Matyukhin
796d227537
feat: rewrite frontpage code with direct db queries
2022-03-24 21:08:48 +03:00
Vyacheslav Matyukhin
abf3ba8327
feat: setCookies uses netlify
2022-03-24 15:47:35 +03:00
Vyacheslav Matyukhin
20af4e91fb
cleanup: remove unused data/ and input/ files
2022-03-24 15:47:16 +03:00
Vyacheslav Matyukhin
490f698f26
cleanup old commented fs.writeFileSync calls
2022-03-24 01:48:36 +03:00
Vyacheslav Matyukhin
f3592cde40
remove getSecret, always use env variables
2022-03-24 01:07:55 +03:00
Vyacheslav Matyukhin
a5563f9d2e
store frontpage code in db
2022-03-22 03:30:25 +03:00
Vyacheslav Matyukhin
6ffa3c0cfc
fix: import
2022-03-22 03:30:25 +03:00
Vyacheslav Matyukhin
244f02b3af
refactor: monorepo
2022-03-22 03:30:25 +03:00
2df73b4933
fix: Deal with Metaculus throttling
...
Parse the error messages and wait for the indicated amount.
2022-03-20 10:46:58 -04:00
941fecc36e
feat: Added to-do list
2022-03-14 23:39:55 -04:00
1e2562ba3f
fix: smarkets bug-ish
2022-03-08 01:59:30 -05:00
2138c0c642
fix: also save year
2022-03-05 19:03:22 -05:00
896e48efaa
feat: Workable history on postgres
...
Still has to be optimized. In particular, I could paste
one table into another one, rather than have them
pass through node.
2022-03-05 18:21:55 -05:00
20b22ab75a
fix: pg timestamp problems
2022-03-05 10:28:09 -05:00
81eb03e029
feat: Migration from mongo to pg
2022-03-03 16:55:32 -05:00
6043f56a1b
tweak: Change Manifold markets url
2022-03-03 12:18:41 -05:00
62f77071f5
fix: database bug
2022-02-28 11:50:40 -05:00
83e50e7349
fix: pg url
2022-02-26 13:36:19 -05:00
752a5b2cfe
fix: weird problem with GiveWell dates
2022-02-14 15:39:30 -05:00
927114a8cc
feat: save changes to show Cole &co
2022-02-14 13:58:36 -05:00
e280b36e20
tweak: switch infer debug mode off
2022-02-12 16:55:20 -05:00
7d0293a013
fix: reorder prompt items
2022-02-12 16:53:31 -05:00
7bd1fc50c5
fix: Too much logging
2022-02-12 16:27:18 -05:00
3a901077c9
fix: upsert logic
2022-02-12 16:24:16 -05:00
8b6f648c08
fix: pg client logic
2022-02-12 16:13:51 -05:00
29c51a13ed
fix: change cookie to env variable
2022-02-12 16:09:26 -05:00
6a257c2152
feat: Read pg database
2022-02-12 16:04:31 -05:00
6bb3da0e32
feat: Added postgres database in parallel to the mongo one
2022-02-12 01:27:56 -05:00
65fbddf0cf
feat: Make code somewhat database independent, and reorganized old
...
data.
2022-02-11 14:15:09 -05:00
2dcea149d1
feat: code reorganization
2022-02-11 12:19:33 -05:00
3d43aa3b6e
feat: Markets now have unique ids in preparation for dashbards.
2022-02-11 09:21:36 -05:00
d760532e95
tweak: just use the backup proxy
2022-02-04 16:49:20 -05:00
76325bcc48
tweak: add hardcoded proxy as backup
2022-02-04 16:42:49 -05:00
9bda1c2558
fix: add proxy
2022-02-04 16:42:49 -05:00
e0bc00d6e9
feat: add proxy
2022-02-04 16:41:52 -05:00
108da329d5
tweak
2022-02-04 16:41:52 -05:00
c064b23c9e
tweak: change user agent for good judgment forecasts
2022-02-04 16:41:47 -05:00
20c9c820fb
feat: Added infer
2022-02-04 14:54:04 -05:00
68a7feb6e6
chore: Deprecate outdated or inaccessible platforms, but keep the code
2022-02-04 13:33:39 -05:00
ba24ef7722
fix: recalculate manifold markets stars
2022-02-04 11:14:17 -05:00
a7c09e14ae
chore: Cleanup.
...
- Deleted foretold community on astralcodexten questions
- because now they are managed by Metaculus/Manifold
- fixed small mistake for good judgment
- recalculated scores for manifold markets
- avoid low-quality markets.
2022-02-04 10:42:03 -05:00
9159af7ece
tweak: Consolidate the extra field as distinct from the quality indicators field. Replace tabs with spaces.
2022-01-12 14:03:31 +01:00
884cfb2463
fix: less verbose log
2022-01-12 13:08:50 +01:00
379269a2a1
fix: metaculus fetch
2022-01-12 13:06:29 +01:00
07f30f57a2
fix: further Manifold Market tweaks
2022-01-11 23:25:32 +01:00
eb2bbe5551
fix: Manifold Markets liq.
2022-01-11 23:14:34 +01:00
08715357fd
feat: Added Manifold Markets
2022-01-11 22:55:46 +01:00
62b0f8e210
tweak: Found some bugs, added some convenience options
2021-12-05 13:30:06 +01:00
ee0ee3ca16
feat: regiggled metaculus predictions to deal with new interface
2021-12-02 13:30:16 +01:00
36e3d4af46
tweak: Pull predictions to frontpage
2021-11-05 15:14:45 +00:00
1462580d44
fix: Keeping up with cultivate labs
2021-11-05 13:45:55 +00:00
7ec50c599d
feat: Download questions more conveniently
2021-10-22 18:43:56 +02:00
e074b934a5
fix: Wildeford tweaks
2021-10-15 11:57:19 +02:00
d1c41f4c01
feat: Added predictions from Peter Wildeford
...
- Wildeford, née Hurford
- Also removed node_modules from tracking
2021-10-15 11:40:05 +02:00
c573c1a2a6
fix: Update polymarket endpoint
2021-09-22 19:29:23 +02:00
c08ee19479
tweak: Improvements to PredictIt fetcher
2021-09-14 12:25:28 +02:00
d9b654d19e
fix: Changed units of Kalshi volume to shares traded
...
- Previously was in dollars
- Also some tweaks to stars
- Also some tweaks too Good Judgment fetching1
2021-09-03 23:00:07 +02:00
50224cbb88
fix: Update polymarket endpoint
2021-08-31 22:06:28 +02:00
6f87f8bc43
fix: Streamlined Polymarket code; removed sports markets
2021-08-31 21:55:57 +02:00
f7a324cce0
feat: Deal with new CSET-Foretell question types.
...
Per https://www.cset-foretell.com/blog/rolling-question-formats ,
CSET-Foretell has added new question types.
They appear to be fairly hard to parse, so I'm not doing that yet.
However, I'm still incorporating them into the database
2021-08-31 21:23:08 +02:00
d836e7c26f
feat: Added the correct urls to Kalshi markets.
2021-08-31 21:14:55 +02:00
6593b48553
fix: Added timeout before trying again after an error
...
in the doEverything function at doEverything.js
2021-08-31 21:14:14 +02:00
682ea25615
fix: Throttle Metaculus requests.
2021-08-26 15:32:09 +02:00
b3678df9cd
feat: Adapted metaforecast to work with the new Metaculus frontend.
2021-08-25 23:42:03 +02:00
b6b4252c72
fix: Light csetforetell-fetch modifications
2021-08-22 20:08:04 +02:00
45deb7abe2
feat: Improved star ratings
...
- Deprecated some star ratings which I now think are not coarse enough
2021-08-21 13:59:23 +02:00
a97e1986b1
fix: Renamed manualDownloadFromMongo.js to manualDownload.js to make less confusing to newcomers.
...
Based on feedback by Ozzie
2021-08-16 20:18:15 +02:00
68648880c3
fix: Added timestamps to Hypermind predictions which didn't have them
2021-08-15 18:25:54 +02:00
08267e790b
fix: Minor tweaks
...
Kalshi doesn't print so many messages, algolia uses more efficient version
2021-08-15 17:07:57 +02:00
255af85b39
fix: Fix js memory/garbage collecting problems by not fetching as much information in the 1st place.
...
Turns out that the Hypermind request just has a parameter I can switch.
2021-08-13 18:35:39 +02:00
140184cd64
fix: Fix JavaScript memory/garbage collecting problems by deleted unwanted objects sooner.
...
In more context, when fetching Hypermind predictions, questions for the AI in 2030 challenge
have a really large crowdFcstHist property. I'm seeing if deleting it right after fetching
the items for the challenge makes js problems go away.
2021-08-13 18:18:36 +02:00
3c0a01db95
fix: Better markdown conversion for Hypermind questions
2021-08-11 23:06:46 +02:00
1fd3b29def
fix: Cosmetic tweaks to Hypermind forecasts
2021-08-11 22:01:31 +02:00
8e47215e6e
fix: Added fix to nasty bug which was inflating the number of coup cast predictions
...
Also made algolia code slightly more robust
2021-08-11 21:00:13 +02:00
6144675a41
feat: Added missing Hypermind tournament
...
- Also made the Hypermind code more maintainable.
2021-08-11 20:21:48 +02:00
ec28944178
chore: Updated README
2021-08-11 01:25:10 +02:00
b8d2823d2b
feat: Deal correctly in markdown with links that contain parenthesis.
2021-08-08 21:06:43 +02:00
1980ac53e3
chore: tweaks
2021-08-08 19:42:21 +02:00
e2adcf95f4
feat: Added Algolia to search
...
Also some light cleanup necessary to Algolia, e.g., numforecasts is now guaranteed to be a Number() (or a NaN, in case something goes very wrong)
2021-08-08 15:24:56 +02:00
b1d8c3cba9
fix: Kalshi and Betfair stars are now 3
2021-08-06 04:05:38 +02:00
66b024bd38
feat: Added Betfair
2021-08-01 01:55:08 +02:00
d3d41d94e1
chore: commit before npm audit fix
2021-08-01 00:34:41 +02:00
ec29825d56
fix: Do not update database if signed out
2021-07-27 23:50:31 +02:00
6833849fa6
feat: Added Kalshi
...
Also some fixes, and I think some functionality to get randomly selected forecasts
2021-07-27 23:44:43 +02:00
4247af47c6
fix: Do not update database if signed out
2021-07-09 19:09:22 +02:00
d9390faeec
fix: Reworked logic to better deal with being logged out in CultivateLabs platforms
2021-07-09 18:33:37 +02:00
87db98ec45
fix: Added more detection of whether I'm not logged in to CSET-foretell; it turns out that the first page of questions is shown even if not logged in.
2021-07-05 00:01:09 +02:00
c46c0242a2
fix: Case where GJO/CSET-foretelll cookies are outdated and the program enters an infinite loop is now fixed.
2021-07-04 23:37:08 +02:00
843d69d937
Added evaluations community to foretold fetcher. Fixed small bug in wrapper
2021-07-03 15:09:04 +02:00
216be068a9
Reinstated history functionality. This is for all platforms except for Metaculus (and Estimize). I'll see how it goes, and i particular, if I exceed the limit for July. If I do, the thing to do is to have a history for every platform for every month, rather than a history for all platforms for every month. It would make things slightly messier, though
2021-06-27 23:54:10 +02:00
c5bf99cee8
Rootclaim tweak
2021-06-27 20:12:46 +02:00
5b92f73747
Rootclaim formatting tweak
2021-06-27 19:56:39 +02:00
35a2a3c1f2
Rootclaim tweak
2021-06-27 19:32:50 +02:00
13481b8b0b
Added Rootclaim to backend
2021-06-27 19:22:54 +02:00
d733804a72
Fixed annoying cset bug
2021-06-25 18:00:00 +02:00
d66d4b43c9
Removed Good Judgment because they imposed restrictions
2021-06-22 16:22:50 +02:00
afaea9106a
Fixed error which broke CSET predictions
2021-06-11 21:13:28 +02:00
ffbd09416d
Added more throtlling when fetching from metaculus
2021-06-08 15:00:11 +02:00
2ca3815de1
Updated CSET-foretell logs; updated coupcast month
2021-05-10 16:54:27 +02:00
9831c86674
Fixed problem with cset-foretell probabilities
2021-05-02 16:30:02 +02:00
f69814d8e7
New commit; shouldn't produce history
2021-04-29 18:11:45 +02:00
f45e302208
Stopped adding to history as MongoDB total size was exceeded
2021-04-29 12:42:34 +02:00
3d406ac919
Minor updates to cset, added new cookies
2021-04-25 20:10:36 +02:00
0490783289
Testing cset foretell cookies
2021-04-25 14:53:37 +02:00
f092c800ab
Updated database explanations
2021-04-14 18:49:05 +02:00
025c983374
Minor gj bug
2021-04-12 20:56:49 +02:00
bb93a65043
Minor metaculus typo
2021-04-12 20:54:19 +02:00
ff91af4183
Tweaks to persist good judgment superforecaster commentary at the suggestion of MichaelA
2021-04-11 21:40:21 +02:00
965336bf9d
Small tweaks to make the log more manageable
2021-04-11 20:08:59 +02:00
6346565a1c
Trying out cookie system
2021-04-10 20:28:19 +02:00
cf795eb90e
Added somewhat more complicated cookie functionality
2021-04-10 20:18:22 +02:00
abc4f61432
Fixed bug in addToHistory function
2021-04-10 15:49:20 +02:00
3841dbfd1a
Added history state
2021-04-10 12:49:05 +02:00
0ae360a1d7
Made small change to xriskdatabase, and prepared for the creation of a history database
2021-04-10 12:28:32 +02:00
787bac7efe
Cleanup
2021-04-09 17:03:04 +02:00
112f56b6a3
Fixed problem with inactive polymarket markets
2021-04-09 16:53:57 +02:00
6f70199f60
Cleanup after debugging
2021-04-09 16:33:23 +02:00
0254aa03ea
Added code to deal with an edge case
2021-04-09 16:31:13 +02:00
2f6c8daaca
Continuing to integrate netlify
2021-04-09 00:17:10 +02:00
b86d95778c
Added netlify hook
2021-04-09 00:01:50 +02:00
d15a234399
Changed old password to correct new process variable
2021-04-08 23:29:08 +02:00
89c29053d4
Test loop hypothesis
2021-04-08 22:51:02 +02:00
3774ce55d4
Simplified prints
2021-04-08 21:32:03 +02:00
fff8470b8f
Changed process type to a worker
2021-04-08 19:38:06 +02:00
c8b1e3d28d
created a replaceAll method for strings
2021-04-08 19:32:44 +02:00
834d0dcad9
Added print statement to debug
2021-04-08 19:27:12 +02:00
5e0457d051
Added procfile
2021-04-08 19:19:56 +02:00
448864a695
Added doEverything at the beginning to see errors.
2021-04-08 19:17:51 +02:00
9ffe42ccf7
Small change
2021-04-08 18:59:24 +02:00
7aebda5e0d
Removed running of command line interface
2021-04-08 18:53:58 +02:00
8e2d68191e
Use process.env variable instead of a file
2021-04-08 18:52:03 +02:00
799a683d88
Refactored application to use a mongodb database
2021-04-08 18:42:48 +02:00
5006c976c4
Changed foretold/williamwill
2021-04-08 10:45:12 +02:00
590d747b6f
New structure, with a history
2021-04-08 10:21:26 +02:00
c83f2a747f
Added timestamp + quality indicators
2021-04-07 22:29:21 +02:00
01788da517
Daily commit
2021-04-07 12:45:01 +02:00
083a2620d8
Daily commit
2021-04-04 18:37:04 +02:00
04d639455f
Daily commit
2021-04-03 00:33:41 +02:00
4598ae7fbc
Daily commit
2021-03-28 19:45:02 +02:00
9dd9247437
Daily commit
2021-03-27 21:53:57 +01:00
085a8b02cc
Daily commit
2021-03-27 12:21:06 +01:00
8fbfa86337
Added estimize stars
2021-03-18 03:35:45 +01:00
d9a2cb3956
Added estimize
2021-03-18 03:13:34 +01:00
eebc3a8335
Daily commit
2021-03-16 17:55:45 +01:00
8120cceaf7
Daily commit
2021-03-16 12:14:54 +01:00
66e4ac335d
Daily commit
2021-03-16 11:57:49 +01:00
7b7212df17
Daily commit
2021-03-16 11:52:13 +01:00
1a279ff70d
Daily commit
2021-03-15 19:35:24 +01:00
1e7c883b6a
Daily commit
2021-03-13 18:49:29 +01:00
a83abd61ca
Changed ladbrokes and williamhill code to pull all probabilities, not just those above 2%
2021-03-13 18:16:35 +01:00
32b09d8134
Daily commit; also added WilliamHill and Ladbrokes, and started adding a skeleton for betfair
2021-03-13 17:46:22 +01:00
e6496be35b
Daily commit x2
2021-03-11 18:49:41 +01:00
ca81d1e014
Metaculus question edit
2021-03-09 10:50:14 +01:00
d6fc431e71
Changed metaculus fetcher to also pull closed but not yet resolved questions
2021-03-08 22:17:29 +01:00
2e8110d276
Daily commit
2021-03-07 20:27:07 +01:00
756cd45cd9
Added foretold to the mix
2021-03-05 20:54:40 +01:00
a98d500b14
Changed polymarket endpoint
2021-03-03 22:48:00 +01:00
