Vyacheslav Matyukhin
846e235e0c
fix: NEXT_PUBLIC_VERCEL_URL usage
2022-04-12 11:37:17 +03:00
Vyacheslav Matyukhin
ee07435c62
feat: get rid of NEXT_PUBLIC_SITE_URL
2022-04-12 00:10:07 +03:00
Vyacheslav Matyukhin
62e3a37c65
fix: capitalize component files
2022-04-10 17:34:11 +03:00
Vyacheslav Matyukhin
115bd30708
feat: 404 on non-existent dashboards
2022-04-10 16:54:51 +03:00
Vyacheslav Matyukhin
986f7ab888
feat: new dashboards logic, closes #17
2022-04-10 16:54:51 +03:00
Vyacheslav Matyukhin
ce9bb0eedf
refactor: frontend code, especially DisplayForecast(s)
2022-04-10 16:54:48 +03:00
5e7596e6e7
tweak: Clean infer description + cosmetic changes
2022-04-09 23:21:35 -04:00
789fafd0f6
tweak: cosmetic improvments to good judgment fetcher
2022-04-09 23:21:24 -04:00
7aa44746bf
feat: Rework INFER fetcher using the json embedded in its html
2022-04-08 11:14:43 -04:00
63219d429d
fix: add missing dependency
2022-04-08 10:01:30 -04:00
Vyacheslav Matyukhin
5e34ebf35e
cleanup: unnecessary db-related code
2022-04-07 22:47:17 +03:00
Vyacheslav Matyukhin
6a6597c657
WIP: more prisma migrate
2022-04-07 22:47:17 +03:00
Vyacheslav Matyukhin
ebe09bd999
fix: /dashboards props type
2022-04-07 22:47:09 +03:00
Vyacheslav Matyukhin
5aef91414c
fix: rootclaim ( fixes #39 )
2022-04-07 03:02:35 +03:00
Vyacheslav Matyukhin
afeca1e796
fix: avoid connection leaks in frontpage code
2022-04-06 02:16:55 +03:00
Vyacheslav Matyukhin
340dd3ac19
fix: /capture code
2022-04-06 01:51:32 +03:00
Vyacheslav Matyukhin
39e46b1fe6
fix: more dashboards fixing & ts changes
2022-04-06 00:36:38 +03:00
Vyacheslav Matyukhin
3771b53e4f
fix: platform labels in dashboards
2022-04-06 00:02:54 +03:00
067832b72f
fix: Tweak polymarket stars calculation b/c wash-trading incentives
...
Do this by adding liquidity requirements, rather than only loking at
volume
2022-04-05 10:46:46 -04:00
Vyacheslav Matyukhin
5ccbb7fabc
Merge pull request #42 from QURIresearch/no-schemas
...
Should be fine. Tables in `public` schema are ready.
Fixed secretEmbed and dashboards, fixed small bugs in platforms code (I'm starting to dislike the fact that platform fetchers have to populate `platform` field and set `id` to `${platform}-${shortId}`, it seems error-prone; maybe platforms should remove an object with `id: shortId` and without `platform`, and then an external code would populate it as needed... but then we'd need a different type for "fetcher output result", and I'm still hesitant).
Steps for the next half-hour:
- [ ] move tables to new DB instance in the US (copied with pg_dump/pg_restore)
- [ ] merge code, deploy on heroku/netlify
- [ ] switch to the new db
- [ ] update algolia index
- [ ] check that everything works
- [ ] drop schemas (from new DB, not a problem even in case of significant issues since we have backups and the old DB)
2022-04-02 03:12:36 +03:00
Vyacheslav Matyukhin
1b6ff8d440
fix: platform names, dashboards, cleanups
2022-04-02 02:25:12 +03:00
Vyacheslav Matyukhin
1461002070
fix: secretEmbed
2022-04-02 01:38:39 +03:00
Vyacheslav Matyukhin
72db637972
feat: new db structure; platform labels
2022-04-01 23:24:35 +03:00
Vyacheslav Matyukhin
a1ba23e340
feat: data in public schema; merge history tables
2022-03-31 13:00:09 +03:00
e9f0c66ca2
tweak: only show first three options of sample when inserting
2022-03-30 22:02:52 -04:00
Vyacheslav Matyukhin
4eeab9c861
WIP: no schemas
2022-03-30 20:21:38 +03:00
Vyacheslav Matyukhin
838fecd556
feat: faster upserts
2022-03-30 20:15:01 +03:00
Vyacheslav Matyukhin
6dfbe0c05e
cleanup: logs for algolia
2022-03-30 20:14:56 +03:00
Vyacheslav Matyukhin
f9e8f320a0
feat: xrisk and givewellopenphil backend platforms
2022-03-30 19:53:22 +03:00
Vyacheslav Matyukhin
49d8140784
feat: algolia settings in .env
2022-03-30 19:52:43 +03:00
Vyacheslav Matyukhin
0c9e577319
fix: forgot await
2022-03-29 21:47:28 +03:00
Vyacheslav Matyukhin
a3eea5a98e
feat: cli improvements
2022-03-29 20:54:20 +03:00
Vyacheslav Matyukhin
4a58389976
Merge remote-tracking branch 'origin/master' into refactor-platforms
2022-03-29 20:46:05 +03:00
Vyacheslav Matyukhin
89fc5ec8b6
refactor: reorganize platforms code further
2022-03-29 18:10:28 +03:00
4c1376f170
fix: small bugs on new polymarket fetcher
2022-03-28 22:38:14 -04:00
b7409b23f2
feat: make polymarket fetcher more efficient
2022-03-28 22:24:44 -04:00
27652407fd
fix: fix cookies script to apply to heroku, not netlify
2022-03-28 22:24:15 -04:00
Vyacheslav Matyukhin
4a8377704d
comment: draft for future Platform type
2022-03-29 05:10:49 +03:00
Vyacheslav Matyukhin
8553dfa93f
fix: godjudmentopen spelling matches db
2022-03-29 05:10:34 +03:00
Vyacheslav Matyukhin
efae18600f
feat: separate fetchers from upserts
2022-03-29 04:34:27 +03:00
Vyacheslav Matyukhin
066eb0302a
style: bring back double quotes from prettier
...
One large commit to avoid dealing with messy patches later on.
Turns out I had
https://marketplace.visualstudio.com/items?itemName=amatiasq.sort-imports
installed with single quotes which messed up all double quotes from
prettier.
2022-03-28 20:59:07 +03:00
63e77bcd04
Merge branch 'master' into no-mongo
2022-03-27 22:46:35 -04:00
5b9b36d2ed
Merge pull request #23 from QURIresearch/more-typescript
...
feat: More typescript & cleanups
2022-03-27 22:45:25 -04:00
Vyacheslav Matyukhin
a1c3f03d7d
feat: remove mongodb support
...
also:
- refactor and significantly simplify database-wrapper code
- rename manualSendToMongo to manualSendToDb
2022-03-28 02:09:34 +03:00
8a40676b7b
fix: change goodjudment script
2022-03-27 17:53:29 -04:00
Vyacheslav Matyukhin
806ec3ee51
feat: fix mongodb call in databaseReadWithReadCredentials (unused)
2022-03-28 00:32:47 +03:00
Vyacheslav Matyukhin
164f996f41
feat: convert all js to ts
...
allowJs is set to false in tsconfig.json now; please write all future
code with typescript.
cleanups:
- removed platforms/deprecated
- removed flow/history/old
- see https://github.com/QURIresearch/metaforecast/issues/22
- commented some invalid axios options
- minor fixes with mismatching function arguments
- commented invalid mongo call in databaseReadWithReadCredentials
- {encoding: 'utf-8'} in readFileSync calls
2022-03-28 00:32:47 +03:00
Vyacheslav Matyukhin
41b314b84a
cleanup: more ts, delete unused api endpoints
2022-03-28 00:32:27 +03:00
698a11c28f
feat: add plausible.io script
2022-03-27 17:19:06 -04:00
1ac56a3ee6
tweak: Change about page
2022-03-27 11:34:25 -04:00
Vyacheslav Matyukhin
8cfdaddd7a
feat: cli exits properly; disable excessive db logging
2022-03-27 02:03:48 +03:00
Vyacheslav Matyukhin
7565540f8a
feat: repo renamed
2022-03-27 00:33:13 +03:00
Vyacheslav Matyukhin
d662572bcd
feat: don't update progress bar on searches
2022-03-26 14:42:13 +03:00
Vyacheslav Matyukhin
bb846068f3
feat: shallow: true on router.replace
2022-03-26 14:33:22 +03:00
Vyacheslav Matyukhin
d921885f1b
feat: nprogress bar
2022-03-26 14:23:38 +03:00
Vyacheslav Matyukhin
f2745d713c
feat: useNoInitialEffect in CommonDisplay ( fix #14 )
2022-03-26 14:21:36 +03:00
Vyacheslav Matyukhin
1b1c0f4228
refactor: move layout.tsx to web/display
...
https://metaforecast.org/layout is not a real page, so it shouldn't be
in src/pages.
2022-03-26 04:15:07 +03:00
Vyacheslav Matyukhin
9c586c6ec1
refactor: commonDisplay -> CommonDisplay
2022-03-26 03:57:18 +03:00
Vyacheslav Matyukhin
b481212721
feat: more ts, fix tailwind
...
- rename more files to .ts/.tsx
- update tailwind config to use .tsx files from all dirs
- merge css files into a single main.css to avoid import order
dependencies
- minor cleanups due to ts complaints
2022-03-26 03:36:50 +03:00
Vyacheslav Matyukhin
42c0f0967b
feat: back to frontpage-in-db approach
2022-03-26 02:51:55 +03:00
Vyacheslav Matyukhin
80ee4c4055
fix: content jumps due to vertical scrollbar
2022-03-26 01:57:40 +03:00
Vyacheslav Matyukhin
f056d257b2
feat: /capture and / are static
2022-03-25 02:45:21 +03:00
Vyacheslav Matyukhin
98c7c31a0f
feat: always search on client side
2022-03-25 01:51:20 +03:00
Vyacheslav Matyukhin
c92d131ae3
feat: reactive search with useEffect
2022-03-25 01:23:07 +03:00
Vyacheslav Matyukhin
23a4003f31
feat: refactor commonDisplay and related code
...
- more typescript
- fix https://github.com/QURIresearch/metaforecast-frontend/issues/15
- simplify hasDisplayBeenCaptured code
- various cleanups
2022-03-25 01:22:26 +03:00
Vyacheslav Matyukhin
9714e4cd0a
fix: frontpage json serialization
2022-03-24 21:41:23 +03:00
Vyacheslav Matyukhin
796d227537
feat: rewrite frontpage code with direct db queries
2022-03-24 21:08:48 +03:00
Vyacheslav Matyukhin
abf3ba8327
feat: setCookies uses netlify
2022-03-24 15:47:35 +03:00
Vyacheslav Matyukhin
20af4e91fb
cleanup: remove unused data/ and input/ files
2022-03-24 15:47:16 +03:00
Vyacheslav Matyukhin
490f698f26
cleanup old commented fs.writeFileSync calls
2022-03-24 01:48:36 +03:00
Vyacheslav Matyukhin
f3592cde40
remove getSecret, always use env variables
2022-03-24 01:07:55 +03:00
Vyacheslav Matyukhin
a5563f9d2e
store frontpage code in db
2022-03-22 03:30:25 +03:00
Vyacheslav Matyukhin
6ffa3c0cfc
fix: import
2022-03-22 03:30:25 +03:00
Vyacheslav Matyukhin
244f02b3af
refactor: monorepo
2022-03-22 03:30:25 +03:00
2df73b4933
fix: Deal with Metaculus throttling
...
Parse the error messages and wait for the indicated amount.
2022-03-20 10:46:58 -04:00
941fecc36e
feat: Added to-do list
2022-03-14 23:39:55 -04:00
1e2562ba3f
fix: smarkets bug-ish
2022-03-08 01:59:30 -05:00
2138c0c642
fix: also save year
2022-03-05 19:03:22 -05:00
896e48efaa
feat: Workable history on postgres
...
Still has to be optimized. In particular, I could paste
one table into another one, rather than have them
pass through node.
2022-03-05 18:21:55 -05:00
20b22ab75a
fix: pg timestamp problems
2022-03-05 10:28:09 -05:00
81eb03e029
feat: Migration from mongo to pg
2022-03-03 16:55:32 -05:00
6043f56a1b
tweak: Change Manifold markets url
2022-03-03 12:18:41 -05:00
62f77071f5
fix: database bug
2022-02-28 11:50:40 -05:00
83e50e7349
fix: pg url
2022-02-26 13:36:19 -05:00
752a5b2cfe
fix: weird problem with GiveWell dates
2022-02-14 15:39:30 -05:00
927114a8cc
feat: save changes to show Cole &co
2022-02-14 13:58:36 -05:00
e280b36e20
tweak: switch infer debug mode off
2022-02-12 16:55:20 -05:00
7d0293a013
fix: reorder prompt items
2022-02-12 16:53:31 -05:00
7bd1fc50c5
fix: Too much logging
2022-02-12 16:27:18 -05:00
3a901077c9
fix: upsert logic
2022-02-12 16:24:16 -05:00
8b6f648c08
fix: pg client logic
2022-02-12 16:13:51 -05:00
29c51a13ed
fix: change cookie to env variable
2022-02-12 16:09:26 -05:00
6a257c2152
feat: Read pg database
2022-02-12 16:04:31 -05:00
6bb3da0e32
feat: Added postgres database in parallel to the mongo one
2022-02-12 01:27:56 -05:00
65fbddf0cf
feat: Make code somewhat database independent, and reorganized old
...
data.
2022-02-11 14:15:09 -05:00
2dcea149d1
feat: code reorganization
2022-02-11 12:19:33 -05:00
3d43aa3b6e
feat: Markets now have unique ids in preparation for dashbards.
2022-02-11 09:21:36 -05:00
d760532e95
tweak: just use the backup proxy
2022-02-04 16:49:20 -05:00
76325bcc48
tweak: add hardcoded proxy as backup
2022-02-04 16:42:49 -05:00
9bda1c2558
fix: add proxy
2022-02-04 16:42:49 -05:00
e0bc00d6e9
feat: add proxy
2022-02-04 16:41:52 -05:00
108da329d5
tweak
2022-02-04 16:41:52 -05:00
c064b23c9e
tweak: change user agent for good judgment forecasts
2022-02-04 16:41:47 -05:00
20c9c820fb
feat: Added infer
2022-02-04 14:54:04 -05:00
68a7feb6e6
chore: Deprecate outdated or inaccessible platforms, but keep the code
2022-02-04 13:33:39 -05:00
ba24ef7722
fix: recalculate manifold markets stars
2022-02-04 11:14:17 -05:00
a7c09e14ae
chore: Cleanup.
...
- Deleted foretold community on astralcodexten questions
- because now they are managed by Metaculus/Manifold
- fixed small mistake for good judgment
- recalculated scores for manifold markets
- avoid low-quality markets.
2022-02-04 10:42:03 -05:00
9159af7ece
tweak: Consolidate the extra field as distinct from the quality indicators field. Replace tabs with spaces.
2022-01-12 14:03:31 +01:00
884cfb2463
fix: less verbose log
2022-01-12 13:08:50 +01:00
379269a2a1
fix: metaculus fetch
2022-01-12 13:06:29 +01:00
07f30f57a2
fix: further Manifold Market tweaks
2022-01-11 23:25:32 +01:00
eb2bbe5551
fix: Manifold Markets liq.
2022-01-11 23:14:34 +01:00
08715357fd
feat: Added Manifold Markets
2022-01-11 22:55:46 +01:00
62b0f8e210
tweak: Found some bugs, added some convenience options
2021-12-05 13:30:06 +01:00
ee0ee3ca16
feat: regiggled metaculus predictions to deal with new interface
2021-12-02 13:30:16 +01:00
36e3d4af46
tweak: Pull predictions to frontpage
2021-11-05 15:14:45 +00:00
1462580d44
fix: Keeping up with cultivate labs
2021-11-05 13:45:55 +00:00
7ec50c599d
feat: Download questions more conveniently
2021-10-22 18:43:56 +02:00
e074b934a5
fix: Wildeford tweaks
2021-10-15 11:57:19 +02:00
d1c41f4c01
feat: Added predictions from Peter Wildeford
...
- Wildeford, née Hurford
- Also removed node_modules from tracking
2021-10-15 11:40:05 +02:00
c573c1a2a6
fix: Update polymarket endpoint
2021-09-22 19:29:23 +02:00
c08ee19479
tweak: Improvements to PredictIt fetcher
2021-09-14 12:25:28 +02:00
d9b654d19e
fix: Changed units of Kalshi volume to shares traded
...
- Previously was in dollars
- Also some tweaks to stars
- Also some tweaks too Good Judgment fetching1
2021-09-03 23:00:07 +02:00
50224cbb88
fix: Update polymarket endpoint
2021-08-31 22:06:28 +02:00
6f87f8bc43
fix: Streamlined Polymarket code; removed sports markets
2021-08-31 21:55:57 +02:00
f7a324cce0
feat: Deal with new CSET-Foretell question types.
...
Per https://www.cset-foretell.com/blog/rolling-question-formats ,
CSET-Foretell has added new question types.
They appear to be fairly hard to parse, so I'm not doing that yet.
However, I'm still incorporating them into the database
2021-08-31 21:23:08 +02:00
d836e7c26f
feat: Added the correct urls to Kalshi markets.
2021-08-31 21:14:55 +02:00
6593b48553
fix: Added timeout before trying again after an error
...
in the doEverything function at doEverything.js
2021-08-31 21:14:14 +02:00
682ea25615
fix: Throttle Metaculus requests.
2021-08-26 15:32:09 +02:00
b3678df9cd
feat: Adapted metaforecast to work with the new Metaculus frontend.
2021-08-25 23:42:03 +02:00
b6b4252c72
fix: Light csetforetell-fetch modifications
2021-08-22 20:08:04 +02:00
45deb7abe2
feat: Improved star ratings
...
- Deprecated some star ratings which I now think are not coarse enough
2021-08-21 13:59:23 +02:00
a97e1986b1
fix: Renamed manualDownloadFromMongo.js to manualDownload.js to make less confusing to newcomers.
...
Based on feedback by Ozzie
2021-08-16 20:18:15 +02:00
68648880c3
fix: Added timestamps to Hypermind predictions which didn't have them
2021-08-15 18:25:54 +02:00
08267e790b
fix: Minor tweaks
...
Kalshi doesn't print so many messages, algolia uses more efficient version
2021-08-15 17:07:57 +02:00
255af85b39
fix: Fix js memory/garbage collecting problems by not fetching as much information in the 1st place.
...
Turns out that the Hypermind request just has a parameter I can switch.
2021-08-13 18:35:39 +02:00
140184cd64
fix: Fix JavaScript memory/garbage collecting problems by deleted unwanted objects sooner.
...
In more context, when fetching Hypermind predictions, questions for the AI in 2030 challenge
have a really large crowdFcstHist property. I'm seeing if deleting it right after fetching
the items for the challenge makes js problems go away.
2021-08-13 18:18:36 +02:00
3c0a01db95
fix: Better markdown conversion for Hypermind questions
2021-08-11 23:06:46 +02:00
1fd3b29def
fix: Cosmetic tweaks to Hypermind forecasts
2021-08-11 22:01:31 +02:00
8e47215e6e
fix: Added fix to nasty bug which was inflating the number of coup cast predictions
...
Also made algolia code slightly more robust
2021-08-11 21:00:13 +02:00
6144675a41
feat: Added missing Hypermind tournament
...
- Also made the Hypermind code more maintainable.
2021-08-11 20:21:48 +02:00
ec28944178
chore: Updated README
2021-08-11 01:25:10 +02:00
b8d2823d2b
feat: Deal correctly in markdown with links that contain parenthesis.
2021-08-08 21:06:43 +02:00
1980ac53e3
chore: tweaks
2021-08-08 19:42:21 +02:00
e2adcf95f4
feat: Added Algolia to search
...
Also some light cleanup necessary to Algolia, e.g., numforecasts is now guaranteed to be a Number() (or a NaN, in case something goes very wrong)
2021-08-08 15:24:56 +02:00
b1d8c3cba9
fix: Kalshi and Betfair stars are now 3
2021-08-06 04:05:38 +02:00
66b024bd38
feat: Added Betfair
2021-08-01 01:55:08 +02:00
d3d41d94e1
chore: commit before npm audit fix
2021-08-01 00:34:41 +02:00
ec29825d56
fix: Do not update database if signed out
2021-07-27 23:50:31 +02:00
6833849fa6
feat: Added Kalshi
...
Also some fixes, and I think some functionality to get randomly selected forecasts
2021-07-27 23:44:43 +02:00
