Commit Graph

323 Commits

Author SHA1 Message Date
Jakob Ackermann 9dddf59a9d [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-09-10 17:39:16 +01:00
Jakob Ackermann c630cbb4e3 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit.
2020-09-10 17:39:12 +01:00
Jakob Ackermann 3a4aa45e2e Merge branches 'jpa-bump-bson', 'jpa-mongo-find-query-cleanup', 'jpa-mongo-js-cleanup' and 'jpa-mongo-update-query-cleanup' into jpa-mongodb-native 2020-09-10 16:41:45 +01:00
Jakob Ackermann c42561c38a [misc] update the bson package 2020-09-10 16:40:56 +01:00
Jakob Ackermann 6d3fa2ee5b [misc] mongodb: use findOne and find().toArray() 2020-09-10 14:54:18 +01:00
Jakob Ackermann b86acf3ea1 [misc] mongodb: change findAndModify queries to updateOne
There is no need to fetch mongo data when the call-site does not look at
 it. Also handle mongo errors in `setTTLOnArchivedPack`.
2020-09-10 14:18:14 +01:00
Jakob Ackermann e74af0bee6 [misc] PackWorker: drop workaround for db.close in mongojs@1
REF: 3ed3932ee837920e95661b0308dee012f40a71dd
2020-09-10 11:10:59 +01:00
Miguel Serrano 105335c62a Remove source maps 2020-06-19 19:19:15 +02:00
Tim Alby d3a7ffd1a9 fix formatting 2020-06-04 10:24:21 +02:00
mserranom 79f6b9a877 updated express to v4 2020-03-23 11:10:24 +01:00
mserranom 3587b42311 prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 18:34:28 +01:00
mserranom e79e044644 decaffeinate: rename app/coffee dir to app/js 2020-02-17 18:34:25 +01:00
decaffeinate 65ecd31c3a decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files 2020-02-17 18:34:21 +01:00
decaffeinate 57345632e0 decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS 2020-02-17 18:34:04 +01:00
decaffeinate a971c5895b decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js 2020-02-17 18:33:53 +01:00
mserranom 9cee6c3d22 removed unnecessary default argument 2020-02-17 18:32:47 +01:00
Jakob Ackermann b0b96ee014 [misc] add support for offline s3 tests
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Brian Gough ebbe728ec1 fix performance of update removal 2019-10-09 11:11:15 +01:00
Brian Gough 79c1dc5c1a use explicit json content-type to avoid security issues with text/html 2019-02-07 15:54:13 +00:00
Brian Gough def7a0eeaa remove unnecessary modules 2019-01-11 15:17:18 +00:00
James Allen b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough 2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough 9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough 534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough 3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough 3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough 2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough 9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough 43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough 976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough 70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough 9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough 1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough d9ed026d91 simple flush for all projects
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly 96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly 9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough 5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough 7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00