Commit Graph

435 Commits

Author SHA1 Message Date
James Allen c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough 756563fe42 Merge pull request #36 from sharelatex/bg-improve-archiving
make archiving less noisy
2017-05-10 14:18:18 +01:00
Brian Gough 9d5dc20524 Merge pull request #37 from sharelatex/bg-update-redis-sharelatex-npm
update to redis-sharelatex v1.0.2
2017-05-10 14:01:43 +01:00
Brian Gough ff76d1cf62 update to redis-sharelatex v1.0.2 2017-05-10 13:48:43 +01:00
Brian Gough 2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough 9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough 0e8a924f28 Merge pull request #35 from sharelatex/bg-fix-dangling
flush dangling docs
2017-05-05 15:03:41 +01:00
Brian Gough 7cd2911a0a Merge pull request #34 from sharelatex/bg-update-redis-sharelatex-to-v1.0.1
update redis-sharelatex to v1.0.1
2017-05-05 11:51:33 +01:00
Brian Gough 1e56347f4f Merge pull request #33 from sharelatex/bg-support-scan-on-redis-cluster
support scan operations on redis cluster
2017-05-05 11:51:18 +01:00
Brian Gough b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough 842b91b93a update redis-sharelatex to v1.0.1
manual edit to npm-shrinkwrap.json to preserve existing versions
2017-05-05 09:38:58 +01:00
Brian Gough 238638b906 Merge pull request #32 from sharelatex/bg-fix-shrinkwrap
fix shrinkwrap
2017-05-04 13:13:34 +01:00
Brian Gough e0ed321d7b fix shrinkwrap file to add redis-sharelatex 2017-05-03 16:37:12 +01:00
Brian Gough 35810fa702 Revert "update shrinkwrap file"
This reverts commit d16d3a1db97049cd99bfd6d965e4fab77453ae67.
2017-05-03 16:32:23 +01:00
Brian Gough 5fb4a7fdc9 Merge pull request #31 from sharelatex/bg-use-redis-sharelatex-cluster
use redis sharelatex v1.0.0
2017-05-02 15:00:17 +01:00
Brian Gough 534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough 0966f694da fix acceptance tests to work with redis cluster 2017-04-27 10:14:44 +01:00
Brian Gough 3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough 7836556d10 update shrinkwrap file 2017-04-24 14:24:02 +01:00
Brian Gough 3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough a7ff15ec7d remove logging, fix query 2017-04-24 09:49:11 +01:00
Brian Gough 33fb1ddf57 script to flush dangling ops 2017-04-20 16:58:26 +01:00
Brian Gough 60443f3fa6 Merge branch 'bg-limit-flush' 2017-04-20 14:33:06 +01:00
Brian Gough 2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough 7ba45cfc73 Merge pull request #30 from sharelatex/bg-limit-flush
allow limit on flushed projects
2017-04-20 12:14:49 +01:00
Brian Gough 9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough 43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough 976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough 70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough 8f469db1e5 Merge pull request #28 from sharelatex/bg-upate-timeouts
update timeouts to allow for 5 second retry delay
2017-04-19 13:19:05 +01:00
Brian Gough 9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough 1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00
Brian Gough d9ed026d91 simple flush for all projects
does not work with redis cluster, only single redis
2017-04-12 16:34:28 +01:00
Shane Kilkelly 96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly 9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough 5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough cd1d0cc1f4 Merge pull request #26 from sharelatex/bg-error-check-on-unlock
improve error handling of releaseLock
2017-04-03 14:04:59 +01:00
Brian Gough 7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00
Brian Gough b0b05d1e1b improve error handling of releaseLock
ported from docupdater
2017-03-31 15:17:13 +01:00
Shane Kilkelly b10f3adf2b mock out metrics in tests 2017-03-31 11:33:25 +01:00
Shane Kilkelly 9a84798293 Upgrade to latest metrics 2017-03-31 11:32:59 +01:00
Brian Gough 5989d8f27f Merge pull request #25 from sharelatex/bg-error-on-out-of-order-ops
return error when out-of-order ops detected
2017-03-30 14:00:23 +01:00
Brian Gough 8bb3dd07a4 continue when ops are out of order 2017-03-30 13:37:11 +01:00
Brian Gough d29141d583 return error when out-of-order ops detected 2017-03-30 11:48:26 +01:00