Commit Graph

447 Commits

Author SHA1 Message Date
Shane Kilkelly cd2ed24937 Fix WriteStream API 2017-08-25 14:47:07 +01:00
Shane Kilkelly 7c9ca7ccef Revert accidental change 2017-08-25 14:46:47 +01:00
Shane Kilkelly 095ac31347 wip: updating to node 6 2017-08-24 14:32:27 +01:00
Joe Green 004d1c134c Create Jenkinsfile 2017-08-16 10:39:03 +01:00
James Allen 0ac6cc3207 Merge pull request #42 from sharelatex/ja-return-latest-doc-on-no-version
Don't return all updates if no version is given
2017-08-04 09:33:41 +02:00
James Allen b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough ff2363c876 Merge pull request #41 from sharelatex/bg-error-on-null-bytes
null byte check for JSON.stringify in archiving
2017-06-06 09:21:33 +01:00
Brian Gough e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough 853f9eebac Merge pull request #40 from sharelatex/bg-log-bad-updates
log corrupt updates
2017-05-23 13:58:49 +01:00
Brian Gough d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough 756563fe42 Merge pull request #36 from sharelatex/bg-improve-archiving
make archiving less noisy
2017-05-10 14:18:18 +01:00
Brian Gough 9d5dc20524 Merge pull request #37 from sharelatex/bg-update-redis-sharelatex-npm
update to redis-sharelatex v1.0.2
2017-05-10 14:01:43 +01:00
Brian Gough ff76d1cf62 update to redis-sharelatex v1.0.2 2017-05-10 13:48:43 +01:00
Brian Gough 2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough 9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough 0e8a924f28 Merge pull request #35 from sharelatex/bg-fix-dangling
flush dangling docs
2017-05-05 15:03:41 +01:00
Brian Gough 7cd2911a0a Merge pull request #34 from sharelatex/bg-update-redis-sharelatex-to-v1.0.1
update redis-sharelatex to v1.0.1
2017-05-05 11:51:33 +01:00
Brian Gough 1e56347f4f Merge pull request #33 from sharelatex/bg-support-scan-on-redis-cluster
support scan operations on redis cluster
2017-05-05 11:51:18 +01:00
Brian Gough b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough 842b91b93a update redis-sharelatex to v1.0.1
manual edit to npm-shrinkwrap.json to preserve existing versions
2017-05-05 09:38:58 +01:00
Brian Gough 238638b906 Merge pull request #32 from sharelatex/bg-fix-shrinkwrap
fix shrinkwrap
2017-05-04 13:13:34 +01:00
Brian Gough e0ed321d7b fix shrinkwrap file to add redis-sharelatex 2017-05-03 16:37:12 +01:00
Brian Gough 35810fa702 Revert "update shrinkwrap file"
This reverts commit d16d3a1db97049cd99bfd6d965e4fab77453ae67.
2017-05-03 16:32:23 +01:00
Brian Gough 5fb4a7fdc9 Merge pull request #31 from sharelatex/bg-use-redis-sharelatex-cluster
use redis sharelatex v1.0.0
2017-05-02 15:00:17 +01:00
Brian Gough 534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough 0966f694da fix acceptance tests to work with redis cluster 2017-04-27 10:14:44 +01:00
Brian Gough 3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough 7836556d10 update shrinkwrap file 2017-04-24 14:24:02 +01:00
Brian Gough 3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough a7ff15ec7d remove logging, fix query 2017-04-24 09:49:11 +01:00
Brian Gough 33fb1ddf57 script to flush dangling ops 2017-04-20 16:58:26 +01:00
Brian Gough 60443f3fa6 Merge branch 'bg-limit-flush' 2017-04-20 14:33:06 +01:00
Brian Gough 2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough 7ba45cfc73 Merge pull request #30 from sharelatex/bg-limit-flush
allow limit on flushed projects
2017-04-20 12:14:49 +01:00
Brian Gough 9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough 43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00
Brian Gough 976f19f763 remove spurious call to getAllDocIdsWithHistoryOps 2017-04-20 10:14:44 +01:00
Brian Gough 70ce3a5271 Merge pull request #29 from sharelatex/bg-simple-flush-all
simple flush for all projects
2017-04-19 16:32:09 +01:00
Brian Gough b5b61b98d0 avoid blocking when fetching redis keys
use scan instead of keys method
2017-04-19 15:39:33 +01:00
Brian Gough 8f469db1e5 Merge pull request #28 from sharelatex/bg-upate-timeouts
update timeouts to allow for 5 second retry delay
2017-04-19 13:19:05 +01:00
Brian Gough 9ce6d77cca add check for dangling updates 2017-04-13 11:31:45 +01:00
Brian Gough 1ec9f87542 update timeouts to allow for 5 second retry delay
now using requestretry module, which has a five second delay between
retries. Need to increase the timeout on the health checks to allow for
this, as the timeout is currently shorter than the retry delay.
2017-04-12 16:47:34 +01:00