Commit Graph

158 Commits

Author SHA1 Message Date
Brian Gough ca991c1efd fix broken unit test
the behaviour of the code changed so that raw ops are always compressed
2017-08-29 15:10:58 +01:00
James Allen b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
James Allen fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough 0966f694da fix acceptance tests to work with redis cluster 2017-04-27 10:14:44 +01:00
Brian Gough 3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Shane Kilkelly 96f5802462 Merge branch 'sk-upgrade-metrics' 2017-04-04 16:16:37 +01:00
Shane Kilkelly 9a9f0f5c4d Remove the Metrics module, use metrics-sharelatex 2017-04-03 15:17:29 +01:00
Brian Gough 5d6d33966b Merge pull request #27 from sharelatex/bg-retry-web-api-request
use requestretry to work around web api timeouts
2017-04-03 14:05:07 +01:00
Brian Gough 7237467cb4 use requestretry to work around web api timeouts 2017-04-03 11:06:50 +01:00
Brian Gough b0b05d1e1b improve error handling of releaseLock
ported from docupdater
2017-03-31 15:17:13 +01:00
Shane Kilkelly b10f3adf2b mock out metrics in tests 2017-03-31 11:33:25 +01:00
Brian Gough 8bb3dd07a4 continue when ops are out of order 2017-03-30 13:37:11 +01:00
Brian Gough d29141d583 return error when out-of-order ops detected 2017-03-30 11:48:26 +01:00
Brian Gough 28d2ec93b8 Revert "Revert "Merge pull request #23 from sharelatex/bg-move-lock""
This reverts commit 85bc45099f047aa8dfa6d189f02f4b4327c9d602.
2017-03-28 12:52:49 +01:00
Brian Gough a73c8ba7b8 Revert "Merge pull request #23 from sharelatex/bg-move-lock"
This reverts commit 72e6756415e390a29fa784529453f926e5144358, reversing
changes made to 8f507dcc9fbcd51072047c82a443137aaac0f377.
2017-03-24 09:17:11 +00:00
Brian Gough e028de115e Merge pull request #23 from sharelatex/bg-move-lock
move lock inside web http calls
2017-03-23 13:42:52 +00:00
Brian Gough bc7815f7fc remove old processUncompressedUpdates method
replace with new per doc method
2017-03-22 16:59:52 +00:00
Brian Gough b1c0ebbaae add withLock to processUncompressedUpdatesForDoc 2017-03-22 16:16:04 +00:00
Brian Gough 6795820933 move lock inside web http calls 2017-03-21 16:49:23 +00:00
James Allen d60445adfc Pass undo flag to doc updater when restoring from history 2017-03-21 11:32:53 +00:00
Shane Kilkelly 7fbc08d68a Add logger stub to unit test 2017-03-21 09:27:47 +00:00
Shane Kilkelly fa7ee739bb Update to new metrics api 2017-03-17 14:58:35 +00:00
Brian Gough ac5d59211d revert random TTL in favour of delay in archiving
there could be some issues with newer packs expiring before older ones
2017-01-31 15:07:58 +00:00
Henry Oswald 1d356f93ec added random up to 30 mins delay to the ttl of mongo objects 2017-01-26 13:07:54 +00:00
James Allen dadc548f81 Ignore comment updates 2017-01-12 10:04:50 +01:00
James Allen a197c0d148 Merge pull request #18 from sharelatex/ja-split-on-deletes
Split update summary on big deletes
2016-10-10 08:46:46 +01:00
James Allen 40ed6fee46 Split update summary on big deletes 2016-10-04 15:13:04 +01:00
James Allen a7f44bcd01 Add missing return on callback 2016-09-30 13:36:31 +01:00
James Allen deced1aa15 Fix unit tests with logger.warn stub 2016-09-30 11:41:49 +01:00
James Allen bddd1fda7d Retry rewind if doc and update versions don't match 2016-09-30 11:36:47 +01:00
James Allen 8dda44f880 Speed up unit tests by only generating big fixtures once up front 2016-09-16 11:51:41 +01:00
James Allen dfe26262ec Return a No-op if diff returns nothing 2016-09-16 11:50:44 +01:00
James Allen 80375ae2dd Run a diff against big delete - insert changes which are likely copy-pastes 2016-09-16 11:33:36 +01:00
Brian Gough 6e5eadfa86 include a timeout on WebApiManager requests 2016-04-13 16:42:36 +01:00
Brian Gough fd49601716 preserve existing history when user upgrades 2016-04-07 15:16:38 +01:00
Brian Gough e292de5eb0 fix to avoid ever appending permanent changes to expiring packs 2016-04-06 17:00:16 +01:00
Brian Gough 7a0c2900ab add error handler in tests 2016-04-06 13:29:19 +01:00
Brian Gough 10932eb4a9 remove debug logs 2016-03-10 15:20:32 +00:00
Brian Gough 5ea7a31ad9 update archiving acceptance tests 2016-03-10 15:15:57 +00:00
Brian Gough f01bf99682 acceptance tests - work in progress 2016-03-09 16:56:49 +00:00
Brian Gough e2e8292590 update tests 2016-03-09 15:24:28 +00:00
Brian Gough 6d43273f04 working on packmanager tests 2016-03-09 14:44:59 +00:00
Brian Gough bfc9494cc1 update UpdatesManager tests 2016-03-09 14:44:59 +00:00
Brian Gough 4e63c50a75 update MongoManager tests 2016-03-09 14:44:59 +00:00
Brian Gough b780df6801 removed unused tests 2016-03-04 15:47:59 +00:00
Brian Gough 4d58c14573 updated MongoAWS tests 2016-03-04 15:47:47 +00:00
Brian Gough ebd5628e53 temporary workaround to get tests passing
temporary workaround to get tests passing
2016-03-01 10:10:12 +00:00
Brian Gough 3d9dfeccc3 remove pack worker
remove the op-specific code

remove tests for ops, now only packing

remove unused packing code

work in progress

store index for completed packs only

support archiving and unarchiving of individual packs

remove support for archiving whole document history

split out ArchiveManager, IndexManager

remove old DocArchive code

remove docHistoryStats collection

comment about archiving

added method to look at index when last pack has been archived

added start of iterator for project results

use a proper iterator

added heap module

getting it working

increase pack size since bulk operations no longer needed

remove unused MongoAWSexternal

cleanup

added doc iterator

remove old query code

added missing files

cleanup

clean upclean up

started adding pack worker for archiving

work in progress

work in progress

getting pack worker working

updating worker

getting packworker working

added lock

use correct key name for track changes aws access

use correct key name for track changes aws access

always send back users array

fix up comparison of retrieved objects

handle op ids inside packs

log when s3 download completes

comments

cleanup, remove finalisation ideacleanup, remove finalisation idea

remove logging
2016-03-01 10:10:02 +00:00
Brian Gough a23ddf31c0 allow packing of temporary ops 2016-01-29 12:36:03 +00:00