Commit Graph

159 Commits

Author SHA1 Message Date
Shane Kilkelly 4c0dc5a0ef Increase timeout for test. 2016-07-08 16:05:36 +01:00
Shane Kilkelly 0a5f95f22d Move docker-entrypoint.sh into the test/acceptance/scripts directory 2016-07-08 15:52:02 +01:00
Shane Kilkelly 32d06b805c run only the acceptance tests inside container, rather than compile and test. 2016-07-08 15:15:41 +01:00
Shane Kilkelly b16b34d7c6 only execute app inside container, instead of compile and execute. 2016-07-08 14:50:30 +01:00
Shane Kilkelly 6d9aecae4c capture exit code of the test run. 2016-07-08 14:31:43 +01:00
Shane Kilkelly ea41453442 fix docker build command. 2016-07-08 13:44:43 +01:00
Shane Kilkelly 28fda02d2d Merge branch 'master' into sk-dockerize-tests 2016-07-08 13:37:04 +01:00
Shane Kilkelly 879482a955 grunt scripts to run the docker acceptance tests 2016-07-08 12:09:01 +01:00
James Allen 4f34cb7363 Only set keys in migration if they exist 2016-07-08 11:45:36 +01:00
James Allen bd392f5682 Comment out cluster config (again...) 2016-07-08 10:54:56 +01:00
Shane Kilkelly bca8f6c376 working docker image which can run the acceptance tests 2016-07-08 10:51:22 +01:00
James Allen 8b090c0a60 Don't call sadd with blank args 2016-07-07 16:41:38 +01:00
James Allen 9bd7c0017d Allow migrate script to process multi docs at once 2016-07-07 16:29:01 +01:00
Shane Kilkelly c38d903f92 Basic docker file. 2016-07-07 16:07:14 +01:00
James Allen 6bc78ccf77 Add in some null checks on comparing backend results 2016-07-07 11:24:33 +01:00
James Allen 1c62a1c5a1 Don't propagate error on secondary timeout 2016-07-07 09:46:15 +01:00
James Allen edf1e1ab49 Initialize primaryResult to an array, not null 2016-07-06 15:02:05 +01:00
James Allen 59883023ca Ignore different order of results from smembers 2016-07-06 14:24:27 +01:00
James Allen 89f90c1b04 Timeout secondary requests if they take longer than 200ms 2016-07-06 12:25:36 +01:00
James Allen 508a95c19b Use the main redis instance for locks 2016-07-06 11:50:02 +01:00
James Allen e912ccc562 Wait for both backends to return so that they are always in sync 2016-07-05 16:07:47 +01:00
James Allen dfd45bd23c Add timers to time how long each redis request takes 2016-07-04 11:14:23 +01:00
James Allen 149351aa49 Remove debugging log lines 2016-06-29 21:18:13 +01:00
James Allen fde334acc4 Create script that will ensure data is migrate between redis backends 2016-06-29 12:57:56 +01:00
James Allen dbe03e2757 Track metrics of when backends match or disagree 2016-06-28 16:49:15 +01:00
James Allen 0b9e85ea50 Update ioredis version 2016-06-28 15:47:06 +01:00
James Allen e04c946ecd Fix unit tests 2016-06-23 18:04:26 +01:00
James Allen da89ff7172 Add in external health check rather than internal 2016-06-23 18:00:03 +01:00
James Allen 414ab5d6a9 Refactor TCP redis monitoring to be more explicit 2016-06-23 15:59:25 +01:00
James Allen 8ef03c3d2f Add in application layer monitoring of the health of each cluster node 2016-06-23 15:38:51 +01:00
James Allen 27a74d6b71 Improve consistency of stress test script 2016-06-21 14:31:20 +01:00
James Allen 392beac57b Improve error reporting and retry ops in stress test script 2016-06-20 15:01:39 +01:00
James Allen 7915c2ab6c Tweak stress test to work on server 2016-06-20 13:56:46 +01:00
James Allen 39d920682a Only pass through keys to redis that are explicitly set in the config 2016-06-17 14:11:22 +01:00
James Allen 40b7da8edb Support endpoints and masterName in redis config 2016-06-17 14:05:54 +01:00
James Allen e5cf856ddf Add in stress test script 2016-06-17 12:17:43 +01:00
James Allen bc00aab7b1 Explicitly separate calls to web and docupdater redis instances 2016-06-17 12:17:22 +01:00
James Allen 9ff3026807 Merge branch 'master' into ja_redis_cluster 2016-06-09 10:00:58 +01:00
James Allen 48a92b28e5 Don't run redis commands in parallel for easier consistency reasoning 2016-06-09 09:54:13 +01:00
James Allen c823e06912 Don't run redis commands in parallel for easier consistency reasoning 2016-06-08 16:42:09 +01:00
James Allen c6605ed5f0 Fix misapplied arguments to multi commands 2016-06-08 16:41:58 +01:00
James Allen 437e885812 Lock down to specific async version 2016-06-08 16:21:56 +01:00
James Allen b4936f62af Check that return values from different redis backends match 2016-06-08 12:18:37 +01:00
James Allen ef43e2b325 Configure backend database as redis cluster 2016-06-07 18:38:32 +01:00
James Allen 1db6f8f159 Pull out rclient into RedisBackend that supports sending requests to multiple rclients 2016-06-07 17:58:18 +01:00
James Allen e38e883081 Clean up and consolidate RedisManager tests for easy refactoring later 2016-06-01 12:22:47 +01:00
James Allen ea8f4a6d7a Remove unused getDocOpsLength method 2016-06-01 11:58:15 +01:00
James Allen 8004e022fe Fix async version and fix affected unit tests 2016-06-01 11:49:24 +01:00
James Allen 05b09a447e Ensure that all multi call keys will hash to the same node in cluster 2016-06-01 11:40:12 +01:00
James Allen f707783aba Remove old methods of triggering doc updates
Remove the old pub/sub listener which is no longer used.

Also remove the DocsWithPendingUpdates set, which used to track
docs waiting to be updated. This was necessary incase messages were
missed on the pub/sub channel, so we knew which docs still had pending
updates. However, now we use the BLPOP queue, these updates just sit in
the queue until a consumer comes back to continue consuming them.
2016-06-01 11:28:23 +01:00