Commit Graph

33 Commits

Author SHA1 Message Date
Brian Gough 4d58c14573 updated MongoAWS tests 2016-03-04 15:47:47 +00:00
Brian Gough 3d9dfeccc3 remove pack worker
remove the op-specific code

remove tests for ops, now only packing

remove unused packing code

work in progress

store index for completed packs only

support archiving and unarchiving of individual packs

remove support for archiving whole document history

split out ArchiveManager, IndexManager

remove old DocArchive code

remove docHistoryStats collection

comment about archiving

added method to look at index when last pack has been archived

added start of iterator for project results

use a proper iterator

added heap module

getting it working

increase pack size since bulk operations no longer needed

remove unused MongoAWSexternal

cleanup

added doc iterator

remove old query code

added missing files

cleanup

clean upclean up

started adding pack worker for archiving

work in progress

work in progress

getting pack worker working

updating worker

getting packworker working

added lock

use correct key name for track changes aws access

use correct key name for track changes aws access

always send back users array

fix up comparison of retrieved objects

handle op ids inside packs

log when s3 download completes

comments

cleanup, remove finalisation ideacleanup, remove finalisation idea

remove logging
2016-03-01 10:10:02 +00:00
Brian Gough b8862ca5af switch to node-byline module to avoid buffering problem with readline-stream
for lines > 64k the readline-stream module is affected by
https://github.com/jahewson/node-byline/issues/30 which is fixed in
node-byline (readline-stream was an earlier fork of the byline module)
2016-01-11 16:51:35 +00:00
Brian Gough ee8931bc34 log the request to sentry when an error occurs 2016-01-05 15:41:06 +00:00
Brian Gough 911883a566 upgrade logger-sharelatex 2015-12-18 10:38:12 +00:00
Brian Gough b84a9e6e91 upgrade mongojs 2015-12-17 14:11:44 +00:00
Brian Gough e7af602d32 add sentry logging 2015-12-07 15:52:21 +00:00
Brian Gough c44d5b1b3d added healthcheck 2015-10-19 10:59:39 +01:00
Henrique Dias 26c8048729 change mongo stream method (still have a bug in bulk insert limit) 2015-08-14 19:19:54 -03:00
Henrique Dias daa42bcea0 change s3Stream lib 2015-08-09 15:47:47 -03:00
Henrique Dias 438c4f4d0c using mongoexport for s3 archive 2015-08-06 15:46:44 -03:00
Brian Gough 2521c8f751 added npm packages for pack.coffee script 2015-05-26 14:14:51 +01:00
James Allen 24319f6d50 Release version 0.1.4 2015-03-20 15:27:34 +00:00
James Allen 79b9c48efd Release version 0.1.3 2015-02-26 11:35:14 +00:00
Brian Gough f69f6452e9 Merge remote-tracking branch 'origin/master' into support-packs 2015-02-17 13:38:30 +00:00
Brian Gough 3ab8238013 update mongojs version to allow use of bulk updates 2015-02-13 17:01:55 +00:00
James Allen 2d25d54572 Release version 0.1.2 2015-02-10 13:18:12 +00:00
Brian Gough 715b0df4a1 prototype for expanding packs 2015-02-05 16:36:41 +00:00
Henry Oswald 3328acc82b bump sharelatex-redis 2014-10-07 08:33:00 +01:00
Henry Oswald 66bba0dec9 bump redis-sharelatex 2014-09-29 11:41:09 +01:00
Henry Oswald 9891bc37d8 Merge branch 'master' of https://github.com/sharelatex/track-changes-sharelatex 2014-09-26 17:41:27 +01:00
Henry Oswald a0bb289fd3 works with sentinal v1 2014-09-26 17:21:33 +01:00
James Allen f0e5b914a6 Release version 0.1.0 2014-08-19 14:17:11 +01:00
James Allen e7b4359c62 Lock down module versions 2014-08-19 14:15:44 +01:00
James Allen c835528dea Add in metrics 2014-05-09 12:44:13 +01:00
James Allen 953081c39d Delete updates that are older than a week, unless versioning or preserveHistory is enabled 2014-03-28 16:01:34 +00:00
James Allen 3570e8f408 Use grunt forever to run service daemonized for acceptance testing on travis 2014-02-26 16:44:13 +00:00
James Allen ad18c1d5a5 Add Gruntfile 2014-02-26 16:17:15 +00:00
James Allen d27872c9bd Get acceptance tests running 2014-02-26 12:11:45 +00:00
James Allen 5dea123b13 Get append end point working with a simple acceptance test 2014-01-27 17:51:09 +00:00
James Allen dbee4a57fb Compress doc ops in two passes 2013-08-23 14:35:13 +01:00
James Allen 64eb794c02 Compress all docs using compressHistory script 2013-08-09 11:36:19 +01:00
James Allen 7e96933cf2 Initial commit of script for compressing one docs history 2013-08-08 16:42:14 +01:00