Commit Graph

333 Commits

Author SHA1 Message Date
Eric Mc Sween c069445770 Merge pull request #4665 from overleaf/bg-zip-manager
add streaming zip export of history (migrated from track-changes#117)

GitOrigin-RevId: 45e6a66332541f463241f148892817725c0be39c
2021-08-17 08:03:24 +00:00
Jakob Ackermann 181a895c04 [misc] temporary override a few new/changed eslint rules 2021-07-13 12:24:37 +01:00
Jakob Ackermann 9178394dd6 [misc] run format_fix and lint:fix 2021-07-13 12:04:43 +01:00
Jakob Ackermann b5bb7c3b04 [misc] switch from settings-sharelatex to @overleaf/settings 2021-07-12 17:47:16 +01:00
Jakob Ackermann ed70b99d8a [misc] exportProject: collect and send user ids of updates in trailer 2021-02-25 09:52:54 +00:00
Jakob Ackermann f411049b82 [misc] add a new endpoint for exporting all the project history 2021-02-23 18:02:58 +00:00
Jakob Ackermann 8ef3aa1767 [misc] bump metrics module to 3.4.1
- renamed package from `metrics-sharelatex` to `@overleaf/metrics`
- drop support for statsd backend
- decaffeinate
- compress `/metrics` response using gzip
- bump debugging agents to latest versions
- expose prometheus interfaces for custom metrics (custom tags)
- cleanup of open sockets metrics
- fix deprecation warnings for header access
2020-11-25 11:57:20 +00:00
Jakob Ackermann 68a1b4d459 [misc] bump @overleaf/redis-wrapper to version 2.0.0 2020-11-11 16:21:11 +00:00
Jakob Ackermann 2c8916f2e0 [PackWorker] fix the db cleanup process -- we do not expose db.close 2020-09-29 12:23:18 +01:00
Jakob Ackermann 41a65ee41e [PackWorker] wait for the db setup before starting to process updates 2020-09-29 12:22:22 +01:00
Jakob Ackermann 9dddf59a9d [misc] migrate acceptance tests to the native mongo driver, drop mongojs 2020-09-10 17:39:16 +01:00
Jakob Ackermann c630cbb4e3 [misc] migrate the app to the native mongo driver
acceptance tests to follow in a separate commit.
2020-09-10 17:39:12 +01:00
Jakob Ackermann 3a4aa45e2e Merge branches 'jpa-bump-bson', 'jpa-mongo-find-query-cleanup', 'jpa-mongo-js-cleanup' and 'jpa-mongo-update-query-cleanup' into jpa-mongodb-native 2020-09-10 16:41:45 +01:00
Jakob Ackermann c42561c38a [misc] update the bson package 2020-09-10 16:40:56 +01:00
Jakob Ackermann 6d3fa2ee5b [misc] mongodb: use findOne and find().toArray() 2020-09-10 14:54:18 +01:00
Jakob Ackermann b86acf3ea1 [misc] mongodb: change findAndModify queries to updateOne
There is no need to fetch mongo data when the call-site does not look at
 it. Also handle mongo errors in `setTTLOnArchivedPack`.
2020-09-10 14:18:14 +01:00
Jakob Ackermann e74af0bee6 [misc] PackWorker: drop workaround for db.close in mongojs@1
REF: 3ed3932ee837920e95661b0308dee012f40a71dd
2020-09-10 11:10:59 +01:00
Miguel Serrano 105335c62a Remove source maps 2020-06-19 19:19:15 +02:00
Tim Alby d3a7ffd1a9 fix formatting 2020-06-04 10:24:21 +02:00
mserranom 79f6b9a877 updated express to v4 2020-03-23 11:10:24 +01:00
mserranom 3587b42311 prettier: convert app/js decaffeinated files to Prettier format 2020-02-17 18:34:28 +01:00
mserranom e79e044644 decaffeinate: rename app/coffee dir to app/js 2020-02-17 18:34:25 +01:00
decaffeinate 65ecd31c3a decaffeinate: Run post-processing cleanups on DiffGenerator.coffee and 17 other files 2020-02-17 18:34:21 +01:00
decaffeinate 57345632e0 decaffeinate: Convert DiffGenerator.coffee and 17 other files to JS 2020-02-17 18:34:04 +01:00
decaffeinate a971c5895b decaffeinate: Rename DiffGenerator.coffee and 17 other files from .coffee to .js 2020-02-17 18:33:53 +01:00
mserranom 9cee6c3d22 removed unnecessary default argument 2020-02-17 18:32:47 +01:00
Jakob Ackermann b0b96ee014 [misc] add support for offline s3 tests
update the build scripts to 1.3.4
2020-01-27 12:21:30 +01:00
Brian Gough ebbe728ec1 fix performance of update removal 2019-10-09 11:11:15 +01:00
Brian Gough 79c1dc5c1a use explicit json content-type to avoid security issues with text/html 2019-02-07 15:54:13 +00:00
Brian Gough def7a0eeaa remove unnecessary modules 2019-01-11 15:17:18 +00:00
James Allen b8d0eb2823 Merge branch 'master' into ja-return-latest-doc-on-no-version 2017-08-04 09:31:19 +02:00
James Allen c5252f893b Don't return all updates if no version is given 2017-06-28 15:38:31 +01:00
Brian Gough e8dfe3099f add missing callback for null byte check 2017-06-02 14:13:33 +01:00
Brian Gough b71a15a6a0 null byte check for JSON.stringify in archiving 2017-06-01 13:36:13 +01:00
Brian Gough d9763eb105 log corrupt updates 2017-05-23 13:55:10 +01:00
James Allen c6d9df95f3 Merge pull request #38 from sharelatex/ja-redis-cluster
Migrate lock to be redis-cluster compatible
2017-05-16 14:16:43 +01:00
James Allen fb6e028182 Migrate lock to be redis-cluster compatible 2017-05-15 10:34:24 +01:00
Brian Gough 2781d9fd80 keep track of processed/total docs in archiving 2017-05-09 14:00:16 +01:00
Brian Gough c26bccd390 make arguments handling for packworker more robust 2017-05-09 14:00:16 +01:00
Brian Gough cac7556ad5 only check packs for archiving once each week 2017-05-09 14:00:15 +01:00
Brian Gough c6e83c6cb8 allow archiving to exit properly on hard timeout 2017-05-09 14:00:15 +01:00
Brian Gough 9936710a1a replace error with warning for archiving timeout 2017-05-09 14:00:15 +01:00
Brian Gough b82567ef79 support scan operations on redis cluster 2017-05-05 11:30:55 +01:00
Brian Gough 534bd8f7ad add flushing code with error check for cluster 2017-05-02 14:19:49 +01:00
Brian Gough 3b5a07d530 fix update to work with redis cluster
the items do not have the same tag, so we must delete the entry from the
docsWithHistoryOps set outside the multi.
2017-04-26 16:25:34 +01:00
Brian Gough 3045becbb6 use redis-sharelatex with redis cluster config 2017-04-24 14:23:32 +01:00
Brian Gough df38893538 remove old single redis flushing code 2017-04-24 11:36:31 +01:00
Brian Gough 2a68b81cc1 randomise order of flush 2017-04-20 14:32:23 +01:00
Brian Gough 9eb36f9692 improve log message for flushing 2017-04-20 11:55:32 +01:00
Brian Gough 43f51355b2 add limit parameter to flushAll 2017-04-20 11:01:46 +01:00