c781526af0
decaffeinate: Convert DiffCodecTests.coffee and 23 other files to JS
2020-05-06 12:10:51 +02:00
6c4d7fb838
decaffeinate: Rename DiffCodecTests.coffee and 23 other files from .coffee to .js
2020-05-06 12:10:11 +02:00
f935c392bc
Merge branch 'master' into sk-upgrade-dependencies
2020-04-27 13:38:21 +02:00
af93193d6e
remove new_project_history and use project_history instead
2020-04-21 14:43:48 +01:00
ac68f59487
Merge branch 'master' into bg-use-separate-redis-for-project-history
2020-04-16 15:48:21 +01:00
21824d49da
Merge branch 'bg-add-queue-metrics' of github.com:overleaf/document-updater into bg-add-queue-metrics
2020-04-01 16:04:52 +01:00
3a8c362fba
add doclines set/del metric
2020-04-01 15:59:25 +01:00
17c2add0cf
[misc] track redis pub/sub payload sizes on publish
2020-03-30 11:31:43 +02:00
fcb72b9bf7
update tests
2020-03-25 14:27:41 +00:00
ada4fba3dc
Fix express deprecations
2020-03-19 15:39:57 +00:00
d9caced0d6
Change skip_flush option to ignore_flush_errors in delete doc
...
Instead of skipping the flush, we'll still try to flush and proceed with
the doc deletion, even when the flush fails.
2020-03-10 09:40:49 -04:00
9b70eb75b3
Rename flush param to skip_flush in delete doc
...
Also move it to the query string instead of the body.
2020-03-09 16:27:32 -04:00
c09bc0e868
Add a "flush: false" option to the doc delete endpoint
...
This will delete the document from Redis without flushing to web,
docstore or history. To be used when something is broken.
2020-03-07 08:59:15 -05:00
0419039d4d
Merge branch 'master' into bg-use-separate-redis-for-project-history
2020-02-21 14:13:33 +00:00
82ab2f7d14
Merge pull request #65 from das7pad/hotfix-redis-config
...
[redis] use the correct instance for the real time updates
2020-02-12 13:21:04 +01:00
e73978410c
Merge pull request #67 from das7pad/hotfix-static-queue-check
...
[misc] tests: fix a static test
2020-02-12 13:20:55 +01:00
26d8d07e7a
remove unused redis settings from rate limit unit test
2020-02-11 14:32:49 +00:00
4070b0ef6f
[misc] tests: fix a static test
...
`ProjectHistoryRedisManager.queueOps` is masked and can not push
changes into redis during the unittest.
Signed-off-by: Jakob Ackermann <das7pad@outlook.com >
2020-02-07 12:36:46 +01:00
10d177f41b
[misc] test/unit: stub the correct redis settings
2020-02-07 12:24:57 +01:00
7036803acf
add missing argument to metrics.inc
...
also track retries rather than attempts (which is always 1 for a successful request)
2020-01-14 15:00:21 +00:00
3caa0e7c05
add failure/retry metrics for web-api requests
2020-01-14 13:53:50 +00:00
d0c5eb5698
support migration of project history keys to separate redis instance
2019-12-13 16:38:41 +00:00
ad19fee667
add setting so that double flush is the default
...
can be disabled to stop flushing to track-changes
2019-11-25 13:36:25 +00:00
4f6583bbf2
fix getDocVersion and add tests
2019-11-25 13:28:36 +00:00
8b73bb9f13
Merge branch 'master' into bg-filter-track-changes-updates
2019-11-22 10:41:33 +00:00
b7055eecee
add metrics for history flushes
2019-11-22 09:14:32 +00:00
dcd7649bad
filter track-changes updates for projects using project-history
2019-11-19 10:02:56 +00:00
f6b2ac7360
queue deletes for deferred processing
2019-09-25 16:42:49 +01:00
912a3a7753
remove redis server-side hashing for performance
...
we still compute the document hash in node, and check it on retrieval
but we don't check the hash at the point of writing it in redis which
was previously done with a redis Lua script.
2019-09-09 15:27:58 +01:00
e75f2cc325
add unit tests for skipping history flush
2019-08-15 11:01:45 +01:00
97487a077e
fix cluster/sentinel connection with real-time
2019-07-10 09:42:05 +01:00
3b3b2da0f5
add pubsub redis connection and remove real time redis connection
2019-07-04 13:34:31 +01:00
16fb297043
Revert "skip hash check when non-BMP characters replaced"
2019-06-27 11:39:45 +01:00
f37860599d
skip hash check when non-BMP characters replaced
2019-06-25 16:36:10 +01:00
984b2d38e6
add unit tests
2019-06-11 16:33:14 +01:00
e95059f98e
handle non-urgent flushes in background
2019-06-03 10:01:10 +01:00
0bbfa7de27
Merge branch 'master' into bg-downgrade-delete-component-error
2019-05-08 09:07:02 +01:00
27a8248196
convert "Delete component" errors into warnings
2019-05-07 16:55:17 +01:00
e57741cb80
stub out project flusher for unit tests
2019-05-07 15:46:30 +01:00
c1c23e4bee
record last author id on document flush
...
This is a multi-steps process:
* get a update's `user_id` from the metadata
* store the `user_id` (`lastUpdatedBy`) and current date (`lastUpdatedAt`) for
the document in Redis on every updates
* fetch `lastUpdatedAt` and `lastUpdatedBy` from Redis on document flush
* send the data to web to be persisted in Mongo
2019-05-02 11:10:02 +01:00
52f3596e53
Review feedback
2019-04-16 11:05:17 +01:00
3d76f4b9bf
Record a snapshot to mongo when a doc's comments/changes get collapsed
2019-04-11 13:27:46 +01:00
fd1425d83f
include a unique id in every message published to redis
2019-03-21 12:10:15 +00:00
8c5d74faef
use explicit json content-type to avoid security issues with text/html
2019-02-12 16:45:11 +00:00
ecaef6485b
revert the removal of realtime keyspace
2019-02-07 15:27:51 +00:00
4e1a2c787c
Revert "turn down logging, use logger.info for less important data"
...
This reverts commit c5f91428e3c7702fbbd3ffd1ef7a772d513f33f2.
2019-02-06 15:29:22 +00:00
1217d8a80a
Merge branch 'master' into csh-ho-docker-issue-1338-bulk-upgrade
2019-01-04 09:18:40 +00:00
2505be283a
turn down logging, use logger.info for less important data
2018-12-13 12:46:10 +00:00
25e1ad7491
remove redis.realtime
...
real time pushes data into the document updater redis instance
2018-12-05 16:17:41 +00:00
aae1352519
ensure that project history is flushed when the project is deleted
2018-10-30 12:03:44 +00:00
decaffeinate