Jakob Ackermann
1f8371e0a3
[document-updater] flush_all: log progress after every 1k projects ( #33757 )
...
GitOrigin-RevId: b5b68f6f53bece51234799fb626d0d6a2a5b590c
2026-05-19 08:04:41 +00:00
Brian Gough
a9c94c4184
Merge pull request #31444 from overleaf/bg-jpa-use-fetch-in-persistence-manager
...
remove requestretry from PersistenceManager
GitOrigin-RevId: 1fc9ffdfa7879d7ab4f0f4683544d09fe8526f3d
2026-02-19 09:05:45 +00:00
Jakob Ackermann
5b5e5a3d51
[document-updater] remove_deleted_docs: add option to run on single doc ( #31595 )
...
* [document-updater] remove_deleted_docs: use promisified RedisManager
* [document-updater] remove_deleted_docs: log all getDoc details
* [document-updater] remove_deleted_docs: add option to run on single doc
GitOrigin-RevId: e2b73defd1d99d14578ce573d0e05c31073ab739
2026-02-18 09:05:42 +00:00
Jakob Ackermann
06668fd6a8
[document-updater] add more context to docs without historyId in redis ( #31570 )
...
GitOrigin-RevId: 99cf9629d5393e980b14e096377122acf46ff5ed
2026-02-17 09:05:22 +00:00
Jakob Ackermann
935801eabc
[document-updater] check for flushed docs when fetching historyId ( #30838 )
...
* [document-updater] check for flushed docs when fetching historyId
* [document-updater] use doc version key for discovering all docs
GitOrigin-RevId: 122c6786b473c0836a7215ded4fae2819f908cd7
2026-01-20 09:06:47 +00:00
Domagoj Kriskovic
c461d4d8c3
Rename doc updater script to use .mts extension
...
GitOrigin-RevId: 43d84434ee91aa579cb049081a31cb3769844320
2026-01-12 09:06:12 +00:00
Domagoj Kriskovic
c84cfc815a
Document updater script for notifying web on project updates ( #29490 )
...
* Document updater script for notifying web on project updates
* use lua script for deleting keys
* define jobId when adding to queue
* removeOnFail age
* mongo check if collaborator exists
GitOrigin-RevId: f67a79c890a03ccf44fd84243c9a3f380e7afb43
2025-11-11 09:06:04 +00:00
Jakob Ackermann
b0b9733a42
[document-updater] migrate ProjectFlusher to async/await ( #28796 )
...
GitOrigin-RevId: 24f61d6c0fab5d65b962cc7031ce0b8c84d5a915
2025-10-09 08:07:31 +00:00
Jakob Ackermann
c7dd7208fb
[document-updater] add flag for checking sync state of a single project ( #26433 )
...
GitOrigin-RevId: 504f607c652e59fa1305067f273db849d7923da2
2025-06-16 08:06:59 +00:00
Andrew Rumble
2b49653f21
Improve logging
...
This includes setting up the verbose mode appropriately
GitOrigin-RevId: 6d7499467ae1ca80ca88963b14360931c7eb35e6
2025-04-29 08:05:36 +00:00
Andrew Rumble
a0aa6b9cc7
Use correct identifier for updating history id
...
GitOrigin-RevId: d95c6e85a8fd530189c14e36fed1112a51fb8609
2025-04-29 08:05:32 +00:00
Andrew Rumble
f5a89cc38f
Add a script for finding projects missing a history id in Redis
...
GitOrigin-RevId: 3606e82c8e0fc8e1118cd6ce1981610ec20b73af
2025-04-29 08:05:27 +00:00
Antoine Clausse
7f48c67512
Add prefer-node-protocol ESLint rule ( #21532 )
...
* Add `unicorn/prefer-node-protocol`
* Fix `unicorn/prefer-node-protocol` ESLint errors
* Run `npm run format:fix`
* Add sandboxed-module sourceTransformers in mocha setups
Fix `no such file or directory, open 'node:fs'` in `sandboxed-module`
* Remove `node:` in the SandboxedModule requires
* Fix new linting errors with `node:`
GitOrigin-RevId: 68f6e31e2191fcff4cb8058dd0a6914c14f59926
2024-11-11 09:04:51 +00:00
Brian Gough
4920af44b0
Merge pull request #20679 from overleaf/bg-issue19022
...
Move flush_all_projects endpoint in document-updater into script
GitOrigin-RevId: cb774d860b5928b7fece1a8e21b0b76aecae73ff
2024-10-14 11:10:42 +00:00
Jakob Ackermann
84be385550
Merge pull request #20331 from overleaf/jpa-build-scripts-sync
...
[misc] sync build scripts
GitOrigin-RevId: 343fd861b6c7b3d81b21babbd41bbb968f0fd448
2024-09-10 08:05:01 +00:00
Jakob Ackermann
a98fefd24b
Merge pull request #20129 from overleaf/jpa-handle-partial-deletion
...
[misc] improve handling of document deletion
GitOrigin-RevId: bd6b225b91ab38365e9ff272c50ece995e767bf2
2024-08-27 08:04:53 +00:00
Brian Gough
ec433357a4
Merge pull request #20023 from overleaf/bg-exit-from-remove-deleted-docs-script
...
add process exit after completion in remove_deleted_docs script
GitOrigin-RevId: b1cd1606e94563721fcdb883cd83019d8f059c7f
2024-08-21 08:05:28 +00:00
Andrew Rumble
71187a51ba
Merge pull request #18289 from overleaf/ac-ar-eslint-return-await
...
Add ESLint rule @typescript-eslint/return-await to backend services
GitOrigin-RevId: 75e3e32597827fcc852e69d479515fc72e8f45e4
2024-05-27 10:22:49 +00:00
Jakob Ackermann
a7c7f2e69b
Merge pull request #16589 from overleaf/jpa-script-redis-mongo-mismatch
...
[document-updater] add script for checking for redis vs mongo de-syncs
GitOrigin-RevId: b51b61efd750f37180c09af5ccf5681712719ee2
2024-01-24 09:03:59 +00:00
Christopher Hoskin
f5089f596c
Merge pull request #15477 from overleaf/csh-td-issue-11625-mongo-ug-5-document-updater
...
Upgrade mongodb module for document updater from 4.11.0 to 6.2.0
GitOrigin-RevId: 4154763ded77e04cd3f4002824fee4af8b7f8e8a
2023-12-15 09:03:38 +00:00
Brian Gough
af96eb6941
Merge pull request #11746 from overleaf/bg-remove-flush-track-changes-script
...
remove old flush_track_changes script
GitOrigin-RevId: be6e1f5572359ad3805cf0bcbf18817ecaaa5d41
2023-02-09 09:06:45 +00:00
Miguel Serrano
909bb99b9f
[CE/SP] Flush redis on docker stop ( #11714 )
...
* [CE/SP] Flush redis on `docker stop`
* Extracted `limit` to variable
Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com >
* Increased logging
---------
Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com >
GitOrigin-RevId: 4bcb4e70988337369acca0e80f243609bd6323ed
2023-02-09 09:06:37 +00:00
Eric Mc Sween
f76ab26822
Merge pull request #10998 from overleaf/em-upgrade-mongo-document-updater
...
Upgrade Mongo driver in document updater
GitOrigin-RevId: e3c4d86bbcf86dcf16fdfdbfab2aaf0d8eb1037c
2023-01-11 09:05:28 +00:00
Brian Gough
0d10d9b670
Merge pull request #8564 from overleaf/bg-fix-docupdater-script
...
[scripts] fix flush_track_changes script to use correct redis
GitOrigin-RevId: 4fd8b106870bd0f80bcc925a8c2e8a740c7d2bf5
2022-06-24 08:04:37 +00:00
Brian Gough
4ec107137a
Merge pull request #8551 from overleaf/bg-docupdater-flush-script-for-track-changes
...
add script to flush to track-changes data from project-history redis
GitOrigin-RevId: c2cad02e5b167528d32061984fa143bbe331a32c
2022-06-24 08:03:36 +00:00
Brian Gough
780dc55761
Merge pull request #5964 from overleaf/bg-fix-error-handling-in-scripts
...
[document-updater] fix error handling in scripts
GitOrigin-RevId: d80506e0e42ffce70e9eb3571e02bea274f7a263
2021-12-01 09:04:00 +00:00
Brian Gough
805517e728
Merge pull request #5961 from overleaf/bg-remove-deleted-docs
...
[document-updater] remove deleted docs from redis
GitOrigin-RevId: ec9ad55d3c5cd9b55f56599de671068c00442f49
2021-12-01 09:03:47 +00:00
Brian Gough
a757ed898b
Merge pull request #5917 from overleaf/bg-clean-up-pathname-script
...
[document-updater] clean up empty pathname script
GitOrigin-RevId: 6d7e47081de892e96ba93ca273662ec4397df796
2021-11-26 09:03:47 +00:00
Brian Gough
18ecbf37e6
Merge pull request #5916 from overleaf/bg-fix-missing-project-ids
...
add script to fix missing project ids
GitOrigin-RevId: 5b98705859fa041816d5fb1ad431e868b0e81457
2021-11-26 09:03:40 +00:00
Brian Gough
6ec0ae8501
Merge pull request #5893 from overleaf/bg-flush-docs-without-pathnames
...
script to flush docs without pathnames from redis
GitOrigin-RevId: d9363d4f24fea66ae1adb7d306936bef42a48d2f
2021-11-25 09:02:45 +00:00