agw/overleaf-cep
1
0
Fork 0
mirror of https://github.com/yu-i-i/overleaf-cep.git synced 2026-11-12 13:13:45 +01:00
Code Issues Packages Projects Releases Wiki Activity
28,971 Commits 13 Branches 23 Tags
ext-ce
Commit Graph
46 Commits
Author SHA1 Message Date
Andrew Rumble 64b6b28f69 Merge pull request #35800 from overleaf/ar-convert-project-notifications-script-to-esm 
[document-updater] convert project notifications script to ESM

GitOrigin-RevId: df7a617e1e77ee31e4129b5e55d497005ac0acd4
 2026-09-17 11:36:04 +00:00
Andrew Rumble da3adace36 Merge pull request #34850 from overleaf/acf-ar-yarn-pnp-redux 
[monorepo] yarn pnp redux

GitOrigin-RevId: fb04cab879b04ead2665b5e985a44053ceea33f3
 2026-09-17 11:35:26 +00:00
Jakob Ackermann aab08b4c28 [document-updater] remove doc lock from per-doc operations (#35696) 
GitOrigin-RevId: c45c1dbf11049c0fab8a7d788006a698ede0d510
 2026-09-17 11:34:14 +00:00
Jakob Ackermann e1358c4507 [document-updater] remove unused script (#35614) 
GitOrigin-RevId: 95717884ce4b5207ef7289108eb64a84d4ed5dd4
 2026-09-17 11:32:11 +00:00
Jakob Ackermann 324f011d80 [document-updater] add script for flushing/discarding stuck docs (#35603) 
GitOrigin-RevId: 099e1e0a38515b35decbdc608acd75f59de0ec6f
 2026-09-17 11:31:56 +00:00
Jakob Ackermann 68352783b0 [monorepo] clean up per-project queue migration (#35573) 
GitOrigin-RevId: 988df4cdc7d929efc921e7e99d803c6ce6e52c57
 2026-09-17 11:31:52 +00:00
Jakob Ackermann da808cf653 [k8s] document-updater: advance PENDING_UPDATES_MIGRATION_PHASE=3 (#35551) 
* [k8s] document-updater: advance PENDING_UPDATES_MIGRATION_PHASE=3

* [document-updater] add logging to check script

GitOrigin-RevId: e74de189e7bb2036fb0fbfe9e8ba44f8f87af110
 2026-09-17 11:29:48 +00:00
Jakob Ackermann cdba372dfc [monorepo] prepare per-project queues (#35386) 
GitOrigin-RevId: ab020603ec04c705d08be466563adac0ce30bc04
 2026-09-17 11:26:50 +00:00
Kristina 8741846df8 [doc-updater] fix unbounded Redis key growth in project notifications cron (#35425) 
* delete timestamp notification keys for solo projects
* add fallback 7d TTL for keys

GitOrigin-RevId: e0493e74b14b861863afc1d4ef5fa181432ad450
 2026-09-17 11:25:41 +00:00
Kristina 7fe05140b0 [doc-updater] add mongo logging to project notifications cron (#35421) 
GitOrigin-RevId: db8a84f2079c57b5d5f1ae5447f8526dfb0a6d67
 2026-09-17 11:25:37 +00:00
Kristina d3920e76d3 [document-updater] log duration ms for project-notifications job (#35238) 
GitOrigin-RevId: 6a654e4140a6640298d97fdff4f260d6a1be0d99
 2026-09-17 11:22:59 +00:00
Anna Claire Fields 7035a2e025 Revert "Acf pnp migration master" (#34709) 
GitOrigin-RevId: ec7d63e1212e05dd6dfc7a0ddf785c11eca76ad6
 2026-06-17 08:07:56 +00:00
Anna Claire Fields 8f07308342 Acf pnp migration master (#34040) 
GitOrigin-RevId: 418eab9bc733f27a6e0f8f04a2a8e21c2f5a491f
 2026-06-17 08:07:16 +00:00
KristinaandDomagoj Kriskovic 577ff63eca [document-updater] batch collaborator lookups in project_notifications.mts (#33974) 
* Refactor project collaborator check to handle multiple project IDs and optimize Redis caching
* Batch mongo queries and use promiseMapWithLimit

---------

Co-authored-by: Domagoj Kriskovic <dom.kriskovic@overleaf.com>
GitOrigin-RevId: 7d568b4b05894465c930595ebd3f214ebc5c72c0
 2026-05-27 08:07:35 +00:00
Kristina 3bd908d963 [document-updater] update logging in project_notifications script (#33924) 
* reduce logs for project_notifications script
* include cache hit/miss stats

GitOrigin-RevId: 6aac74a18f2ad352b0e8609f0ad2b6c831bd9da5
 2026-05-25 08:05:57 +00:00
Kristina 88eb599d4e [document-updater] increase scanStream COUNT for project notifications (#33833) 
* increase scanStream COUNT for project notifications
* fix Bull queue.add delay option being ignored
* parse timestamp to number before adding to notification queue
* fix outdated comments in project_notifications script

GitOrigin-RevId: 98bb638228550b2f6f2de90280a06c47e022cf96
 2026-05-22 08:06:03 +00:00
Jakob Ackermann 1f8371e0a3 [document-updater] flush_all: log progress after every 1k projects (#33757) 
GitOrigin-RevId: b5b68f6f53bece51234799fb626d0d6a2a5b590c
 2026-05-19 08:04:41 +00:00
Brian Gough a9c94c4184 Merge pull request #31444 from overleaf/bg-jpa-use-fetch-in-persistence-manager 
remove requestretry from PersistenceManager

GitOrigin-RevId: 1fc9ffdfa7879d7ab4f0f4683544d09fe8526f3d
 2026-02-19 09:05:45 +00:00
Jakob Ackermann 5b5e5a3d51 [document-updater] remove_deleted_docs: add option to run on single doc (#31595) 
* [document-updater] remove_deleted_docs: use promisified RedisManager

* [document-updater] remove_deleted_docs: log all getDoc details

* [document-updater] remove_deleted_docs: add option to run on single doc

GitOrigin-RevId: e2b73defd1d99d14578ce573d0e05c31073ab739
 2026-02-18 09:05:42 +00:00
Jakob Ackermann 06668fd6a8 [document-updater] add more context to docs without historyId in redis (#31570) 
GitOrigin-RevId: 99cf9629d5393e980b14e096377122acf46ff5ed
 2026-02-17 09:05:22 +00:00
Jakob Ackermann 935801eabc [document-updater] check for flushed docs when fetching historyId (#30838) 
* [document-updater] check for flushed docs when fetching historyId

* [document-updater] use doc version key for discovering all docs

GitOrigin-RevId: 122c6786b473c0836a7215ded4fae2819f908cd7
 2026-01-20 09:06:47 +00:00
Domagoj Kriskovic c461d4d8c3 Rename doc updater script to use .mts extension 
GitOrigin-RevId: 43d84434ee91aa579cb049081a31cb3769844320
 2026-01-12 09:06:12 +00:00
Domagoj Kriskovic c84cfc815a Document updater script for notifying web on project updates (#29490) 
* Document updater script for notifying web on project updates

* use lua script for deleting keys

* define jobId when adding to queue

* removeOnFail age

* mongo check if collaborator exists

GitOrigin-RevId: f67a79c890a03ccf44fd84243c9a3f380e7afb43
 2025-11-11 09:06:04 +00:00
Jakob Ackermann b0b9733a42 [document-updater] migrate ProjectFlusher to async/await (#28796) 
GitOrigin-RevId: 24f61d6c0fab5d65b962cc7031ce0b8c84d5a915
 2025-10-09 08:07:31 +00:00
Jakob Ackermann c7dd7208fb [document-updater] add flag for checking sync state of a single project (#26433) 
GitOrigin-RevId: 504f607c652e59fa1305067f273db849d7923da2
 2025-06-16 08:06:59 +00:00
Andrew Rumble 2b49653f21 Improve logging 
This includes setting up the verbose mode appropriately

GitOrigin-RevId: 6d7499467ae1ca80ca88963b14360931c7eb35e6
 2025-04-29 08:05:36 +00:00
Andrew Rumble a0aa6b9cc7 Use correct identifier for updating history id 
GitOrigin-RevId: d95c6e85a8fd530189c14e36fed1112a51fb8609
 2025-04-29 08:05:32 +00:00
Andrew Rumble f5a89cc38f Add a script for finding projects missing a history id in Redis 
GitOrigin-RevId: 3606e82c8e0fc8e1118cd6ce1981610ec20b73af
 2025-04-29 08:05:27 +00:00
Antoine Clausse 7f48c67512 Add prefer-node-protocol ESLint rule (#21532) 
* Add `unicorn/prefer-node-protocol`

* Fix `unicorn/prefer-node-protocol` ESLint errors

* Run `npm run format:fix`

* Add sandboxed-module sourceTransformers in mocha setups

Fix `no such file or directory, open 'node:fs'` in `sandboxed-module`

* Remove `node:` in the SandboxedModule requires

* Fix new linting errors with `node:`

GitOrigin-RevId: 68f6e31e2191fcff4cb8058dd0a6914c14f59926
 2024-11-11 09:04:51 +00:00
Brian Gough 4920af44b0 Merge pull request #20679 from overleaf/bg-issue19022 
Move flush_all_projects endpoint in document-updater into script

GitOrigin-RevId: cb774d860b5928b7fece1a8e21b0b76aecae73ff
 2024-10-14 11:10:42 +00:00
Jakob Ackermann 84be385550 Merge pull request #20331 from overleaf/jpa-build-scripts-sync 
[misc] sync build scripts

GitOrigin-RevId: 343fd861b6c7b3d81b21babbd41bbb968f0fd448
 2024-09-10 08:05:01 +00:00
Jakob Ackermann a98fefd24b Merge pull request #20129 from overleaf/jpa-handle-partial-deletion 
[misc] improve handling of document deletion

GitOrigin-RevId: bd6b225b91ab38365e9ff272c50ece995e767bf2
 2024-08-27 08:04:53 +00:00
Brian Gough ec433357a4 Merge pull request #20023 from overleaf/bg-exit-from-remove-deleted-docs-script 
add process exit after completion in remove_deleted_docs script

GitOrigin-RevId: b1cd1606e94563721fcdb883cd83019d8f059c7f
 2024-08-21 08:05:28 +00:00
Andrew Rumble 71187a51ba Merge pull request #18289 from overleaf/ac-ar-eslint-return-await 
Add ESLint rule @typescript-eslint/return-await to backend services

GitOrigin-RevId: 75e3e32597827fcc852e69d479515fc72e8f45e4
 2024-05-27 10:22:49 +00:00
Jakob Ackermann a7c7f2e69b Merge pull request #16589 from overleaf/jpa-script-redis-mongo-mismatch 
[document-updater] add script for checking for redis vs mongo de-syncs

GitOrigin-RevId: b51b61efd750f37180c09af5ccf5681712719ee2
 2024-01-24 09:03:59 +00:00
Christopher Hoskin f5089f596c Merge pull request #15477 from overleaf/csh-td-issue-11625-mongo-ug-5-document-updater 
Upgrade mongodb module for document updater from 4.11.0 to 6.2.0

GitOrigin-RevId: 4154763ded77e04cd3f4002824fee4af8b7f8e8a
 2023-12-15 09:03:38 +00:00
Brian Gough af96eb6941 Merge pull request #11746 from overleaf/bg-remove-flush-track-changes-script 
remove old flush_track_changes script

GitOrigin-RevId: be6e1f5572359ad3805cf0bcbf18817ecaaa5d41
 2023-02-09 09:06:45 +00:00
Miguel SerranoandJakob Ackermann 909bb99b9f [CE/SP] Flush redis on docker stop (#11714) 
* [CE/SP] Flush redis on `docker stop`

* Extracted `limit` to variable

Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>

* Increased logging

---------

Co-authored-by: Jakob Ackermann <jakob.ackermann@overleaf.com>
GitOrigin-RevId: 4bcb4e70988337369acca0e80f243609bd6323ed
 2023-02-09 09:06:37 +00:00
Eric Mc Sween f76ab26822 Merge pull request #10998 from overleaf/em-upgrade-mongo-document-updater 
Upgrade Mongo driver in document updater

GitOrigin-RevId: e3c4d86bbcf86dcf16fdfdbfab2aaf0d8eb1037c
 2023-01-11 09:05:28 +00:00
Brian Gough 0d10d9b670 Merge pull request #8564 from overleaf/bg-fix-docupdater-script 
[scripts] fix flush_track_changes script to use correct redis

GitOrigin-RevId: 4fd8b106870bd0f80bcc925a8c2e8a740c7d2bf5
 2022-06-24 08:04:37 +00:00
Brian Gough 4ec107137a Merge pull request #8551 from overleaf/bg-docupdater-flush-script-for-track-changes 
add script to flush to track-changes data from project-history redis

GitOrigin-RevId: c2cad02e5b167528d32061984fa143bbe331a32c
 2022-06-24 08:03:36 +00:00
Brian Gough 780dc55761 Merge pull request #5964 from overleaf/bg-fix-error-handling-in-scripts 
[document-updater] fix error handling in scripts

GitOrigin-RevId: d80506e0e42ffce70e9eb3571e02bea274f7a263
 2021-12-01 09:04:00 +00:00
Brian Gough 805517e728 Merge pull request #5961 from overleaf/bg-remove-deleted-docs 
[document-updater] remove deleted docs from redis

GitOrigin-RevId: ec9ad55d3c5cd9b55f56599de671068c00442f49
 2021-12-01 09:03:47 +00:00
Brian Gough a757ed898b Merge pull request #5917 from overleaf/bg-clean-up-pathname-script 
[document-updater] clean up empty pathname script

GitOrigin-RevId: 6d7e47081de892e96ba93ca273662ec4397df796
 2021-11-26 09:03:47 +00:00
Brian Gough 18ecbf37e6 Merge pull request #5916 from overleaf/bg-fix-missing-project-ids 
add script to fix missing project ids

GitOrigin-RevId: 5b98705859fa041816d5fb1ad431e868b0e81457
 2021-11-26 09:03:40 +00:00
Brian Gough 6ec0ae8501 Merge pull request #5893 from overleaf/bg-flush-docs-without-pathnames 
script to flush docs without pathnames from redis

GitOrigin-RevId: d9363d4f24fea66ae1adb7d306936bef42a48d2f
 2021-11-25 09:02:45 +00:00