Jakob Ackermann 93c04fe240 [history-v1] extend --report with number of files to check/missing (#27397) ...

* [history-v1] put logs of back_fill_file_hash script in /var/log/overleaf

* [history-v1] do not leave tmp dir behind when using --report

* [history-v1] extend --report with number of files to check/missing

* [history-v1] move all the options into command line flags

Change default values:
- concurrency to 10
- concurrent batches to 1
- stream high water mark to 1MiB

* [web] find_malformed_filetrees: log progress on stderr

* [history-v1] fix percentage of projects that need back-filling

GitOrigin-RevId: ebd7889840f97b24eda43774ffe7524998fb634b

2025-07-30 08:07:12 +00:00

..

analytics

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

delete-duplicate-splittest-versions

Merge pull request #21427 from overleaf/jpa-populate-db-on-import

2024-11-01 09:05:15 +00:00

delete-orphaned-docs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

example

Merge pull request #24466 from overleaf/ls-script-runner

2025-04-14 08:04:37 +00:00

helpers

Merge pull request #24070 from overleaf/csh-fix-check_institution_users

2025-03-13 09:05:45 +00:00

history

Remove projectHistoryMetaData from mongo db interface

2025-06-06 08:05:47 +00:00

learn/checkSanitize

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

lezer-latex

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

lib

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

oauth

Merge pull request #27085 from overleaf/em-upgrade-oauth-tokens

2025-07-14 08:06:14 +00:00

plan-prices

[web] rm annual-prices-monthly-rates split test (#26727)

2025-07-03 08:06:13 +00:00

recurly

Merge pull request #27202 from overleaf/msm-fix-pricing

2025-07-18 08:07:17 +00:00

sync-user-entitlements

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

translations

[third-party-datastore] improve error handling (#26881)

2025-07-22 08:07:13 +00:00

ukamf

Merge pull request #25479 from overleaf/msm-passport-saml-5

2025-07-28 08:05:20 +00:00

writefull

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

add_feature_override.mjs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

add_salesforce_data_to_subscriptions.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

add_subscription_members_csv.mjs

[web] script to update group members via CSV (#24861)

2025-05-01 08:06:27 +00:00

add_user_count_to_csv.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

attach_dangling_comments_to_doc.mjs

[web] Add script to attach dangling comments to a document (#23904)

2025-02-28 09:05:06 +00:00

back_fill_doc_name_for_deleted_docs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

back_fill_doc_rev.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

back_fill_dummy_doc_meta.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

back_fill_staff_access.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

back_fill_warning_user_personal_and_group_subscription.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

backfill_mixpanel_user_properties.mjs

Merge pull request #26397 from overleaf/kh-use-new-price-lookups

2025-06-17 08:05:51 +00:00

backfill_project_image_name.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

backfill_project_invites_token_hmac.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

backfill_user_properties.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

backfill_users_sso_attribute.mjs

Merge pull request #21288 from overleaf/ar-convert-modules-saas-authentication-to-es-modules

2024-10-31 09:05:08 +00:00

bench_bcrypt.mjs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

check_docs.mjs

Add support for --any-comments to check_docs script (#26903)

2025-07-08 08:08:04 +00:00

check_duplicate_collaborators.mjs

Add script to check and fix duplicate collaborators in projects (#26572)

2025-07-03 08:05:17 +00:00

check_institution_users.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

check_overleafModuleImports.mjs

Merge pull request #21097 from overleaf/ls-scripts-to-esm-1

2024-10-21 08:04:42 +00:00

check_project_files.js

[web] update the projects lastUpdated timestamp when changing file-tree (#24867)

2025-04-16 08:05:14 +00:00

check_saml_emails.mjs

Merge pull request #21288 from overleaf/ar-convert-modules-saas-authentication-to-es-modules

2024-10-31 09:05:08 +00:00

clear_admin_sessions.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

clear_feedback_collection.mjs

[web] Fixup .mjs extension in scripts mentions (calls, comments, copybara) (#21969)

2024-11-21 09:04:23 +00:00

clear_institution_notifications.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

clear_project_tokens.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

clear_sessions_2fa.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

clear_sessions_set_must_reconfirm.mjs

[web] Add audit logs for clear_sessions_set_must_reconfirm script, "must-reset-password-set" and "must-reset-password-unset" (#21776)

2024-11-15 09:05:21 +00:00

convert_doc_to_file.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

count_encrypted_access_tokens.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

count_files_in_projects.mjs

[web] remove deledFiles collection (#25750)

2025-05-23 08:05:01 +00:00

count_image_files.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

count_project_size.mjs

[web] remove deledFiles collection (#25750)

2025-05-23 08:05:01 +00:00

create_oauth_personal_access_token.mjs

Merge pull request #21434 from overleaf/msm-esm-oauth2-server

2024-11-21 09:03:39 +00:00

create_project.mjs

[web] Fixup .mjs extension in scripts mentions (calls, comments, copybara) (#21969)

2024-11-21 09:04:23 +00:00

deactivate_projects.mjs

Merge pull request #25743 from overleaf/bg-deactivate-projects-script

2025-05-21 08:05:25 +00:00

delete_dangling_comments.mjs

Merge pull request #23706 from overleaf/em-fix-dangling-comments-script

2025-02-20 09:06:05 +00:00

delete_dangling_file_refs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

delete_orphaned_chat_threads.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

delete_orphaned_data_helper.mjs

Merge pull request #21097 from overleaf/ls-scripts-to-esm-1

2024-10-21 08:04:42 +00:00

delete_orphaned_doc_comment_ranges.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

delete_orphaned_docs_online_check.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

delete_subscriptions.mjs

Merge pull request #21427 from overleaf/jpa-populate-db-on-import

2024-11-01 09:05:15 +00:00

disconnect_all_users.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

e2e_test_setup.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

ensure_affiliations.mjs

[web] Remove promises exports from Controller modules (#22242)

2025-01-17 09:05:36 +00:00

esm-check-migration.mjs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

extract_onboardingdatacollection_csv.js

Create a script to extract OnboardingDataCollection (#17657)

2024-03-28 09:04:33 +00:00

extract_onboardingdatacollection_never_used_latex.js

Merge pull request #22260 from overleaf/rh-odc-students-never-used

2024-12-03 09:04:59 +00:00

find_malformed_filetrees.mjs

[history-v1] extend --report with number of files to check/missing (#27397)

2025-07-30 08:07:12 +00:00

fix_collaborator_refs_null.mjs

Add script to update null references in for readOnly_refs and pendingReviewer_refs (#25417)

2025-05-13 08:06:23 +00:00

fix_comment_id.mjs

Script for updating comment id to match the one from history (#23460)

2025-02-12 09:05:42 +00:00

fix_group_invite_emails_to_lowercase.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

fix_malformed_filetree.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

fix_oversized_docs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

force_doc_flush.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

inst_table.mjs

Merge pull request #21097 from overleaf/ls-scripts-to-esm-1

2024-10-21 08:04:42 +00:00

invalidate_tokens.mjs

Merge pull request #21427 from overleaf/jpa-populate-db-on-import

2024-11-01 09:05:15 +00:00

lowercase_institution_user_ids.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

mark_migration.mjs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

merge_group_subscription_members.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

migrate_audit_logs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

process_lapsed_reconfirmations.mjs

Convert scripts that use institutions module

2024-10-16 08:04:52 +00:00

purge_non_logged_in_sessions.mjs

Merge pull request #21202 from overleaf/ls-scripts-to-esm-2

2024-10-23 08:04:53 +00:00

recover_docs_from_redis.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

refresh_features.mjs

Merge pull request #21427 from overleaf/jpa-populate-db-on-import

2024-11-01 09:05:15 +00:00

refresh_institution_users.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

regenerate_duplicate_referral_ids.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

remove_deleted_users_from_token_access_refs.mjs

[web] Fixup .mjs extension in scripts mentions (calls, comments, copybara) (#21969)

2024-11-21 09:04:23 +00:00

remove_email.mjs

Merge pull request #21427 from overleaf/jpa-populate-db-on-import

2024-11-01 09:05:15 +00:00

remove_feature_from_all_users.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

remove_oauth_application.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

remove_unconfirmed_emails.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

remove_user_enrollment.mjs

Script for removing user enrollment from a subscription (#24627)

2025-04-03 08:04:54 +00:00

restore_orphaned_docs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

restore_soft_deleted_docs.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

set_tex_live_image.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

soft_delete_project.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

sso_id_migration_check.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

sso_id_remove_not_migrated.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

stress_test.mjs

[web] Add prefer-node-protocol ESLint rule (#21523)

2024-11-05 09:04:33 +00:00

suspend_users.mjs

Merge pull request #22433 from overleaf/tm-suspend-users-script

2024-12-11 09:04:40 +00:00

tsconfig.json

Merge pull request #16353 from overleaf/em-typescript-in-web-backend

2024-01-04 09:03:43 +00:00

undelete_project_to_user.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

unlink_third_party_id.mjs

Merge pull request #24790 from overleaf/ls-use-script-runner

2025-05-23 08:05:23 +00:00

update_project_image_name.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00

validate-data-of-model.mjs

Merge pull request #21668 from overleaf/jpa-mongo-utils

2024-11-08 09:07:09 +00:00