* [history-v1] add migrations record after full binary file migration
* [server-pro] add hotfix 5.5.5
* [server-ce] test: build hotfix 5.5.5 and use it in tests
GitOrigin-RevId: fb84e5710c59f466a3305de5f32f78e0ac9ce15d
* [web] reduce noise from CollectPayPalPastDueInvoiceTest
* [web] reduce noise for frontend tests that use Range.getClientRects
* [web] avoid nesting <li> elements in ProjectToolsMoreDropdownButton
RenameProjectMenuItem/CopyProjectMenuItem will return <li> elements.
* [web] avoid clicking on links that navigate away in JSDom
* [web] add mock for location change in JSDom
* [web] add fallback stripe subscription data for test
3.8k lines of log noise!
GitOrigin-RevId: 7adab182487a6c07ac9809c60802e498a0edb0ec
* [web] move sentry upload into a Makefile target
* [web] fix typos in jenkins pipeline
* [web] fix BRANCH_NAME for PR builds
This is currently "true". Just use PR-xxx for now.
* [web] remove explicit pull of main-deps for Jenkins
In Jenkins we do not need to wait for the cloud-builder image. The
docker build can start right away. Let docker validate the remote cache
and pull it if needed.
* [packer] jenkins-worker: prefetch sentry image
* [packer] jenkins-worker: switch to production AR
* [packer] jenkins-worker: wait for monorepo setup before pulling sentry
* [web] cloudbuild: fix directory for prefetch_sentry
GitOrigin-RevId: ec394bbf51efd516f0ade8813014dec9b63fb732
* [saas-e2e] adjust project name for new SpamSafe limits
* [saas-e2e] stay below 6 digits for spam safe project name
Co-authored-by: Antoine Clausse <antoine.clausse@overleaf.com>
---------
Co-authored-by: Antoine Clausse <antoine.clausse@overleaf.com>
GitOrigin-RevId: 77c039312c01b33aeb3b57661ec6ca5b88a0a36b
* [packer] jenkins-worker: install htop and lsof
* [web] trim tailing space in Jenkinsfile
* [web] cleanup after finishing Jenkins pipeline
* [server-ce] test: cleanup after finishing Jenkins pipeline
* [saas-e2e] add timeout to waiting for rail/web startup
* [monorepo] add 60s timeout for waiting on mongo to startup
* [saas-e2e] cleanup after finishing Jenkins pipeline
GitOrigin-RevId: 9954ab17b4db6a95c444e8e0b55cebb8d5daae59
* [web] add missing await statement in admin-panel tests
* [web] add audit log for changing admin access in Server Pro via SSO
GitOrigin-RevId: 69e994d0b2e0f0e0281ade80acbdf7fb30bd2e89
* [server-ce] tests: optimize sharding
* [server-ce] tests: remove shard CE_CUSTOM_2
* [server-ce] tests: move project sharing tests onto a new shard
Previously they were on their own CE_CUSTOM_1 shard.
GitOrigin-RevId: de256e04f5956b4651a5dc4ab47cdb5972723c5d
- Use Makefile for coordinating all the independent tasks
- Pull down lots of other docker images, notably all the images for
running Server Pro E2E tests
- Run copybara to populate it's caches
- Build Server CE and Server Pro images to populate npm caches
- Build all the monorepo images for SaaS E2E tests
- Restore the latest database backup into the CI local dev-env
GitOrigin-RevId: 821b036d1afaf2f00372dc6d0f82a51b4c3b7cc4
* [history-v1] use String.padStart instead of lodash.padStart
* [web] download binary files in clsi from filestore via new endpoints
* [server-ce] tests: Cypress.env() is parsing boolean values
* [server-ce] tests: run history migration as root
GitOrigin-RevId: bdf6c0e542531ccc4b3f13d2ed68ca0d31e580e9
* [history-v1] put logs of back_fill_file_hash script in /var/log/overleaf
* [history-v1] do not leave tmp dir behind when using --report
* [history-v1] extend --report with number of files to check/missing
* [history-v1] move all the options into command line flags
Change default values:
- concurrency to 10
- concurrent batches to 1
- stream high water mark to 1MiB
* [web] find_malformed_filetrees: log progress on stderr
* [history-v1] fix percentage of projects that need back-filling
GitOrigin-RevId: ebd7889840f97b24eda43774ffe7524998fb634b
* [server-pro] check_vulnerabilities.sh: move cache into $HOME/.cache
* [monorepo] move root-owned minio certs into docker volume
* [server-pro] check_vulnerabilities.sh: remove unused vars
* [filestore] fix image name for certs container when using sharding
GitOrigin-RevId: c6756e8f24ccc689c12d5f5be2b7f4eee7d9b989
* [monorepo] ensure DOCKER_USER is set and used on all cypress containers
* [server-ce] test: deduplicate cypress container config
GitOrigin-RevId: ca569a6c95574df7fb29c99577c18f22cdfb83d8
* [server-ce] test filestore migration with upgrade from version 1.x
* [server-ce] tests: drop verbose logs from host-admin in CI
* [server-ce] tests: fix flag following rebase
GitOrigin-RevId: dc00127fc76f87ee3eb5071fd430f4917e8123ff
* [third-party-datastore] use generic serializer for dropboxError
The `err` serializer will not pick up all the dropbox fields.
Co-authored-by: Thomas Mees <thomas.mees@overleaf.com>
* [third-party-datastore] handle user_suspended like insufficient_space
Unlink dropbox and display a notification (same key to clear later).
Co-authored-by: Thomas Mees <thomas.mees@overleaf.com>
* [third-party-datastore] skip retries when rejected with disallowed_name
Co-authored-by: Thomas Mees <thomas.mees@overleaf.com>
* [web] sort translations
* [web] update copy for dropbox_unlinked_because_suspended
Co-authored-by: Kamal Arkinstall <kamal.arkinstall@overleaf.com>
---------
Co-authored-by: Thomas Mees <thomas.mees@overleaf.com>
Co-authored-by: Kamal Arkinstall <kamal.arkinstall@overleaf.com>
GitOrigin-RevId: 8fbb9074d1d6eb879e904d79dd4b2a2c952ff902
* [web] reject upload requests without a file path
* [web] update copy on error message and link to contact form
Co-authored-by: Kamal Arkinstall <kamal.arkinstall@overleaf.com>
* [web] update copy: move dot to the end
---------
Co-authored-by: Kamal Arkinstall <kamal.arkinstall@overleaf.com>
GitOrigin-RevId: ba1ee81a91b046540caeb2f3f3da0e305611b35f
* [history-v1] move MockFilestore into shared place
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
* [history-v1] make back_fill_file_hash_fix_up compatible with Server Pro
---------
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
GitOrigin-RevId: 70ea57e1503031d9f14dcd60c4c110e746450587
* [mics] fix "app" label in clsi-cache metrics in dev-env
* [clsi-cache] validate filePath when processing file
* [clsi-cache] meter ingress and egress bandwidth
Files are downloaded directly from nginx, hence we cannot meter egress
in clsi-cache easily.
GitOrigin-RevId: 24de8c41728f0e9c984113c1470dec6153e75f20
* [terraform] clsi: add C3D trial
* [terraform] clsi: switch C3D to standard variant with local SSD
GitOrigin-RevId: 6e6ceeb93ee94800d8ce46557322da82dc99fc2a
* [history-v1] use POST requests for expiring redis buffer from cron
(cherry picked from commit 15780ac54e36b96e1aed9fd9eb6dfe9d4fbf842f)
* [history-v1] remove double claim of expire job
GitOrigin-RevId: 8b2eab07006a5819a47eed3f646b2a4d75f86e5b
* [web] change status page URL to HTTPS everywhere
Also open all links to the status page or admin email in a new tab.
* [server-ce] explicit protocol matching
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
---------
Co-authored-by: Brian Gough <brian.gough@overleaf.com>
GitOrigin-RevId: d7d12eef4efc737c5d70fc969c862acae9faf14c
* [project-history] add support for resync of history-ot ranges
* [project-history] avoid compressing sharejs and history-ot upgrades
* [document-updater] improve error message of some assertions
... by migrating the assertions like this:
```diff
-stub.calledWith().should.equal(true)
+stub.should.have.been.calledWith()
```
```diff
-stub.called.should.equal(false)
+stub.should.not.have.been.called
```
* [document-updater] move content field in resyncDocContent
* [document-updater] add support for resync of history-ot ranges
GitOrigin-RevId: e6104686a26934a5f25a8f095cbe00c163fbbaa7
* [web] fix typo in ESM migration of a db migration
* [web] migrate old migration to ESM
* [web] use batchedUpdate for bulk updates in old migrations
GitOrigin-RevId: a984f785c577c2ac4125c947b8a3efffa57e1eb7
* [project-history] fix tests and cover callback for processing updates
The before setup was hiding that some tests were not doing what the
assertions were expecting.
* [project-history] fix callback signature when processing no updates
GitOrigin-RevId: 4fa14d47b9a1afd998316b0c9024d49760785a47
* [docstore] add endpoint for getting a projects comment thread ids
* [web] let docstore determine a projects comment thread ids
Also fetch the comment thread ids once when reverting project.
GitOrigin-RevId: c3ebab976821509c9627962e58918f9c6ebb0e1d
* [misc] migrate remaining references to our GCR repositories to AR
* [server-ce] fix retagging of texlive images
GitOrigin-RevId: 81f955ad4c4486ad42b29cbd6bcc9d5ef4b1a432
* [docstore] add endpoint for getting user ids of tracked changes
* [web] let docstore determine user ids of tracked changes
GitOrigin-RevId: 8d0a131555aa827f7ff80690fedc1aca26cf0817
* [web] skip db query when getting empty list of users
* [web] fetch token users in a single db query per access mode
GitOrigin-RevId: fa5d9edcb761bd5d5e5ea07d137a5a86efdbdd5c
* [web] hide sensitive data from joinProject when building project view
* [web] skip fetching members and invites for restricted users
* [web] fix owner features in joinProject view
* [web] separate invited members from owner
* [web] skip fetching users with empty members list
* [web] split await chain
Co-authored-by: Antoine Clausse <antoine.clausse@overleaf.com>
* [web] remove spurious parentheses
* [web] remove dead code
Co-authored-by: Antoine Clausse <antoine.clausse@overleaf.com>
---------
Co-authored-by: Antoine Clausse <antoine.clausse@overleaf.com>
GitOrigin-RevId: 5b4d874f974971e9c14d7412620805f8ebf63541
* [document-updater] flush history for projects with short queues ASAP
* [k8s] document-updater: enable short history queue for history-ot demo
* [project-history] flush history for projects with short queues ASAP
* [project-history] wait for mongo before running acceptance tests
* [k8s] project-history: enable short history queue for history-ot demo
* [project-history] change wait-for-mongo step in tests
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
---------
Co-authored-by: Eric Mc Sween <eric.mcsween@overleaf.com>
GitOrigin-RevId: 3e989c409e8e9887655b35f2659ce0829e61b357
