agw/overleaf-cep
1
0
Fork 0
mirror of https://github.com/yu-i-i/overleaf-cep.git synced 2026-11-12 13:13:45 +01:00
Code Issues Packages Projects Releases Wiki Activity
27,254 Commits 13 Branches 23 Tags
9b10da6eaf3e67cf2b5222e792de191057feaefe
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Henry Oswald a3e1eaa0a6 Merge pull request #10413 from overleaf/ho-delete-project-archiver 
Delete project archiver

GitOrigin-RevId: e2a2723dbc315b884e91adf8f873a5bea8dc360f
 2022-11-18 09:03:52 +00:00
Henry Oswald 6f4975b721 Merge pull request #9750 from overleaf/ho-redis-volatile 
setup web to accept new connection for rate limit redis

GitOrigin-RevId: 114dc4ce06126d77b59f4bfdf39dd3c60bc5eee0
 2022-09-30 08:04:30 +00:00
Henry Oswald aa999d6f2f Merge pull request #9083 from overleaf/ho-redis-sessions-config 
split websessions web config into separate config section & point sessions to existing redis

GitOrigin-RevId: 2f5798d7c7502ad8dced90f88c559a5572843771
 2022-08-08 08:04:46 +00:00
Henry Oswald 5f1abee345 Merge pull request #8939 from overleaf/revert-8882-jk-web-reject-same-password 
Revert "[web] Password set/reset: reject current password"

GitOrigin-RevId: f14f970fe93064658a8659537c5cb417e34e2751
 2022-07-20 08:04:00 +00:00
Henry Oswald ee6ecfffed Merge pull request #7976 from overleaf/ho-rt-upgrade-2022 
bump real time node pools to 1.21.10-gke.2000

GitOrigin-RevId: 2d5f89970de5da7037657c7f12d5a761044a0a8a
 2022-05-18 08:03:29 +00:00
Henry Oswald 380ba96a8b Merge pull request #7360 from overleaf/ho-purge-sess-improvements 
improve the purge sessions script a bit

GitOrigin-RevId: 3b211c1377bc6aa117d3f872a829bb87b16fd9e5
 2022-04-05 12:21:58 +00:00
Henry Oswald 9b71561814 Merge pull request #7302 from overleaf/ho-session-purge 
mvp to purge session keys from redis

GitOrigin-RevId: d1298d4b042164d9c94a7a1d1b7560b6531ae093
 2022-04-05 12:19:36 +00:00
Henry Oswald 92316a2266 Merge pull request #6920 from overleaf/revert-6917-ho-v1-timeout 
Revert "v1 timeout of 2 seconds"

GitOrigin-RevId: e170356d515d68d5e8380b163a71857ce97e8e38
 2022-02-25 09:04:12 +00:00
Henry Oswald 85bf61e5fe Merge pull request #6917 from overleaf/ho-v1-timeout 
v1 timeout of 2 seconds

GitOrigin-RevId: 810a5b0c104fb3eb2b8878ab184d7a4010828f8c
 2022-02-25 09:04:06 +00:00
Henry Oswald 8197411cdf Merge pull request #4891 from overleaf/ho-web-mongo-4-2 
bump mongo to 4.2.15

GitOrigin-RevId: 1ac2057f264bd6dbe042d8f999a4ab1054c9edf5
 2021-09-15 08:03:54 +00:00
Henry Oswald 2b7c7e84ef Clsi user id mapping (#4736) 
* add user-id into clsi project mapping

* add user_id on backend group clsi key

GitOrigin-RevId: ebbf025f5cd88848b44f35a46045d112ea6b4c3b
 2021-08-23 08:02:45 +00:00
Henry Oswald d22bb95ab3 Merge pull request #251 from overleaf/ho-load-shed-mvp 
very basic mvp for shedding load
 2021-06-28 11:00:21 +01:00
Henry Oswald 8e2cd57cb9 very basic mvp for shedding load 
When the box is over 100% capacity start to shed load.

Use 5 min load average to make the system less likely to start moving
projects off after a temporary cpu spike
 2021-06-22 09:46:24 +01:00
Henry Oswald 7cd36e139a support post and get for getting status of clsi project 2021-03-16 10:24:59 +00:00
Henry Oswald 18cbe6424c Merge pull request #159 from overleaf/ho-remove-pending-migration-code 
stop listening on the pending updates channels 10 times
 2021-02-23 13:29:52 +00:00
Henry Oswald 20a373d95c stop listening on the pending updates channels 10 times 2021-02-23 08:27:29 +00:00
Henry Oswald 34bfe9d3b1 Merge pull request #156 from overleaf/ho-shard-pending-queue 
shard the pending-updates-list queue
 2021-02-22 09:08:43 +00:00
Henry Oswald 9247eb4249 Merge pull request #205 from overleaf/ho-pending-update-shard 
Pending update shard
 2021-02-22 09:08:35 +00:00
Henry Oswald 27e7b77bdb bump default key shards to 10 2021-02-16 10:53:35 +00:00
Henry Oswald c7e57cd28f add Dispatchers running on old queue while we migrate 
revert once migrated
 2021-02-15 14:16:45 +00:00
Henry Oswald 854e24bb57 remove unneeded anonymous func 2021-02-15 14:12:28 +00:00
Henry Oswald 49bed6595d added queueKey to error info when trying to push to redis 2021-02-09 12:42:58 +00:00
Henry Oswald 0cdeffae6c fix off by 1 error in Doc updater client helper file 2021-02-09 10:50:37 +00:00
Henry Oswald 46b389e8b3 fix off by 1 error in key sharding 2021-02-09 10:48:40 +00:00
Henry Oswald bcfc7e66fc add missing comma in settings file 2021-02-09 10:32:16 +00:00
Henry Oswald 31e1808dd8 shard the pending-updates-list queue 2021-02-08 16:02:41 +00:00
Henry Oswald c308e60b6b speed up DocumentUpdaterControllerTests by directly injecting redis into 
tests
 2021-02-08 11:13:22 +00:00
Henry OswaldandJohn Lees-Miller 40de999766 Update config/settings.defaults.js 
parseint on dispatcher count

Co-authored-by: John Lees-Miller <jdleesmiller@gmail.com>
 2021-02-04 09:30:35 +00:00
Henry Oswald 11c8cfc939 shard the pending-updates-list queue 2021-02-02 16:38:25 +00:00
Henry Oswald 2339884bd5 Merge pull request #3596 from overleaf/ho-read-pref-secondary 
add .setReadPreference('secondary') to slow queries

GitOrigin-RevId: 828f9a417a43237b3de5609ee9b12b30a68fc167
 2021-01-27 03:04:13 +00:00
Henry Oswald 321a4c1f8a Merge pull request #3085 from overleaf/ho-mongo-4.0 
bump mongo to 4.0.19 to see if tests pass on ci

GitOrigin-RevId: 70fa2ed6c33c4fa0f996fb975935b71e643fa1c7
 2020-08-10 15:55:43 +00:00
Henry Oswald 5c3da905ba Merge pull request #162 from overleaf/ta-jpa-epipe-retry 
[DockerRunner] retry container inspect on EPIPE
 2020-05-19 11:15:25 +01:00
Henry Oswald b450a6e097 Merge pull request #166 from overleaf/jpa-port-smoke-test-patch 
[misc] simplify the smoke test and process shutdown
 2020-05-19 10:31:32 +01:00
Henry Oswald 2547725f35 Merge pull request #164 from overleaf/bg-fix-buffer-deprecations 
fix deprecated usage of Buffer constructor
 2020-05-19 10:26:56 +01:00
Henry Oswald e9c6f3b074 Merge pull request #163 from overleaf/bg-use-encoding-on-process-output 
set encoding when reading from streams
 2020-05-19 10:26:26 +01:00
Henry Oswald 457b7d6657 Merge pull request #165 from overleaf/ho-retry-url-downloads 
add pipeUrlToFileWithRetry for file downloads
 2020-05-19 10:25:19 +01:00
Henry Oswald 44b36c2806 Merge pull request #168 from overleaf/ho-dynamic-disk-size-checker-2 
add refreshExpiryTimeout function
 2020-05-19 10:25:12 +01:00
Henry Oswald 7b9912034d Merge pull request #146 from overleaf/bg-support-other-runtimes 
support other runtimes
 2020-04-23 14:42:18 +01:00
Henry Oswald a5887fad50 Merge pull request #158 from overleaf/jpa-entry-point-cleanup 
[misc] entry point cleanup
 2020-04-23 13:52:04 +01:00
Henry Oswald ea1ff96e0e Merge pull request #155 from overleaf/ho-limit-lifespan 
limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS
 2020-04-23 13:51:09 +01:00
Henry Oswald acbfc465dc add variance into shutdown time to avoid stampeed 2020-04-14 13:36:11 +01:00
Henry Oswald 694267603a Merge pull request #2711 from overleaf/ho-redis-1-0-12 
bump redis to 1.0.12

GitOrigin-RevId: 9065a809617cd856db3d0af10811c705eb0efe77
 2020-04-02 03:19:22 +00:00
Henry Oswald 09ac5e06a0 Merge pull request #131 from overleaf/ho-redis-1-0-12 
bump redis to 1.0.12
 2020-04-01 10:16:14 +01:00
Henry Oswald 4bd11613dd Merge pull request #124 from overleaf/ho-redis-1-0-12 
bump redis to 1.0.12
 2020-04-01 08:16:51 +01:00
Henry Oswald 79f65ded76 Merge pull request #81 from overleaf/ho-redis-1-0-12 
bump redis to 1.0.12
 2020-03-31 15:47:25 +01:00
Henry Oswald 8711abdb66 bump redis to 1.0.12 2020-03-31 14:04:33 +01:00
Henry Oswald 5cb369cba8 bump redis to 1.0.12 2020-03-31 13:22:38 +01:00
Henry Oswald c2b050e286 bump redis to 1.0.12 2020-03-31 10:21:50 +01:00
Henry Oswald 87188e0830 Merge branch 'master' of github.com:overleaf/clsi into ho-limit-lifespan 2020-03-31 09:52:37 +01:00
Henry Oswald 3044558351 Merge pull request #14 from overleaf/ho-redis-4-16-1 
bump io redis to 4.16.1
 2020-03-31 09:47:19 +01:00
Henry Oswald 264e549fc5 bump io redis to 4.16.1 2020-03-31 09:40:44 +01:00
Henry Oswald 3e07af3f1b limit clsi lifespan via health checks and PROCESS_LIFE_SPAN_LIMIT_MS 2020-03-20 13:37:58 +00:00
Henry Oswald 052b5624d3 copy synctex over to /app/bin/synctex-mount in entrypoint 2020-03-11 11:06:46 +00:00
Henry Oswald 01c46e9e94 remove ./bin/install_texlive_gce.sh which shouldn't be needed 
we shouldn't have needed this for a while, I think it is a cause of
startup delay, however this should have stopped other missing texlive
images in the past which is strange
 2020-03-11 10:06:55 +00:00
Henry Oswald fe8ef3f08f Merge pull request #2531 from overleaf/ho-restore-lodash-2526 
Revert "Reverts move from underscore to lodash"

GitOrigin-RevId: 1ea964d5c98a85f9490c0e731d6a68335df93c67
 2020-01-17 04:19:51 +00:00
Henry Oswald 94e3051d2e Merge pull request #2529 from overleaf/revert-2527-ho-angular-revert-1.6.10 
Revert "Revert "Upgrade angular, angular-sanitize and angular-mocks to v1.6.10""

GitOrigin-RevId: eb9db384b0dbc5ed366b79746f2721cd05ef6689
 2020-01-17 04:19:47 +00:00
Henry Oswald 01a7ed7927 Merge pull request #2528 from overleaf/as-fix-dupe-algolia 
Remove duplicate copy of algolia

GitOrigin-RevId: 7099cb0dfd6497f203d8222270b51c2e6f3f616d
 2020-01-17 04:19:38 +00:00
Henry Oswald a3ce442448 Merge pull request #2527 from overleaf/ho-angular-revert-1.6.10 
Revert "Upgrade angular, angular-sanitize and angular-mocks to v1.6.10"

GitOrigin-RevId: 8d13387dd99425eae07e5e4b451d8a8fe7e4e8d3
 2020-01-17 04:19:34 +00:00
Henry Oswald c607976c4a Merge pull request #2526 from overleaf/ho-revert-to-underscore 
Reverts move from underscore to lodash

GitOrigin-RevId: 3d88590a76c37a43f693b53400fdf1f24384cafb
 2020-01-17 04:19:30 +00:00
Henry Oswald 176604a938 add once callback to templates manager for v1 templates 
see if it fixes sl headers crashing

GitOrigin-RevId: 72e7d716155ed7584e8e163801921f852b358f8f
 2019-12-03 14:21:08 +00:00
Henry Oswald 0aad6f2bc8 Merge pull request #2386 from overleaf/ho-disable-view-precompile 
fix eslint issues

GitOrigin-RevId: 90b5a0b81117768ef646c40f55d032426a3f78f8
 2019-11-19 17:05:26 +00:00
Henry Oswald a7567714d1 Merge pull request #2385 from overleaf/ho-disable-view-precompile 
disable view precompile

GitOrigin-RevId: 82e1b8da97af1d9be47834f1687e25f55fe95737
 2019-11-19 17:05:21 +00:00
Henry Oswald 3f3c2136d7 Merge pull request #94 from overleaf/ho-log-redis-events 
logs out when a redis event occurs
 2019-10-07 10:32:14 +01:00
Henry Oswald e9efd6b93b logs out when a redis event occurs 2019-10-03 11:10:31 +01:00
Henry Oswald c64cae2248 Merge pull request #86 from overleaf/ho-add-logging 
Add logging for all project flushing
 2019-08-30 09:46:46 +01:00
Henry Oswald aa15a76059 added log lines for all project flushing 2019-08-30 07:38:53 +01:00
Henry Oswald 0ae838dd2d add logger into project flusher 2019-08-29 20:36:00 +01:00
Henry Oswald 38ed780d80 add log line to draining 2019-08-15 14:41:22 +01:00
Henry Oswald 87605d835e Merge pull request #2075 from overleaf/ho-setting-doc-log-level 
downgrade log of no root doc to log to reduce noise

GitOrigin-RevId: f729f44b46704a26a8bcd808e64a239a0da38107
 2019-08-14 15:19:29 +00:00
Henry Oswald 78629610d5 add health check endpoint and http route logger 2019-08-14 15:38:02 +01:00
Henry Oswald 2ae4c8c174 Merge branch 'ho-drain-connections-timewindow' of github.com:overleaf/real-time into ho-drain-connections-timewindow 2019-08-14 11:52:22 +01:00
Henry Oswald 4a984f533e remove forceDrainMsDelay 
as soon as a pod is marked as being killed we should start draining
 2019-08-14 11:51:25 +01:00
Henry Oswald 00cca29d9e add shutdownDrainTimeWindow, drains all connections within time range 2019-08-13 14:21:47 +01:00
Henry Oswald aa1c74a979 use MONGO_CONNECTION_STRING in settings.defaults.coffee if set 2019-08-07 15:44:57 +01:00
Henry Oswald 032ef02a03 Merge pull request #1990 from overleaf/ho-sharelatex-overleaf-rename 
change name of site in maintenance popup from SL to OL

GitOrigin-RevId: 2adf3b76e4ac16d2137a3fd13239bd78e178a8da
 2019-07-18 13:34:46 +00:00
Henry Oswald 95a7069178 Merge pull request #1953 from overleaf/ho-update-error-package 
Ho update error package

GitOrigin-RevId: 83904fc3f29ad830223d4f961c0ee3d967d5625b
 2019-07-08 15:41:39 +00:00
Henry Oswald 97356e3e23 Merge pull request #1941 from overleaf/ho-pubsub-redis-connection 
use pubsub redis connection

GitOrigin-RevId: 9c0686098c63f9d573abe5c3d0a450db3f609ef1
 2019-07-08 15:41:33 +00:00
Henry Oswald 06ad0f7acd Merge pull request #75 from overleaf/ho-pubsub-connection 
Remove real time redis connection and consolidate on pubsub
 2019-07-08 13:58:41 +01:00
Henry Oswald 374585f47d Merge pull request #72 from overleaf/sk-dep-upgrades-2019-06 
Update logger, metrics, and redis
 2019-07-08 13:58:28 +01:00
Henry Oswald 94b787f467 Merge pull request #71 from overleaf/ho-detailed-flush-status 
return failed and succesfully flushed projects when flushing everything
 2019-07-08 13:58:17 +01:00
Henry Oswald 6d4649c842 Merge pull request #60 from overleaf/ho-pubsub-healthcheck 
Ho pubsub healthcheck
 2019-07-08 13:32:52 +01:00
Henry Oswald 520857cf7a simplify redis continual traffic 
we can't send double health check events to same redis, it causes
health check duplicate errors. Commit just sends health check data to
pub sub pair and then sends non health check traffic to cluster to keep
the connection open
 2019-07-08 12:07:28 +01:00
Henry Oswald 1038c5cd0d send health check to pubsub channel and use different var name 2019-07-08 11:53:42 +01:00
Henry Oswald eadef7b133 Merge pull request #59 from overleaf/ho-redis-natmap-sentinel 
Move pubsub to seperate connection
 2019-07-08 11:18:12 +01:00
Henry Oswald 9953c933ee Update package.json 2019-07-08 11:18:02 +01:00
Henry Oswald 487865fad3 Merge pull request #57 from overleaf/sk-dep-upgrades-2019-06 
update logger and metrics
 2019-07-08 11:17:29 +01:00
Henry Oswald 42e5d2fb6e Update app.coffee 2019-07-08 11:17:08 +01:00
Henry Oswald 8042a415ec move pubsub traffic over to a pubsub redis connection string 2019-07-04 13:38:39 +01:00
Henry Oswald 3b3b2da0f5 add pubsub redis connection and remove real time redis connection 2019-07-04 13:34:31 +01:00
Henry Oswald a42aa45a36 Merge branch 'sk-dep-upgrades-2019-06' into ho-pubsub-connection 2019-07-03 10:18:13 +01:00
Henry Oswald eed8e215d7 bump redis-sharelatex (and io redis) to 1.0.9 2019-07-02 16:58:30 +01:00
Henry Oswald b268285ff6 bump redis-sharelatex (and io redis) to 1.0.9 2019-07-02 16:55:07 +01:00
Henry Oswald 670ce61da1 require underscore 2019-07-02 15:36:17 +01:00
Henry Oswald 88b75b8baa send health check data to all redis backends 2019-07-02 14:56:50 +01:00
Henry Oswald 92f60690f3 add redis set 2019-07-02 14:46:58 +01:00
Henry Oswald 922a1a1aba bump redis driver 2019-07-02 12:04:19 +01:00
Henry Oswald 630a957d7b bump ioredis to have naptmap for sentinal 2019-07-02 11:56:21 +01:00
Henry Oswald fdef197271 Merge branch 'master' into ho-detailed-flush-status 2019-06-13 14:33:22 +01:00
Henry Oswald d9a737f97c return failed and succesfully flushed projects when flushing everything 2019-06-13 14:21:38 +01:00
Henry Oswald 973a25fc64 fix background flush unit test 2019-06-03 10:33:32 +01:00