b5e4345855
Merge pull request #96 from overleaf/jpa-dependencies-cleanup
...
[misc] dependencies cleanup
2020-03-04 10:00:56 +00:00
467af9885a
Merge pull request #97 from overleaf/jpa-3rd-party-s3-via-env
...
[config] add support for third party s3 which uses path-style buckets
2020-03-04 09:59:48 +00:00
62b2aa8f02
Merge pull request #98 from overleaf/jpa-promisify-filehandler
...
[misc] promisify FileHandler and remove dependency on async
2020-03-04 09:59:15 +00:00
2e9dd5ccf5
Merge pull request #100 from overleaf/spd-prettierfix
...
Fix prettier task
2020-03-04 09:58:35 +00:00
2b15729658
[misc] promisify FileHandler and remove dependency on async
...
Signed-off-by: Jakob Ackermann <das7pad@outlook.com >
2020-03-02 18:23:17 +01:00
ada6ac0764
[misc] revert eslint rules
2020-03-02 18:12:55 +01:00
1276fb426a
[misc] bump buildscript version to 1.3.6
2020-03-02 17:50:45 +01:00
0312b00150
Fix prettier task
2020-03-02 16:31:35 +00:00
4b7c6fafd2
[misc] drop unused dependency pngcrush
2020-03-02 17:11:56 +01:00
3c61e53918
[misc] move mocha to the devDependencies
2020-03-02 17:11:39 +01:00
6f27f7a1bf
[misc] drop the /heapdump route and related heapdump package
2020-03-02 17:09:35 +01:00
32557ab1d7
[SafeExec] replace _.once with lodash.once
2020-03-02 17:08:42 +01:00
0db4a17a14
[HealthCheckController] use fs.copyFile instead of fs-extra.copy
...
the fs-extra method has a HUGE overhead of JS code and also syscalls for
no particular benefit in this case: just copy the tiny.pdf file.
Here is an overview of the major operations: paths are relative to
https://github.com/jprichardson/node-fs-extra/blob/1.0.0
We start in /lib/copy/copy.js
- sys: check that the source file exists
- sys: check that the source file has an existing parent directory?!
Continue in /lib/copy/ncp.js
- sys: more stat calls on both source and dest to determine permissions
- read/write streams to pipe the file content through the process
- sys: chmod on the destination to match the source permissions
What we actually need is a call to the binding and let node/the os
figure out the best way to copy the contents.
Signed-off-by: Jakob Ackermann <das7pad@outlook.com >
2020-03-02 17:02:35 +01:00
428dcdf0ee
Merge pull request #99 from overleaf/bg-update-npm-packages
...
run npm update
2020-03-02 11:28:27 +00:00
c13d7f4197
Bump aws-sdk version in package.json
2020-03-02 11:18:06 +00:00
ebabe52632
fix settings unit test
2020-02-28 15:27:29 +00:00
e3011b2521
run npm update
2020-02-28 14:51:57 +00:00
b4e3d7de62
[config] add support for third party s3 which uses path-style buckets
...
Signed-off-by: Jakob Ackermann <das7pad@outlook.com >
2020-02-28 12:48:52 +01:00
00d949ba26
Merge pull request #94 from overleaf/spd-unhandled-errors
...
Write to error log on unhandled rejection/exception
2020-02-27 10:37:31 +00:00
6e19a650d2
Write to error log on unhandled rejection/exception
2020-02-27 10:33:48 +00:00
0cdcac4cd2
Merge pull request #93 from overleaf/spd-migration-persistor-redux
...
Add migration persistor with md5 fix
2020-02-18 10:52:18 +00:00
492f8abc9f
Update config/settings.defaults.coffee
...
Co-Authored-By: Jakob Ackermann <das7pad@outlook.com >
2020-02-18 10:24:29 +00:00
8acc9ef0ae
Make S3 partSize a setting
2020-02-17 14:06:15 +00:00
7c4bf97a7f
Avoid fetching file a second time when source md5 can't be fetched
2020-02-17 14:06:05 +00:00
9e7eec7a19
Add acceptance test for large files
2020-02-17 14:05:56 +00:00
2f2a819b74
Re-fetch file to calculate md5 if etag is not in correct format
2020-02-17 14:05:43 +00:00
5adfb3e2c0
Use large upload chunks
2020-02-17 14:05:31 +00:00
4e507197fc
Revert "Merge pull request #91 from overleaf/revert-78-spd-migration-persistor"
...
This reverts commit 0cce792604c258538cf012486e7329fa1be7da0f, reversing
changes made to 08b606e22f855121b2d8a2832a5d7e2f45836c3f.
2020-02-17 14:04:42 +00:00
bbea064687
Merge pull request #91 from overleaf/revert-78-spd-migration-persistor
...
Revert "Add Migration Persistor, to send missing file requests to a fallback persistor"
2020-02-14 14:34:29 +00:00
df2ddbe0e1
Revert "Add Migration Persistor, to send missing file requests to a fallback persistor"
2020-02-14 14:26:33 +00:00
8f86002bb4
Merge pull request #89 from overleaf/spd-error-logging-fix
...
Move error handler to be the last middleware
2020-02-14 11:07:07 +00:00
e4926e09a7
Move error handler to be the last middleware
2020-02-14 10:58:46 +00:00
2f67ade3ec
Merge pull request #88 from overleaf/dependabot-lodash-4.17.15
...
Bump lodash from 4.17.11 to 4.17.15
2020-02-14 09:45:12 +00:00
31f2572e57
Bump lodash from 4.17.11 to 4.17.15
...
Bumps [lodash](https://github.com/lodash/lodash ) from 4.17.11 to 4.17.15.
- [Release notes](https://github.com/lodash/lodash/releases )
- [Commits](https://github.com/lodash/lodash/compare/4.17.11...4.17.15 )
Signed-off-by: dependabot[bot] <support@github.com >
2020-02-14 09:39:06 +00:00
485cfce6d3
Merge pull request #85 from overleaf/jpa-dependencies-cleanup
...
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-14 09:24:43 +00:00
16d1674eab
Merge pull request #84 from overleaf/bg-remove-travis-yml
...
Remove unused .travis.yml file
2020-02-14 09:21:03 +00:00
84a80930eb
[misc] rename npm-shrinkwrap.json to package-lock.json and run npm i
2020-02-14 09:19:29 +00:00
44fbc6a733
Merge pull request #82 from overleaf/spd-error-handler-error
...
Fix log info assignment in error handler
2020-02-14 09:18:16 +00:00
aae277e16e
Merge pull request #78 from overleaf/spd-migration-persistor
...
Add Migration Persistor, to send missing file requests to a fallback persistor
2020-02-14 09:17:31 +00:00
9cf473ba7b
Merge pull request #79 from overleaf/spd-helper-refactor
...
Refactor persistors to use a helper for common things
2020-02-13 16:59:35 +00:00
3b011258d2
Tidy up md5 hash generation
2020-02-12 13:27:12 +00:00
49ad408b30
Remove unused imports and format correctly
2020-02-12 13:27:12 +00:00
93cd55fb79
Refactor persistors to use a helper for common things
2020-02-12 13:27:12 +00:00
304fdfd35c
Explicitly resume stream after adding listener
2020-02-12 13:21:53 +00:00
6dcf351377
Remove unnecessary 'async'
2020-02-12 13:21:53 +00:00
f4a16cd972
Update tests to properly check for copied files
2020-02-12 13:21:53 +00:00
42a5d168df
Remove unused packages
2020-02-12 13:21:52 +00:00
9e0b378948
Remove minipass as dependency and refactor to make things clearer
2020-02-12 13:21:52 +00:00
5d5d325691
Preserve all error information when cleanup of copied file fails
2020-02-12 13:21:52 +00:00
b4b7fd226e
Add mechanisms to transfer files with md5-based integrity checks
...
Fix error in settings and tidy up tests
Remove unused variable declaration
Remove .only from tests and update eslint rules to catch it in future
Use to catch errors more safely getting md5 hash
Avoid unnecessary call to S3 to get md5 response
2020-02-12 13:21:52 +00:00
Simon Detheridge