diff --git a/MANUAL.html b/MANUAL.html
index 9d85a4095..c2eebde23 100644
--- a/MANUAL.html
+++ b/MANUAL.html
@@ -17,7 +17,7 @@
Rclone syncs your files to cloud storage

@@ -4330,12 +4330,21 @@ rclone rc core/bwlimit rate=1M
command - a string with the command name
arg - a list of arguments for the backend command
opt - a map of string to string of options
+returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
+
+- defaults to "COMBINED_OUTPUT" if not set
+- the STREAM returnTypes will write the output to the body of the HTTP message
+- the COMBINED_OUTPUT will write the output to the "result" parameter
+
Returns
-- result - result from the backend command
+- result - result from the backend command
+
+- only set when using returnType "COMBINED_OUTPUT"
+
- error - set if rclone exits with an error code
-- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT". "STREAM_ONLY_STDERR")
+- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
For example
rclone rc core/command command=ls -a mydrive:/ -o max-depth=1
@@ -5098,7 +5107,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| Dropbox |
-DBHASH † |
+DBHASH ¹ |
Yes |
Yes |
No |
@@ -5170,7 +5179,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| Mail.ru Cloud |
-Mailru ‡‡‡ |
+Mailru ⁶ |
Yes |
Yes |
No |
@@ -5202,7 +5211,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| Microsoft OneDrive |
-SHA1 ‡‡ |
+SHA1 ⁵ |
Yes |
Yes |
No |
@@ -5213,7 +5222,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
MD5 |
Yes |
Yes |
-Partial * |
+Partial ⁸ |
- |
@@ -5226,7 +5235,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| pCloud |
-MD5, SHA1 |
+MD5, SHA1 ⁷ |
Yes |
No |
No |
@@ -5266,7 +5275,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| SFTP |
-MD5, SHA1 ‡ |
+MD5, SHA1 ² |
Yes |
Depends |
No |
@@ -5290,8 +5299,8 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
| WebDAV |
-MD5, SHA1 †† |
-Yes ††† |
+MD5, SHA1 ³ |
+Yes ⁴ |
Depends |
No |
- |
@@ -5314,15 +5323,18 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
+Notes
+¹ Dropbox supports its own custom hash. This is an SHA256 sum of all the 4MB block SHA256s.
+² SFTP supports checksums if the same login has shell access and md5sum or sha1sum as well as echo are in the remote's PATH.
+³ WebDAV supports hashes when used with Owncloud and Nextcloud only.
+⁴ WebDAV supports modtimes when used with Owncloud and Nextcloud only.
+⁵ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive for business and SharePoint server support Microsoft's own QuickXorHash.
+⁶ Mail.ru uses its own modified SHA1 hash
+⁷ pCloud only supports SHA1 (not MD5) in its EU region
+⁸ Opendrive does not support creation of duplicate files using their web client interface or other stock clients, but the underlying storage platform has been determined to allow duplicate files, and it is possible to create them with rclone. It may be that this is a mistake or an unsupported feature.
Hash
The cloud storage system supports various hash types of the objects. The hashes are used when transferring data as an integrity check and can be specifically used with the --checksum flag in syncs and in the check command.
To use the verify checksums when transferring between cloud storage systems they must support a common hash type.
-† Note that Dropbox supports its own custom hash. This is an SHA256 sum of all the 4MB block SHA256s.
-‡ SFTP supports checksums if the same login has shell access and md5sum or sha1sum as well as echo are in the remote's PATH.
-†† WebDAV supports hashes when used with Owncloud and Nextcloud only.
-††† WebDAV supports modtimes when used with Owncloud and Nextcloud only.
-‡‡ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive for business and SharePoint server support Microsoft's own QuickXorHash.
-‡‡‡ Mail.ru uses its own modified SHA1 hash
ModTime
The cloud storage system supports setting modification times on objects. If it does then this enables a using the modification times as part of the sync. If not then only the size will be checked by default, though the MD5SUM can be checked with the --checksum flag.
All cloud storage systems support some kind of date on the object and these will be set when transferring from the cloud storage system.
@@ -5339,7 +5351,6 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
Duplicate files
If a cloud storage system allows duplicate files then it can have two objects with the same name.
This confuses rclone greatly when syncing - use the rclone dedupe command to rename or remove duplicates.
-* Opendrive does not support creation of duplicate files using their web client interface or other stock clients, but the underlying storage platform has been determined to allow duplicate files, and it is possible to create them with rclone. It may be that this is a mistake or an unsupported feature.
Restricted filenames
Some cloud storage systems might have restrictions on the characters that are usable in file or directory names. When rclone detects such a name during a file upload, it will transparently replace the restricted characters with similar looking Unicode characters.
This process is designed to avoid ambiguous file names as much as possible and allow to move files between many cloud storage systems transparently.
@@ -6291,7 +6302,7 @@ Showing nodes accounting for 1537.03kB, 100% of 1537.03kB total
--use-json-log Use json log format.
--use-mmap Use mmap allocator (see docs).
--use-server-modtime Use server modified time instead of object metadata
- --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.3")
+ --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.4")
-v, --verbose count Print lots more stuff (repeat for more)
Backend Flags
These flags are available for every command. They control the backends and may be set in the config file.
@@ -16160,7 +16171,8 @@ y/e/d> y
rclone copy /home/source remote:backup
Modified time and hashes
pCloud allows modification times to be set on objects accurate to 1 second. These will be used to detect whether objects need syncing or not. In order to set a Modification time pCloud requires the object be re-uploaded.
-pCloud supports MD5 and SHA1 type hashes, so you can use the --checksum flag.
+pCloud supports MD5 and SHA1 type hashes in the US region but and SHA1 only in the EU region, so you can use the --checksum flag.
+(Note that pCloud also support SHA256 in the EU region, but rclone does not have support for that yet.)
Restricted filename characters
In addition to the default restricted characters set the following characters are also replaced:
@@ -18552,6 +18564,71 @@ $ tree /tmp/b
"error": return an error based on option value
Changelog
+v1.53.4 - 2021-01-20
+See commits
+
+- Bug Fixes
+
+- accounting: Fix data race in Transferred() (Maciej Zimnoch)
+- build
+
+- Stop tagged releases making a current beta (Nick Craig-Wood)
+- Upgrade docker buildx action (Matteo Pietro Dazzi)
+- Add -buildmode to cross-compile.go (Nick Craig-Wood)
+- Fix docker build by upgrading ilteoood/docker_buildx (Nick Craig-Wood)
+- Revert GitHub actions brew fix since this is now fixed (Nick Craig-Wood)
+- Fix brew install --cask syntax for macOS build (Nick Craig-Wood)
+- Update nfpm syntax to fix build of .deb/.rpm packages (Nick Craig-Wood)
+- Fix for Windows build errors (Ivan Andreev)
+
+- fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
+- fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
+- rc
+
+- Fix core/command giving 500 internal error (Nick Craig-Wood)
+- Add Copy method to rc.Params (Nick Craig-Wood)
+- Fix 500 error when marshalling errors from core/command (Nick Craig-Wood)
+- plugins: Create plugins files only if webui is enabled. (negative0)
+
+- serve http: Fix serving files of unknown length (Nick Craig-Wood)
+- serve sftp: Fix authentication on one connection blocking others (Nick Craig-Wood)
+
+- Mount
+
+- Add optional
brew tag to throw an error when using mount in the binaries installed via Homebrew (Anagh Kumar Baranwal)
+- Add "." and ".." to directories to match cmount and expectations (Nick Craig-Wood)
+
+- VFS
+
+- Make cache dir absolute before using it to fix path too long errors (Nick Craig-Wood)
+
+- Chunker
+
+- Improve detection of incompatible metadata (Ivan Andreev)
+
+- Google Cloud Storage
+
+- Fix server side copy of large objects (Nick Craig-Wood)
+
+- Jottacloud
+
+- Fix token renewer to fix long uploads (Nick Craig-Wood)
+- Fix token refresh failed: is not a regular file error (Nick Craig-Wood)
+
+- Pcloud
+
+- Only use SHA1 hashes in EU region (Nick Craig-Wood)
+
+- Sharefile
+
+- Undo Fix backend due to API swapping integers for strings (Nick Craig-Wood)
+
+- WebDAV
+
+- Fix Open Range requests to fix 4shared mount (Nick Craig-Wood)
+- Add "Depth: 0" to GET requests to fix bitrix (Nick Craig-Wood)
+
+
v1.53.3 - 2020-11-19
See commits
diff --git a/MANUAL.md b/MANUAL.md
index af6690c00..45629d589 100644
--- a/MANUAL.md
+++ b/MANUAL.md
@@ -1,6 +1,6 @@
% rclone(1) User Manual
% Nick Craig-Wood
-% Nov 19, 2020
+% Jan 20, 2021
# Rclone syncs your files to cloud storage
@@ -8907,17 +8907,22 @@ This takes the following parameters
- command - a string with the command name
- arg - a list of arguments for the backend command
- opt - a map of string to string of options
+- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
+ - defaults to "COMBINED_OUTPUT" if not set
+ - the STREAM returnTypes will write the output to the body of the HTTP message
+ - the COMBINED_OUTPUT will write the output to the "result" parameter
Returns
- result - result from the backend command
+ - only set when using returnType "COMBINED_OUTPUT"
- error - set if rclone exits with an error code
-- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT". "STREAM_ONLY_STDERR")
+- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
For example
rclone rc core/command command=ls -a mydrive:/ -o max-depth=1
- rclone rc core/command -a ls -a mydrive:/ -o max-depth=1
+ rclone rc core/command -a ls -a mydrive:/ -o max-depth=1
Returns
@@ -10010,7 +10015,7 @@ Here is an overview of the major features of each cloud storage system.
| Backblaze B2 | SHA1 | Yes | No | No | R/W |
| Box | SHA1 | Yes | Yes | No | - |
| Citrix ShareFile | MD5 | Yes | Yes | No | - |
-| Dropbox | DBHASH † | Yes | Yes | No | - |
+| Dropbox | DBHASH ¹ | Yes | Yes | No | - |
| FTP | - | No | No | No | - |
| Google Cloud Storage | MD5 | Yes | No | No | R/W |
| Google Drive | MD5 | Yes | No | Yes | R/W |
@@ -10019,25 +10024,52 @@ Here is an overview of the major features of each cloud storage system.
| Hubic | MD5 | Yes | No | No | R/W |
| Jottacloud | MD5 | Yes | Yes | No | R/W |
| Koofr | MD5 | No | Yes | No | - |
-| Mail.ru Cloud | Mailru ‡‡‡ | Yes | Yes | No | - |
+| Mail.ru Cloud | Mailru ⁶ | Yes | Yes | No | - |
| Mega | - | No | No | Yes | - |
| Memory | MD5 | Yes | No | No | - |
| Microsoft Azure Blob Storage | MD5 | Yes | No | No | R/W |
-| Microsoft OneDrive | SHA1 ‡‡ | Yes | Yes | No | R |
-| OpenDrive | MD5 | Yes | Yes | Partial \* | - |
+| Microsoft OneDrive | SHA1 ⁵ | Yes | Yes | No | R |
+| OpenDrive | MD5 | Yes | Yes | Partial ⁸ | - |
| OpenStack Swift | MD5 | Yes | No | No | R/W |
-| pCloud | MD5, SHA1 | Yes | No | No | W |
+| pCloud | MD5, SHA1 ⁷ | Yes | No | No | W |
| premiumize.me | - | No | Yes | No | R |
| put.io | CRC-32 | Yes | No | Yes | R |
| QingStor | MD5 | No | No | No | R/W |
| Seafile | - | No | No | No | - |
-| SFTP | MD5, SHA1 ‡ | Yes | Depends | No | - |
+| SFTP | MD5, SHA1 ² | Yes | Depends | No | - |
| SugarSync | - | No | No | No | - |
| Tardigrade | - | Yes | No | No | - |
-| WebDAV | MD5, SHA1 ††| Yes ††† | Depends | No | - |
+| WebDAV | MD5, SHA1 ³ | Yes ⁴ | Depends | No | - |
| Yandex Disk | MD5 | Yes | No | No | R/W |
| The local filesystem | All | Yes | Depends | No | - |
+### Notes
+
+¹ Dropbox supports [its own custom
+hash](https://www.dropbox.com/developers/reference/content-hash).
+This is an SHA256 sum of all the 4MB block SHA256s.
+
+² SFTP supports checksums if the same login has shell access and
+`md5sum` or `sha1sum` as well as `echo` are in the remote's PATH.
+
+³ WebDAV supports hashes when used with Owncloud and Nextcloud only.
+
+⁴ WebDAV supports modtimes when used with Owncloud and Nextcloud only.
+
+⁵ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive
+for business and SharePoint server support Microsoft's own
+[QuickXorHash](https://docs.microsoft.com/en-us/onedrive/developer/code-snippets/quickxorhash).
+
+⁶ Mail.ru uses its own modified SHA1 hash
+
+⁷ pCloud only supports SHA1 (not MD5) in its EU region
+
+⁸ Opendrive does not support creation of duplicate files using
+their web client interface or other stock clients, but the underlying
+storage platform has been determined to allow duplicate files, and it
+is possible to create them with `rclone`. It may be that this is a
+mistake or an unsupported feature.
+
### Hash ###
The cloud storage system supports various hash types of the objects.
@@ -10048,23 +10080,6 @@ the `check` command.
To use the verify checksums when transferring between cloud storage
systems they must support a common hash type.
-† Note that Dropbox supports [its own custom
-hash](https://www.dropbox.com/developers/reference/content-hash).
-This is an SHA256 sum of all the 4MB block SHA256s.
-
-‡ SFTP supports checksums if the same login has shell access and `md5sum`
-or `sha1sum` as well as `echo` are in the remote's PATH.
-
-†† WebDAV supports hashes when used with Owncloud and Nextcloud only.
-
-††† WebDAV supports modtimes when used with Owncloud and Nextcloud only.
-
-‡‡ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive
-for business and SharePoint server support Microsoft's own
-[QuickXorHash](https://docs.microsoft.com/en-us/onedrive/developer/code-snippets/quickxorhash).
-
-‡‡‡ Mail.ru uses its own modified SHA1 hash
-
### ModTime ###
The cloud storage system supports setting modification times on
@@ -10105,12 +10120,6 @@ objects with the same name.
This confuses rclone greatly when syncing - use the `rclone dedupe`
command to rename or remove duplicates.
-\* Opendrive does not support creation of duplicate files using
-their web client interface or other stock clients, but the underlying
-storage platform has been determined to allow duplicate files, and it
-is possible to create them with `rclone`. It may be that this is a
-mistake or an unsupported feature.
-
### Restricted filenames ###
Some cloud storage systems might have restrictions on the characters
@@ -10569,7 +10578,7 @@ These flags are available for every command.
--use-json-log Use json log format.
--use-mmap Use mmap allocator (see docs).
--use-server-modtime Use server modified time instead of object metadata
- --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.3")
+ --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.4")
-v, --verbose count Print lots more stuff (repeat for more)
```
@@ -22744,8 +22753,11 @@ second. These will be used to detect whether objects need syncing or
not. In order to set a Modification time pCloud requires the object
be re-uploaded.
-pCloud supports MD5 and SHA1 type hashes, so you can use the
-`--checksum` flag.
+pCloud supports MD5 and SHA1 type hashes in the US region but and SHA1
+only in the EU region, so you can use the `--checksum` flag.
+
+(Note that pCloud also support SHA256 in the EU region, but rclone
+does not have support for that yet.)
#### Restricted filename characters
@@ -25727,6 +25739,50 @@ Options:
# Changelog
+## v1.53.4 - 2021-01-20
+
+[See commits](https://github.com/rclone/rclone/compare/v1.53.3...v1.53.4)
+
+* Bug Fixes
+ * accounting: Fix data race in Transferred() (Maciej Zimnoch)
+ * build
+ * Stop tagged releases making a current beta (Nick Craig-Wood)
+ * Upgrade docker buildx action (Matteo Pietro Dazzi)
+ * Add -buildmode to cross-compile.go (Nick Craig-Wood)
+ * Fix docker build by upgrading ilteoood/docker_buildx (Nick Craig-Wood)
+ * Revert GitHub actions brew fix since this is now fixed (Nick Craig-Wood)
+ * Fix brew install --cask syntax for macOS build (Nick Craig-Wood)
+ * Update nfpm syntax to fix build of .deb/.rpm packages (Nick Craig-Wood)
+ * Fix for Windows build errors (Ivan Andreev)
+ * fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
+ * fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
+ * rc
+ * Fix core/command giving 500 internal error (Nick Craig-Wood)
+ * Add Copy method to rc.Params (Nick Craig-Wood)
+ * Fix 500 error when marshalling errors from core/command (Nick Craig-Wood)
+ * plugins: Create plugins files only if webui is enabled. (negative0)
+ * serve http: Fix serving files of unknown length (Nick Craig-Wood)
+ * serve sftp: Fix authentication on one connection blocking others (Nick Craig-Wood)
+* Mount
+ * Add optional `brew` tag to throw an error when using mount in the binaries installed via Homebrew (Anagh Kumar Baranwal)
+ * Add "." and ".." to directories to match cmount and expectations (Nick Craig-Wood)
+* VFS
+ * Make cache dir absolute before using it to fix path too long errors (Nick Craig-Wood)
+* Chunker
+ * Improve detection of incompatible metadata (Ivan Andreev)
+* Google Cloud Storage
+ * Fix server side copy of large objects (Nick Craig-Wood)
+* Jottacloud
+ * Fix token renewer to fix long uploads (Nick Craig-Wood)
+ * Fix token refresh failed: is not a regular file error (Nick Craig-Wood)
+* Pcloud
+ * Only use SHA1 hashes in EU region (Nick Craig-Wood)
+* Sharefile
+ * Undo Fix backend due to API swapping integers for strings (Nick Craig-Wood)
+* WebDAV
+ * Fix Open Range requests to fix 4shared mount (Nick Craig-Wood)
+ * Add "Depth: 0" to GET requests to fix bitrix (Nick Craig-Wood)
+
## v1.53.3 - 2020-11-19
[See commits](https://github.com/rclone/rclone/compare/v1.53.2...v1.53.3)
diff --git a/MANUAL.txt b/MANUAL.txt
index b13fb965f..2d6c00f74 100644
--- a/MANUAL.txt
+++ b/MANUAL.txt
@@ -1,6 +1,6 @@
rclone(1) User Manual
Nick Craig-Wood
-Nov 19, 2020
+Jan 20, 2021
@@ -9018,13 +9018,21 @@ This takes the following parameters
- command - a string with the command name
- arg - a list of arguments for the backend command
- opt - a map of string to string of options
+- returnType - one of ("COMBINED_OUTPUT", "STREAM",
+ "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
+ - defaults to "COMBINED_OUTPUT" if not set
+ - the STREAM returnTypes will write the output to the body of the
+ HTTP message
+ - the COMBINED_OUTPUT will write the output to the "result"
+ parameter
Returns
- result - result from the backend command
+ - only set when using returnType "COMBINED_OUTPUT"
- error - set if rclone exits with an error code
- returnType - one of ("COMBINED_OUTPUT", "STREAM",
- "STREAM_ONLY_STDOUT". "STREAM_ONLY_STDERR")
+ "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
For example
@@ -10096,41 +10104,66 @@ Features
Here is an overview of the major features of each cloud storage system.
- Name Hash ModTime Case Insensitive Duplicate Files MIME Type
- ------------------------------ -------------- --------- ------------------ ----------------- -----------
- 1Fichier Whirlpool No No Yes R
- Amazon Drive MD5 No Yes No R
- Amazon S3 MD5 Yes No No R/W
- Backblaze B2 SHA1 Yes No No R/W
- Box SHA1 Yes Yes No -
- Citrix ShareFile MD5 Yes Yes No -
- Dropbox DBHASH † Yes Yes No -
- FTP - No No No -
- Google Cloud Storage MD5 Yes No No R/W
- Google Drive MD5 Yes No Yes R/W
- Google Photos - No No Yes R
- HTTP - No No No R
- Hubic MD5 Yes No No R/W
- Jottacloud MD5 Yes Yes No R/W
- Koofr MD5 No Yes No -
- Mail.ru Cloud Mailru ‡‡‡ Yes Yes No -
- Mega - No No Yes -
- Memory MD5 Yes No No -
- Microsoft Azure Blob Storage MD5 Yes No No R/W
- Microsoft OneDrive SHA1 ‡‡ Yes Yes No R
- OpenDrive MD5 Yes Yes Partial * -
- OpenStack Swift MD5 Yes No No R/W
- pCloud MD5, SHA1 Yes No No W
- premiumize.me - No Yes No R
- put.io CRC-32 Yes No Yes R
- QingStor MD5 No No No R/W
- Seafile - No No No -
- SFTP MD5, SHA1 ‡ Yes Depends No -
- SugarSync - No No No -
- Tardigrade - Yes No No -
- WebDAV MD5, SHA1 †† Yes ††† Depends No -
- Yandex Disk MD5 Yes No No R/W
- The local filesystem All Yes Depends No -
+ Name Hash ModTime Case Insensitive Duplicate Files MIME Type
+ ------------------------------ ------------- --------- ------------------ ----------------- -----------
+ 1Fichier Whirlpool No No Yes R
+ Amazon Drive MD5 No Yes No R
+ Amazon S3 MD5 Yes No No R/W
+ Backblaze B2 SHA1 Yes No No R/W
+ Box SHA1 Yes Yes No -
+ Citrix ShareFile MD5 Yes Yes No -
+ Dropbox DBHASH ¹ Yes Yes No -
+ FTP - No No No -
+ Google Cloud Storage MD5 Yes No No R/W
+ Google Drive MD5 Yes No Yes R/W
+ Google Photos - No No Yes R
+ HTTP - No No No R
+ Hubic MD5 Yes No No R/W
+ Jottacloud MD5 Yes Yes No R/W
+ Koofr MD5 No Yes No -
+ Mail.ru Cloud Mailru ⁶ Yes Yes No -
+ Mega - No No Yes -
+ Memory MD5 Yes No No -
+ Microsoft Azure Blob Storage MD5 Yes No No R/W
+ Microsoft OneDrive SHA1 ⁵ Yes Yes No R
+ OpenDrive MD5 Yes Yes Partial ⁸ -
+ OpenStack Swift MD5 Yes No No R/W
+ pCloud MD5, SHA1 ⁷ Yes No No W
+ premiumize.me - No Yes No R
+ put.io CRC-32 Yes No Yes R
+ QingStor MD5 No No No R/W
+ Seafile - No No No -
+ SFTP MD5, SHA1 ² Yes Depends No -
+ SugarSync - No No No -
+ Tardigrade - Yes No No -
+ WebDAV MD5, SHA1 ³ Yes ⁴ Depends No -
+ Yandex Disk MD5 Yes No No R/W
+ The local filesystem All Yes Depends No -
+
+Notes
+
+¹ Dropbox supports its own custom hash. This is an SHA256 sum of all the
+4MB block SHA256s.
+
+² SFTP supports checksums if the same login has shell access and md5sum
+or sha1sum as well as echo are in the remote's PATH.
+
+³ WebDAV supports hashes when used with Owncloud and Nextcloud only.
+
+⁴ WebDAV supports modtimes when used with Owncloud and Nextcloud only.
+
+⁵ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive for
+business and SharePoint server support Microsoft's own QuickXorHash.
+
+⁶ Mail.ru uses its own modified SHA1 hash
+
+⁷ pCloud only supports SHA1 (not MD5) in its EU region
+
+⁸ Opendrive does not support creation of duplicate files using their web
+client interface or other stock clients, but the underlying storage
+platform has been determined to allow duplicate files, and it is
+possible to create them with rclone. It may be that this is a mistake or
+an unsupported feature.
Hash
@@ -10142,21 +10175,6 @@ command.
To use the verify checksums when transferring between cloud storage
systems they must support a common hash type.
-† Note that Dropbox supports its own custom hash. This is an SHA256 sum
-of all the 4MB block SHA256s.
-
-‡ SFTP supports checksums if the same login has shell access and md5sum
-or sha1sum as well as echo are in the remote's PATH.
-
-†† WebDAV supports hashes when used with Owncloud and Nextcloud only.
-
-††† WebDAV supports modtimes when used with Owncloud and Nextcloud only.
-
-‡‡ Microsoft OneDrive Personal supports SHA1 hashes, whereas OneDrive
-for business and SharePoint server support Microsoft's own QuickXorHash.
-
-‡‡‡ Mail.ru uses its own modified SHA1 hash
-
ModTime
The cloud storage system supports setting modification times on objects.
@@ -10197,12 +10215,6 @@ objects with the same name.
This confuses rclone greatly when syncing - use the rclone dedupe
command to rename or remove duplicates.
-* Opendrive does not support creation of duplicate files using their web
-client interface or other stock clients, but the underlying storage
-platform has been determined to allow duplicate files, and it is
-possible to create them with rclone. It may be that this is a mistake or
-an unsupported feature.
-
Restricted filenames
Some cloud storage systems might have restrictions on the characters
@@ -10660,7 +10672,7 @@ These flags are available for every command.
--use-json-log Use json log format.
--use-mmap Use mmap allocator (see docs).
--use-server-modtime Use server modified time instead of object metadata
- --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.3")
+ --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.4")
-v, --verbose count Print lots more stuff (repeat for more)
@@ -22730,8 +22742,11 @@ second. These will be used to detect whether objects need syncing or
not. In order to set a Modification time pCloud requires the object be
re-uploaded.
-pCloud supports MD5 and SHA1 type hashes, so you can use the --checksum
-flag.
+pCloud supports MD5 and SHA1 type hashes in the US region but and SHA1
+only in the EU region, so you can use the --checksum flag.
+
+(Note that pCloud also support SHA256 in the EU region, but rclone does
+not have support for that yet.)
Restricted filename characters
@@ -25700,6 +25715,64 @@ Options:
CHANGELOG
+v1.53.4 - 2021-01-20
+
+See commits
+
+- Bug Fixes
+ - accounting: Fix data race in Transferred() (Maciej Zimnoch)
+ - build
+ - Stop tagged releases making a current beta (Nick Craig-Wood)
+ - Upgrade docker buildx action (Matteo Pietro Dazzi)
+ - Add -buildmode to cross-compile.go (Nick Craig-Wood)
+ - Fix docker build by upgrading ilteoood/docker_buildx (Nick
+ Craig-Wood)
+ - Revert GitHub actions brew fix since this is now fixed (Nick
+ Craig-Wood)
+ - Fix brew install --cask syntax for macOS build (Nick
+ Craig-Wood)
+ - Update nfpm syntax to fix build of .deb/.rpm packages (Nick
+ Craig-Wood)
+ - Fix for Windows build errors (Ivan Andreev)
+ - fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
+ - fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
+ - rc
+ - Fix core/command giving 500 internal error (Nick Craig-Wood)
+ - Add Copy method to rc.Params (Nick Craig-Wood)
+ - Fix 500 error when marshalling errors from core/command
+ (Nick Craig-Wood)
+ - plugins: Create plugins files only if webui is enabled.
+ (negative0)
+ - serve http: Fix serving files of unknown length (Nick
+ Craig-Wood)
+ - serve sftp: Fix authentication on one connection blocking others
+ (Nick Craig-Wood)
+- Mount
+ - Add optional brew tag to throw an error when using mount in the
+ binaries installed via Homebrew (Anagh Kumar Baranwal)
+ - Add "." and ".." to directories to match cmount and expectations
+ (Nick Craig-Wood)
+- VFS
+ - Make cache dir absolute before using it to fix path too long
+ errors (Nick Craig-Wood)
+- Chunker
+ - Improve detection of incompatible metadata (Ivan Andreev)
+- Google Cloud Storage
+ - Fix server side copy of large objects (Nick Craig-Wood)
+- Jottacloud
+ - Fix token renewer to fix long uploads (Nick Craig-Wood)
+ - Fix token refresh failed: is not a regular file error (Nick
+ Craig-Wood)
+- Pcloud
+ - Only use SHA1 hashes in EU region (Nick Craig-Wood)
+- Sharefile
+ - Undo Fix backend due to API swapping integers for strings (Nick
+ Craig-Wood)
+- WebDAV
+ - Fix Open Range requests to fix 4shared mount (Nick Craig-Wood)
+ - Add "Depth: 0" to GET requests to fix bitrix (Nick Craig-Wood)
+
+
v1.53.3 - 2020-11-19
See commits
diff --git a/docs/content/changelog.md b/docs/content/changelog.md
index 8ed2b6163..c907ebc75 100644
--- a/docs/content/changelog.md
+++ b/docs/content/changelog.md
@@ -5,6 +5,50 @@ description: "Rclone Changelog"
# Changelog
+## v1.53.4 - 2021-01-20
+
+[See commits](https://github.com/rclone/rclone/compare/v1.53.3...v1.53.4)
+
+* Bug Fixes
+ * accounting: Fix data race in Transferred() (Maciej Zimnoch)
+ * build
+ * Stop tagged releases making a current beta (Nick Craig-Wood)
+ * Upgrade docker buildx action (Matteo Pietro Dazzi)
+ * Add -buildmode to cross-compile.go (Nick Craig-Wood)
+ * Fix docker build by upgrading ilteoood/docker_buildx (Nick Craig-Wood)
+ * Revert GitHub actions brew fix since this is now fixed (Nick Craig-Wood)
+ * Fix brew install --cask syntax for macOS build (Nick Craig-Wood)
+ * Update nfpm syntax to fix build of .deb/.rpm packages (Nick Craig-Wood)
+ * Fix for Windows build errors (Ivan Andreev)
+ * fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
+ * fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
+ * rc
+ * Fix core/command giving 500 internal error (Nick Craig-Wood)
+ * Add Copy method to rc.Params (Nick Craig-Wood)
+ * Fix 500 error when marshalling errors from core/command (Nick Craig-Wood)
+ * plugins: Create plugins files only if webui is enabled. (negative0)
+ * serve http: Fix serving files of unknown length (Nick Craig-Wood)
+ * serve sftp: Fix authentication on one connection blocking others (Nick Craig-Wood)
+* Mount
+ * Add optional `brew` tag to throw an error when using mount in the binaries installed via Homebrew (Anagh Kumar Baranwal)
+ * Add "." and ".." to directories to match cmount and expectations (Nick Craig-Wood)
+* VFS
+ * Make cache dir absolute before using it to fix path too long errors (Nick Craig-Wood)
+* Chunker
+ * Improve detection of incompatible metadata (Ivan Andreev)
+* Google Cloud Storage
+ * Fix server side copy of large objects (Nick Craig-Wood)
+* Jottacloud
+ * Fix token renewer to fix long uploads (Nick Craig-Wood)
+ * Fix token refresh failed: is not a regular file error (Nick Craig-Wood)
+* Pcloud
+ * Only use SHA1 hashes in EU region (Nick Craig-Wood)
+* Sharefile
+ * Undo Fix backend due to API swapping integers for strings (Nick Craig-Wood)
+* WebDAV
+ * Fix Open Range requests to fix 4shared mount (Nick Craig-Wood)
+ * Add "Depth: 0" to GET requests to fix bitrix (Nick Craig-Wood)
+
## v1.53.3 - 2020-11-19
[See commits](https://github.com/rclone/rclone/compare/v1.53.2...v1.53.3)
diff --git a/docs/content/flags.md b/docs/content/flags.md
index 34462cad8..a79f67140 100755
--- a/docs/content/flags.md
+++ b/docs/content/flags.md
@@ -147,7 +147,7 @@ These flags are available for every command.
--use-json-log Use json log format.
--use-mmap Use mmap allocator (see docs).
--use-server-modtime Use server modified time instead of object metadata
- --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.3")
+ --user-agent string Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.53.4")
-v, --verbose count Print lots more stuff (repeat for more)
```
diff --git a/docs/content/rc.md b/docs/content/rc.md
index 490ebf307..6f5fc9fd3 100644
--- a/docs/content/rc.md
+++ b/docs/content/rc.md
@@ -511,17 +511,22 @@ This takes the following parameters
- command - a string with the command name
- arg - a list of arguments for the backend command
- opt - a map of string to string of options
+- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
+ - defaults to "COMBINED_OUTPUT" if not set
+ - the STREAM returnTypes will write the output to the body of the HTTP message
+ - the COMBINED_OUTPUT will write the output to the "result" parameter
Returns
- result - result from the backend command
+ - only set when using returnType "COMBINED_OUTPUT"
- error - set if rclone exits with an error code
-- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT". "STREAM_ONLY_STDERR")
+- returnType - one of ("COMBINED_OUTPUT", "STREAM", "STREAM_ONLY_STDOUT", "STREAM_ONLY_STDERR")
For example
rclone rc core/command command=ls -a mydrive:/ -o max-depth=1
- rclone rc core/command -a ls -a mydrive:/ -o max-depth=1
+ rclone rc core/command -a ls -a mydrive:/ -o max-depth=1
Returns
diff --git a/rclone.1 b/rclone.1
index c77887008..6b3c2cf0a 100644
--- a/rclone.1
+++ b/rclone.1
@@ -1,7 +1,7 @@
.\"t
.\" Automatically generated by Pandoc 2.5
.\"
-.TH "rclone" "1" "Nov 19, 2020" "User Manual" ""
+.TH "rclone" "1" "Jan 20, 2021" "User Manual" ""
.hy
.SH Rclone syncs your files to cloud storage
.PP
@@ -10770,16 +10770,32 @@ command \- a string with the command name
arg \- a list of arguments for the backend command
.IP \[bu] 2
opt \- a map of string to string of options
+.IP \[bu] 2
+returnType \- one of (\[dq]COMBINED_OUTPUT\[dq], \[dq]STREAM\[dq],
+\[dq]STREAM_ONLY_STDOUT\[dq], \[dq]STREAM_ONLY_STDERR\[dq])
+.RS 2
+.IP \[bu] 2
+defaults to \[dq]COMBINED_OUTPUT\[dq] if not set
+.IP \[bu] 2
+the STREAM returnTypes will write the output to the body of the HTTP
+message
+.IP \[bu] 2
+the COMBINED_OUTPUT will write the output to the \[dq]result\[dq]
+parameter
+.RE
.PP
Returns
.IP \[bu] 2
result \- result from the backend command
+.RS 2
+.IP \[bu] 2
+only set when using returnType \[dq]COMBINED_OUTPUT\[dq]
+.RE
.IP \[bu] 2
error \- set if rclone exits with an error code
.IP \[bu] 2
returnType \- one of (\[dq]COMBINED_OUTPUT\[dq], \[dq]STREAM\[dq],
-\[dq]STREAM_ONLY_STDOUT\[dq].
-\[dq]STREAM_ONLY_STDERR\[dq])
+\[dq]STREAM_ONLY_STDOUT\[dq], \[dq]STREAM_ONLY_STDERR\[dq])
.PP
For example
.IP
@@ -12168,7 +12184,7 @@ T}
T{
Dropbox
T}@T{
-DBHASH \[dg]
+DBHASH \[S1]
T}@T{
Yes
T}@T{
@@ -12285,7 +12301,7 @@ T}
T{
Mail.ru Cloud
T}@T{
-Mailru \[dd]\[dd]\[dd]
+Mailru \[u2076]
T}@T{
Yes
T}@T{
@@ -12337,7 +12353,7 @@ T}
T{
Microsoft OneDrive
T}@T{
-SHA1 \[dd]\[dd]
+SHA1 \[u2075]
T}@T{
Yes
T}@T{
@@ -12356,7 +12372,7 @@ Yes
T}@T{
Yes
T}@T{
-Partial *
+Partial \[u2078]
T}@T{
\-
T}
@@ -12376,7 +12392,7 @@ T}
T{
pCloud
T}@T{
-MD5, SHA1
+MD5, SHA1 \[u2077]
T}@T{
Yes
T}@T{
@@ -12441,7 +12457,7 @@ T}
T{
SFTP
T}@T{
-MD5, SHA1 \[dd]
+MD5, SHA1 \[S2]
T}@T{
Yes
T}@T{
@@ -12480,9 +12496,9 @@ T}
T{
WebDAV
T}@T{
-MD5, SHA1 \[dg]\[dg]
+MD5, SHA1 \[S3]
T}@T{
-Yes \[dg]\[dg]\[dg]
+Yes \[u2074]
T}@T{
Depends
T}@T{
@@ -12517,6 +12533,34 @@ T}@T{
\-
T}
.TE
+.SS Notes
+.PP
+\[S1] Dropbox supports its own custom
+hash (https://www.dropbox.com/developers/reference/content-hash).
+This is an SHA256 sum of all the 4MB block SHA256s.
+.PP
+\[S2] SFTP supports checksums if the same login has shell access and
+\f[C]md5sum\f[R] or \f[C]sha1sum\f[R] as well as \f[C]echo\f[R] are in
+the remote\[aq]s PATH.
+.PP
+\[S3] WebDAV supports hashes when used with Owncloud and Nextcloud only.
+.PP
+\[u2074] WebDAV supports modtimes when used with Owncloud and Nextcloud
+only.
+.PP
+\[u2075] Microsoft OneDrive Personal supports SHA1 hashes, whereas
+OneDrive for business and SharePoint server support Microsoft\[aq]s own
+QuickXorHash (https://docs.microsoft.com/en-us/onedrive/developer/code-snippets/quickxorhash).
+.PP
+\[u2076] Mail.ru uses its own modified SHA1 hash
+.PP
+\[u2077] pCloud only supports SHA1 (not MD5) in its EU region
+.PP
+\[u2078] Opendrive does not support creation of duplicate files using
+their web client interface or other stock clients, but the underlying
+storage platform has been determined to allow duplicate files, and it is
+possible to create them with \f[C]rclone\f[R].
+It may be that this is a mistake or an unsupported feature.
.SS Hash
.PP
The cloud storage system supports various hash types of the objects.
@@ -12526,26 +12570,6 @@ in the \f[C]check\f[R] command.
.PP
To use the verify checksums when transferring between cloud storage
systems they must support a common hash type.
-.PP
-\[dg] Note that Dropbox supports its own custom
-hash (https://www.dropbox.com/developers/reference/content-hash).
-This is an SHA256 sum of all the 4MB block SHA256s.
-.PP
-\[dd] SFTP supports checksums if the same login has shell access and
-\f[C]md5sum\f[R] or \f[C]sha1sum\f[R] as well as \f[C]echo\f[R] are in
-the remote\[aq]s PATH.
-.PP
-\[dg]\[dg] WebDAV supports hashes when used with Owncloud and Nextcloud
-only.
-.PP
-\[dg]\[dg]\[dg] WebDAV supports modtimes when used with Owncloud and
-Nextcloud only.
-.PP
-\[dd]\[dd] Microsoft OneDrive Personal supports SHA1 hashes, whereas
-OneDrive for business and SharePoint server support Microsoft\[aq]s own
-QuickXorHash (https://docs.microsoft.com/en-us/onedrive/developer/code-snippets/quickxorhash).
-.PP
-\[dd]\[dd]\[dd] Mail.ru uses its own modified SHA1 hash
.SS ModTime
.PP
The cloud storage system supports setting modification times on objects.
@@ -12590,12 +12614,6 @@ objects with the same name.
.PP
This confuses rclone greatly when syncing \- use the
\f[C]rclone dedupe\f[R] command to rename or remove duplicates.
-.PP
-* Opendrive does not support creation of duplicate files using their web
-client interface or other stock clients, but the underlying storage
-platform has been determined to allow duplicate files, and it is
-possible to create them with \f[C]rclone\f[R].
-It may be that this is a mistake or an unsupported feature.
.SS Restricted filenames
.PP
Some cloud storage systems might have restrictions on the characters
@@ -14154,7 +14172,7 @@ These flags are available for every command.
\-\-use\-json\-log Use json log format.
\-\-use\-mmap Use mmap allocator (see docs).
\-\-use\-server\-modtime Use server modified time instead of object metadata
- \-\-user\-agent string Set the user\-agent to a specified string. The default is rclone/ version (default \[dq]rclone/v1.53.3\[dq])
+ \-\-user\-agent string Set the user\-agent to a specified string. The default is rclone/ version (default \[dq]rclone/v1.53.4\[dq])
\-v, \-\-verbose count Print lots more stuff (repeat for more)
\f[R]
.fi
@@ -30918,8 +30936,11 @@ These will be used to detect whether objects need syncing or not.
In order to set a Modification time pCloud requires the object be
re\-uploaded.
.PP
-pCloud supports MD5 and SHA1 type hashes, so you can use the
-\f[C]\-\-checksum\f[R] flag.
+pCloud supports MD5 and SHA1 type hashes in the US region but and SHA1
+only in the EU region, so you can use the \f[C]\-\-checksum\f[R] flag.
+.PP
+(Note that pCloud also support SHA256 in the EU region, but rclone does
+not have support for that yet.)
.SS Restricted filename characters
.PP
In addition to the default restricted characters
@@ -35088,6 +35109,117 @@ Options:
.IP \[bu] 2
\[dq]error\[dq]: return an error based on option value
.SH Changelog
+.SS v1.53.4 \- 2021\-01\-20
+.PP
+See commits (https://github.com/rclone/rclone/compare/v1.53.3...v1.53.4)
+.IP \[bu] 2
+Bug Fixes
+.RS 2
+.IP \[bu] 2
+accounting: Fix data race in Transferred() (Maciej Zimnoch)
+.IP \[bu] 2
+build
+.RS 2
+.IP \[bu] 2
+Stop tagged releases making a current beta (Nick Craig\-Wood)
+.IP \[bu] 2
+Upgrade docker buildx action (Matteo Pietro Dazzi)
+.IP \[bu] 2
+Add \-buildmode to cross\-compile.go (Nick Craig\-Wood)
+.IP \[bu] 2
+Fix docker build by upgrading ilteoood/docker_buildx (Nick Craig\-Wood)
+.IP \[bu] 2
+Revert GitHub actions brew fix since this is now fixed (Nick
+Craig\-Wood)
+.IP \[bu] 2
+Fix brew install \-\-cask syntax for macOS build (Nick Craig\-Wood)
+.IP \[bu] 2
+Update nfpm syntax to fix build of .deb/.rpm packages (Nick Craig\-Wood)
+.IP \[bu] 2
+Fix for Windows build errors (Ivan Andreev)
+.RE
+.IP \[bu] 2
+fs: Parseduration: fixed tests to use UTC time (Ankur Gupta)
+.IP \[bu] 2
+fshttp: Prevent overlap of HTTP headers in logs (Nathan Collins)
+.IP \[bu] 2
+rc
+.RS 2
+.IP \[bu] 2
+Fix core/command giving 500 internal error (Nick Craig\-Wood)
+.IP \[bu] 2
+Add Copy method to rc.Params (Nick Craig\-Wood)
+.IP \[bu] 2
+Fix 500 error when marshalling errors from core/command (Nick
+Craig\-Wood)
+.IP \[bu] 2
+plugins: Create plugins files only if webui is enabled.
+(negative0)
+.RE
+.IP \[bu] 2
+serve http: Fix serving files of unknown length (Nick Craig\-Wood)
+.IP \[bu] 2
+serve sftp: Fix authentication on one connection blocking others (Nick
+Craig\-Wood)
+.RE
+.IP \[bu] 2
+Mount
+.RS 2
+.IP \[bu] 2
+Add optional \f[C]brew\f[R] tag to throw an error when using mount in
+the binaries installed via Homebrew (Anagh Kumar Baranwal)
+.IP \[bu] 2
+Add \[dq].\[dq] and \[dq]..\[dq] to directories to match cmount and
+expectations (Nick Craig\-Wood)
+.RE
+.IP \[bu] 2
+VFS
+.RS 2
+.IP \[bu] 2
+Make cache dir absolute before using it to fix path too long errors
+(Nick Craig\-Wood)
+.RE
+.IP \[bu] 2
+Chunker
+.RS 2
+.IP \[bu] 2
+Improve detection of incompatible metadata (Ivan Andreev)
+.RE
+.IP \[bu] 2
+Google Cloud Storage
+.RS 2
+.IP \[bu] 2
+Fix server side copy of large objects (Nick Craig\-Wood)
+.RE
+.IP \[bu] 2
+Jottacloud
+.RS 2
+.IP \[bu] 2
+Fix token renewer to fix long uploads (Nick Craig\-Wood)
+.IP \[bu] 2
+Fix token refresh failed: is not a regular file error (Nick Craig\-Wood)
+.RE
+.IP \[bu] 2
+Pcloud
+.RS 2
+.IP \[bu] 2
+Only use SHA1 hashes in EU region (Nick Craig\-Wood)
+.RE
+.IP \[bu] 2
+Sharefile
+.RS 2
+.IP \[bu] 2
+Undo Fix backend due to API swapping integers for strings (Nick
+Craig\-Wood)
+.RE
+.IP \[bu] 2
+WebDAV
+.RS 2
+.IP \[bu] 2
+Fix Open Range requests to fix 4shared mount (Nick Craig\-Wood)
+.IP \[bu] 2
+Add \[dq]Depth: 0\[dq] to GET requests to fix bitrix (Nick Craig\-Wood)
+.RE
.SS v1.53.3 \- 2020\-11\-19
.PP
See commits (https://github.com/rclone/rclone/compare/v1.53.2...v1.53.3)