Version v1.44

Until https://github.com/Azure/azure-storage-blob-go/pull/75 is merged
the SDK can't upload a single blob of exactly the chunk size, so
upload files of this size with a multpart upload as a work around.

The previous fix for this 6a773289e7 turned out to cause problems
uploading files with maximum chunk size so needed to be redone.

Fixes #2653

.github/ISSUE_TEMPLATE.md

@@ -0,0 +1,31 @@
+<!--
+
+Welcome :-) We understand you are having a problem with rclone; we want to help you with that!
+
+If you've just got a question or aren't sure if you've found a bug then please use the rclone forum:
+
+    https://forum.rclone.org/
+
+instead of filing an issue for a quick response.
+
+If you are reporting a bug or asking for a new feature then please use one of the templates here:
+
+    https://github.com/ncw/rclone/issues/new
+
+otherwise fill in the form below.
+
+Thank you
+
+The Rclone Developers
+
+-->
+
+
+#### Output of `rclone version`
+
+
+
+#### Describe the issue
+
+
+

.github/ISSUE_TEMPLATE/Bug.md

@@ -1,14 +1,17 @@
+---
+name: Bug report
+about: Report a problem with rclone
+---
+
 <!--
 
-Hi!
+Welcome :-) We understand you are having a problem with rclone; we want to help you with that!
 
-We understand you are having a problem with rclone or have an idea for an improvement - we want to help you with that!
-
-If you've just got a question or aren't sure if you've found a bug then please use the rclone forum
+If you've just got a question or aren't sure if you've found a bug then please use the rclone forum:
 
     https://forum.rclone.org/
 
-instead of filing an issue.  We'll reply quickly and it won't increase our massive issue backlog.
+instead of filing an issue for a quick response.
 
 If you think you might have found a bug, please can you try to replicate it with the latest beta?
 
@@ -16,9 +19,7 @@ If you think you might have found a bug, please can you try to replicate it with
     
 If you can still replicate it with the latest beta, then please fill in the info below which makes our lives much easier.  A log with -vv will make our day :-)
 
-If you have an idea for an improvement, then please search the old issues first and if you don't find your idea, make a new issue.
-
-Thanks
+Thank you
 
 The Rclone Developers
 
@@ -27,17 +28,23 @@ The Rclone Developers
 #### What is the problem you are having with rclone?
 
 
-#### What is your rclone version (eg output from `rclone -V`)
+
+#### What is your rclone version (output from `rclone version`)
+
 
 
 #### Which OS you are using and how many bits (eg Windows 7, 64 bit)
 
 
+
 ####  Which cloud storage system are you using? (eg Google Drive)
 
 
+
 #### The command you were trying to run (eg `rclone copy /tmp remote:tmp`)
 
 
+
 #### A log from the command with the `-vv` flag (eg output from `rclone -vv copy /tmp remote:tmp`)
 
+

.github/ISSUE_TEMPLATE/Feature.md

@@ -0,0 +1,36 @@
+---
+name: Feature request
+about: Suggest a new feature or enhancement for rclone
+---
+
+<!--
+
+Welcome :-)
+
+So you've got an idea to improve rclone? We love that! You'll be glad to hear we've incorporated hundreds of ideas from contributors already.
+
+Here is a checklist of things to do:
+
+  1. Please search the old issues first for your idea and +1 or comment on an existing issue if possible.
+  2. Discuss on the forum first: https://forum.rclone.org/
+  3. Make a feature request issue (this is the right place!).
+  4. Be prepared to get involved making the feature :-)
+
+Looking forward to your great idea!
+
+The Rclone Developers
+
+-->
+
+
+#### What is your current rclone version (output from `rclone version`)?
+
+
+
+#### What problem are you are trying to solve?
+
+
+
+#### How do you think rclone should be changed to solve that?
+
+

.github/PULL_REQUEST_TEMPLATE.md

@@ -0,0 +1,29 @@
+<!--
+Thank you very much for contributing code or documentation to rclone! Please
+fill out the following questions to make it easier for us to review your
+changes.
+
+You do not need to check all the boxes below all at once, feel free to take
+your time and add more commits. If you're done and ready for review, please
+check the last box.
+-->
+
+#### What is the purpose of this change?
+
+<!--
+Describe the changes here
+-->
+
+#### Was the change discussed in an issue or in the forum before?
+
+<!--
+Link issues and relevant forum posts here.
+-->
+
+#### Checklist
+
+- [ ] I have read the [contribution guidelines](https://github.com/ncw/rclone/blob/master/CONTRIBUTING.md#submitting-a-pull-request).
+- [ ] I have added tests for all changes in this PR if appropriate.
+- [ ] I have added documentation for the changes if appropriate.
+- [ ] All commit messages are in [house style](https://github.com/ncw/rclone/blob/master/CONTRIBUTING.md#commit-messages).
+- [ ] I'm done, this Pull Request is ready for review :-)

CONTRIBUTING.md

@@ -21,14 +21,14 @@ with the [latest beta of rclone](https://beta.rclone.org/):
 ## Submitting a pull request ##
 
 If you find a bug that you'd like to fix, or a new feature that you'd
-like to implement then please submit a pull request via Github.
+like to implement then please submit a pull request via GitHub.
 
 If it is a big feature then make an issue first so it can be discussed.
 
 You'll need a Go environment set up with GOPATH set.  See [the Go
 getting started docs](https://golang.org/doc/install) for more info.
 
-First in your web browser press the fork button on [rclone's Github
+First in your web browser press the fork button on [rclone's GitHub
 page](https://github.com/ncw/rclone).
 
 Now in your terminal
@@ -64,22 +64,23 @@ packages which you can install with
 
 Make sure you
 
-  * Add documentation for a new feature (see below for where)
-  * Add unit tests for a new feature
+  * Add [documentation](#writing-documentation) for a new feature.
+  * Follow the [commit message guidelines](#commit-messages).
+  * Add [unit tests](#testing) for a new feature
   * squash commits down to one per feature
-  * rebase to master `git rebase master`
+  * rebase to master with `git rebase master`
 
 When you are done with that
 
     git push origin my-new-feature
 
-Go to the Github website and click [Create pull
+Go to the GitHub website and click [Create pull
 request](https://help.github.com/articles/creating-a-pull-request/).
 
 You patch will get reviewed and you might get asked to fix some stuff.
 
 If so, then make the changes in the same branch, squash the commits,
-rebase it to master then push it to Github with `--force`.
+rebase it to master then push it to GitHub with `--force`.
 
 ## Enabling CI for your fork ##
 
@@ -181,10 +182,14 @@ with modules beneath.
 
 If you are adding a new feature then please update the documentation.
 
-If you add a new flag, then if it is a general flag, document it in
+If you add a new general flag (not for a backend), then document it in
 `docs/content/docs.md` - the flags there are supposed to be in
-alphabetical order.  If it is a remote specific flag, then document it
-in `docs/content/remote.md`.
+alphabetical order.
+
+If you add a new backend option/flag, then it should be documented in
+the source file in the `Help:` field.  The first line of this is used
+for the flag help, the remainder is shown to the user in `rclone
+config` and is added to the docs with `make backenddocs`.
 
 The only documentation you need to edit are the `docs/content/*.md`
 files.  The MANUAL.*, rclone.1, web site etc are all auto generated
@@ -203,14 +208,20 @@ file.
 ## Commit messages ##
 
 Please make the first line of your commit message a summary of the
-change, and prefix it with the directory of the change followed by a
-colon.  The changelog gets made by looking at just these first lines
-so make it good!
+change that a user (not a developer) of rclone would like to read, and
+prefix it with the directory of the change followed by a colon.  The
+changelog gets made by looking at just these first lines so make it
+good!
 
 If you have more to say about the commit, then enter a blank line and
 carry on the description.  Remember to say why the change was needed -
 the commit itself shows what was changed.
 
+Writing more is better than less.  Comparing the behaviour before the
+change to that after the change is very useful.  Imagine you are
+writing to yourself in 12 months time when you've forgotten everything
+about what you just did and you need to get up to speed quickly.
+
 If the change fixes an issue then write `Fixes #1234` in the commit
 message.  This can be on the subject line if it will fit.  If you
 don't want to close the associated issue just put `#1234` and the
@@ -258,9 +269,8 @@ To add a dependency `github.com/ncw/new_dependency` see the
 instructions below.  These will fetch the dependency, add it to
 `go.mod` and `go.sum` and vendor it for older go versions.
 
-    export GO111MODULE=on
-    go get github.com/ncw/new_dependency
-    go mod vendor
+    GO111MODULE=on go get github.com/ncw/new_dependency
+    GO111MODULE=on go mod vendor
 
 You can add constraints on that package when doing `go get` (see the
 go docs linked above), but don't unless you really need to.
@@ -275,9 +285,8 @@ in `vendor`.
 
 If you need to update a dependency then run
 
-    export GO111MODULE=on
-    go get -u github.com/pkg/errors
-    go mod vendor
+    GO111MODULE=on go get -u github.com/pkg/errors
+    GO111MODULE=on go mod vendor
 
 Check in in a single commit as above.
 
@@ -349,8 +358,8 @@ See the [testing](#testing) section for more information on integration tests.
 
 Add your fs to the docs - you'll need to pick an icon for it from [fontawesome](http://fontawesome.io/icons/).  Keep lists of remotes in alphabetical order but with the local file system last.
 
-  * `README.md` - main Github page
-  * `docs/content/remote.md` - main docs page
+  * `README.md` - main GitHub page
+  * `docs/content/remote.md` - main docs page (note the backend options are automatically added to this file with `make backenddocs`)
   * `docs/content/overview.md` - overview docs
   * `docs/content/docs.md` - list of remotes in config section
   * `docs/content/about.md` - front page of rclone.org

MAINTAINERS.md

@@ -58,7 +58,7 @@ Close tickets as soon as you can - make sure they are tagged with a release.  Po
 
 Try to process pull requests promptly!
 
-Merging pull requests on Github itself works quite well now-a-days so you can squash and rebase or rebase pull requests.  rclone doesn't use merge commits.  Use the squash and rebase option if you need to edit the commit message.
+Merging pull requests on GitHub itself works quite well now-a-days so you can squash and rebase or rebase pull requests.  rclone doesn't use merge commits.  Use the squash and rebase option if you need to edit the commit message.
 
 After merging the commit, in your local master branch, do `git pull` then run `bin/update-authors.py` to update the authors file then `git push`.
 

Makefile

@@ -51,7 +51,7 @@ version:
 # Full suite of integration tests
 test:	rclone
 	go install github.com/ncw/rclone/fstest/test_all
-	-go test -v -count 1 $(BUILDTAGS) $(GO_FILES) 2>&1 | tee test.log
+	-go test -v -count 1 -timeout 20m $(BUILDTAGS) $(GO_FILES) 2>&1 | tee test.log
 	-test_all github.com/ncw/rclone/fs/operations github.com/ncw/rclone/fs/sync 2>&1 | tee fs/test_all.log
 	@echo "Written logs in test.log and fs/test_all.log"
 
@@ -88,7 +88,7 @@ build_dep:
 ifdef FULL_TESTS
 	go get -u github.com/kisielk/errcheck
 	go get -u golang.org/x/tools/cmd/goimports
-	go get -u github.com/golang/lint/golint
+	go get -u golang.org/x/lint/golint
 endif
 
 # Get the release dependencies
@@ -99,15 +99,15 @@ release_dep:
 # Update dependencies
 update:
 	GO111MODULE=on go get -u ./...
-	GO111MODULE=on go tidy
-	GO111MODULE=on go vendor
+	GO111MODULE=on go mod tidy
+	GO111MODULE=on go mod vendor
 
 doc:	rclone.1 MANUAL.html MANUAL.txt rcdocs commanddocs
 
 rclone.1:	MANUAL.md
 	pandoc -s --from markdown --to man MANUAL.md -o rclone.1
 
-MANUAL.md:	bin/make_manual.py docs/content/*.md commanddocs
+MANUAL.md:	bin/make_manual.py docs/content/*.md commanddocs backenddocs
 	./bin/make_manual.py
 
 MANUAL.html:	MANUAL.md
@@ -119,6 +119,9 @@ MANUAL.txt:	MANUAL.md
 commanddocs: rclone
 	rclone gendocs docs/content/commands/
 
+backenddocs: rclone bin/make_backend_docs.py
+	./bin/make_backend_docs.py
+
 rcdocs: rclone
 	bin/make_rc_docs.sh
 
@@ -229,4 +232,3 @@ startdev:
 
 winzip:
 	zip -9 rclone-$(TAG).zip rclone.exe
-

README.md

@@ -2,10 +2,11 @@
 
 [Website](https://rclone.org) |
 [Documentation](https://rclone.org/docs/) |
+[Download](https://rclone.org/downloads/) | 
 [Contributing](CONTRIBUTING.md) |
 [Changelog](https://rclone.org/changelog/) |
 [Installation](https://rclone.org/install/) |
-[Forum](https://forum.rclone.org/)
+[Forum](https://forum.rclone.org/) | 
 [G+](https://google.com/+RcloneOrg)
 
 [![Build Status](https://travis-ci.org/ncw/rclone.svg?branch=master)](https://travis-ci.org/ncw/rclone)
@@ -13,50 +14,74 @@
 [![CircleCI](https://circleci.com/gh/ncw/rclone/tree/master.svg?style=svg)](https://circleci.com/gh/ncw/rclone/tree/master)
 [![GoDoc](https://godoc.org/github.com/ncw/rclone?status.svg)](https://godoc.org/github.com/ncw/rclone) 
 
-Rclone is a command line program to sync files and directories to and from
+# Rclone
 
-  * Amazon Drive ([See note](https://rclone.org/amazonclouddrive/#status))
-  * Amazon S3 / Dreamhost / Ceph / Minio / Wasabi
-  * Backblaze B2
-  * Box
-  * Dropbox
-  * FTP
-  * Google Cloud Storage
-  * Google Drive
-  * HTTP
-  * Hubic
-  * Jottacloud
-  * Mega
-  * Microsoft Azure Blob Storage
-  * Microsoft OneDrive
-  * OpenDrive
-  * Openstack Swift / Rackspace cloud files / Memset Memstore / OVH / Oracle Cloud Storage
-  * pCloud
-  * QingStor
-  * SFTP
-  * Webdav / Owncloud / Nextcloud
-  * Yandex Disk
-  * The local filesystem
+Rclone *("rsync for cloud storage")* is a command line program to sync files and directories to and from different cloud storage providers.
 
-Features
+## Storage providers
+
+  * Amazon Drive [:page_facing_up:](https://rclone.org/amazonclouddrive/) ([See note](https://rclone.org/amazonclouddrive/#status))
+  * Amazon S3 [:page_facing_up:](https://rclone.org/s3/)
+  * Backblaze B2 [:page_facing_up:](https://rclone.org/b2/)
+  * Box [:page_facing_up:](https://rclone.org/box/)
+  * Ceph [:page_facing_up:](https://rclone.org/s3/#ceph)
+  * DigitalOcean Spaces [:page_facing_up:](https://rclone.org/s3/#digitalocean-spaces)
+  * Dreamhost [:page_facing_up:](https://rclone.org/s3/#dreamhost)
+  * Dropbox [:page_facing_up:](https://rclone.org/dropbox/)
+  * FTP [:page_facing_up:](https://rclone.org/ftp/)
+  * Google Cloud Storage [:page_facing_up:](https://rclone.org/googlecloudstorage/)
+  * Google Drive [:page_facing_up:](https://rclone.org/drive/)
+  * HTTP [:page_facing_up:](https://rclone.org/http/)
+  * Hubic [:page_facing_up:](https://rclone.org/hubic/)
+  * Jottacloud [:page_facing_up:](https://rclone.org/jottacloud/)
+  * IBM COS S3 [:page_facing_up:](https://rclone.org/s3/#ibm-cos-s3)
+  * Memset Memstore [:page_facing_up:](https://rclone.org/swift/)
+  * Mega [:page_facing_up:](https://rclone.org/mega/)
+  * Microsoft Azure Blob Storage [:page_facing_up:](https://rclone.org/azureblob/)
+  * Microsoft OneDrive [:page_facing_up:](https://rclone.org/onedrive/)
+  * Minio [:page_facing_up:](https://rclone.org/s3/#minio)
+  * Nextcloud [:page_facing_up:](https://rclone.org/webdav/#nextcloud)
+  * OVH [:page_facing_up:](https://rclone.org/swift/)
+  * OpenDrive [:page_facing_up:](https://rclone.org/opendrive/)
+  * Openstack Swift [:page_facing_up:](https://rclone.org/swift/)
+  * Oracle Cloud Storage [:page_facing_up:](https://rclone.org/swift/)
+  * ownCloud [:page_facing_up:](https://rclone.org/webdav/#owncloud)
+  * pCloud [:page_facing_up:](https://rclone.org/pcloud/)
+  * put.io [:page_facing_up:](https://rclone.org/webdav/#put-io)
+  * QingStor [:page_facing_up:](https://rclone.org/qingstor/)
+  * Rackspace Cloud Files [:page_facing_up:](https://rclone.org/swift/)
+  * SFTP [:page_facing_up:](https://rclone.org/sftp/)
+  * Wasabi [:page_facing_up:](https://rclone.org/s3/#wasabi)
+  * WebDAV [:page_facing_up:](https://rclone.org/webdav/)
+  * Yandex Disk [:page_facing_up:](https://rclone.org/yandex/)
+  * The local filesystem [:page_facing_up:](https://rclone.org/local/)
+
+## Features
 
   * MD5/SHA1 hashes checked at all times for file integrity
   * Timestamps preserved on files
   * Partial syncs supported on a whole file basis
-  * Copy mode to just copy new/changed files
-  * Sync (one way) mode to make a directory identical
-  * Check mode to check for file hash equality
+  * [Copy](https://rclone.org/commands/rclone_copy/) mode to just copy new/changed files
+  * [Sync](https://rclone.org/commands/rclone_sync/) (one way) mode to make a directory identical
+  * [Check](https://rclone.org/commands/rclone_check/) mode to check for file hash equality
   * Can sync to and from network, eg two different cloud accounts
-  * Optional encryption (Crypt)
-  * Optional FUSE mount
+  * Optional encryption ([Crypt](https://rclone.org/crypt/))
+  * Optional cache ([Cache](https://rclone.org/cache/))
+  * Optional FUSE mount ([rclone mount](https://rclone.org/commands/rclone_mount/))
 
-See the home page for installation, usage, documentation, changelog
-and configuration walkthroughs.
+## Installation & documentation
+
+Please see the rclone website for installation, usage, documentation, 
+changelog and configuration walkthroughs.
 
   * https://rclone.org/
 
+## Downloads
+
+  * https://rclone.org/downloads/
+
 License
 -------
 
 This is free software under the terms of MIT the license (check the
-COPYING file included in this package).
+[COPYING file](/rclone/COPYING) included in this package).

backend/alias/alias.go

@@ -2,13 +2,12 @@ package alias
 
 import (
 	"errors"
-	"path"
-	"path/filepath"
 	"strings"
 
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fs/config/configmap"
 	"github.com/ncw/rclone/fs/config/configstruct"
+	"github.com/ncw/rclone/fs/fspath"
 )
 
 // Register with Fs
@@ -47,13 +46,9 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if strings.HasPrefix(opt.Remote, name+":") {
 		return nil, errors.New("can't point alias remote at itself - check the value of the remote setting")
 	}
-	_, configName, fsPath, err := fs.ParseRemote(opt.Remote)
+	fsInfo, configName, fsPath, config, err := fs.ConfigFs(opt.Remote)
 	if err != nil {
 		return nil, err
 	}
-	root = path.Join(fsPath, filepath.ToSlash(root))
-	if configName == "local" {
-		return fs.NewFs(root)
-	}
-	return fs.NewFs(configName + ":" + root)
+	return fsInfo.NewFs(configName, fspath.JoinRootPath(fsPath, root), config)
 }

backend/amazonclouddrive/amazonclouddrive.go

@@ -97,13 +97,42 @@ func init() {
 			Hide:     fs.OptionHideBoth,
 			Advanced: true,
 		}, {
-			Name:     "upload_wait_per_gb",
-			Help:     "Additional time per GB to wait after a failed complete upload to see if it appears.",
+			Name: "upload_wait_per_gb",
+			Help: `Additional time per GB to wait after a failed complete upload to see if it appears.
+
+Sometimes Amazon Drive gives an error when a file has been fully
+uploaded but the file appears anyway after a little while.  This
+happens sometimes for files over 1GB in size and nearly every time for
+files bigger than 10GB. This parameter controls the time rclone waits
+for the file to appear.
+
+The default value for this parameter is 3 minutes per GB, so by
+default it will wait 3 minutes for every GB uploaded to see if the
+file appears.
+
+You can disable this feature by setting it to 0. This may cause
+conflict errors as rclone retries the failed upload but the file will
+most likely appear correctly eventually.
+
+These values were determined empirically by observing lots of uploads
+of big files for a range of file sizes.
+
+Upload with the "-v" flag to see more info about what rclone is doing
+in this situation.`,
 			Default:  fs.Duration(180 * time.Second),
 			Advanced: true,
 		}, {
-			Name:     "templink_threshold",
-			Help:     "Files >= this size will be downloaded via their tempLink.",
+			Name: "templink_threshold",
+			Help: `Files >= this size will be downloaded via their tempLink.
+
+Files this size or more will be downloaded via their "tempLink". This
+is to work around a problem with Amazon Drive which blocks downloads
+of files bigger than about 10GB.  The default for this is 9GB which
+shouldn't need to be changed.
+
+To download files above this threshold, rclone requests a "tempLink"
+which downloads the file through a temporary URL directly from the
+underlying S3 storage.`,
 			Default:  defaultTempLinkThreshold,
 			Advanced: true,
 		}},
@@ -283,16 +312,16 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		// Assume it is a file
 		newRoot, remote := dircache.SplitPath(root)
-		newF := *f
-		newF.dirCache = dircache.New(newRoot, f.trueRootID, &newF)
-		newF.root = newRoot
+		tempF := *f
+		tempF.dirCache = dircache.New(newRoot, f.trueRootID, &tempF)
+		tempF.root = newRoot
 		// Make new Fs which is the parent
-		err = newF.dirCache.FindRoot(false)
+		err = tempF.dirCache.FindRoot(false)
 		if err != nil {
 			// No root so return old f
 			return f, nil
 		}
-		_, err := newF.newObjectWithInfo(remote, nil)
+		_, err := tempF.newObjectWithInfo(remote, nil)
 		if err != nil {
 			if err == fs.ErrorObjectNotFound {
 				// File doesn't exist so return old f
@@ -300,8 +329,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 			}
 			return nil, err
 		}
+		// XXX: update the old f here instead of returning tempF, since
+		// `features` were already filled with functions having *f as a receiver.
+		// See https://github.com/ncw/rclone/issues/2182
+		f.dirCache = tempF.dirCache
+		f.root = tempF.root
 		// return an error with an fs which points to the parent
-		return &newF, fs.ErrorIsFile
+		return f, fs.ErrorIsFile
 	}
 	return f, nil
 }
@@ -1240,24 +1274,38 @@ func (o *Object) MimeType() string {
 // Automatically restarts itself in case of unexpected behaviour of the remote.
 //
 // Close the returned channel to stop being notified.
-func (f *Fs) ChangeNotify(notifyFunc func(string, fs.EntryType), pollInterval time.Duration) chan bool {
+func (f *Fs) ChangeNotify(notifyFunc func(string, fs.EntryType), pollIntervalChan <-chan time.Duration) {
 	checkpoint := f.opt.Checkpoint
 
-	quit := make(chan bool)
 	go func() {
+		var ticker *time.Ticker
+		var tickerC <-chan time.Time
 		for {
-			checkpoint = f.changeNotifyRunner(notifyFunc, checkpoint)
-			if err := config.SetValueAndSave(f.name, "checkpoint", checkpoint); err != nil {
-				fs.Debugf(f, "Unable to save checkpoint: %v", err)
-			}
 			select {
-			case <-quit:
-				return
-			case <-time.After(pollInterval):
+			case pollInterval, ok := <-pollIntervalChan:
+				if !ok {
+					if ticker != nil {
+						ticker.Stop()
+					}
+					return
+				}
+				if pollInterval == 0 {
+					if ticker != nil {
+						ticker.Stop()
+						ticker, tickerC = nil, nil
+					}
+				} else {
+					ticker = time.NewTicker(pollInterval)
+					tickerC = ticker.C
+				}
+			case <-tickerC:
+				checkpoint = f.changeNotifyRunner(notifyFunc, checkpoint)
+				if err := config.SetValueAndSave(f.name, "checkpoint", checkpoint); err != nil {
+					fs.Debugf(f, "Unable to save checkpoint: %v", err)
+				}
 			}
 		}
 	}()
-	return quit
 }
 
 func (f *Fs) changeNotifyRunner(notifyFunc func(string, fs.EntryType), checkpoint string) string {

backend/azureblob/azureblob.go

@@ -45,10 +45,10 @@ const (
 	maxTotalParts         = 50000 // in multipart upload
 	storageDefaultBaseURL = "blob.core.windows.net"
 	// maxUncommittedSize = 9 << 30 // can't upload bigger than this
-	defaultChunkSize    = 4 * 1024 * 1024
-	maxChunkSize        = 100 * 1024 * 1024
-	defaultUploadCutoff = 256 * 1024 * 1024
-	maxUploadCutoff     = 256 * 1024 * 1024
+	defaultChunkSize    = 4 * fs.MebiByte
+	maxChunkSize        = 100 * fs.MebiByte
+	defaultUploadCutoff = 256 * fs.MebiByte
+	maxUploadCutoff     = 256 * fs.MebiByte
 	defaultAccessTier   = azblob.AccessTierNone
 )
 
@@ -73,23 +73,44 @@ func init() {
 			Advanced: true,
 		}, {
 			Name:     "upload_cutoff",
-			Help:     "Cutoff for switching to chunked upload.",
+			Help:     "Cutoff for switching to chunked upload (<= 256MB).",
 			Default:  fs.SizeSuffix(defaultUploadCutoff),
 			Advanced: true,
 		}, {
-			Name:     "chunk_size",
-			Help:     "Upload chunk size. Must fit in memory.",
+			Name: "chunk_size",
+			Help: `Upload chunk size (<= 100MB).
+
+Note that this is stored in memory and there may be up to
+"--transfers" chunks stored at once in memory.`,
 			Default:  fs.SizeSuffix(defaultChunkSize),
 			Advanced: true,
 		}, {
-			Name:     "list_chunk",
-			Help:     "Size of blob list.",
+			Name: "list_chunk",
+			Help: `Size of blob list.
+
+This sets the number of blobs requested in each listing chunk. Default
+is the maximum, 5000. "List blobs" requests are permitted 2 minutes
+per megabyte to complete. If an operation is taking longer than 2
+minutes per megabyte on average, it will time out (
+[source](https://docs.microsoft.com/en-us/rest/api/storageservices/setting-timeouts-for-blob-service-operations#exceptions-to-default-timeout-interval)
+). This can be used to limit the number of blobs items to return, to
+avoid the time out.`,
 			Default:  maxListChunkSize,
 			Advanced: true,
 		}, {
 			Name: "access_tier",
-			Help: "Access tier of blob, supports hot, cool and archive tiers.\nArchived blobs can be restored by setting access tier to hot or cool." +
-				" Leave blank if you intend to use default access tier, which is set at account level",
+			Help: `Access tier of blob: hot, cool or archive.
+
+Archived blobs can be restored by setting access tier to hot or
+cool. Leave blank if you intend to use default access tier, which is
+set at account level
+
+If there is no "access tier" specified, rclone doesn't apply any tier.
+rclone performs "Set Tier" operation on blobs while uploading, if objects
+are not modified, specifying "access tier" to new one will have no effect.
+If blobs are in "archive tier" at remote, trying to perform data transfer
+operations from remote will not be allowed. User should first restore by
+tiering blob to "Hot" or "Cool".`,
 			Advanced: true,
 		}},
 	})
@@ -191,19 +212,6 @@ func validateAccessTier(tier string) bool {
 	}
 }
 
-// validAccessTiers returns list of supported storage tiers on azureblob fs
-func validAccessTiers() []string {
-	validTiers := [...]azblob.AccessTierType{azblob.AccessTierHot, azblob.AccessTierCool,
-		azblob.AccessTierArchive}
-
-	var tiers [len(validTiers)]string
-
-	for i, tier := range validTiers {
-		tiers[i] = string(tier)
-	}
-	return tiers[:]
-}
-
 // retryErrorCodes is a slice of error codes that we will retry
 var retryErrorCodes = []int{
 	401, // Unauthorized (eg "Token has expired")
@@ -229,6 +237,40 @@ func (f *Fs) shouldRetry(err error) (bool, error) {
 	return fserrors.ShouldRetry(err), err
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	const minChunkSize = fs.Byte
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	if cs > maxChunkSize {
+		return errors.Errorf("%s is greater than %s", cs, maxChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+	}
+	return
+}
+
+func checkUploadCutoff(cs fs.SizeSuffix) error {
+	if cs > maxUploadCutoff {
+		return errors.Errorf("%v must be less than or equal to %v", cs, maxUploadCutoff)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadCutoff(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadCutoff(cs)
+	if err == nil {
+		old, f.opt.UploadCutoff = f.opt.UploadCutoff, cs
+	}
+	return
+}
+
 // NewFs contstructs an Fs from the path, container:path
 func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	// Parse config into Options struct
@@ -238,11 +280,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		return nil, err
 	}
 
-	if opt.UploadCutoff > maxUploadCutoff {
-		return nil, errors.Errorf("azure: upload cutoff (%v) must be less than or equal to %v", opt.UploadCutoff, maxUploadCutoff)
+	err = checkUploadCutoff(opt.UploadCutoff)
+	if err != nil {
+		return nil, errors.Wrap(err, "azure: upload cutoff")
 	}
-	if opt.ChunkSize > maxChunkSize {
-		return nil, errors.Errorf("azure: chunk size can't be greater than %v - was %v", maxChunkSize, opt.ChunkSize)
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "azure: chunk size")
 	}
 	if opt.ListChunkSize > maxListChunkSize {
 		return nil, errors.Errorf("azure: blob list size can't be greater than %v - was %v", maxListChunkSize, opt.ListChunkSize)
@@ -321,7 +365,6 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		BucketBased:   true,
 		SetTier:       true,
 		GetTier:       true,
-		ListTiers:     true,
 	}).Fill(f)
 	if f.root != "" {
 		f.root += "/"
@@ -1247,11 +1290,20 @@ func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOptio
 		Metadata:        o.meta,
 		BlobHTTPHeaders: httpHeaders,
 	}
+	// FIXME Until https://github.com/Azure/azure-storage-blob-go/pull/75
+	// is merged the SDK can't upload a single blob of exactly the chunk
+	// size, so upload with a multpart upload to work around.
+	// See: https://github.com/ncw/rclone/issues/2653
+	multipartUpload := size >= int64(o.fs.opt.UploadCutoff)
+	if size == int64(o.fs.opt.ChunkSize) {
+		multipartUpload = true
+		fs.Debugf(o, "Setting multipart upload for file of chunk size (%d) to work around SDK bug", size)
+	}
 
 	ctx := context.Background()
 	// Don't retry, return a retry error instead
 	err = o.fs.pacer.CallNoRetry(func() (bool, error) {
-		if size >= int64(o.fs.opt.UploadCutoff) {
+		if multipartUpload {
 			// If a large file upload in chunks
 			err = o.uploadMultipart(in, size, &blob, &httpHeaders)
 		} else {
@@ -1337,11 +1389,6 @@ func (o *Object) GetTier() string {
 	return string(o.accessTier)
 }
 
-// ListTiers returns list of storage tiers supported on this object
-func (o *Object) ListTiers() []string {
-	return validAccessTiers()
-}
-
 // Check the interfaces are satisfied
 var (
 	_ fs.Fs        = &Fs{}

backend/azureblob/azureblob_internal_test.go

@@ -11,9 +11,7 @@ import (
 func (f *Fs) InternalTest(t *testing.T) {
 	// Check first feature flags are set on this
 	// remote
-	enabled := f.Features().ListTiers
-	assert.True(t, enabled)
-	enabled = f.Features().SetTier
+	enabled := f.Features().SetTier
 	assert.True(t, enabled)
 	enabled = f.Features().GetTier
 	assert.True(t, enabled)

backend/azureblob/azureblob_test.go

@@ -2,19 +2,36 @@
 
 // +build !freebsd,!netbsd,!openbsd,!plan9,!solaris,go1.8
 
-package azureblob_test
+package azureblob
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/azureblob"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
 // TestIntegration runs integration tests against the remote
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
-		RemoteName: "TestAzureBlob:",
-		NilObject:  (*azureblob.Object)(nil),
+		RemoteName:  "TestAzureBlob:",
+		NilObject:   (*Object)(nil),
+		TiersToTest: []string{"Hot", "Cool"},
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			MaxChunkSize: maxChunkSize,
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+func (f *Fs) SetUploadCutoff(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadCutoff(cs)
+}
+
+var (
+	_ fstests.SetUploadChunkSizer = (*Fs)(nil)
+	_ fstests.SetUploadCutoffer   = (*Fs)(nil)
+)

backend/b2/b2.go

@@ -48,9 +48,9 @@ const (
 	decayConstant       = 1 // bigger for slower decay, exponential
 	maxParts            = 10000
 	maxVersions         = 100 // maximum number of versions we search in --b2-versions mode
-	minChunkSize        = 5E6
-	defaultChunkSize    = 96 * 1024 * 1024
-	defaultUploadCutoff = 200E6
+	minChunkSize        = 5 * fs.MebiByte
+	defaultChunkSize    = 96 * fs.MebiByte
+	defaultUploadCutoff = 200 * fs.MebiByte
 )
 
 // Globals
@@ -77,14 +77,24 @@ func init() {
 			Help:     "Endpoint for the service.\nLeave blank normally.",
 			Advanced: true,
 		}, {
-			Name:     "test_mode",
-			Help:     "A flag string for X-Bz-Test-Mode header for debugging.",
+			Name: "test_mode",
+			Help: `A flag string for X-Bz-Test-Mode header for debugging.
+
+This is for debugging purposes only. Setting it to one of the strings
+below will cause b2 to return specific errors:
+
+  * "fail_some_uploads"
+  * "expire_some_account_authorization_tokens"
+  * "force_cap_exceeded"
+
+These will be set in the "X-Bz-Test-Mode" header which is documented
+in the [b2 integrations checklist](https://www.backblaze.com/b2/docs/integration_checklist.html).`,
 			Default:  "",
 			Hide:     fs.OptionHideConfigurator,
 			Advanced: true,
 		}, {
 			Name:     "versions",
-			Help:     "Include old versions in directory listings.",
+			Help:     "Include old versions in directory listings.\nNote that when using this no file write operations are permitted,\nso you can't upload files or delete them.",
 			Default:  false,
 			Advanced: true,
 		}, {
@@ -92,13 +102,22 @@ func init() {
 			Help:    "Permanently delete files on remote removal, otherwise hide files.",
 			Default: false,
 		}, {
-			Name:     "upload_cutoff",
-			Help:     "Cutoff for switching to chunked upload.",
+			Name: "upload_cutoff",
+			Help: `Cutoff for switching to chunked upload.
+
+Files above this size will be uploaded in chunks of "--b2-chunk-size".
+
+This value should be set no larger than 4.657GiB (== 5GB).`,
 			Default:  fs.SizeSuffix(defaultUploadCutoff),
 			Advanced: true,
 		}, {
-			Name:     "chunk_size",
-			Help:     "Upload chunk size. Must fit in memory.",
+			Name: "chunk_size",
+			Help: `Upload chunk size. Must fit in memory.
+
+When uploading large files, chunk the file into this size.  Note that
+these chunks are buffered in memory and there might a maximum of
+"--transfers" chunks in progress at once.  5,000,000 Bytes is the
+minimim size.`,
 			Default:  fs.SizeSuffix(defaultChunkSize),
 			Advanced: true,
 		}},
@@ -263,6 +282,37 @@ func errorHandler(resp *http.Response) error {
 	return errResponse
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+		f.fillBufferTokens() // reset the buffer tokens
+	}
+	return
+}
+
+func checkUploadCutoff(opt *Options, cs fs.SizeSuffix) error {
+	if cs < opt.ChunkSize {
+		return errors.Errorf("%v is less than chunk size %v", cs, opt.ChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadCutoff(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadCutoff(&f.opt, cs)
+	if err == nil {
+		old, f.opt.UploadCutoff = f.opt.UploadCutoff, cs
+	}
+	return
+}
+
 // NewFs contstructs an Fs from the path, bucket:path
 func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	// Parse config into Options struct
@@ -271,11 +321,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		return nil, err
 	}
-	if opt.UploadCutoff < opt.ChunkSize {
-		return nil, errors.Errorf("b2: upload cutoff (%v) must be greater than or equal to chunk size (%v)", opt.UploadCutoff, opt.ChunkSize)
+	err = checkUploadCutoff(opt, opt.UploadCutoff)
+	if err != nil {
+		return nil, errors.Wrap(err, "b2: upload cutoff")
 	}
-	if opt.ChunkSize < minChunkSize {
-		return nil, errors.Errorf("b2: chunk size can't be less than %v - was %v", minChunkSize, opt.ChunkSize)
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "b2: chunk size")
 	}
 	bucket, directory, err := parsePath(root)
 	if err != nil {
@@ -291,13 +343,12 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		opt.Endpoint = defaultEndpoint
 	}
 	f := &Fs{
-		name:         name,
-		opt:          *opt,
-		bucket:       bucket,
-		root:         directory,
-		srv:          rest.NewClient(fshttp.NewClient(fs.Config)).SetErrorHandler(errorHandler),
-		pacer:        pacer.New().SetMinSleep(minSleep).SetMaxSleep(maxSleep).SetDecayConstant(decayConstant),
-		bufferTokens: make(chan []byte, fs.Config.Transfers),
+		name:   name,
+		opt:    *opt,
+		bucket: bucket,
+		root:   directory,
+		srv:    rest.NewClient(fshttp.NewClient(fs.Config)).SetErrorHandler(errorHandler),
+		pacer:  pacer.New().SetMinSleep(minSleep).SetMaxSleep(maxSleep).SetDecayConstant(decayConstant),
 	}
 	f.features = (&fs.Features{
 		ReadMimeType:  true,
@@ -310,10 +361,7 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		f.srv.SetHeader(testModeHeader, testMode)
 		fs.Debugf(f, "Setting test header \"%s: %s\"", testModeHeader, testMode)
 	}
-	// Fill up the buffer tokens
-	for i := 0; i < fs.Config.Transfers; i++ {
-		f.bufferTokens <- nil
-	}
+	f.fillBufferTokens()
 	err = f.authorizeAccount()
 	if err != nil {
 		return nil, errors.Wrap(err, "failed to authorize account")
@@ -421,6 +469,14 @@ func (f *Fs) clearUploadURL() {
 	f.uploadMu.Unlock()
 }
 
+// Fill up (or reset) the buffer tokens
+func (f *Fs) fillBufferTokens() {
+	f.bufferTokens = make(chan []byte, fs.Config.Transfers)
+	for i := 0; i < fs.Config.Transfers; i++ {
+		f.bufferTokens <- nil
+	}
+}
+
 // getUploadBlock gets a block from the pool of size chunkSize
 func (f *Fs) getUploadBlock() []byte {
 	buf := <-f.bufferTokens

backend/b2/b2_test.go

@@ -1,10 +1,10 @@
 // Test B2 filesystem interface
-package b2_test
+package b2
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/b2"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,23 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestB2:",
-		NilObject:  (*b2.Object)(nil),
+		NilObject:  (*Object)(nil),
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			MinChunkSize:       minChunkSize,
+			NeedMultipleChunks: true,
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+func (f *Fs) SetUploadCutoff(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadCutoff(cs)
+}
+
+var (
+	_ fstests.SetUploadChunkSizer = (*Fs)(nil)
+	_ fstests.SetUploadCutoffer   = (*Fs)(nil)
+)

backend/box/box.go

@@ -85,7 +85,7 @@ func init() {
 			Help: "Box App Client Secret\nLeave blank normally.",
 		}, {
 			Name:     "upload_cutoff",
-			Help:     "Cutoff for switching to multipart upload.",
+			Help:     "Cutoff for switching to multipart upload (>= 50MB).",
 			Default:  fs.SizeSuffix(defaultUploadCutoff),
 			Advanced: true,
 		}, {
@@ -283,16 +283,16 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		// Assume it is a file
 		newRoot, remote := dircache.SplitPath(root)
-		newF := *f
-		newF.dirCache = dircache.New(newRoot, rootID, &newF)
-		newF.root = newRoot
+		tempF := *f
+		tempF.dirCache = dircache.New(newRoot, rootID, &tempF)
+		tempF.root = newRoot
 		// Make new Fs which is the parent
-		err = newF.dirCache.FindRoot(false)
+		err = tempF.dirCache.FindRoot(false)
 		if err != nil {
 			// No root so return old f
 			return f, nil
 		}
-		_, err := newF.newObjectWithInfo(remote, nil)
+		_, err := tempF.newObjectWithInfo(remote, nil)
 		if err != nil {
 			if err == fs.ErrorObjectNotFound {
 				// File doesn't exist so return old f
@@ -300,9 +300,14 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 			}
 			return nil, err
 		}
-		f.features.Fill(&newF)
+		f.features.Fill(&tempF)
+		// XXX: update the old f here instead of returning tempF, since
+		// `features` were already filled with functions having *f as a receiver.
+		// See https://github.com/ncw/rclone/issues/2182
+		f.dirCache = tempF.dirCache
+		f.root = tempF.root
 		// return an error with an fs which points to the parent
-		return &newF, fs.ErrorIsFile
+		return f, fs.ErrorIsFile
 	}
 	return f, nil
 }

backend/cache/cache.go

@@ -11,6 +11,7 @@ import (
 	"os/signal"
 	"path"
 	"path/filepath"
+	"sort"
 	"strconv"
 	"strings"
 	"sync"
@@ -23,6 +24,7 @@ import (
 	"github.com/ncw/rclone/fs/config/configmap"
 	"github.com/ncw/rclone/fs/config/configstruct"
 	"github.com/ncw/rclone/fs/config/obscure"
+	"github.com/ncw/rclone/fs/fspath"
 	"github.com/ncw/rclone/fs/hash"
 	"github.com/ncw/rclone/fs/rc"
 	"github.com/ncw/rclone/fs/walk"
@@ -86,8 +88,12 @@ func init() {
 			Help:     "Skip all certificate verifications when connecting to the Plex server",
 			Advanced: true,
 		}, {
-			Name:    "chunk_size",
-			Help:    "The size of a chunk. Lower value good for slow connections but can affect seamless reading.",
+			Name: "chunk_size",
+			Help: `The size of a chunk (partial file data).
+
+Use lower numbers for slower connections. If the chunk size is
+changed, any downloaded chunks will be invalid and cache-chunk-path
+will need to be cleared or unexpected EOF errors will occur.`,
 			Default: DefCacheChunkSize,
 			Examples: []fs.OptionExample{{
 				Value: "1m",
@@ -100,8 +106,10 @@ func init() {
 				Help:  "10 MB",
 			}},
 		}, {
-			Name:    "info_age",
-			Help:    "How much time should object info (file size, file hashes etc) be stored in cache.\nUse a very high value if you don't plan on changing the source FS from outside the cache.\nAccepted units are: \"s\", \"m\", \"h\".",
+			Name: "info_age",
+			Help: `How long to cache file structure information (directory listings, file size, times etc). 
+If all write operations are done through the cache then you can safely make
+this value very large as the cache store will also be updated in real time.`,
 			Default: DefCacheInfoAge,
 			Examples: []fs.OptionExample{{
 				Value: "1h",
@@ -114,8 +122,11 @@ func init() {
 				Help:  "48 hours",
 			}},
 		}, {
-			Name:    "chunk_total_size",
-			Help:    "The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted.",
+			Name: "chunk_total_size",
+			Help: `The total size that the chunks can take up on the local disk.
+
+If the cache exceeds this value then it will start to delete the
+oldest chunks until it goes under this value.`,
 			Default: DefCacheTotalChunkSize,
 			Examples: []fs.OptionExample{{
 				Value: "500M",
@@ -130,63 +141,143 @@ func init() {
 		}, {
 			Name:     "db_path",
 			Default:  filepath.Join(config.CacheDir, "cache-backend"),
-			Help:     "Directory to cache DB",
+			Help:     "Directory to store file structure metadata DB.\nThe remote name is used as the DB file name.",
 			Advanced: true,
 		}, {
-			Name:     "chunk_path",
-			Default:  filepath.Join(config.CacheDir, "cache-backend"),
-			Help:     "Directory to cache chunk files",
+			Name:    "chunk_path",
+			Default: filepath.Join(config.CacheDir, "cache-backend"),
+			Help: `Directory to cache chunk files.
+
+Path to where partial file data (chunks) are stored locally. The remote
+name is appended to the final path.
+
+This config follows the "--cache-db-path". If you specify a custom
+location for "--cache-db-path" and don't specify one for "--cache-chunk-path"
+then "--cache-chunk-path" will use the same path as "--cache-db-path".`,
 			Advanced: true,
 		}, {
 			Name:     "db_purge",
 			Default:  false,
-			Help:     "Purge the cache DB before",
+			Help:     "Clear all the cached data for this remote on start.",
 			Hide:     fs.OptionHideConfigurator,
 			Advanced: true,
 		}, {
-			Name:     "chunk_clean_interval",
-			Default:  DefCacheChunkCleanInterval,
-			Help:     "Interval at which chunk cleanup runs",
+			Name:    "chunk_clean_interval",
+			Default: DefCacheChunkCleanInterval,
+			Help: `How often should the cache perform cleanups of the chunk storage.
+The default value should be ok for most people. If you find that the
+cache goes over "cache-chunk-total-size" too often then try to lower
+this value to force it to perform cleanups more often.`,
 			Advanced: true,
 		}, {
-			Name:     "read_retries",
-			Default:  DefCacheReadRetries,
-			Help:     "How many times to retry a read from a cache storage",
+			Name:    "read_retries",
+			Default: DefCacheReadRetries,
+			Help: `How many times to retry a read from a cache storage.
+
+Since reading from a cache stream is independent from downloading file
+data, readers can get to a point where there's no more data in the
+cache.  Most of the times this can indicate a connectivity issue if
+cache isn't able to provide file data anymore.
+
+For really slow connections, increase this to a point where the stream is
+able to provide data but your experience will be very stuttering.`,
 			Advanced: true,
 		}, {
-			Name:     "workers",
-			Default:  DefCacheTotalWorkers,
-			Help:     "How many workers should run in parallel to download chunks",
+			Name:    "workers",
+			Default: DefCacheTotalWorkers,
+			Help: `How many workers should run in parallel to download chunks.
+
+Higher values will mean more parallel processing (better CPU needed)
+and more concurrent requests on the cloud provider.  This impacts
+several aspects like the cloud provider API limits, more stress on the
+hardware that rclone runs on but it also means that streams will be
+more fluid and data will be available much more faster to readers.
+
+**Note**: If the optional Plex integration is enabled then this
+setting will adapt to the type of reading performed and the value
+specified here will be used as a maximum number of workers to use.`,
 			Advanced: true,
 		}, {
-			Name:     "chunk_no_memory",
-			Default:  DefCacheChunkNoMemory,
-			Help:     "Disable the in-memory cache for storing chunks during streaming",
+			Name:    "chunk_no_memory",
+			Default: DefCacheChunkNoMemory,
+			Help: `Disable the in-memory cache for storing chunks during streaming.
+
+By default, cache will keep file data during streaming in RAM as well
+to provide it to readers as fast as possible.
+
+This transient data is evicted as soon as it is read and the number of
+chunks stored doesn't exceed the number of workers. However, depending
+on other settings like "cache-chunk-size" and "cache-workers" this footprint
+can increase if there are parallel streams too (multiple files being read
+at the same time).
+
+If the hardware permits it, use this feature to provide an overall better
+performance during streaming but it can also be disabled if RAM is not
+available on the local machine.`,
 			Advanced: true,
 		}, {
-			Name:     "rps",
-			Default:  int(DefCacheRps),
-			Help:     "Limits the number of requests per second to the source FS. -1 disables the rate limiter",
+			Name:    "rps",
+			Default: int(DefCacheRps),
+			Help: `Limits the number of requests per second to the source FS (-1 to disable)
+
+This setting places a hard limit on the number of requests per second
+that cache will be doing to the cloud provider remote and try to
+respect that value by setting waits between reads.
+
+If you find that you're getting banned or limited on the cloud
+provider through cache and know that a smaller number of requests per
+second will allow you to work with it then you can use this setting
+for that.
+
+A good balance of all the other settings should make this setting
+useless but it is available to set for more special cases.
+
+**NOTE**: This will limit the number of requests during streams but
+other API calls to the cloud provider like directory listings will
+still pass.`,
 			Advanced: true,
 		}, {
-			Name:     "writes",
-			Default:  DefCacheWrites,
-			Help:     "Will cache file data on writes through the FS",
+			Name:    "writes",
+			Default: DefCacheWrites,
+			Help: `Cache file data on writes through the FS
+
+If you need to read files immediately after you upload them through
+cache you can enable this flag to have their data stored in the
+cache store at the same time during upload.`,
 			Advanced: true,
 		}, {
-			Name:     "tmp_upload_path",
-			Default:  "",
-			Help:     "Directory to keep temporary files until they are uploaded to the cloud storage",
+			Name:    "tmp_upload_path",
+			Default: "",
+			Help: `Directory to keep temporary files until they are uploaded.
+
+This is the path where cache will use as a temporary storage for new
+files that need to be uploaded to the cloud provider.
+
+Specifying a value will enable this feature. Without it, it is
+completely disabled and files will be uploaded directly to the cloud
+provider`,
 			Advanced: true,
 		}, {
-			Name:     "tmp_wait_time",
-			Default:  DefCacheTmpWaitTime,
-			Help:     "How long should files be stored in local cache before being uploaded",
+			Name:    "tmp_wait_time",
+			Default: DefCacheTmpWaitTime,
+			Help: `How long should files be stored in local cache before being uploaded
+
+This is the duration that a file must wait in the temporary location
+_cache-tmp-upload-path_ before it is selected for upload.
+
+Note that only one file is uploaded at a time and it can take longer
+to start the upload if a queue formed for this purpose.`,
 			Advanced: true,
 		}, {
-			Name:     "db_wait_time",
-			Default:  DefCacheDbWaitTime,
-			Help:     "How long to wait for the DB to be available - 0 is unlimited",
+			Name:    "db_wait_time",
+			Default: DefCacheDbWaitTime,
+			Help: `How long to wait for the DB to be available - 0 is unlimited
+
+Only one process can have the DB open at any one time, so rclone waits
+for this duration for the DB to become available before it gives an
+error.
+
+If you set it to 0 then it will wait forever.`,
 			Advanced: true,
 		}},
 	})
@@ -273,7 +364,7 @@ func NewFs(name, rootPath string, m configmap.Mapper) (fs.Fs, error) {
 		return nil, errors.Wrapf(err, "failed to parse remote %q to wrap", opt.Remote)
 	}
 
-	remotePath := path.Join(wPath, rootPath)
+	remotePath := fspath.JoinRootPath(wPath, rootPath)
 	wrappedFs, wrapErr := wInfo.NewFs(wName, remotePath, wConfig)
 	if wrapErr != nil && wrapErr != fs.ErrorIsFile {
 		return nil, errors.Wrapf(wrapErr, "failed to make remote %s:%s to wrap", wName, remotePath)
@@ -415,7 +506,9 @@ func NewFs(name, rootPath string, m configmap.Mapper) (fs.Fs, error) {
 	}()
 
 	if doChangeNotify := wrappedFs.Features().ChangeNotify; doChangeNotify != nil {
-		doChangeNotify(f.receiveChangeNotify, time.Duration(f.opt.ChunkCleanInterval))
+		pollInterval := make(chan time.Duration, 1)
+		pollInterval <- time.Duration(f.opt.ChunkCleanInterval)
+		doChangeNotify(f.receiveChangeNotify, pollInterval)
 	}
 
 	f.features = (&fs.Features{
@@ -780,12 +873,15 @@ func (f *Fs) notifyChangeUpstream(remote string, entryType fs.EntryType) {
 // ChangeNotify can subsribe multiple callers
 // this is coupled with the wrapped fs ChangeNotify (if it supports it)
 // and also notifies other caches (i.e VFS) to clear out whenever something changes
-func (f *Fs) ChangeNotify(notifyFunc func(string, fs.EntryType), pollInterval time.Duration) chan bool {
+func (f *Fs) ChangeNotify(notifyFunc func(string, fs.EntryType), pollInterval <-chan time.Duration) {
 	f.parentsForgetMu.Lock()
 	defer f.parentsForgetMu.Unlock()
 	fs.Debugf(f, "subscribing to ChangeNotify")
 	f.parentsForgetFn = append(f.parentsForgetFn, notifyFunc)
-	return make(chan bool)
+	go func() {
+		for range pollInterval {
+		}
+	}()
 }
 
 // Name of the remote (as passed into NewFs)
@@ -886,7 +982,6 @@ func (f *Fs) List(dir string) (entries fs.DirEntries, err error) {
 		fs.Debugf(dir, "list: cached entries: %v", entries)
 		return entries, nil
 	}
-	// FIXME need to clean existing cached listing
 
 	// we first search any temporary files stored locally
 	var cachedEntries fs.DirEntries
@@ -912,27 +1007,42 @@ func (f *Fs) List(dir string) (entries fs.DirEntries, err error) {
 	}
 
 	// search from the source
-	entries, err = f.Fs.List(dir)
+	sourceEntries, err := f.Fs.List(dir)
 	if err != nil {
 		return nil, err
 	}
-	fs.Debugf(dir, "list: read %v from source", len(entries))
-	fs.Debugf(dir, "list: source entries: %v", entries)
+	fs.Debugf(dir, "list: read %v from source", len(sourceEntries))
+	fs.Debugf(dir, "list: source entries: %v", sourceEntries)
+
+	sort.Sort(sourceEntries)
+	for _, entry := range entries {
+		entryRemote := entry.Remote()
+		i := sort.Search(len(sourceEntries), func(i int) bool { return sourceEntries[i].Remote() >= entryRemote })
+		if i < len(sourceEntries) && sourceEntries[i].Remote() == entryRemote {
+			continue
+		}
+		fp := path.Join(f.Root(), entryRemote)
+		switch entry.(type) {
+		case fs.Object:
+			_ = f.cache.RemoveObject(fp)
+		case fs.Directory:
+			_ = f.cache.RemoveDir(fp)
+		}
+		fs.Debugf(dir, "list: remove entry: %v", entryRemote)
+	}
+	entries = nil
 
 	// and then iterate over the ones from source (temp Objects will override source ones)
 	var batchDirectories []*Directory
-	for _, entry := range entries {
+	sort.Sort(cachedEntries)
+	tmpCnt := len(cachedEntries)
+	for _, entry := range sourceEntries {
 		switch o := entry.(type) {
 		case fs.Object:
 			// skip over temporary objects (might be uploading)
-			found := false
-			for _, t := range cachedEntries {
-				if t.Remote() == o.Remote() {
-					found = true
-					break
-				}
-			}
-			if found {
+			oRemote := o.Remote()
+			i := sort.Search(tmpCnt, func(i int) bool { return cachedEntries[i].Remote() >= oRemote })
+			if i < tmpCnt && cachedEntries[i].Remote() == oRemote {
 				continue
 			}
 			co := ObjectFromOriginal(f, o).persist()

backend/cache/cache_internal_test.go

@@ -4,29 +4,25 @@ package cache_test
 
 import (
 	"bytes"
+	"encoding/base64"
+	"encoding/json"
+	goflag "flag"
+	"fmt"
 	"io"
 	"io/ioutil"
 	"log"
 	"math/rand"
+	"net/http"
 	"os"
 	"path"
 	"path/filepath"
 	"runtime"
+	"runtime/debug"
 	"strconv"
 	"strings"
 	"testing"
 	"time"
 
-	"github.com/pkg/errors"
-
-	"encoding/base64"
-	goflag "flag"
-	"fmt"
-	"runtime/debug"
-
-	"encoding/json"
-	"net/http"
-
 	"github.com/ncw/rclone/backend/cache"
 	"github.com/ncw/rclone/backend/crypt"
 	_ "github.com/ncw/rclone/backend/drive"
@@ -40,6 +36,7 @@ import (
 	"github.com/ncw/rclone/fstest"
 	"github.com/ncw/rclone/vfs"
 	"github.com/ncw/rclone/vfs/vfsflags"
+	"github.com/pkg/errors"
 	"github.com/stretchr/testify/require"
 )
 

backend/cache/cache_upload_test.go

@@ -3,6 +3,7 @@
 package cache_test
 
 import (
+	"fmt"
 	"math/rand"
 	"os"
 	"path"
@@ -10,8 +11,6 @@ import (
 	"testing"
 	"time"
 
-	"fmt"
-
 	"github.com/ncw/rclone/backend/cache"
 	_ "github.com/ncw/rclone/backend/drive"
 	"github.com/ncw/rclone/fs"

backend/cache/directory.go

@@ -3,9 +3,8 @@
 package cache
 
 import (
-	"time"
-
 	"path"
+	"time"
 
 	"github.com/ncw/rclone/fs"
 )

backend/cache/handle.go

@@ -5,12 +5,11 @@ package cache
 import (
 	"fmt"
 	"io"
-	"sync"
-	"time"
-
 	"path"
 	"runtime"
 	"strings"
+	"sync"
+	"time"
 
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fs/operations"

backend/cache/plex.go

@@ -3,18 +3,16 @@
 package cache
 
 import (
+	"bytes"
 	"crypto/tls"
 	"encoding/json"
 	"fmt"
+	"io/ioutil"
 	"net/http"
 	"net/url"
 	"strings"
-	"time"
-
 	"sync"
-
-	"bytes"
-	"io/ioutil"
+	"time"
 
 	"github.com/ncw/rclone/fs"
 	"github.com/patrickmn/go-cache"

backend/cache/storage_persistent.go

@@ -3,20 +3,17 @@
 package cache
 
 import (
-	"time"
-
 	"bytes"
 	"encoding/binary"
 	"encoding/json"
+	"fmt"
+	"io/ioutil"
 	"os"
 	"path"
 	"strconv"
 	"strings"
 	"sync"
-
-	"io/ioutil"
-
-	"fmt"
+	"time"
 
 	bolt "github.com/coreos/bbolt"
 	"github.com/ncw/rclone/fs"

backend/crypt/cipher.go

@@ -17,11 +17,9 @@ import (
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fs/accounting"
 	"github.com/pkg/errors"
-
+	"github.com/rfjakob/eme"
 	"golang.org/x/crypto/nacl/secretbox"
 	"golang.org/x/crypto/scrypt"
-
-	"github.com/rfjakob/eme"
 )
 
 // Constants

backend/crypt/crypt.go

@@ -4,7 +4,6 @@ package crypt
 import (
 	"fmt"
 	"io"
-	"path"
 	"strings"
 	"time"
 
@@ -13,6 +12,7 @@ import (
 	"github.com/ncw/rclone/fs/config/configmap"
 	"github.com/ncw/rclone/fs/config/configstruct"
 	"github.com/ncw/rclone/fs/config/obscure"
+	"github.com/ncw/rclone/fs/fspath"
 	"github.com/ncw/rclone/fs/hash"
 	"github.com/pkg/errors"
 )
@@ -67,8 +67,16 @@ func init() {
 			Help:       "Password or pass phrase for salt. Optional but recommended.\nShould be different to the previous password.",
 			IsPassword: true,
 		}, {
-			Name:     "show_mapping",
-			Help:     "For all files listed show how the names encrypt.",
+			Name: "show_mapping",
+			Help: `For all files listed show how the names encrypt.
+
+If this flag is set then for each file that the remote is asked to
+list, it will log (at level INFO) a line stating the decrypted file
+name and the encrypted file name.
+
+This is so you can work out which encrypted names are which decrypted
+names just in case you need to do something with the encrypted file
+names, or for debugging purposes.`,
 			Default:  false,
 			Hide:     fs.OptionHideConfigurator,
 			Advanced: true,
@@ -135,11 +143,11 @@ func NewFs(name, rpath string, m configmap.Mapper) (fs.Fs, error) {
 		return nil, errors.Wrapf(err, "failed to parse remote %q to wrap", remote)
 	}
 	// Look for a file first
-	remotePath := path.Join(wPath, cipher.EncryptFileName(rpath))
+	remotePath := fspath.JoinRootPath(wPath, cipher.EncryptFileName(rpath))
 	wrappedFs, err := wInfo.NewFs(wName, remotePath, wConfig)
 	// if that didn't produce a file, look for a directory
 	if err != fs.ErrorIsFile {
-		remotePath = path.Join(wPath, cipher.EncryptDirName(rpath))
+		remotePath = fspath.JoinRootPath(wPath, cipher.EncryptDirName(rpath))
 		wrappedFs, err = wInfo.NewFs(wName, remotePath, wConfig)
 	}
 	if err != fs.ErrorIsFile && err != nil {
@@ -165,7 +173,7 @@ func NewFs(name, rpath string, m configmap.Mapper) (fs.Fs, error) {
 
 	doChangeNotify := wrappedFs.Features().ChangeNotify
 	if doChangeNotify != nil {
-		f.features.ChangeNotify = func(notifyFunc func(string, fs.EntryType), pollInterval time.Duration) chan bool {
+		f.features.ChangeNotify = func(notifyFunc func(string, fs.EntryType), pollInterval <-chan time.Duration) {
 			wrappedNotifyFunc := func(path string, entryType fs.EntryType) {
 				decrypted, err := f.DecryptFileName(path)
 				if err != nil {
@@ -174,7 +182,7 @@ func NewFs(name, rpath string, m configmap.Mapper) (fs.Fs, error) {
 				}
 				notifyFunc(decrypted, entryType)
 			}
-			return doChangeNotify(wrappedNotifyFunc, pollInterval)
+			doChangeNotify(wrappedNotifyFunc, pollInterval)
 		}
 	}
 

backend/drive/drive_internal_test.go

@@ -1,62 +1,55 @@
 package drive
 
 import (
+	"bytes"
 	"encoding/json"
+	"io"
+	"io/ioutil"
+	"mime"
+	"path/filepath"
+	"strings"
 	"testing"
 
-	"google.golang.org/api/drive/v3"
-
+	_ "github.com/ncw/rclone/backend/local"
+	"github.com/ncw/rclone/fs"
+	"github.com/ncw/rclone/fs/operations"
+	"github.com/ncw/rclone/fstest/fstests"
 	"github.com/pkg/errors"
 	"github.com/stretchr/testify/assert"
+	"github.com/stretchr/testify/require"
+	"google.golang.org/api/drive/v3"
 )
 
-const exampleExportFormats = `{
-	"application/vnd.google-apps.document": [
-		"application/rtf",
-		"application/vnd.oasis.opendocument.text",
-		"text/html",
-		"application/pdf",
-		"application/epub+zip",
-		"application/zip",
-		"application/vnd.openxmlformats-officedocument.wordprocessingml.document",
-		"text/plain"
-	],
-	"application/vnd.google-apps.spreadsheet": [
-		"application/x-vnd.oasis.opendocument.spreadsheet",
-		"text/tab-separated-values",
-		"application/pdf",
-		"application/vnd.openxmlformats-officedocument.spreadsheetml.sheet",
-		"text/csv",
-		"application/zip",
-		"application/vnd.oasis.opendocument.spreadsheet"
-	],
-	"application/vnd.google-apps.jam": [
-		"application/pdf"
-	],
-	"application/vnd.google-apps.script": [
-		"application/vnd.google-apps.script+json"
-	],
-	"application/vnd.google-apps.presentation": [
-		"application/vnd.oasis.opendocument.presentation",
-		"application/pdf",
-		"application/vnd.openxmlformats-officedocument.presentationml.presentation",
-		"text/plain"
-	],
-	"application/vnd.google-apps.form": [
-		"application/zip"
-	],
-	"application/vnd.google-apps.drawing": [
-		"image/svg+xml",
-		"image/png",
-		"application/pdf",
-		"image/jpeg"
-	]
-}`
+/*
+var additionalMimeTypes = map[string]string{
+	"application/vnd.ms-excel.sheet.macroenabled.12":                          ".xlsm",
+	"application/vnd.ms-excel.template.macroenabled.12":                       ".xltm",
+	"application/vnd.ms-powerpoint.presentation.macroenabled.12":              ".pptm",
+	"application/vnd.ms-powerpoint.slideshow.macroenabled.12":                 ".ppsm",
+	"application/vnd.ms-powerpoint.template.macroenabled.12":                  ".potm",
+	"application/vnd.ms-powerpoint":                                           ".ppt",
+	"application/vnd.ms-word.document.macroenabled.12":                        ".docm",
+	"application/vnd.ms-word.template.macroenabled.12":                        ".dotm",
+	"application/vnd.openxmlformats-officedocument.presentationml.template":   ".potx",
+	"application/vnd.openxmlformats-officedocument.spreadsheetml.template":    ".xltx",
+	"application/vnd.openxmlformats-officedocument.wordprocessingml.template": ".dotx",
+	"application/vnd.sun.xml.writer":                                          ".sxw",
+	"text/richtext":                                                           ".rtf",
+}
+*/
 
 // Load the example export formats into exportFormats for testing
-func TestInternalLoadExampleExportFormats(t *testing.T) {
-	exportFormatsOnce.Do(func() {})
-	assert.NoError(t, json.Unmarshal([]byte(exampleExportFormats), &_exportFormats))
+func TestInternalLoadExampleFormats(t *testing.T) {
+	fetchFormatsOnce.Do(func() {})
+	buf, err := ioutil.ReadFile(filepath.FromSlash("test/about.json"))
+	var about struct {
+		ExportFormats map[string][]string `json:"exportFormats,omitempty"`
+		ImportFormats map[string][]string `json:"importFormats,omitempty"`
+	}
+	require.NoError(t, err)
+	require.NoError(t, json.Unmarshal(buf, &about))
+	_exportFormats = fixMimeTypeMap(about.ExportFormats)
+	_importFormats = fixMimeTypeMap(about.ImportFormats)
 }
 
 func TestInternalParseExtensions(t *testing.T) {
@@ -65,27 +58,24 @@ func TestInternalParseExtensions(t *testing.T) {
 		want    []string
 		wantErr error
 	}{
-		{"doc", []string{"doc"}, nil},
-		{" docx ,XLSX, 	pptx,svg", []string{"docx", "xlsx", "pptx", "svg"}, nil},
-		{"docx,svg,Docx", []string{"docx", "svg"}, nil},
-		{"docx,potato,docx", []string{"docx"}, errors.New(`couldn't find mime type for extension "potato"`)},
+		{"doc", []string{".doc"}, nil},
+		{" docx ,XLSX, 	pptx,svg", []string{".docx", ".xlsx", ".pptx", ".svg"}, nil},
+		{"docx,svg,Docx", []string{".docx", ".svg"}, nil},
+		{"docx,potato,docx", []string{".docx"}, errors.New(`couldn't find MIME type for extension ".potato"`)},
 	} {
-		f := new(Fs)
-		gotErr := f.parseExtensions(test.in)
+		extensions, _, gotErr := parseExtensions(test.in)
 		if test.wantErr == nil {
 			assert.NoError(t, gotErr)
 		} else {
 			assert.EqualError(t, gotErr, test.wantErr.Error())
 		}
-		assert.Equal(t, test.want, f.extensions)
+		assert.Equal(t, test.want, extensions)
 	}
 
 	// Test it is appending
-	f := new(Fs)
-	assert.Nil(t, f.parseExtensions("docx,svg"))
-	assert.Nil(t, f.parseExtensions("docx,svg,xlsx"))
-	assert.Equal(t, []string{"docx", "svg", "xlsx"}, f.extensions)
-
+	extensions, _, gotErr := parseExtensions("docx,svg", "docx,svg,xlsx")
+	assert.NoError(t, gotErr)
+	assert.Equal(t, []string{".docx", ".svg", ".xlsx"}, extensions)
 }
 
 func TestInternalFindExportFormat(t *testing.T) {
@@ -99,17 +89,17 @@ func TestInternalFindExportFormat(t *testing.T) {
 		wantMimeType  string
 	}{
 		{[]string{}, "", ""},
-		{[]string{"pdf"}, "pdf", "application/pdf"},
-		{[]string{"pdf", "rtf", "xls"}, "pdf", "application/pdf"},
-		{[]string{"xls", "rtf", "pdf"}, "rtf", "application/rtf"},
-		{[]string{"xls", "csv", "svg"}, "", ""},
+		{[]string{".pdf"}, ".pdf", "application/pdf"},
+		{[]string{".pdf", ".rtf", ".xls"}, ".pdf", "application/pdf"},
+		{[]string{".xls", ".rtf", ".pdf"}, ".rtf", "application/rtf"},
+		{[]string{".xls", ".csv", ".svg"}, "", ""},
 	} {
 		f := new(Fs)
-		f.extensions = test.extensions
+		f.exportExtensions = test.extensions
 		gotExtension, gotFilename, gotMimeType, gotIsDocument := f.findExportFormat(item)
 		assert.Equal(t, test.wantExtension, gotExtension)
 		if test.wantExtension != "" {
-			assert.Equal(t, item.Name+"."+gotExtension, gotFilename)
+			assert.Equal(t, item.Name+gotExtension, gotFilename)
 		} else {
 			assert.Equal(t, "", gotFilename)
 		}
@@ -117,3 +107,146 @@ func TestInternalFindExportFormat(t *testing.T) {
 		assert.Equal(t, true, gotIsDocument)
 	}
 }
+
+func TestMimeTypesToExtension(t *testing.T) {
+	for mimeType, extension := range _mimeTypeToExtension {
+		extensions, err := mime.ExtensionsByType(mimeType)
+		assert.NoError(t, err)
+		assert.Contains(t, extensions, extension)
+	}
+}
+
+func TestExtensionToMimeType(t *testing.T) {
+	for mimeType, extension := range _mimeTypeToExtension {
+		gotMimeType := mime.TypeByExtension(extension)
+		mediatype, _, err := mime.ParseMediaType(gotMimeType)
+		assert.NoError(t, err)
+		assert.Equal(t, mimeType, mediatype)
+	}
+}
+
+func TestExtensionsForExportFormats(t *testing.T) {
+	if _exportFormats == nil {
+		t.Error("exportFormats == nil")
+	}
+	for fromMT, toMTs := range _exportFormats {
+		for _, toMT := range toMTs {
+			if !isInternalMimeType(toMT) {
+				extensions, err := mime.ExtensionsByType(toMT)
+				assert.NoError(t, err, "invalid MIME type %q", toMT)
+				assert.NotEmpty(t, extensions, "No extension found for %q (from: %q)", fromMT, toMT)
+			}
+		}
+	}
+}
+
+func TestExtensionsForImportFormats(t *testing.T) {
+	t.Skip()
+	if _importFormats == nil {
+		t.Error("_importFormats == nil")
+	}
+	for fromMT := range _importFormats {
+		if !isInternalMimeType(fromMT) {
+			extensions, err := mime.ExtensionsByType(fromMT)
+			assert.NoError(t, err, "invalid MIME type %q", fromMT)
+			assert.NotEmpty(t, extensions, "No extension found for %q", fromMT)
+		}
+	}
+}
+
+func (f *Fs) InternalTestDocumentImport(t *testing.T) {
+	oldAllow := f.opt.AllowImportNameChange
+	f.opt.AllowImportNameChange = true
+	defer func() {
+		f.opt.AllowImportNameChange = oldAllow
+	}()
+
+	testFilesPath, err := filepath.Abs(filepath.FromSlash("test/files"))
+	require.NoError(t, err)
+
+	testFilesFs, err := fs.NewFs(testFilesPath)
+	require.NoError(t, err)
+
+	_, f.importMimeTypes, err = parseExtensions("odt,ods,doc")
+	require.NoError(t, err)
+
+	err = operations.CopyFile(f, testFilesFs, "example2.doc", "example2.doc")
+	require.NoError(t, err)
+}
+
+func (f *Fs) InternalTestDocumentUpdate(t *testing.T) {
+	testFilesPath, err := filepath.Abs(filepath.FromSlash("test/files"))
+	require.NoError(t, err)
+
+	testFilesFs, err := fs.NewFs(testFilesPath)
+	require.NoError(t, err)
+
+	_, f.importMimeTypes, err = parseExtensions("odt,ods,doc")
+	require.NoError(t, err)
+
+	err = operations.CopyFile(f, testFilesFs, "example2.xlsx", "example1.ods")
+	require.NoError(t, err)
+}
+
+func (f *Fs) InternalTestDocumentExport(t *testing.T) {
+	var buf bytes.Buffer
+	var err error
+
+	f.exportExtensions, _, err = parseExtensions("txt")
+	require.NoError(t, err)
+
+	obj, err := f.NewObject("example2.txt")
+	require.NoError(t, err)
+
+	rc, err := obj.Open()
+	require.NoError(t, err)
+	defer func() { require.NoError(t, rc.Close()) }()
+
+	_, err = io.Copy(&buf, rc)
+	require.NoError(t, err)
+	text := buf.String()
+
+	for _, excerpt := range []string{
+		"Lorem ipsum dolor sit amet, consectetur",
+		"porta at ultrices in, consectetur at augue.",
+	} {
+		require.Contains(t, text, excerpt)
+	}
+}
+
+func (f *Fs) InternalTestDocumentLink(t *testing.T) {
+	var buf bytes.Buffer
+	var err error
+
+	f.exportExtensions, _, err = parseExtensions("link.html")
+	require.NoError(t, err)
+
+	obj, err := f.NewObject("example2.link.html")
+	require.NoError(t, err)
+
+	rc, err := obj.Open()
+	require.NoError(t, err)
+	defer func() { require.NoError(t, rc.Close()) }()
+
+	_, err = io.Copy(&buf, rc)
+	require.NoError(t, err)
+	text := buf.String()
+
+	require.True(t, strings.HasPrefix(text, "<html>"))
+	require.True(t, strings.HasSuffix(text, "</html>\n"))
+	for _, excerpt := range []string{
+		`<meta http-equiv="refresh"`,
+		`Loading <a href="`,
+	} {
+		require.Contains(t, text, excerpt)
+	}
+}
+
+func (f *Fs) InternalTest(t *testing.T) {
+	t.Run("DocumentImport", f.InternalTestDocumentImport)
+	t.Run("DocumentUpdate", f.InternalTestDocumentUpdate)
+	t.Run("DocumentExport", f.InternalTestDocumentExport)
+	t.Run("DocumentLink", f.InternalTestDocumentLink)
+}
+
+var _ fstests.InternalTester = (*Fs)(nil)

backend/drive/drive_test.go

@@ -1,10 +1,10 @@
 // Test Drive filesystem interface
-package drive_test
+package drive
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/drive"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,23 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestDrive:",
-		NilObject:  (*drive.Object)(nil),
+		NilObject:  (*Object)(nil),
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			MinChunkSize:  minChunkSize,
+			CeilChunkSize: fstests.NextPowerOfTwo,
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+func (f *Fs) SetUploadCutoff(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadCutoff(cs)
+}
+
+var (
+	_ fstests.SetUploadChunkSizer = (*Fs)(nil)
+	_ fstests.SetUploadCutoffer   = (*Fs)(nil)
+)

backend/drive/test/about.json

@@ -0,0 +1,178 @@
+{
+ "importFormats": {
+  "text/tab-separated-values": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/x-vnd.oasis.opendocument.presentation": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "image/jpeg": [
+   "application/vnd.google-apps.document"
+  ],
+  "image/bmp": [
+   "application/vnd.google-apps.document"
+  ],
+  "image/gif": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.ms-excel.sheet.macroenabled.12": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/vnd.openxmlformats-officedocument.wordprocessingml.template": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.ms-powerpoint.presentation.macroenabled.12": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "application/vnd.ms-word.template.macroenabled.12": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.openxmlformats-officedocument.wordprocessingml.document": [
+   "application/vnd.google-apps.document"
+  ],
+  "image/pjpeg": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.google-apps.script+text/plain": [
+   "application/vnd.google-apps.script"
+  ],
+  "application/vnd.ms-excel": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/vnd.sun.xml.writer": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.ms-word.document.macroenabled.12": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.ms-powerpoint.slideshow.macroenabled.12": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "text/rtf": [
+   "application/vnd.google-apps.document"
+  ],
+  "text/plain": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.oasis.opendocument.spreadsheet": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/x-vnd.oasis.opendocument.spreadsheet": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "image/png": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/x-vnd.oasis.opendocument.text": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/msword": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/pdf": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/json": [
+   "application/vnd.google-apps.script"
+  ],
+  "application/x-msmetafile": [
+   "application/vnd.google-apps.drawing"
+  ],
+  "application/vnd.openxmlformats-officedocument.spreadsheetml.template": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/vnd.ms-powerpoint": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "application/vnd.ms-excel.template.macroenabled.12": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "image/x-bmp": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/rtf": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.openxmlformats-officedocument.presentationml.template": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "image/x-png": [
+   "application/vnd.google-apps.document"
+  ],
+  "text/html": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.oasis.opendocument.text": [
+   "application/vnd.google-apps.document"
+  ],
+  "application/vnd.openxmlformats-officedocument.presentationml.presentation": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/vnd.google-apps.script+json": [
+   "application/vnd.google-apps.script"
+  ],
+  "application/vnd.openxmlformats-officedocument.presentationml.slideshow": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "application/vnd.ms-powerpoint.template.macroenabled.12": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "text/csv": [
+   "application/vnd.google-apps.spreadsheet"
+  ],
+  "application/vnd.oasis.opendocument.presentation": [
+   "application/vnd.google-apps.presentation"
+  ],
+  "image/jpg": [
+   "application/vnd.google-apps.document"
+  ],
+  "text/richtext": [
+   "application/vnd.google-apps.document"
+  ]
+ },
+ "exportFormats": {
+  "application/vnd.google-apps.document": [
+   "application/rtf",
+   "application/vnd.oasis.opendocument.text",
+   "text/html",
+   "application/pdf",
+   "application/epub+zip",
+   "application/zip",
+   "application/vnd.openxmlformats-officedocument.wordprocessingml.document",
+   "text/plain"
+  ],
+  "application/vnd.google-apps.spreadsheet": [
+   "application/x-vnd.oasis.opendocument.spreadsheet",
+   "text/tab-separated-values",
+   "application/pdf",
+   "application/vnd.openxmlformats-officedocument.spreadsheetml.sheet",
+   "text/csv",
+   "application/zip",
+   "application/vnd.oasis.opendocument.spreadsheet"
+  ],
+  "application/vnd.google-apps.jam": [
+   "application/pdf"
+  ],
+  "application/vnd.google-apps.script": [
+   "application/vnd.google-apps.script+json"
+  ],
+  "application/vnd.google-apps.presentation": [
+   "application/vnd.oasis.opendocument.presentation",
+   "application/pdf",
+   "application/vnd.openxmlformats-officedocument.presentationml.presentation",
+   "text/plain"
+  ],
+  "application/vnd.google-apps.form": [
+   "application/zip"
+  ],
+  "application/vnd.google-apps.drawing": [
+   "image/svg+xml",
+   "image/png",
+   "application/pdf",
+   "image/jpeg"
+  ]
+ }
+}

backend/drive/upload.go

@@ -50,11 +50,12 @@ type resumableUpload struct {
 }
 
 // Upload the io.Reader in of size bytes with contentType and info
-func (f *Fs) Upload(in io.Reader, size int64, contentType string, fileID string, info *drive.File, remote string) (*drive.File, error) {
-	params := make(url.Values)
-	params.Set("alt", "json")
-	params.Set("uploadType", "resumable")
-	params.Set("fields", partialFields)
+func (f *Fs) Upload(in io.Reader, size int64, contentType, fileID, remote string, info *drive.File) (*drive.File, error) {
+	params := url.Values{
+		"alt":        {"json"},
+		"uploadType": {"resumable"},
+		"fields":     {partialFields},
+	}
 	if f.isTeamDrive {
 		params.Set("supportsTeamDrives", "true")
 	}

backend/dropbox/dropbox.go

@@ -79,8 +79,8 @@ const (
 	// Choose 48MB which is 91% of Maximum speed.  rclone by
 	// default does 4 transfers so this should use 4*48MB = 192MB
 	// by default.
-	defaultChunkSize = 48 * 1024 * 1024
-	maxChunkSize     = 150 * 1024 * 1024
+	defaultChunkSize = 48 * fs.MebiByte
+	maxChunkSize     = 150 * fs.MebiByte
 )
 
 var (
@@ -120,8 +120,15 @@ func init() {
 			Name: config.ConfigClientSecret,
 			Help: "Dropbox App Client Secret\nLeave blank normally.",
 		}, {
-			Name:     "chunk_size",
-			Help:     fmt.Sprintf("Upload chunk size. Max %v.", fs.SizeSuffix(maxChunkSize)),
+			Name: "chunk_size",
+			Help: fmt.Sprintf(`Upload chunk size. (< %v).
+
+Any files larger than this will be uploaded in chunks of this size.
+
+Note that chunks are buffered in memory (one at a time) so rclone can
+deal with retries.  Setting this larger will increase the speed
+slightly (at most 10%% for 128MB in tests) at the cost of using more
+memory.  It can be set smaller if you are tight on memory.`, fs.SizeSuffix(maxChunkSize)),
 			Default:  fs.SizeSuffix(defaultChunkSize),
 			Advanced: true,
 		}},
@@ -195,6 +202,25 @@ func shouldRetry(err error) (bool, error) {
 	return fserrors.ShouldRetry(err), err
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	const minChunkSize = fs.Byte
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	if cs > maxChunkSize {
+		return errors.Errorf("%s is greater than %s", cs, maxChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+	}
+	return
+}
+
 // NewFs contstructs an Fs from the path, container:path
 func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	// Parse config into Options struct
@@ -203,8 +229,9 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		return nil, err
 	}
-	if opt.ChunkSize > maxChunkSize {
-		return nil, errors.Errorf("chunk size too big, must be < %v", maxChunkSize)
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "dropbox: chunk size")
 	}
 
 	// Convert the old token if it exists.  The old token was just

backend/dropbox/dropbox_test.go

@@ -1,10 +1,10 @@
 // Test Dropbox filesystem interface
-package dropbox_test
+package dropbox
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/dropbox"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,15 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestDropbox:",
-		NilObject:  (*dropbox.Object)(nil),
+		NilObject:  (*Object)(nil),
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			MaxChunkSize: maxChunkSize,
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+var _ fstests.SetUploadChunkSizer = (*Fs)(nil)

backend/ftp/ftp.go

@@ -704,6 +704,11 @@ func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOptio
 	path := path.Join(o.fs.root, o.remote)
 	// remove the file if upload failed
 	remove := func() {
+		// Give the FTP server a chance to get its internal state in order after the error.
+		// The error may have been local in which case we closed the connection.  The server
+		// may still be dealing with it for a moment. A sleep isn't ideal but I haven't been
+		// able to think of a better method to find out if the server has finished - ncw
+		time.Sleep(1 * time.Second)
 		removeErr := o.Remove()
 		if removeErr != nil {
 			fs.Debugf(o, "Failed to remove: %v", removeErr)
@@ -717,7 +722,7 @@ func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOptio
 	}
 	err = c.Stor(path, in)
 	if err != nil {
-		_ = c.Quit()
+		_ = c.Quit() // toss this connection to avoid sync errors
 		remove()
 		return errors.Wrap(err, "update stor")
 	}

backend/jottacloud/jottacloud.go

@@ -80,7 +80,7 @@ func init() {
 			Advanced: true,
 		}, {
 			Name:     "unlink",
-			Help:     "Remove existing public link to file/folder with link command rather than creating.",
+			Help:     "Remove existing public link to file/folder with link command rather than creating.\nDefault is false, meaning link command will create or retrieve public link.",
 			Default:  false,
 			Advanced: true,
 		}},
@@ -199,7 +199,7 @@ func (f *Fs) readMetaDataForPath(path string) (info *api.JottaFile, err error) {
 func (f *Fs) getAccountInfo() (info *api.AccountInfo, err error) {
 	opts := rest.Opts{
 		Method: "GET",
-		Path:   rest.URLPathEscape(f.user),
+		Path:   urlPathEscape(f.user),
 	}
 
 	var resp *http.Response
@@ -220,7 +220,7 @@ func (f *Fs) setEndpointURL(mountpoint string) (err error) {
 	if err != nil {
 		return errors.Wrap(err, "failed to get endpoint url")
 	}
-	f.endpointURL = rest.URLPathEscape(path.Join(info.Username, defaultDevice, mountpoint))
+	f.endpointURL = urlPathEscape(path.Join(info.Username, defaultDevice, mountpoint))
 	return nil
 }
 
@@ -241,6 +241,11 @@ func errorHandler(resp *http.Response) error {
 	return errResponse
 }
 
+// Jottacloud want's '+' to be URL encoded even though the RFC states it's not reserved
+func urlPathEscape(in string) string {
+	return strings.Replace(rest.URLPathEscape(in), "+", "%2B", -1)
+}
+
 // filePathRaw returns an unescaped file path (f.root, file)
 func (f *Fs) filePathRaw(file string) string {
 	return path.Join(f.endpointURL, replaceReservedChars(path.Join(f.root, file)))
@@ -248,7 +253,7 @@ func (f *Fs) filePathRaw(file string) string {
 
 // filePath returns a escaped file path (f.root, file)
 func (f *Fs) filePath(file string) string {
-	return rest.URLPathEscape(f.filePathRaw(file))
+	return urlPathEscape(f.filePathRaw(file))
 }
 
 // filePath returns a escaped file path (f.root, remote)
@@ -1080,6 +1085,7 @@ func (o *Object) Remove() error {
 		Method:     "POST",
 		Path:       o.filePath(),
 		Parameters: url.Values{},
+		NoResponse: true,
 	}
 
 	if o.fs.opt.HardDelete {

backend/jottacloud/jottacloud_internal_test.go

@@ -4,50 +4,25 @@ import (
 	"crypto/md5"
 	"fmt"
 	"io"
-	"io/ioutil"
 	"testing"
 
+	"github.com/ncw/rclone/lib/readers"
 	"github.com/stretchr/testify/assert"
 	"github.com/stretchr/testify/require"
 )
 
-// A test reader to return a test pattern of size
-type testReader struct {
-	size int64
-	c    byte
-}
-
-// Reader is the interface that wraps the basic Read method.
-func (r *testReader) Read(p []byte) (n int, err error) {
-	for i := range p {
-		if r.size <= 0 {
-			return n, io.EOF
-		}
-		p[i] = r.c
-		r.c = (r.c + 1) % 253
-		r.size--
-		n++
-	}
-	return
-}
-
 func TestReadMD5(t *testing.T) {
-	// smoke test the reader
-	b, err := ioutil.ReadAll(&testReader{size: 10})
-	require.NoError(t, err)
-	assert.Equal(t, []byte{0, 1, 2, 3, 4, 5, 6, 7, 8, 9}, b)
-
 	// Check readMD5 for different size and threshold
 	for _, size := range []int64{0, 1024, 10 * 1024, 100 * 1024} {
 		t.Run(fmt.Sprintf("%d", size), func(t *testing.T) {
 			hasher := md5.New()
-			n, err := io.Copy(hasher, &testReader{size: size})
+			n, err := io.Copy(hasher, readers.NewPatternReader(size))
 			require.NoError(t, err)
 			assert.Equal(t, n, size)
 			wantMD5 := fmt.Sprintf("%x", hasher.Sum(nil))
 			for _, threshold := range []int64{512, 1024, 10 * 1024, 20 * 1024} {
 				t.Run(fmt.Sprintf("%d", threshold), func(t *testing.T) {
-					in := &testReader{size: size}
+					in := readers.NewPatternReader(size)
 					gotMD5, out, cleanup, err := readMD5(in, size, threshold)
 					defer cleanup()
 					require.NoError(t, err)

backend/jottacloud/replace.go

@@ -27,21 +27,14 @@ import (
 var (
 	charMap = map[rune]rune{
 		'\\': '＼', // FULLWIDTH REVERSE SOLIDUS
-		'+':  '＋', // FULLWIDTH PLUS SIGN
 		'*':  '＊', // FULLWIDTH ASTERISK
 		'<':  '＜', // FULLWIDTH LESS-THAN SIGN
 		'>':  '＞', // FULLWIDTH GREATER-THAN SIGN
 		'?':  '？', // FULLWIDTH QUESTION MARK
-		'!':  '！', // FULLWIDTH EXCLAMATION MARK
-		'&':  '＆', // FULLWIDTH AMPERSAND
 		':':  '：', // FULLWIDTH COLON
 		';':  '；', // FULLWIDTH SEMICOLON
 		'|':  '｜', // FULLWIDTH VERTICAL LINE
-		'#':  '＃', // FULLWIDTH NUMBER SIGN
-		'%':  '％', // FULLWIDTH PERCENT SIGN
 		'"':  '＂', // FULLWIDTH QUOTATION MARK - not on the list but seems to be reserved
-		'\'': '＇', // FULLWIDTH APOSTROPHE
-		'~':  '～', // FULLWIDTH TILDE
 		' ':  '␠', // SYMBOL FOR SPACE
 	}
 	invCharMap           map[rune]rune

backend/jottacloud/replace_test.go

@@ -9,8 +9,8 @@ func TestReplace(t *testing.T) {
 	}{
 		{"", ""},
 		{"abc 123", "abc 123"},
-		{`\+*<>?!&:;|#%"'~`, `＼＋＊＜＞？！＆：；｜＃％＂＇～`},
-		{`\+*<>?!&:;|#%"'~\+*<>?!&:;|#%"'~`, `＼＋＊＜＞？！＆：；｜＃％＂＇～＼＋＊＜＞？！＆：；｜＃％＂＇～`},
+		{`\*<>?:;|"`, `＼＊＜＞？：；｜＂`},
+		{`\*<>?:;|"\*<>?:;|"`, `＼＊＜＞？：；｜＂＼＊＜＞？：；｜＂`},
 		{" leading space", "␠leading space"},
 		{"trailing space ", "trailing space␠"},
 		{" leading space/ leading space/ leading space", "␠leading space/␠leading space/␠leading space"},

backend/local/local.go

@@ -49,19 +49,33 @@ func init() {
 			ShortOpt: "L",
 			Advanced: true,
 		}, {
-			Name:     "skip_links",
-			Help:     "Don't warn about skipped symlinks.",
+			Name: "skip_links",
+			Help: `Don't warn about skipped symlinks.
+This flag disables warning messages on skipped symlinks or junction
+points, as you explicitly acknowledge that they should be skipped.`,
 			Default:  false,
 			NoPrefix: true,
 			Advanced: true,
 		}, {
-			Name:     "no_unicode_normalization",
-			Help:     "Don't apply unicode normalization to paths and filenames",
+			Name: "no_unicode_normalization",
+			Help: `Don't apply unicode normalization to paths and filenames (Deprecated)
+
+This flag is deprecated now.  Rclone no longer normalizes unicode file
+names, but it compares them with unicode normalization in the sync
+routine instead.`,
 			Default:  false,
 			Advanced: true,
 		}, {
-			Name:     "no_check_updated",
-			Help:     "Don't check to see if the files change during upload",
+			Name: "no_check_updated",
+			Help: `Don't check to see if the files change during upload
+
+Normally rclone checks the size and modification time of files as they
+are being uploaded and aborts with a message which starts "can't copy
+- source file is being updated" if the file changes during upload.
+
+However on some file systems this modification time check may fail (eg
+[Glusterfs #2206](https://github.com/ncw/rclone/issues/2206)) so this
+check can be disabled with this flag.`,
 			Default:  false,
 			Advanced: true,
 		}, {
@@ -817,6 +831,12 @@ func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOptio
 		return err
 	}
 
+	// Pre-allocate the file for performance reasons
+	err = preAllocate(src.Size(), out)
+	if err != nil {
+		fs.Debugf(o, "Failed to pre-allocate: %v", err)
+	}
+
 	// Calculate the hash of the object we are reading as we go along
 	hash, err := hash.NewMultiHasherTypes(hashes)
 	if err != nil {

backend/local/preallocate_other.go

@@ -0,0 +1,10 @@
+//+build !windows,!linux
+
+package local
+
+import "os"
+
+// preAllocate the file for performance reasons
+func preAllocate(size int64, out *os.File) error {
+	return nil
+}

backend/local/preallocate_unix.go

@@ -0,0 +1,22 @@
+//+build linux
+
+package local
+
+import (
+	"os"
+
+	"golang.org/x/sys/unix"
+)
+
+// preAllocate the file for performance reasons
+func preAllocate(size int64, out *os.File) error {
+	if size <= 0 {
+		return nil
+	}
+	err := unix.Fallocate(int(out.Fd()), unix.FALLOC_FL_KEEP_SIZE, 0, size)
+	// FIXME could be doing something here
+	// if err == unix.ENOSPC {
+	// 	log.Printf("No space")
+	// }
+	return err
+}

backend/local/preallocate_windows.go

@@ -0,0 +1,79 @@
+//+build windows
+
+package local
+
+import (
+	"os"
+	"syscall"
+	"unsafe"
+
+	"github.com/pkg/errors"
+	"golang.org/x/sys/windows"
+)
+
+var (
+	ntdll                        = windows.NewLazySystemDLL("ntdll.dll")
+	ntQueryVolumeInformationFile = ntdll.NewProc("NtQueryVolumeInformationFile")
+	ntSetInformationFile         = ntdll.NewProc("NtSetInformationFile")
+)
+
+type fileAllocationInformation struct {
+	AllocationSize uint64
+}
+
+type fileFsSizeInformation struct {
+	TotalAllocationUnits     uint64
+	AvailableAllocationUnits uint64
+	SectorsPerAllocationUnit uint32
+	BytesPerSector           uint32
+}
+
+type ioStatusBlock struct {
+	Status, Information uintptr
+}
+
+// preAllocate the file for performance reasons
+func preAllocate(size int64, out *os.File) error {
+	if size <= 0 {
+		return nil
+	}
+
+	var (
+		iosb       ioStatusBlock
+		fsSizeInfo fileFsSizeInformation
+		allocInfo  fileAllocationInformation
+	)
+
+	// Query info about the block sizes on the file system
+	_, _, e1 := ntQueryVolumeInformationFile.Call(
+		uintptr(out.Fd()),
+		uintptr(unsafe.Pointer(&iosb)),
+		uintptr(unsafe.Pointer(&fsSizeInfo)),
+		uintptr(unsafe.Sizeof(fsSizeInfo)),
+		uintptr(3), // FileFsSizeInformation
+	)
+	if e1 != nil && e1 != syscall.Errno(0) {
+		return errors.Wrap(e1, "preAllocate NtQueryVolumeInformationFile failed")
+	}
+
+	// Calculate the allocation size
+	clusterSize := uint64(fsSizeInfo.BytesPerSector) * uint64(fsSizeInfo.SectorsPerAllocationUnit)
+	if clusterSize <= 0 {
+		return errors.Errorf("preAllocate clusterSize %d <= 0", clusterSize)
+	}
+	allocInfo.AllocationSize = (1 + uint64(size-1)/clusterSize) * clusterSize
+
+	// Ask for the allocation
+	_, _, e1 = ntSetInformationFile.Call(
+		uintptr(out.Fd()),
+		uintptr(unsafe.Pointer(&iosb)),
+		uintptr(unsafe.Pointer(&allocInfo)),
+		uintptr(unsafe.Sizeof(allocInfo)),
+		uintptr(19), // FileAllocationInformation
+	)
+	if e1 != nil && e1 != syscall.Errno(0) {
+		return errors.Wrap(e1, "preAllocate NtSetInformationFile failed")
+	}
+
+	return nil
+}

backend/mega/mega.go

@@ -63,13 +63,20 @@ func init() {
 			Required:   true,
 			IsPassword: true,
 		}, {
-			Name:     "debug",
-			Help:     "Output more debug from Mega.",
+			Name: "debug",
+			Help: `Output more debug from Mega.
+
+If this flag is set (along with -vv) it will print further debugging
+information from the mega backend.`,
 			Default:  false,
 			Advanced: true,
 		}, {
-			Name:     "hard_delete",
-			Help:     "Delete files permanently rather than putting them into the trash.",
+			Name: "hard_delete",
+			Help: `Delete files permanently rather than putting them into the trash.
+
+Normally the mega backend will put all deletions into the trash rather
+than permanently deleting them.  If you specify this then rclone will
+permanently delete objects instead.`,
 			Default:  false,
 			Advanced: true,
 		}},

backend/onedrive/api/types.go

@@ -9,6 +9,9 @@ import (
 
 const (
 	timeFormat = `"` + time.RFC3339 + `"`
+
+	// PackageTypeOneNote is the package type value for OneNote files
+	PackageTypeOneNote = "oneNote"
 )
 
 // Error is returned from one drive when things go wrong
@@ -107,6 +110,7 @@ type RemoteItemFacet struct {
 	LastModifiedDateTime Timestamp            `json:"lastModifiedDateTime"` // Date and time the item was last modified. Read-only.
 	Folder               *FolderFacet         `json:"folder"`               // Folder metadata, if the item is a folder. Read-only.
 	File                 *FileFacet           `json:"file"`                 // File metadata, if the item is a file. Read-only.
+	Package              *PackageFacet        `json:"package"`              // If present, indicates that this item is a package instead of a folder or file. Packages are treated like files in some contexts and folders in others. Read-only.
 	FileSystemInfo       *FileSystemInfoFacet `json:"fileSystemInfo"`       // File system information on client. Read-write.
 	ParentReference      *ItemReference       `json:"parentReference"`      // Parent information, if the item has a parent. Read-write.
 	Size                 int64                `json:"size"`                 // Size of the item in bytes. Read-only.
@@ -147,6 +151,13 @@ type FileSystemInfoFacet struct {
 type DeletedFacet struct {
 }
 
+// PackageFacet indicates that a DriveItem is the top level item
+// in a "package" or a collection of items that should be treated as a collection instead of individual items.
+// `oneNote` is the only currently defined value.
+type PackageFacet struct {
+	Type string `json:"type"`
+}
+
 // Item represents metadata for an item in OneDrive
 type Item struct {
 	ID                   string               `json:"id"`                   // The unique identifier of the item within the Drive. Read-only.
@@ -170,6 +181,7 @@ type Item struct {
 	//	Audio                *AudioFacet          `json:"audio"`                // Audio metadata, if the item is an audio file. Read-only.
 	//	Video                *VideoFacet          `json:"video"`                // Video metadata, if the item is a video. Read-only.
 	//	Location             *LocationFacet       `json:"location"`             // Location metadata, if the item has location data. Read-only.
+	Package *PackageFacet `json:"package"` // If present, indicates that this item is a package instead of a folder or file. Packages are treated like files in some contexts and folders in others. Read-only.
 	Deleted *DeletedFacet `json:"deleted"` // Information about the deleted state of the item. Read-only.
 }
 
@@ -238,6 +250,28 @@ type MoveItemRequest struct {
 	FileSystemInfo  *FileSystemInfoFacet `json:"fileSystemInfo,omitempty"`  // File system information on client. Read-write.
 }
 
+//CreateShareLinkRequest is the request to create a sharing link
+//Always Type:view and Scope:anonymous for public sharing
+type CreateShareLinkRequest struct {
+	Type  string `json:"type"`            //Link type in View, Edit or Embed
+	Scope string `json:"scope,omitempty"` //Optional. Scope in anonymousi, organization
+}
+
+//CreateShareLinkResponse is the response from CreateShareLinkRequest
+type CreateShareLinkResponse struct {
+	ID    string   `json:"id"`
+	Roles []string `json:"roles"`
+	Link  struct {
+		Type        string `json:"type"`
+		Scope       string `json:"scope"`
+		WebURL      string `json:"webUrl"`
+		Application struct {
+			ID          string `json:"id"`
+			DisplayName string `json:"displayName"`
+		} `json:"application"`
+	} `json:"link"`
+}
+
 // AsyncOperationStatus provides information on the status of a asynchronous job progress.
 //
 // The following API calls return AsyncOperationStatus resources:
@@ -281,6 +315,24 @@ func (i *Item) GetFolder() *FolderFacet {
 	return i.Folder
 }
 
+// GetPackage returns a normalized Package of the item
+func (i *Item) GetPackage() *PackageFacet {
+	if i.IsRemote() && i.RemoteItem.Package != nil {
+		return i.RemoteItem.Package
+	}
+	return i.Package
+}
+
+// GetPackageType returns the package type of the item if available,
+// otherwise ""
+func (i *Item) GetPackageType() string {
+	pack := i.GetPackage()
+	if pack == nil {
+		return ""
+	}
+	return pack.Type
+}
+
 // GetFile returns a normalized File of the item
 func (i *Item) GetFile() *FileFacet {
 	if i.IsRemote() && i.RemoteItem.File != nil {

backend/onedrive/onedrive.go

@@ -43,6 +43,8 @@ const (
 	driveTypePersonal           = "personal"
 	driveTypeBusiness           = "business"
 	driveTypeSharepoint         = "documentLibrary"
+	defaultChunkSize            = 10 * fs.MebiByte
+	chunkSizeMultiple           = 320 * fs.KibiByte
 )
 
 // Globals
@@ -212,9 +214,12 @@ func init() {
 			Name: config.ConfigClientSecret,
 			Help: "Microsoft App Client Secret\nLeave blank normally.",
 		}, {
-			Name:     "chunk_size",
-			Help:     "Chunk size to upload files with - must be multiple of 320k.",
-			Default:  fs.SizeSuffix(10 * 1024 * 1024),
+			Name: "chunk_size",
+			Help: `Chunk size to upload files with - must be multiple of 320k.
+
+Above this size files will be chunked - must be multiple of 320k. Note
+that the chunks will be buffered into memory.`,
+			Default:  defaultChunkSize,
 			Advanced: true,
 		}, {
 			Name:     "drive_id",
@@ -226,15 +231,27 @@ func init() {
 			Help:     "The type of the drive ( personal | business | documentLibrary )",
 			Default:  "",
 			Advanced: true,
+		}, {
+			Name: "expose_onenote_files",
+			Help: `Set to make OneNote files show up in directory listings.
+
+By default rclone will hide OneNote files in directory listings because
+operations like "Open" and "Update" won't work on them.  But this
+behaviour may also prevent you from deleting them.  If you want to
+delete OneNote files or otherwise want them to show up in directory
+listing, set this option.`,
+			Default:  false,
+			Advanced: true,
 		}},
 	})
 }
 
 // Options defines the configuration for this backend
 type Options struct {
-	ChunkSize fs.SizeSuffix `config:"chunk_size"`
-	DriveID   string        `config:"drive_id"`
-	DriveType string        `config:"drive_type"`
+	ChunkSize          fs.SizeSuffix `config:"chunk_size"`
+	DriveID            string        `config:"drive_id"`
+	DriveType          string        `config:"drive_type"`
+	ExposeOneNoteFiles bool          `config:"expose_onenote_files"`
 }
 
 // Fs represents a remote one drive
@@ -255,15 +272,16 @@ type Fs struct {
 //
 // Will definitely have info but maybe not meta
 type Object struct {
-	fs           *Fs       // what this object is part of
-	remote       string    // The remote path
-	hasMetaData  bool      // whether info below has been set
-	size         int64     // size of the object
-	modTime      time.Time // modification time of the object
-	id           string    // ID of the object
-	sha1         string    // SHA-1 of the object content
-	quickxorhash string    // QuickXorHash of the object content
-	mimeType     string    // Content-Type of object from server (may not be as uploaded)
+	fs            *Fs       // what this object is part of
+	remote        string    // The remote path
+	hasMetaData   bool      // whether info below has been set
+	isOneNoteFile bool      // Whether the object is a OneNote file
+	size          int64     // size of the object
+	modTime       time.Time // modification time of the object
+	id            string    // ID of the object
+	sha1          string    // SHA-1 of the object content
+	quickxorhash  string    // QuickXorHash of the object content
+	mimeType      string    // Content-Type of object from server (may not be as uploaded)
 }
 
 // ------------------------------------------------------------
@@ -352,6 +370,25 @@ func errorHandler(resp *http.Response) error {
 	return errResponse
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	const minChunkSize = fs.Byte
+	if cs%chunkSizeMultiple != 0 {
+		return errors.Errorf("%s is not a multiple of %s", cs, chunkSizeMultiple)
+	}
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+	}
+	return
+}
+
 // NewFs constructs an Fs from the path, container:path
 func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	// Parse config into Options struct
@@ -360,8 +397,10 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		return nil, err
 	}
-	if opt.ChunkSize%(320*1024) != 0 {
-		return nil, errors.Errorf("chunk size %d is not a multiple of 320k", opt.ChunkSize)
+
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "onedrive: chunk size")
 	}
 
 	if opt.DriveID == "" || opt.DriveType == "" {
@@ -409,16 +448,16 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		// Assume it is a file
 		newRoot, remote := dircache.SplitPath(root)
-		newF := *f
-		newF.dirCache = dircache.New(newRoot, rootInfo.ID, &newF)
-		newF.root = newRoot
+		tempF := *f
+		tempF.dirCache = dircache.New(newRoot, rootInfo.ID, &tempF)
+		tempF.root = newRoot
 		// Make new Fs which is the parent
-		err = newF.dirCache.FindRoot(false)
+		err = tempF.dirCache.FindRoot(false)
 		if err != nil {
 			// No root so return old f
 			return f, nil
 		}
-		_, err := newF.newObjectWithInfo(remote, nil)
+		_, err := tempF.newObjectWithInfo(remote, nil)
 		if err != nil {
 			if err == fs.ErrorObjectNotFound {
 				// File doesn't exist so return old f
@@ -426,8 +465,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 			}
 			return nil, err
 		}
+		// XXX: update the old f here instead of returning tempF, since
+		// `features` were already filled with functions having *f as a receiver.
+		// See https://github.com/ncw/rclone/issues/2182
+		f.dirCache = tempF.dirCache
+		f.root = tempF.root
 		// return an error with an fs which points to the parent
-		return &newF, fs.ErrorIsFile
+		return f, fs.ErrorIsFile
 	}
 	return f, nil
 }
@@ -488,6 +532,9 @@ func (f *Fs) FindLeaf(pathID, leaf string) (pathIDOut string, found bool, err er
 		}
 		return "", false, err
 	}
+	if info.GetPackageType() == api.PackageTypeOneNote {
+		return "", false, errors.New("found OneNote file when looking for folder")
+	}
 	if info.GetFolder() == nil {
 		return "", false, errors.New("found file when looking for folder")
 	}
@@ -596,6 +643,11 @@ func (f *Fs) List(dir string) (entries fs.DirEntries, err error) {
 	}
 	var iErr error
 	_, err = f.listAll(directoryID, false, false, func(info *api.Item) bool {
+		if !f.opt.ExposeOneNoteFiles && info.GetPackageType() == api.PackageTypeOneNote {
+			fs.Debugf(info.Name, "OneNote file not shown in directory listing")
+			return false
+		}
+
 		remote := path.Join(dir, info.GetName())
 		folder := info.GetFolder()
 		if folder != nil {
@@ -1064,6 +1116,32 @@ func (f *Fs) Hashes() hash.Set {
 	return hash.Set(hash.QuickXorHash)
 }
 
+// PublicLink returns a link for downloading without accout.
+func (f *Fs) PublicLink(remote string) (link string, err error) {
+	info, _, err := f.readMetaDataForPath(f.srvPath(remote))
+	if err != nil {
+		return "", err
+	}
+	opts := newOptsCall(info.ID, "POST", "/createLink")
+
+	share := api.CreateShareLinkRequest{
+		Type:  "view",
+		Scope: "anonymous",
+	}
+
+	var resp *http.Response
+	var result api.CreateShareLinkResponse
+	err = f.pacer.Call(func() (bool, error) {
+		resp, err = f.srv.CallJSON(&opts, &share, &result)
+		return shouldRetry(resp, err)
+	})
+	if err != nil {
+		fmt.Println(err)
+		return "", err
+	}
+	return result.Link.WebURL, nil
+}
+
 // ------------------------------------------------------------
 
 // Fs returns the parent Fs
@@ -1084,9 +1162,14 @@ func (o *Object) Remote() string {
 	return o.remote
 }
 
+// srvPath returns a path for use in server given a remote
+func (f *Fs) srvPath(remote string) string {
+	return replaceReservedChars(f.rootSlash() + remote)
+}
+
 // srvPath returns a path for use in server
 func (o *Object) srvPath() string {
-	return replaceReservedChars(o.fs.rootSlash() + o.remote)
+	return o.fs.srvPath(o.remote)
 }
 
 // Hash returns the SHA-1 of an object returning a lowercase hex string
@@ -1121,6 +1204,8 @@ func (o *Object) setMetaData(info *api.Item) (err error) {
 	o.hasMetaData = true
 	o.size = info.GetSize()
 
+	o.isOneNoteFile = info.GetPackageType() == api.PackageTypeOneNote
+
 	// Docs: https://docs.microsoft.com/en-us/onedrive/developer/rest-api/resources/hashes
 	//
 	// We use SHA1 for onedrive personal and QuickXorHash for onedrive for business
@@ -1232,6 +1317,10 @@ func (o *Object) Open(options ...fs.OpenOption) (in io.ReadCloser, err error) {
 	if o.id == "" {
 		return nil, errors.New("can't download - no id")
 	}
+	if o.isOneNoteFile {
+		return nil, errors.New("can't open a OneNote file")
+	}
+
 	fs.FixRangeOption(options, o.size)
 	var resp *http.Response
 	opts := newOptsCall(o.id, "GET", "/content")
@@ -1275,6 +1364,12 @@ func (o *Object) createUploadSession(modTime time.Time) (response *api.CreateUpl
 	var resp *http.Response
 	err = o.fs.pacer.Call(func() (bool, error) {
 		resp, err = o.fs.srv.CallJSON(&opts, &createRequest, &response)
+		if apiErr, ok := err.(*api.Error); ok {
+			if apiErr.ErrorInfo.Code == "nameAlreadyExists" {
+				// Make the error more user-friendly
+				err = errors.New(err.Error() + " (is it a OneNote file?)")
+			}
+		}
 		return shouldRetry(resp, err)
 	})
 	return response, err
@@ -1407,6 +1502,12 @@ func (o *Object) uploadSinglepart(in io.Reader, size int64, modTime time.Time) (
 
 	err = o.fs.pacer.Call(func() (bool, error) {
 		resp, err = o.fs.srv.CallJSON(&opts, nil, &info)
+		if apiErr, ok := err.(*api.Error); ok {
+			if apiErr.ErrorInfo.Code == "nameAlreadyExists" {
+				// Make the error more user-friendly
+				err = errors.New(err.Error() + " (is it a OneNote file?)")
+			}
+		}
 		return shouldRetry(resp, err)
 	})
 	if err != nil {
@@ -1425,6 +1526,10 @@ func (o *Object) uploadSinglepart(in io.Reader, size int64, modTime time.Time) (
 //
 // The new object may have been created if an error is returned
 func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOption) (err error) {
+	if o.hasMetaData && o.isOneNoteFile {
+		return errors.New("can't upload content to a OneNote file")
+	}
+
 	o.fs.tokenRenewer.Start()
 	defer o.fs.tokenRenewer.Stop()
 
@@ -1494,6 +1599,7 @@ var (
 	_ fs.DirMover        = (*Fs)(nil)
 	_ fs.DirCacheFlusher = (*Fs)(nil)
 	_ fs.Abouter         = (*Fs)(nil)
+	_ fs.PublicLinker    = (*Fs)(nil)
 	_ fs.Object          = (*Object)(nil)
 	_ fs.MimeTyper       = &Object{}
 	_ fs.IDer            = &Object{}

backend/onedrive/onedrive_test.go

@@ -1,10 +1,10 @@
 // Test OneDrive filesystem interface
-package onedrive_test
+package onedrive
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/onedrive"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,15 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestOneDrive:",
-		NilObject:  (*onedrive.Object)(nil),
+		NilObject:  (*Object)(nil),
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			CeilChunkSize: fstests.NextMultipleOf(chunkSizeMultiple),
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+var _ fstests.SetUploadChunkSizer = (*Fs)(nil)

backend/opendrive/opendrive.go

@@ -177,17 +177,17 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		// Assume it is a file
 		newRoot, remote := dircache.SplitPath(root)
-		newF := *f
-		newF.dirCache = dircache.New(newRoot, "0", &newF)
-		newF.root = newRoot
+		tempF := *f
+		tempF.dirCache = dircache.New(newRoot, "0", &tempF)
+		tempF.root = newRoot
 
 		// Make new Fs which is the parent
-		err = newF.dirCache.FindRoot(false)
+		err = tempF.dirCache.FindRoot(false)
 		if err != nil {
 			// No root so return old f
 			return f, nil
 		}
-		_, err := newF.newObjectWithInfo(remote, nil)
+		_, err := tempF.newObjectWithInfo(remote, nil)
 		if err != nil {
 			if err == fs.ErrorObjectNotFound {
 				// File doesn't exist so return old f
@@ -195,8 +195,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 			}
 			return nil, err
 		}
+		// XXX: update the old f here instead of returning tempF, since
+		// `features` were already filled with functions having *f as a receiver.
+		// See https://github.com/ncw/rclone/issues/2182
+		f.dirCache = tempF.dirCache
+		f.root = tempF.root
 		// return an error with an fs which points to the parent
-		return &newF, fs.ErrorIsFile
+		return f, fs.ErrorIsFile
 	}
 	return f, nil
 }

backend/pcloud/pcloud.go

@@ -276,16 +276,16 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		// Assume it is a file
 		newRoot, remote := dircache.SplitPath(root)
-		newF := *f
-		newF.dirCache = dircache.New(newRoot, rootID, &newF)
-		newF.root = newRoot
+		tempF := *f
+		tempF.dirCache = dircache.New(newRoot, rootID, &tempF)
+		tempF.root = newRoot
 		// Make new Fs which is the parent
-		err = newF.dirCache.FindRoot(false)
+		err = tempF.dirCache.FindRoot(false)
 		if err != nil {
 			// No root so return old f
 			return f, nil
 		}
-		_, err := newF.newObjectWithInfo(remote, nil)
+		_, err := tempF.newObjectWithInfo(remote, nil)
 		if err != nil {
 			if err == fs.ErrorObjectNotFound {
 				// File doesn't exist so return old f
@@ -293,8 +293,13 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 			}
 			return nil, err
 		}
+		// XXX: update the old f here instead of returning tempF, since
+		// `features` were already filled with functions having *f as a receiver.
+		// See https://github.com/ncw/rclone/issues/2182
+		f.dirCache = tempF.dirCache
+		f.root = tempF.root
 		// return an error with an fs which points to the parent
-		return &newF, fs.ErrorIsFile
+		return f, fs.ErrorIsFile
 	}
 	return f, nil
 }

backend/s3/s3.go

@@ -517,7 +517,7 @@ func init() {
 			}},
 		}, {
 			Name:     "storage_class",
-			Help:     "The storage class to use when storing objects in S3.",
+			Help:     "The storage class to use when storing new objects in S3.",
 			Provider: "AWS",
 			Examples: []fs.OptionExample{{
 				Value: "",
@@ -536,9 +536,18 @@ func init() {
 				Help:  "One Zone Infrequent Access storage class",
 			}},
 		}, {
-			Name:     "chunk_size",
-			Help:     "Chunk size to use for uploading",
-			Default:  fs.SizeSuffix(s3manager.MinUploadPartSize),
+			Name: "chunk_size",
+			Help: `Chunk size to use for uploading.
+
+Any files larger than this will be uploaded in chunks of this
+size. The default is 5MB. The minimum is 5MB.
+
+Note that "--s3-upload-concurrency" chunks of this size are buffered
+in memory per transfer.
+
+If you are transferring large files over high speed links and you have
+enough memory, then increasing this will speed up the transfers.`,
+			Default:  minChunkSize,
 			Advanced: true,
 		}, {
 			Name:     "disable_checksum",
@@ -548,18 +557,41 @@ func init() {
 		}, {
 			Name:     "session_token",
 			Help:     "An AWS session token",
-			Hide:     fs.OptionHideBoth,
 			Advanced: true,
 		}, {
-			Name:     "upload_concurrency",
-			Help:     "Concurrency for multipart uploads.",
+			Name: "upload_concurrency",
+			Help: `Concurrency for multipart uploads.
+
+This is the number of chunks of the same file that are uploaded
+concurrently.
+
+If you are uploading small numbers of large file over high speed link
+and these uploads do not fully utilize your bandwidth, then increasing
+this may help to speed up the transfers.`,
 			Default:  2,
 			Advanced: true,
 		}, {
-			Name:     "force_path_style",
-			Help:     "If true use path style access if false use virtual hosted style.\nSome providers (eg Aliyun OSS or Netease COS) require this.",
+			Name: "force_path_style",
+			Help: `If true use path style access if false use virtual hosted style.
+
+If this is true (the default) then rclone will use path style access,
+if false then rclone will use virtual path style. See [the AWS S3
+docs](https://docs.aws.amazon.com/AmazonS3/latest/dev/UsingBucket.html#access-bucket-intro)
+for more info.
+
+Some providers (eg Aliyun OSS or Netease COS) require this set to false.`,
 			Default:  true,
 			Advanced: true,
+		}, {
+			Name: "v2_auth",
+			Help: `If true use v2 authentication.
+
+If this is false (the default) then rclone will use v4 authentication.
+If it is set then rclone will use v2 authentication.
+
+Use this only if v4 signatures don't work, eg pre Jewel/v10 CEPH.`,
+			Default:  false,
+			Advanced: true,
 		}},
 	})
 }
@@ -572,7 +604,8 @@ const (
 	maxRetries     = 10                            // number of retries to make of operations
 	maxSizeForCopy = 5 * 1024 * 1024 * 1024        // The maximum size of object we can COPY
 	maxFileSize    = 5 * 1024 * 1024 * 1024 * 1024 // largest possible upload file size
-	minSleep       = 10 * time.Millisecond         // In case of error, start at 10ms sleep.
+	minChunkSize   = fs.SizeSuffix(s3manager.MinUploadPartSize)
+	minSleep       = 10 * time.Millisecond // In case of error, start at 10ms sleep.
 )
 
 // Options defines the configuration for this backend
@@ -593,6 +626,7 @@ type Options struct {
 	SessionToken         string        `config:"session_token"`
 	UploadConcurrency    int           `config:"upload_concurrency"`
 	ForcePathStyle       bool          `config:"force_path_style"`
+	V2Auth               bool          `config:"v2_auth"`
 }
 
 // Fs represents a remote s3 server
@@ -767,7 +801,7 @@ func s3Connection(opt *Options) (*s3.S3, *session.Session, error) {
 	// awsConfig.WithLogLevel(aws.LogDebugWithSigning)
 	ses := session.New()
 	c := s3.New(ses, awsConfig)
-	if opt.Region == "other-v2-signature" {
+	if opt.V2Auth || opt.Region == "other-v2-signature" {
 		fs.Debugf(nil, "Using v2 auth")
 		signer := func(req *request.Request) {
 			// Ignore AnonymousCredentials object
@@ -783,6 +817,21 @@ func s3Connection(opt *Options) (*s3.S3, *session.Session, error) {
 	return c, ses, nil
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+	}
+	return
+}
+
 // NewFs constructs an Fs from the path, bucket:path
 func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	// Parse config into Options struct
@@ -791,8 +840,9 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		return nil, err
 	}
-	if opt.ChunkSize < fs.SizeSuffix(s3manager.MinUploadPartSize) {
-		return nil, errors.Errorf("s3 chunk size (%v) must be >= %v", opt.ChunkSize, fs.SizeSuffix(s3manager.MinUploadPartSize))
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "s3: chunk size")
 	}
 	bucket, directory, err := s3ParsePath(root)
 	if err != nil {
@@ -1240,6 +1290,15 @@ func (f *Fs) Copy(src fs.Object, remote string) (fs.Object, error) {
 		CopySource:        &source,
 		MetadataDirective: aws.String(s3.MetadataDirectiveCopy),
 	}
+	if f.opt.ServerSideEncryption != "" {
+		req.ServerSideEncryption = &f.opt.ServerSideEncryption
+	}
+	if f.opt.SSEKMSKeyID != "" {
+		req.SSEKMSKeyId = &f.opt.SSEKMSKeyID
+	}
+	if f.opt.StorageClass != "" {
+		req.StorageClass = &f.opt.StorageClass
+	}
 	err = f.pacer.Call(func() (bool, error) {
 		_, err = f.c.CopyObject(&req)
 		return shouldRetry(err)
@@ -1409,6 +1468,15 @@ func (o *Object) SetModTime(modTime time.Time) error {
 		Metadata:          o.meta,
 		MetadataDirective: &directive,
 	}
+	if o.fs.opt.ServerSideEncryption != "" {
+		req.ServerSideEncryption = &o.fs.opt.ServerSideEncryption
+	}
+	if o.fs.opt.SSEKMSKeyID != "" {
+		req.SSEKMSKeyId = &o.fs.opt.SSEKMSKeyID
+	}
+	if o.fs.opt.StorageClass != "" {
+		req.StorageClass = &o.fs.opt.StorageClass
+	}
 	err = o.fs.pacer.Call(func() (bool, error) {
 		_, err := o.fs.c.CopyObject(&req)
 		return shouldRetry(err)

backend/s3/s3_test.go

@@ -1,10 +1,10 @@
 // Test S3 filesystem interface
-package s3_test
+package s3
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/s3"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,15 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestS3:",
-		NilObject:  (*s3.Object)(nil),
+		NilObject:  (*Object)(nil),
+		ChunkedUpload: fstests.ChunkedUploadConfig{
+			MinChunkSize: minChunkSize,
+		},
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+var _ fstests.SetUploadChunkSizer = (*Fs)(nil)

backend/s3/v2sign.go

@@ -44,16 +44,7 @@ func sign(AccessKey, SecretKey string, req *http.Request) {
 	req.Header.Set("Date", date)
 
 	// Sort out URI
-	uri := req.URL.Opaque
-	if uri != "" {
-		if strings.HasPrefix(uri, "//") {
-			// Strip off //host/uri
-			uri = "/" + strings.Join(strings.Split(uri, "/")[3:], "/")
-			req.URL.Opaque = uri // reset to plain URI otherwise Ceph gets confused
-		}
-	} else {
-		uri = req.URL.Path
-	}
+	uri := req.URL.EscapedPath()
 	if uri == "" {
 		uri = "/"
 	}

backend/sftp/sftp.go

@@ -90,9 +90,20 @@ func init() {
 			Help:     "Allow asking for SFTP password when needed.",
 			Advanced: true,
 		}, {
-			Name:     "path_override",
-			Default:  "",
-			Help:     "Override path used by SSH connection.",
+			Name:    "path_override",
+			Default: "",
+			Help: `Override path used by SSH connection.
+
+This allows checksum calculation when SFTP and SSH paths are
+different. This issue affects among others Synology NAS boxes.
+
+Shared folders can be found in directories representing volumes
+
+    rclone sync /home/local/directory remote:/directory --ssh-path-override /volume2/directory
+
+Home directory can be found in a shared folder called "home"
+
+    rclone sync /home/local/directory remote:/home/directory --ssh-path-override /volume1/homes/USER/directory`,
 			Advanced: true,
 		}, {
 			Name:     "set_modtime",

backend/swift/swift.go

@@ -29,13 +29,17 @@ import (
 const (
 	directoryMarkerContentType = "application/directory" // content type of directory marker objects
 	listChunks                 = 1000                    // chunk size to read directory listings
+	defaultChunkSize           = 5 * fs.GibiByte
 )
 
 // SharedOptions are shared between swift and hubic
 var SharedOptions = []fs.Option{{
-	Name:     "chunk_size",
-	Help:     "Above this size files will be chunked into a _segments container.",
-	Default:  fs.SizeSuffix(5 * 1024 * 1024 * 1024),
+	Name: "chunk_size",
+	Help: `Above this size files will be chunked into a _segments container.
+
+Above this size files will be chunked into a _segments container.  The
+default for this is 5GB which is its maximum value.`,
+	Default:  defaultChunkSize,
 	Advanced: true,
 }}
 
@@ -129,8 +133,13 @@ func init() {
 				Value: "admin",
 			}},
 		}, {
-			Name:    "storage_policy",
-			Help:    "The storage policy to use when creating a new container",
+			Name: "storage_policy",
+			Help: `The storage policy to use when creating a new container
+
+This applies the specified storage policy when creating a new
+container. The policy cannot be changed afterwards. The allowed
+configuration values and their meaning depend on your Swift storage
+provider.`,
 			Default: "",
 			Examples: []fs.OptionExample{{
 				Help:  "Default",
@@ -294,6 +303,22 @@ func swiftConnection(opt *Options, name string) (*swift.Connection, error) {
 	return c, nil
 }
 
+func checkUploadChunkSize(cs fs.SizeSuffix) error {
+	const minChunkSize = fs.Byte
+	if cs < minChunkSize {
+		return errors.Errorf("%s is less than %s", cs, minChunkSize)
+	}
+	return nil
+}
+
+func (f *Fs) setUploadChunkSize(cs fs.SizeSuffix) (old fs.SizeSuffix, err error) {
+	err = checkUploadChunkSize(cs)
+	if err == nil {
+		old, f.opt.ChunkSize = f.opt.ChunkSize, cs
+	}
+	return
+}
+
 // NewFsWithConnection constructs an Fs from the path, container:path
 // and authenticated connection.
 //
@@ -344,6 +369,10 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 	if err != nil {
 		return nil, err
 	}
+	err = checkUploadChunkSize(opt.ChunkSize)
+	if err != nil {
+		return nil, errors.Wrap(err, "swift: chunk size")
+	}
 
 	c, err := swiftConnection(opt, name)
 	if err != nil {

backend/swift/swift_test.go

@@ -1,10 +1,10 @@
 // Test Swift filesystem interface
-package swift_test
+package swift
 
 import (
 	"testing"
 
-	"github.com/ncw/rclone/backend/swift"
+	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest/fstests"
 )
 
@@ -12,6 +12,12 @@ import (
 func TestIntegration(t *testing.T) {
 	fstests.Run(t, &fstests.Opt{
 		RemoteName: "TestSwift:",
-		NilObject:  (*swift.Object)(nil),
+		NilObject:  (*Object)(nil),
 	})
 }
+
+func (f *Fs) SetUploadChunkSize(cs fs.SizeSuffix) (fs.SizeSuffix, error) {
+	return f.setUploadChunkSize(cs)
+}
+
+var _ fstests.SetUploadChunkSizer = (*Fs)(nil)

backend/union/union.go

@@ -19,7 +19,7 @@ import (
 func init() {
 	fsi := &fs.RegInfo{
 		Name:        "union",
-		Description: "Builds a stackable unification remote, which can appear to merge the contents of several remotes",
+		Description: "A stackable unification remote, which can appear to merge the contents of several remotes",
 		NewFs:       NewFs,
 		Options: []fs.Option{{
 			Name:     "remotes",
@@ -35,13 +35,36 @@ type Options struct {
 	Remotes fs.SpaceSepList `config:"remotes"`
 }
 
-// Fs represents a remote acd server
+// Fs represents a union of remotes
 type Fs struct {
 	name     string       // name of this remote
 	features *fs.Features // optional features
 	opt      Options      // options for this Fs
 	root     string       // the path we are working on
 	remotes  []fs.Fs      // slice of remotes
+	wr       fs.Fs        // writable remote
+	hashSet  hash.Set     // intersection of hash types
+}
+
+// Object describes a union Object
+//
+// This is a wrapped object which returns the Union Fs as its parent
+type Object struct {
+	fs.Object
+	fs *Fs // what this object is part of
+}
+
+// Wrap an existing object in the union Object
+func (f *Fs) wrapObject(o fs.Object) *Object {
+	return &Object{
+		Object: o,
+		fs:     f,
+	}
+}
+
+// Fs returns the union Fs as the parent
+func (o *Object) Fs() fs.Info {
+	return o.fs
 }
 
 // Name of the remote (as passed into NewFs)
@@ -66,18 +89,146 @@ func (f *Fs) Features() *fs.Features {
 
 // Rmdir removes the root directory of the Fs object
 func (f *Fs) Rmdir(dir string) error {
-	return f.remotes[len(f.remotes)-1].Rmdir(dir)
+	return f.wr.Rmdir(dir)
 }
 
 // Hashes returns hash.HashNone to indicate remote hashing is unavailable
 func (f *Fs) Hashes() hash.Set {
-	// This could probably be set if all remotes share the same hashing algorithm
-	return hash.Set(hash.None)
+	return f.hashSet
 }
 
 // Mkdir makes the root directory of the Fs object
 func (f *Fs) Mkdir(dir string) error {
-	return f.remotes[len(f.remotes)-1].Mkdir(dir)
+	return f.wr.Mkdir(dir)
+}
+
+// Purge all files in the root and the root directory
+//
+// Implement this if you have a way of deleting all the files
+// quicker than just running Remove() on the result of List()
+//
+// Return an error if it doesn't exist
+func (f *Fs) Purge() error {
+	return f.wr.Features().Purge()
+}
+
+// Copy src to this remote using server side copy operations.
+//
+// This is stored with the remote path given
+//
+// It returns the destination Object and a possible error
+//
+// Will only be called if src.Fs().Name() == f.Name()
+//
+// If it isn't possible then return fs.ErrorCantCopy
+func (f *Fs) Copy(src fs.Object, remote string) (fs.Object, error) {
+	if src.Fs() != f.wr {
+		fs.Debugf(src, "Can't copy - not same remote type")
+		return nil, fs.ErrorCantCopy
+	}
+	o, err := f.wr.Features().Copy(src, remote)
+	if err != nil {
+		return nil, err
+	}
+	return f.wrapObject(o), nil
+}
+
+// Move src to this remote using server side move operations.
+//
+// This is stored with the remote path given
+//
+// It returns the destination Object and a possible error
+//
+// Will only be called if src.Fs().Name() == f.Name()
+//
+// If it isn't possible then return fs.ErrorCantMove
+func (f *Fs) Move(src fs.Object, remote string) (fs.Object, error) {
+	if src.Fs() != f.wr {
+		fs.Debugf(src, "Can't move - not same remote type")
+		return nil, fs.ErrorCantMove
+	}
+	o, err := f.wr.Features().Move(src, remote)
+	if err != nil {
+		return nil, err
+	}
+	return f.wrapObject(o), err
+}
+
+// DirMove moves src, srcRemote to this remote at dstRemote
+// using server side move operations.
+//
+// Will only be called if src.Fs().Name() == f.Name()
+//
+// If it isn't possible then return fs.ErrorCantDirMove
+//
+// If destination exists then return fs.ErrorDirExists
+func (f *Fs) DirMove(src fs.Fs, srcRemote, dstRemote string) error {
+	srcFs, ok := src.(*Fs)
+	if !ok {
+		fs.Debugf(srcFs, "Can't move directory - not same remote type")
+		return fs.ErrorCantDirMove
+	}
+	return f.wr.Features().DirMove(srcFs.wr, srcRemote, dstRemote)
+}
+
+// ChangeNotify calls the passed function with a path
+// that has had changes. If the implementation
+// uses polling, it should adhere to the given interval.
+// At least one value will be written to the channel,
+// specifying the initial value and updated values might
+// follow. A 0 Duration should pause the polling.
+// The ChangeNotify implemantion must empty the channel
+// regulary. When the channel gets closed, the implemantion
+// should stop polling and release resources.
+func (f *Fs) ChangeNotify(fn func(string, fs.EntryType), ch <-chan time.Duration) {
+	var remoteChans []chan time.Duration
+
+	for _, remote := range f.remotes {
+		if ChangeNotify := remote.Features().ChangeNotify; ChangeNotify != nil {
+			ch := make(chan time.Duration)
+			remoteChans = append(remoteChans, ch)
+			ChangeNotify(fn, ch)
+		}
+	}
+
+	go func() {
+		for i := range ch {
+			for _, c := range remoteChans {
+				c <- i
+			}
+		}
+		for _, c := range remoteChans {
+			close(c)
+		}
+	}()
+}
+
+// DirCacheFlush resets the directory cache - used in testing
+// as an optional interface
+func (f *Fs) DirCacheFlush() {
+	for _, remote := range f.remotes {
+		if DirCacheFlush := remote.Features().DirCacheFlush; DirCacheFlush != nil {
+			DirCacheFlush()
+		}
+	}
+}
+
+// PutStream uploads to the remote path with the modTime given of indeterminate size
+//
+// May create the object even if it returns an error - if so
+// will return the object and the error, otherwise will return
+// nil and the error
+func (f *Fs) PutStream(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOption) (fs.Object, error) {
+	o, err := f.wr.Features().PutStream(in, src, options...)
+	if err != nil {
+		return nil, err
+	}
+	return f.wrapObject(o), err
+}
+
+// About gets quota information from the Fs
+func (f *Fs) About() (*fs.Usage, error) {
+	return f.wr.Features().About()
 }
 
 // Put in to the remote path with the modTime given of the given size
@@ -86,7 +237,11 @@ func (f *Fs) Mkdir(dir string) error {
 // will return the object and the error, otherwise will return
 // nil and the error
 func (f *Fs) Put(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOption) (fs.Object, error) {
-	return f.remotes[len(f.remotes)-1].Put(in, src, options...)
+	o, err := f.wr.Put(in, src, options...)
+	if err != nil {
+		return nil, err
+	}
+	return f.wrapObject(o), err
 }
 
 // List the objects and directories in dir into entries.  The
@@ -117,8 +272,11 @@ func (f *Fs) List(dir string) (entries fs.DirEntries, err error) {
 	if !found {
 		return nil, fs.ErrorDirNotFound
 	}
-	for key := range set {
-		entries = append(entries, set[key])
+	for _, entry := range set {
+		if o, ok := entry.(fs.Object); ok {
+			entry = f.wrapObject(o)
+		}
+		entries = append(entries, entry)
 	}
 	return entries, nil
 }
@@ -134,7 +292,7 @@ func (f *Fs) NewObject(path string) (fs.Object, error) {
 		if err != nil {
 			return nil, errors.Wrapf(err, "NewObject failed on %v", remote)
 		}
-		return obj, nil
+		return f.wrapObject(obj), nil
 	}
 	return nil, fs.ErrorObjectNotFound
 }
@@ -204,6 +362,7 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		root:    root,
 		opt:     *opt,
 		remotes: remotes,
+		wr:      remotes[len(remotes)-1],
 	}
 	var features = (&fs.Features{
 		CaseInsensitive:         true,
@@ -212,16 +371,53 @@ func NewFs(name, root string, m configmap.Mapper) (fs.Fs, error) {
 		WriteMimeType:           true,
 		CanHaveEmptyDirectories: true,
 		BucketBased:             true,
+		SetTier:                 true,
+		GetTier:                 true,
 	}).Fill(f)
+	features = features.Mask(f.wr) // mask the features just on the writable fs
+
+	// FIXME maybe should be masking the bools here?
+
+	// Clear ChangeNotify and DirCacheFlush if all are nil
+	clearChangeNotify := true
+	clearDirCacheFlush := true
 	for _, remote := range f.remotes {
-		features = features.Mask(remote)
+		remoteFeatures := remote.Features()
+		if remoteFeatures.ChangeNotify != nil {
+			clearChangeNotify = false
+		}
+		if remoteFeatures.DirCacheFlush != nil {
+			clearDirCacheFlush = false
+		}
 	}
+	if clearChangeNotify {
+		features.ChangeNotify = nil
+	}
+	if clearDirCacheFlush {
+		features.DirCacheFlush = nil
+	}
+
 	f.features = features
 
+	// Get common intersection of hashes
+	hashSet := f.remotes[0].Hashes()
+	for _, remote := range f.remotes[1:] {
+		hashSet = hashSet.Overlap(remote.Hashes())
+	}
+	f.hashSet = hashSet
+
 	return f, nil
 }
 
 // Check the interfaces are satisfied
 var (
-	_ fs.Fs = &Fs{}
+	_ fs.Fs              = (*Fs)(nil)
+	_ fs.Purger          = (*Fs)(nil)
+	_ fs.PutStreamer     = (*Fs)(nil)
+	_ fs.Copier          = (*Fs)(nil)
+	_ fs.Mover           = (*Fs)(nil)
+	_ fs.DirMover        = (*Fs)(nil)
+	_ fs.DirCacheFlusher = (*Fs)(nil)
+	_ fs.ChangeNotifier  = (*Fs)(nil)
+	_ fs.Abouter         = (*Fs)(nil)
 )

backend/webdav/api/types.go

@@ -155,6 +155,12 @@ func (t *Time) UnmarshalXML(d *xml.Decoder, start xml.StartElement) error {
 		return err
 	}
 
+	// If time is missing then return the epoch
+	if v == "" {
+		*t = Time(time.Unix(0, 0))
+		return nil
+	}
+
 	// Parse the time format in multiple possible ways
 	var newT time.Time
 	for _, timeFormat := range timeFormats {

backend/webdav/webdav.go

@@ -979,6 +979,12 @@ func (o *Object) Update(in io.Reader, src fs.ObjectInfo, options ...fs.OpenOptio
 		return shouldRetry(resp, err)
 	})
 	if err != nil {
+		// Give the WebDAV server a chance to get its internal state in order after the
+		// error.  The error may have been local in which case we closed the connection.
+		// The server may still be dealing with it for a moment. A sleep isn't ideal but I
+		// haven't been able to think of a better method to find out if the server has
+		// finished - ncw
+		time.Sleep(1 * time.Second)
 		// Remove failed upload
 		_ = o.Remove()
 		return err

backend/yandex/api/client.go

@@ -67,10 +67,8 @@ var defaultErrorHandler ErrorHandler = func(resp *http.Response) error {
 func (HTTPRequest *HTTPRequest) run(client *Client) ([]byte, error) {
 	var err error
 	values := make(url.Values)
-	if HTTPRequest.Parameters != nil {
-		for k, v := range HTTPRequest.Parameters {
-			values.Set(k, fmt.Sprintf("%v", v))
-		}
+	for k, v := range HTTPRequest.Parameters {
+		values.Set(k, fmt.Sprintf("%v", v))
 	}
 
 	var req *http.Request

bin/bisect-go-rclone.sh

@@ -9,7 +9,7 @@ set -e
 
 # Compile the go version
 cd src
-./make.bash
+./make.bash || exit 125
 
 # Make sure we are using it
 source ~/bin/use-go1.11

bin/bisect-rclone.sh

@@ -1,15 +1,33 @@
 #!/bin/bash
 
-# Example script for git-bisect -run
+# Example script for git bisect run
+#
+# Copy this file into /tmp say before running as it will be
+# overwritten by the bisect as it is checked in.
+#
+# Change the test below to find out whether rclone is working or not
+#
 # Run from the project root
+#
+# git bisect start
+# git checkout master
+# git bisect bad
+# git checkout v1.41 (or whatever is the first good one)
+# git bisect good
+# git bisect run /tmp/bisect-rclone.sh
 
 set -e
 
-# Compile
-make
+# Compile notifying git on compile failure
+make || exit 125
 rclone version
 
-# Test whatever it is that is going wrong
-truncate -s 10M /tmp/10M
-rclone delete azure:rclone-test1/10M || true
-rclone --retries 1 copyto -vv /tmp/10M azure:rclone-test1/10M --azureblob-upload-cutoff 1M
+# Test whatever it is that is going wrong - exit with non zero exit code on failure
+# commented out examples follow
+
+# truncate -s 10M /tmp/10M
+# rclone delete azure:rclone-test1/10M || true
+# rclone --retries 1 copyto -vv /tmp/10M azure:rclone-test1/10M --azureblob-upload-cutoff 1M
+
+# rm -f "/tmp/tests's.docx" || true
+# rclone -vv --retries 1 copy "drive:test/tests's.docx" /tmp

bin/make_backend_docs.py

@@ -0,0 +1,60 @@
+#!/usr/bin/env python
+"""
+Make backend documentation
+"""
+
+import os
+import subprocess
+
+marker = "<!--- autogenerated options"
+start = marker + " start"
+stop = marker + " stop"
+
+def find_backends():
+    """Return a list of all backends"""
+    return [ x for x in os.listdir("backend") if x not in ("all",) ]
+
+def output_docs(backend, out):
+    """Output documentation for backend options to out"""
+    out.flush()
+    subprocess.check_call(["rclone", "help", "backend", backend], stdout=out)
+
+def alter_doc(backend):
+    """Alter the documentation for backend"""
+    doc_file = "docs/content/"+backend+".md"
+    if not os.path.exists(doc_file):
+        raise ValueError("Didn't find doc file %s" % (doc_file,))
+    new_file = doc_file+"~new~"
+    altered = False
+    with open(doc_file, "r") as in_file, open(new_file, "w") as out_file:
+        in_docs = False
+        for line in in_file:
+            if not in_docs:
+                if start in line:
+                    in_docs = True
+                    start_full = start + " - DO NOT EDIT, instead edit fs.RegInfo in backend/%s/%s.go then run make backenddocs -->\n" % (backend, backend)
+                    out_file.write(start_full)
+                    output_docs(backend, out_file)
+                    out_file.write(stop+" -->\n")
+                    altered = True
+            if not in_docs:
+                out_file.write(line)
+            if in_docs:
+                if stop in line:
+                    in_docs = False
+    os.rename(doc_file, doc_file+"~")
+    os.rename(new_file, doc_file)
+    if not altered:
+        raise ValueError("Didn't find '%s' markers for in %s" % (start, doc_file))
+
+if __name__ == "__main__":
+    failed, success = 0, 0
+    for backend in find_backends():
+        try:
+            alter_doc(backend)
+        except Exception, e:
+            print "Failed adding docs for %s backend: %s" % (backend, e)
+            failed += 1
+        else:
+            success += 1
+    print "Added docs for %d backends with %d failures" % (success, failed)

bin/make_changelog.py

@@ -165,7 +165,7 @@ def main():
 %s
 * Bug Fixes
 %s
-%s""" % (version, datetime.date.today(), "\n".join(new_features_lines), "\n".join(bugfix_lines), "\n".join(backend_lines)))
+%s""" % (next_version, datetime.date.today(), "\n".join(new_features_lines), "\n".join(bugfix_lines), "\n".join(backend_lines)))
     sys.stdout.write(old_tail)
                 
 

cmd/cmd.go

@@ -17,12 +17,9 @@ import (
 	"runtime/pprof"
 	"strconv"
 	"strings"
+	"sync"
 	"time"
 
-	"github.com/pkg/errors"
-	"github.com/spf13/cobra"
-	"github.com/spf13/pflag"
-
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fs/accounting"
 	"github.com/ncw/rclone/fs/config/configflags"
@@ -35,6 +32,9 @@ import (
 	"github.com/ncw/rclone/fs/rc"
 	"github.com/ncw/rclone/fs/rc/rcflags"
 	"github.com/ncw/rclone/lib/atexit"
+	"github.com/pkg/errors"
+	"github.com/spf13/cobra"
+	"github.com/spf13/pflag"
 )
 
 // Globals
@@ -66,81 +66,6 @@ const (
 	exitCodeTransferExceeded
 )
 
-// Root is the main rclone command
-var Root = &cobra.Command{
-	Use:   "rclone",
-	Short: "Sync files and directories to and from local and remote object stores - " + fs.Version,
-	Long: `
-Rclone is a command line program to sync files and directories to and
-from various cloud storage systems and using file transfer services, such as:
-
-  * Amazon Drive
-  * Amazon S3
-  * Backblaze B2
-  * Box
-  * Dropbox
-  * FTP
-  * Google Cloud Storage
-  * Google Drive
-  * HTTP
-  * Hubic
-  * Jottacloud
-  * Mega
-  * Microsoft Azure Blob Storage
-  * Microsoft OneDrive
-  * OpenDrive
-  * Openstack Swift / Rackspace cloud files / Memset Memstore
-  * pCloud
-  * QingStor
-  * SFTP
-  * Webdav / Owncloud / Nextcloud
-  * Yandex Disk
-  * The local filesystem
-
-Features
-
-  * MD5/SHA1 hashes checked at all times for file integrity
-  * Timestamps preserved on files
-  * Partial syncs supported on a whole file basis
-  * Copy mode to just copy new/changed files
-  * Sync (one way) mode to make a directory identical
-  * Check mode to check for file hash equality
-  * Can sync to and from network, eg two different cloud accounts
-
-See the home page for installation, usage, documentation, changelog
-and configuration walkthroughs.
-
-  * https://rclone.org/
-`,
-	PersistentPostRun: func(cmd *cobra.Command, args []string) {
-		fs.Debugf("rclone", "Version %q finishing with parameters %q", fs.Version, os.Args)
-		atexit.Run()
-	},
-}
-
-// runRoot implements the main rclone command with no subcommands
-func runRoot(cmd *cobra.Command, args []string) {
-	if version {
-		ShowVersion()
-		resolveExitCode(nil)
-	} else {
-		_ = Root.Usage()
-		_, _ = fmt.Fprintf(os.Stderr, "Command not found.\n")
-		resolveExitCode(errorCommandNotFound)
-	}
-}
-
-func init() {
-	// Add global flags
-	configflags.AddFlags(pflag.CommandLine)
-	filterflags.AddFlags(pflag.CommandLine)
-	rcflags.AddFlags(pflag.CommandLine)
-
-	Root.Run = runRoot
-	Root.Flags().BoolVarP(&version, "version", "V", false, "Print the version number")
-	cobra.OnInitialize(initConfig)
-}
-
 // ShowVersion prints the version to stdout
 func ShowVersion() {
 	fmt.Printf("rclone %s\n", fs.Version)
@@ -293,7 +218,7 @@ func ShowStats() bool {
 // Run the function with stats and retries if required
 func Run(Retry bool, showStats bool, cmd *cobra.Command, f func() error) {
 	var err error
-	var stopStats chan struct{}
+	stopStats := func() {}
 	if !showStats && ShowStats() {
 		showStats = true
 	}
@@ -331,9 +256,7 @@ func Run(Retry bool, showStats bool, cmd *cobra.Command, f func() error) {
 			time.Sleep(*retriesInterval)
 		}
 	}
-	if showStats {
-		close(stopStats)
-	}
+	stopStats()
 	if err != nil {
 		log.Printf("Failed to %s: %v", cmd.Name(), err)
 		resolveExitCode(err)
@@ -384,24 +307,31 @@ func CheckArgs(MinArgs, MaxArgs int, cmd *cobra.Command, args []string) {
 
 // StartStats prints the stats every statsInterval
 //
-// It returns a channel which should be closed to stop the stats.
-func StartStats() chan struct{} {
-	stopStats := make(chan struct{})
-	if *statsInterval > 0 {
-		go func() {
-			ticker := time.NewTicker(*statsInterval)
-			for {
-				select {
-				case <-ticker.C:
-					accounting.Stats.Log()
-				case <-stopStats:
-					ticker.Stop()
-					return
-				}
-			}
-		}()
+// It returns a func which should be called to stop the stats.
+func StartStats() func() {
+	if *statsInterval <= 0 {
+		return func() {}
+	}
+	stopStats := make(chan struct{})
+	var wg sync.WaitGroup
+	wg.Add(1)
+	go func() {
+		defer wg.Done()
+		ticker := time.NewTicker(*statsInterval)
+		for {
+			select {
+			case <-ticker.C:
+				accounting.Stats.Log()
+			case <-stopStats:
+				ticker.Stop()
+				return
+			}
+		}
+	}()
+	return func() {
+		close(stopStats)
+		wg.Wait()
 	}
-	return stopStats
 }
 
 // initConfig is run by cobra after initialising the flags
@@ -501,8 +431,11 @@ func resolveExitCode(err error) {
 	}
 }
 
+var backendFlags map[string]struct{}
+
 // AddBackendFlags creates flags for all the backend options
 func AddBackendFlags() {
+	backendFlags = map[string]struct{}{}
 	for _, fsInfo := range fs.Registry {
 		done := map[string]struct{}{}
 		for i := range fsInfo.Options {
@@ -513,10 +446,7 @@ func AddBackendFlags() {
 			}
 			done[opt.Name] = struct{}{}
 			// Make a flag from each option
-			name := strings.Replace(opt.Name, "_", "-", -1) // convert snake_case to kebab-case
-			if !opt.NoPrefix {
-				name = fsInfo.Prefix + "-" + name
-			}
+			name := opt.FlagName(fsInfo.Prefix)
 			found := pflag.CommandLine.Lookup(name) != nil
 			if !found {
 				// Take first line of help only
@@ -533,6 +463,7 @@ func AddBackendFlags() {
 				if opt.Hide&fs.OptionHideCommandLine != 0 {
 					flag.Hidden = true
 				}
+				backendFlags[name] = struct{}{}
 			} else {
 				fs.Errorf(nil, "Not adding duplicate flag --%s", name)
 			}
@@ -543,6 +474,7 @@ func AddBackendFlags() {
 
 // Main runs rclone interpreting flags and commands out of os.Args
 func Main() {
+	setupRootCommand(Root)
 	AddBackendFlags()
 	if err := Root.Execute(); err != nil {
 		log.Fatalf("Fatal error: %v", err)

cmd/deletefile/deletefile.go

@@ -3,7 +3,6 @@ package deletefile
 import (
 	"github.com/ncw/rclone/cmd"
 	"github.com/ncw/rclone/fs/operations"
-
 	"github.com/pkg/errors"
 	"github.com/spf13/cobra"
 )

cmd/help.go

@@ -0,0 +1,250 @@
+package cmd
+
+import (
+	"fmt"
+	"log"
+	"os"
+	"regexp"
+	"strings"
+
+	"github.com/ncw/rclone/fs"
+	"github.com/ncw/rclone/fs/config/configflags"
+	"github.com/ncw/rclone/fs/filter/filterflags"
+	"github.com/ncw/rclone/fs/rc/rcflags"
+	"github.com/ncw/rclone/lib/atexit"
+	"github.com/spf13/cobra"
+	"github.com/spf13/pflag"
+)
+
+// Root is the main rclone command
+var Root = &cobra.Command{
+	Use:   "rclone",
+	Short: "Show help for rclone commands, flags and backends.",
+	Long: `
+Rclone syncs files to and from cloud storage providers as well as
+mounting them, listing them in lots of different ways.
+
+See the home page (https://rclone.org/) for installation, usage,
+documentation, changelog and configuration walkthroughs.
+
+`,
+	PersistentPostRun: func(cmd *cobra.Command, args []string) {
+		fs.Debugf("rclone", "Version %q finishing with parameters %q", fs.Version, os.Args)
+		atexit.Run()
+	},
+}
+
+// root help command
+var helpCommand = &cobra.Command{
+	Use:   "help",
+	Short: Root.Short,
+	Long:  Root.Long,
+	Run: func(command *cobra.Command, args []string) {
+		Root.SetOutput(os.Stdout)
+		_ = Root.Usage()
+	},
+}
+
+// to filter the flags with
+var flagsRe *regexp.Regexp
+
+// Show the flags
+var helpFlags = &cobra.Command{
+	Use:   "flags [<regexp to match>]",
+	Short: "Show the global flags for rclone",
+	Run: func(command *cobra.Command, args []string) {
+		if len(args) > 0 {
+			re, err := regexp.Compile(args[0])
+			if err != nil {
+				log.Fatalf("Failed to compile flags regexp: %v", err)
+			}
+			flagsRe = re
+		}
+		Root.SetOutput(os.Stdout)
+		_ = command.Usage()
+	},
+}
+
+// Show the backends
+var helpBackends = &cobra.Command{
+	Use:   "backends",
+	Short: "List the backends available",
+	Run: func(command *cobra.Command, args []string) {
+		showBackends()
+	},
+}
+
+// Show a single backend
+var helpBackend = &cobra.Command{
+	Use:   "backend <name>",
+	Short: "List full info about a backend",
+	Run: func(command *cobra.Command, args []string) {
+		if len(args) == 0 {
+			Root.SetOutput(os.Stdout)
+			_ = command.Usage()
+			return
+		}
+		showBackend(args[0])
+	},
+}
+
+// runRoot implements the main rclone command with no subcommands
+func runRoot(cmd *cobra.Command, args []string) {
+	if version {
+		ShowVersion()
+		resolveExitCode(nil)
+	} else {
+		_ = cmd.Usage()
+		if len(args) > 0 {
+			_, _ = fmt.Fprintf(os.Stderr, "Command not found.\n")
+		}
+		resolveExitCode(errorCommandNotFound)
+	}
+}
+
+// setupRootCommand sets default usage, help, and error handling for
+// the root command.
+//
+// Helpful example: http://rtfcode.com/xref/moby-17.03.2-ce/cli/cobra.go
+func setupRootCommand(rootCmd *cobra.Command) {
+	// Add global flags
+	configflags.AddFlags(pflag.CommandLine)
+	filterflags.AddFlags(pflag.CommandLine)
+	rcflags.AddFlags(pflag.CommandLine)
+
+	Root.Run = runRoot
+	Root.Flags().BoolVarP(&version, "version", "V", false, "Print the version number")
+
+	cobra.AddTemplateFunc("showGlobalFlags", func(cmd *cobra.Command) bool {
+		return cmd.CalledAs() == "flags"
+	})
+	cobra.AddTemplateFunc("showCommands", func(cmd *cobra.Command) bool {
+		return cmd.CalledAs() != "flags"
+	})
+	cobra.AddTemplateFunc("showLocalFlags", func(cmd *cobra.Command) bool {
+		// Don't show local flags (which are the global ones on the root) on "rclone" and
+		// "rclone help" (which shows the global help)
+		return cmd.CalledAs() != "rclone" && cmd.CalledAs() != ""
+	})
+	cobra.AddTemplateFunc("backendFlags", func(cmd *cobra.Command, include bool) *pflag.FlagSet {
+		backendFlagSet := pflag.NewFlagSet("Backend Flags", pflag.ExitOnError)
+		cmd.InheritedFlags().VisitAll(func(flag *pflag.Flag) {
+			matched := flagsRe == nil || flagsRe.MatchString(flag.Name)
+			if _, ok := backendFlags[flag.Name]; matched && ok == include {
+				backendFlagSet.AddFlag(flag)
+			}
+		})
+		return backendFlagSet
+	})
+	rootCmd.SetUsageTemplate(usageTemplate)
+	// rootCmd.SetHelpTemplate(helpTemplate)
+	// rootCmd.SetFlagErrorFunc(FlagErrorFunc)
+	rootCmd.SetHelpCommand(helpCommand)
+	// rootCmd.PersistentFlags().BoolP("help", "h", false, "Print usage")
+	// rootCmd.PersistentFlags().MarkShorthandDeprecated("help", "please use --help")
+
+	rootCmd.AddCommand(helpCommand)
+	helpCommand.AddCommand(helpFlags)
+	helpCommand.AddCommand(helpBackends)
+	helpCommand.AddCommand(helpBackend)
+
+	cobra.OnInitialize(initConfig)
+
+}
+
+var usageTemplate = `Usage:{{if .Runnable}}
+  {{.UseLine}}{{end}}{{if .HasAvailableSubCommands}}
+  {{.CommandPath}} [command]{{end}}{{if gt (len .Aliases) 0}}
+
+Aliases:
+  {{.NameAndAliases}}{{end}}{{if .HasExample}}
+
+Examples:
+{{.Example}}{{end}}{{if and (showCommands .) .HasAvailableSubCommands}}
+
+Available Commands:{{range .Commands}}{{if (or .IsAvailableCommand (eq .Name "help"))}}
+  {{rpad .Name .NamePadding }} {{.Short}}{{end}}{{end}}{{end}}{{if and (showLocalFlags .) .HasAvailableLocalFlags}}
+
+Flags:
+{{.LocalFlags.FlagUsages | trimTrailingWhitespaces}}{{end}}{{if and (showGlobalFlags .) .HasAvailableInheritedFlags}}
+
+Global Flags:
+{{(backendFlags . false).FlagUsages | trimTrailingWhitespaces}}
+
+Backend Flags:
+{{(backendFlags . true).FlagUsages | trimTrailingWhitespaces}}{{end}}{{if .HasHelpSubCommands}}
+
+Additional help topics:{{range .Commands}}{{if .IsAdditionalHelpTopicCommand}}
+  {{rpad .CommandPath .CommandPathPadding}} {{.Short}}{{end}}{{end}}{{end}}
+
+Use "rclone [command] --help" for more information about a command.
+Use "rclone help flags" for to see the global flags.
+Use "rclone help backends" for a list of supported services.
+`
+
+// show all the backends
+func showBackends() {
+	fmt.Printf("All rclone backends:\n\n")
+	for _, backend := range fs.Registry {
+		fmt.Printf("  %-12s %s\n", backend.Prefix, backend.Description)
+	}
+	fmt.Printf("\nTo see more info about a particular backend use:\n")
+	fmt.Printf("  rclone help backend <name>\n")
+}
+
+func quoteString(v interface{}) string {
+	switch v.(type) {
+	case string:
+		return fmt.Sprintf("%q", v)
+	}
+	return fmt.Sprint(v)
+}
+
+// show a single backend
+func showBackend(name string) {
+	backend, err := fs.Find(name)
+	if err != nil {
+		log.Fatal(err)
+	}
+	var standardOptions, advancedOptions fs.Options
+	done := map[string]struct{}{}
+	for _, opt := range backend.Options {
+		// Skip if done already (eg with Provider options)
+		if _, doneAlready := done[opt.Name]; doneAlready {
+			continue
+		}
+		if opt.Advanced {
+			advancedOptions = append(advancedOptions, opt)
+		} else {
+			standardOptions = append(standardOptions, opt)
+		}
+	}
+	optionsType := "standard"
+	for _, opts := range []fs.Options{standardOptions, advancedOptions} {
+		if len(opts) == 0 {
+			continue
+		}
+		fmt.Printf("### %s Options\n\n", strings.Title(optionsType))
+		fmt.Printf("Here are the %s options specific to %s (%s).\n\n", optionsType, backend.Name, backend.Description)
+		optionsType = "advanced"
+		for _, opt := range opts {
+			done[opt.Name] = struct{}{}
+			fmt.Printf("#### --%s\n\n", opt.FlagName(backend.Prefix))
+			fmt.Printf("%s\n\n", opt.Help)
+			fmt.Printf("- Config:      %s\n", opt.Name)
+			fmt.Printf("- Env Var:     %s\n", opt.EnvVarName(backend.Prefix))
+			fmt.Printf("- Type:        %s\n", opt.Type())
+			fmt.Printf("- Default:     %s\n", quoteString(opt.GetValue()))
+			if len(opt.Examples) > 0 {
+				fmt.Printf("- Examples:\n")
+				for _, ex := range opt.Examples {
+					fmt.Printf("    - %s\n", quoteString(ex.Value))
+					for _, line := range strings.Split(ex.Help, "\n") {
+						fmt.Printf("        - %s\n", line)
+					}
+				}
+			}
+			fmt.Printf("\n")
+		}
+	}
+}

cmd/lsf/lsf_test.go

@@ -4,13 +4,12 @@ import (
 	"bytes"
 	"testing"
 
+	_ "github.com/ncw/rclone/backend/local"
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fs/list"
 	"github.com/ncw/rclone/fstest"
 	"github.com/stretchr/testify/assert"
 	"github.com/stretchr/testify/require"
-
-	_ "github.com/ncw/rclone/backend/local"
 )
 
 func TestDefaultLsf(t *testing.T) {

cmd/mountlib/mount.go

@@ -66,14 +66,12 @@ func checkMountEmpty(mountpoint string) error {
 func NewMountCommand(commandName string, Mount func(f fs.Fs, mountpoint string) error) *cobra.Command {
 	var commandDefintion = &cobra.Command{
 		Use:   commandName + " remote:path /path/to/mountpoint",
-		Short: `Mount the remote as a mountpoint. **EXPERIMENTAL**`,
+		Short: `Mount the remote as file system on a mountpoint.`,
 		Long: `
 rclone ` + commandName + ` allows Linux, FreeBSD, macOS and Windows to
 mount any of Rclone's cloud storage systems as a file system with
 FUSE.
 
-This is **EXPERIMENTAL** - use with care.
-
 First set up your remote using ` + "`rclone config`" + `.  Check it works with ` + "`rclone ls`" + ` etc.
 
 Start the mount like this
@@ -148,7 +146,7 @@ File systems expect things to be 100% reliable, whereas cloud storage
 systems are a long way from 100% reliable. The rclone sync/copy
 commands cope with this with lots of retries.  However rclone ` + commandName + `
 can't use retries in the same way without making local copies of the
-uploads. Look at the **EXPERIMENTAL** [file caching](#file-caching)
+uploads. Look at the [file caching](#file-caching)
 for solutions to make ` + commandName + ` mount more reliable.
 
 ### Attribute caching
@@ -226,8 +224,7 @@ be copied to the vfs cache before opening with --vfs-cache-mode full.
 
 			// Show stats if the user has specifically requested them
 			if cmd.ShowStats() {
-				stopStats := cmd.StartStats()
-				defer close(stopStats)
+				defer cmd.StartStats()()
 			}
 
 			// Skip checkMountEmpty if --allow-non-empty flag is used or if

cmd/progress.go

@@ -25,8 +25,8 @@ const (
 
 // startProgress starts the progress bar printing
 //
-// It returns a channel which should be closed to stop the stats.
-func startProgress() chan struct{} {
+// It returns a func which should be called to stop the stats.
+func startProgress() func() {
 	stopStats := make(chan struct{})
 	oldLogPrint := fs.LogPrint
 	if !log.Redirected() {
@@ -36,7 +36,10 @@ func startProgress() chan struct{} {
 
 		}
 	}
+	var wg sync.WaitGroup
+	wg.Add(1)
 	go func() {
+		defer wg.Done()
 		progressInterval := defaultProgressInterval
 		if ShowStats() && *statsInterval > 0 {
 			progressInterval = *statsInterval
@@ -54,7 +57,10 @@ func startProgress() chan struct{} {
 			}
 		}
 	}()
-	return stopStats
+	return func() {
+		close(stopStats)
+		wg.Wait()
+	}
 }
 
 // VT100 codes

cmd/progress_windows.go

@@ -21,6 +21,15 @@ func writeToTerminal(b []byte) {
 		winEventHandler := winterm.CreateWinEventHandler(os.Stdout.Fd(), os.Stdout)
 		ansiParser = ansiterm.CreateParser("Ground", winEventHandler)
 	})
+	// Remove all non-ASCII characters until this is fixed
+	// https://github.com/Azure/go-ansiterm/issues/26
+	r := []rune(string(b))
+	for i := range r {
+		if r[i] >= 127 {
+			r[i] = '.'
+		}
+	}
+	b = []byte(string(r))
 	_, err := ansiParser.Parse(b)
 	if err != nil {
 		_, _ = fmt.Fprintf(os.Stderr, "\n*** Error from ANSI parser: %v\n", err)

cmd/serve/ftp/ftp.go

@@ -0,0 +1,420 @@
+// Package ftp implements an FTP server for rclone
+
+//+build !plan9
+
+package ftp
+
+import (
+	"errors"
+	"fmt"
+	"io"
+	"net"
+	"os"
+	"os/user"
+	"strconv"
+	"sync"
+
+	ftp "github.com/goftp/server"
+	"github.com/ncw/rclone/cmd"
+	"github.com/ncw/rclone/cmd/serve/ftp/ftpflags"
+	"github.com/ncw/rclone/cmd/serve/ftp/ftpopt"
+	"github.com/ncw/rclone/fs"
+	"github.com/ncw/rclone/fs/accounting"
+	"github.com/ncw/rclone/fs/log"
+	"github.com/ncw/rclone/vfs"
+	"github.com/ncw/rclone/vfs/vfsflags"
+	"github.com/spf13/cobra"
+)
+
+func init() {
+	ftpflags.AddFlags(Command.Flags())
+	vfsflags.AddFlags(Command.Flags())
+}
+
+// Command definition for cobra
+var Command = &cobra.Command{
+	Use:   "ftp remote:path",
+	Short: `Serve remote:path over FTP.`,
+	Long: `
+rclone serve ftp implements a basic ftp server to serve the
+remote over FTP protocol. This can be viewed with a ftp client
+or you can make a remote of type ftp to read and write it.
+` + ftpopt.Help + vfs.Help,
+	Run: func(command *cobra.Command, args []string) {
+		cmd.CheckArgs(1, 1, command, args)
+		f := cmd.NewFsSrc(args)
+		cmd.Run(false, false, command, func() error {
+			s, err := newServer(f, &ftpflags.Opt)
+			if err != nil {
+				return err
+			}
+			return s.serve()
+		})
+	},
+}
+
+// server contains everything to run the server
+type server struct {
+	f   fs.Fs
+	srv *ftp.Server
+}
+
+// Make a new FTP to serve the remote
+func newServer(f fs.Fs, opt *ftpopt.Options) (*server, error) {
+	host, port, err := net.SplitHostPort(opt.ListenAddr)
+	if err != nil {
+		return nil, errors.New("Failed to parse host:port")
+	}
+	portNum, err := strconv.Atoi(port)
+	if err != nil {
+		return nil, errors.New("Failed to parse host:port")
+	}
+
+	ftpopt := &ftp.ServerOpts{
+		Name:           "Rclone FTP Server",
+		WelcomeMessage: "Welcome on Rclone FTP Server",
+		Factory: &DriverFactory{
+			vfs: vfs.New(f, &vfsflags.Opt),
+		},
+		Hostname:     host,
+		Port:         portNum,
+		PassivePorts: opt.PassivePorts,
+		Auth: &Auth{
+			BasicUser: opt.BasicUser,
+			BasicPass: opt.BasicPass,
+		},
+		Logger: &Logger{},
+		//TODO implement a maximum of https://godoc.org/github.com/goftp/server#ServerOpts
+	}
+	return &server{
+		f:   f,
+		srv: ftp.NewServer(ftpopt),
+	}, nil
+}
+
+// serve runs the ftp server
+func (s *server) serve() error {
+	fs.Logf(s.f, "Serving FTP on %s", s.srv.Hostname+":"+strconv.Itoa(s.srv.Port))
+	return s.srv.ListenAndServe()
+}
+
+// serve runs the ftp server
+func (s *server) close() error {
+	fs.Logf(s.f, "Stopping FTP on %s", s.srv.Hostname+":"+strconv.Itoa(s.srv.Port))
+	return s.srv.Shutdown()
+}
+
+//Logger ftp logger output formatted message
+type Logger struct{}
+
+//Print log simple text message
+func (l *Logger) Print(sessionID string, message interface{}) {
+	fs.Infof(sessionID, "%s", message)
+}
+
+//Printf log formatted text message
+func (l *Logger) Printf(sessionID string, format string, v ...interface{}) {
+	fs.Infof(sessionID, format, v...)
+}
+
+//PrintCommand log formatted command execution
+func (l *Logger) PrintCommand(sessionID string, command string, params string) {
+	if command == "PASS" {
+		fs.Infof(sessionID, "> PASS ****")
+	} else {
+		fs.Infof(sessionID, "> %s %s", command, params)
+	}
+}
+
+//PrintResponse log responses
+func (l *Logger) PrintResponse(sessionID string, code int, message string) {
+	fs.Infof(sessionID, "< %d %s", code, message)
+}
+
+//Auth struct to handle ftp auth (temporary simple for POC)
+type Auth struct {
+	BasicUser string
+	BasicPass string
+}
+
+//CheckPasswd handle auth based on configuration
+func (a *Auth) CheckPasswd(user, pass string) (bool, error) {
+	return a.BasicUser == user && (a.BasicPass == "" || a.BasicPass == pass), nil
+}
+
+//DriverFactory factory of ftp driver for each session
+type DriverFactory struct {
+	vfs *vfs.VFS
+}
+
+//NewDriver start a new session
+func (f *DriverFactory) NewDriver() (ftp.Driver, error) {
+	log.Trace("", "Init driver")("")
+	return &Driver{
+		vfs: f.vfs,
+	}, nil
+}
+
+//Driver impletation of ftp server
+type Driver struct {
+	vfs  *vfs.VFS
+	lock sync.Mutex
+}
+
+//Init a connection
+func (d *Driver) Init(*ftp.Conn) {
+	defer log.Trace("", "Init session")("")
+}
+
+//Stat get information on file or folder
+func (d *Driver) Stat(path string) (fi ftp.FileInfo, err error) {
+	defer log.Trace(path, "")("fi=%+v, err = %v", &fi, &err)
+	n, err := d.vfs.Stat(path)
+	if err != nil {
+		return nil, err
+	}
+	return &FileInfo{n, n.Mode(), d.vfs.Opt.UID, d.vfs.Opt.GID}, err
+}
+
+//ChangeDir move current folder
+func (d *Driver) ChangeDir(path string) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "")("err = %v", &err)
+	n, err := d.vfs.Stat(path)
+	if err != nil {
+		return err
+	}
+	if !n.IsDir() {
+		return errors.New("Not a directory")
+	}
+	return nil
+}
+
+//ListDir list content of a folder
+func (d *Driver) ListDir(path string, callback func(ftp.FileInfo) error) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "")("err = %v", &err)
+	node, err := d.vfs.Stat(path)
+	if err == vfs.ENOENT {
+		return errors.New("Directory not found")
+	} else if err != nil {
+		return err
+	}
+	if !node.IsDir() {
+		return errors.New("Not a directory")
+	}
+
+	dir := node.(*vfs.Dir)
+	dirEntries, err := dir.ReadDirAll()
+	if err != nil {
+		return err
+	}
+
+	// Account the transfer
+	accounting.Stats.Transferring(path)
+	defer accounting.Stats.DoneTransferring(path, true)
+
+	for _, file := range dirEntries {
+		err = callback(&FileInfo{file, file.Mode(), d.vfs.Opt.UID, d.vfs.Opt.GID})
+		if err != nil {
+			return err
+		}
+	}
+	return nil
+}
+
+//DeleteDir delete a folder and his content
+func (d *Driver) DeleteDir(path string) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "")("err = %v", &err)
+	node, err := d.vfs.Stat(path)
+	if err != nil {
+		return err
+	}
+	if !node.IsDir() {
+		return errors.New("Not a directory")
+	}
+	err = node.Remove()
+	if err != nil {
+		return err
+	}
+	return nil
+}
+
+//DeleteFile delete a file
+func (d *Driver) DeleteFile(path string) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "")("err = %v", &err)
+	node, err := d.vfs.Stat(path)
+	if err != nil {
+		return err
+	}
+	if !node.IsFile() {
+		return errors.New("Not a file")
+	}
+	err = node.Remove()
+	if err != nil {
+		return err
+	}
+	return nil
+}
+
+//Rename rename a file or folder
+func (d *Driver) Rename(oldName, newName string) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(oldName, "newName=%q", newName)("err = %v", &err)
+	return d.vfs.Rename(oldName, newName)
+}
+
+//MakeDir create a folder
+func (d *Driver) MakeDir(path string) (err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "")("err = %v", &err)
+	dir, leaf, err := d.vfs.StatParent(path)
+	if err != nil {
+		return err
+	}
+	_, err = dir.Mkdir(leaf)
+	return err
+}
+
+//GetFile download a file
+func (d *Driver) GetFile(path string, offset int64) (size int64, fr io.ReadCloser, err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "offset=%v", offset)("err = %v", &err)
+	node, err := d.vfs.Stat(path)
+	if err == vfs.ENOENT {
+		fs.Infof(path, "File not found")
+		return 0, nil, errors.New("File not found")
+	} else if err != nil {
+		return 0, nil, err
+	}
+	if !node.IsFile() {
+		return 0, nil, errors.New("Not a file")
+	}
+
+	handle, err := node.Open(os.O_RDONLY)
+	if err != nil {
+		return 0, nil, err
+	}
+	_, err = handle.Seek(offset, os.SEEK_SET)
+	if err != nil {
+		return 0, nil, err
+	}
+
+	// Account the transfer
+	accounting.Stats.Transferring(path)
+	defer accounting.Stats.DoneTransferring(path, true)
+
+	return node.Size(), handle, nil
+}
+
+//PutFile upload a file
+func (d *Driver) PutFile(path string, data io.Reader, appendData bool) (n int64, err error) {
+	d.lock.Lock()
+	defer d.lock.Unlock()
+	defer log.Trace(path, "append=%v", appendData)("err = %v", &err)
+	var isExist bool
+	node, err := d.vfs.Stat(path)
+	if err == nil {
+		isExist = true
+		if node.IsDir() {
+			return 0, errors.New("A dir has the same name")
+		}
+	} else {
+		if os.IsNotExist(err) {
+			isExist = false
+		} else {
+			return 0, err
+		}
+	}
+
+	if appendData && !isExist {
+		appendData = false
+	}
+
+	if !appendData {
+		if isExist {
+			err = node.Remove()
+			if err != nil {
+				return 0, err
+			}
+		}
+		f, err := d.vfs.OpenFile(path, os.O_RDWR|os.O_CREATE, 0660)
+		if err != nil {
+			return 0, err
+		}
+		defer closeIO(path, f)
+		bytes, err := io.Copy(f, data)
+		if err != nil {
+			return 0, err
+		}
+		return bytes, nil
+	}
+
+	of, err := d.vfs.OpenFile(path, os.O_APPEND|os.O_RDWR, 0660)
+	if err != nil {
+		return 0, err
+	}
+	defer closeIO(path, of)
+
+	_, err = of.Seek(0, os.SEEK_END)
+	if err != nil {
+		return 0, err
+	}
+
+	bytes, err := io.Copy(of, data)
+	if err != nil {
+		return 0, err
+	}
+
+	return bytes, nil
+}
+
+//FileInfo  struct ot hold file infor for ftp server
+type FileInfo struct {
+	os.FileInfo
+
+	mode  os.FileMode
+	owner uint32
+	group uint32
+}
+
+//Mode return êrm mode of file.
+func (f *FileInfo) Mode() os.FileMode {
+	return f.mode
+}
+
+//Owner return owner of file. Try to find the username if possible
+func (f *FileInfo) Owner() string {
+	str := fmt.Sprint(f.owner)
+	u, err := user.LookupId(str)
+	if err != nil {
+		return str //User not found
+	}
+	return u.Username
+}
+
+//Group return group of file. Try to find the group name if possible
+func (f *FileInfo) Group() string {
+	str := fmt.Sprint(f.group)
+	g, err := user.LookupGroupId(str)
+	if err != nil {
+		return str //Group not found default to numrical value
+	}
+	return g.Name
+}
+
+func closeIO(path string, c io.Closer) {
+	err := c.Close()
+	if err != nil {
+		log.Trace(path, "")("err = %v", &err)
+	}
+}

cmd/serve/ftp/ftp_test.go

@@ -0,0 +1,89 @@
+// Serve ftp tests set up a server and run the integration tests
+// for the ftp remote against it.
+//
+// We skip tests on platforms with troublesome character mappings
+
+//+build !windows,!darwin,!plan9
+
+package ftp
+
+import (
+	"fmt"
+	"os"
+	"os/exec"
+	"testing"
+
+	ftp "github.com/goftp/server"
+	_ "github.com/ncw/rclone/backend/local"
+	"github.com/ncw/rclone/cmd/serve/ftp/ftpopt"
+	"github.com/ncw/rclone/fstest"
+	"github.com/stretchr/testify/assert"
+)
+
+const (
+	testHOST             = "localhost"
+	testPORT             = "51780"
+	testPASSIVEPORTRANGE = "30000-32000"
+)
+
+// TestFTP runs the ftp server then runs the unit tests for the
+// ftp remote against it.
+func TestFTP(t *testing.T) {
+	opt := ftpopt.DefaultOpt
+	opt.ListenAddr = testHOST + ":" + testPORT
+	opt.PassivePorts = testPASSIVEPORTRANGE
+	opt.BasicUser = "rclone"
+	opt.BasicPass = "password"
+
+	fstest.Initialise()
+
+	fremote, _, clean, err := fstest.RandomRemote(*fstest.RemoteName, *fstest.SubDir)
+	assert.NoError(t, err)
+	defer clean()
+
+	err = fremote.Mkdir("")
+	assert.NoError(t, err)
+
+	// Start the server
+	w, err := newServer(fremote, &opt)
+	assert.NoError(t, err)
+
+	go func() {
+		err := w.serve()
+		if err != ftp.ErrServerClosed {
+			assert.NoError(t, err)
+		}
+	}()
+	defer func() {
+		err := w.close()
+		assert.NoError(t, err)
+	}()
+
+	// Change directory to run the tests
+	err = os.Chdir("../../../backend/ftp")
+	assert.NoError(t, err, "failed to cd to ftp remote")
+
+	// Run the ftp tests with an on the fly remote
+	args := []string{"test"}
+	if testing.Verbose() {
+		args = append(args, "-v")
+	}
+	if *fstest.Verbose {
+		args = append(args, "-verbose")
+	}
+	args = append(args, "-list-retries", fmt.Sprint(*fstest.ListRetries))
+	args = append(args, "-remote", "ftptest:")
+	cmd := exec.Command("go", args...)
+	cmd.Env = append(os.Environ(),
+		"RCLONE_CONFIG_FTPTEST_TYPE=ftp",
+		"RCLONE_CONFIG_FTPTEST_HOST="+testHOST,
+		"RCLONE_CONFIG_FTPTEST_PORT="+testPORT,
+		"RCLONE_CONFIG_FTPTEST_USER=rclone",
+		"RCLONE_CONFIG_FTPTEST_PASS=0HU5Hx42YiLoNGJxppOOP3QTbr-KB_MP", // ./rclone obscure password
+	)
+	out, err := cmd.CombinedOutput()
+	if len(out) != 0 {
+		t.Logf("\n----------\n%s----------\n", string(out))
+	}
+	assert.NoError(t, err, "Running ftp integration tests")
+}

cmd/serve/ftp/ftp_unsupported.go

@@ -0,0 +1,11 @@
+// Build  for unsupported platforms to stop go complaining
+// about "no buildable Go source files "
+
+// +build plan9
+
+package ftp
+
+import "github.com/spf13/cobra"
+
+// Command definition is nil to show not implemented
+var Command *cobra.Command = nil

cmd/serve/ftp/ftpflags/ftpflags.go

@@ -0,0 +1,25 @@
+package ftpflags
+
+import (
+	"github.com/ncw/rclone/cmd/serve/ftp/ftpopt"
+	"github.com/ncw/rclone/fs/config/flags"
+	"github.com/spf13/pflag"
+)
+
+// Options set by command line flags
+var (
+	Opt = ftpopt.DefaultOpt
+)
+
+// AddFlagsPrefix adds flags for the ftpopt
+func AddFlagsPrefix(flagSet *pflag.FlagSet, prefix string, Opt *ftpopt.Options) {
+	flags.StringVarP(flagSet, &Opt.ListenAddr, prefix+"addr", "", Opt.ListenAddr, "IPaddress:Port or :Port to bind server to.")
+	flags.StringVarP(flagSet, &Opt.PassivePorts, prefix+"passive-port", "", Opt.PassivePorts, "Passive port range to use.")
+	flags.StringVarP(flagSet, &Opt.BasicUser, prefix+"user", "", Opt.BasicUser, "User name for authentication.")
+	flags.StringVarP(flagSet, &Opt.BasicPass, prefix+"pass", "", Opt.BasicPass, "Password for authentication. (empty value allow every password)")
+}
+
+// AddFlags adds flags for the httplib
+func AddFlags(flagSet *pflag.FlagSet) {
+	AddFlagsPrefix(flagSet, "", &Opt)
+}

cmd/serve/ftp/ftpopt/ftp_options.go

@@ -0,0 +1,38 @@
+package ftpopt
+
+// Help contains text describing the http server to add to the command
+// help.
+var Help = `
+### Server options
+
+Use --addr to specify which IP address and port the server should
+listen on, eg --addr 1.2.3.4:8000 or --addr :8080 to listen to all
+IPs.  By default it only listens on localhost.  You can use port
+:0 to let the OS choose an available port.
+
+If you set --addr to listen on a public or LAN accessible IP address
+then using Authentication is advised - see the next section for info.
+
+#### Authentication
+
+By default this will serve files without needing a login.
+
+You can set a single username and password with the --user and --pass flags.
+`
+
+// Options contains options for the http Server
+type Options struct {
+	//TODO add more options
+	ListenAddr   string // Port to listen on
+	PassivePorts string // Passive ports range
+	BasicUser    string // single username for basic auth if not using Htpasswd
+	BasicPass    string // password for BasicUser
+}
+
+// DefaultOpt is the default values used for Options
+var DefaultOpt = Options{
+	ListenAddr:   "localhost:2121",
+	PassivePorts: "30000-32000",
+	BasicUser:    "anonymous",
+	BasicPass:    "",
+}

cmd/serve/restic/restic.go

@@ -12,7 +12,6 @@ import (
 	"regexp"
 	"strconv"
 	"strings"
-
 	"time"
 
 	"github.com/ncw/rclone/cmd"

cmd/serve/serve.go

@@ -4,6 +4,7 @@ import (
 	"errors"
 
 	"github.com/ncw/rclone/cmd"
+	"github.com/ncw/rclone/cmd/serve/ftp"
 	"github.com/ncw/rclone/cmd/serve/http"
 	"github.com/ncw/rclone/cmd/serve/restic"
 	"github.com/ncw/rclone/cmd/serve/webdav"
@@ -14,6 +15,9 @@ func init() {
 	Command.AddCommand(http.Command)
 	Command.AddCommand(webdav.Command)
 	Command.AddCommand(restic.Command)
+	if ftp.Command != nil {
+		Command.AddCommand(ftp.Command)
+	}
 	cmd.Root.AddCommand(Command)
 }
 

cmd/serve/webdav/webdav.go

@@ -14,7 +14,6 @@ import (
 	"github.com/ncw/rclone/vfs/vfsflags"
 	"github.com/spf13/cobra"
 	"golang.org/x/net/context" // switch to "context" when we stop supporting go1.8
-
 	"golang.org/x/net/webdav"
 )
 

cmd/touch/touch_test.go

@@ -4,11 +4,10 @@ import (
 	"testing"
 	"time"
 
+	_ "github.com/ncw/rclone/backend/local"
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest"
 	"github.com/stretchr/testify/require"
-
-	_ "github.com/ncw/rclone/backend/local"
 )
 
 var (

cmd/tree/tree_test.go

@@ -5,12 +5,11 @@ import (
 	"testing"
 
 	"github.com/a8m/tree"
+	_ "github.com/ncw/rclone/backend/local"
 	"github.com/ncw/rclone/fs"
 	"github.com/ncw/rclone/fstest"
 	"github.com/stretchr/testify/assert"
 	"github.com/stretchr/testify/require"
-
-	_ "github.com/ncw/rclone/backend/local"
 )
 
 func TestTree(t *testing.T) {

docs/content/about.md

@@ -66,7 +66,7 @@ Features
 Links
 
   * <i class="fa fa-home"></i> [Home page](https://rclone.org/)
-  * <i class="fa fa-github"></i> [Github project page for source and bug tracker](https://github.com/ncw/rclone)
+  * <i class="fa fa-github"></i> [GitHub project page for source and bug tracker](https://github.com/ncw/rclone)
   * <i class="fa fa-comments"></i> [Rclone Forum](https://forum.rclone.org)
   * <i class="fa fa-google-plus"></i> <a href="https://google.com/+RcloneOrg" rel="publisher">Google+ page</a>
   * <i class="fa fa-cloud-download"></i>[Downloads](/downloads/)

docs/content/alias.md

@@ -128,3 +128,19 @@ Copy another local directory to the alias directory called source
 
     rclone copy /home/source remote:source
 
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/alias/alias.go then run make backenddocs -->
+### Standard Options
+
+Here are the standard options specific to alias (Alias for a existing remote).
+
+#### --alias-remote
+
+Remote or path to alias.
+Can be "myremote:path/to/dir", "myremote:bucket", "myremote:" or "/local/path".
+
+- Config:      remote
+- Env Var:     RCLONE_ALIAS_REMOTE
+- Type:        string
+- Default:     ""
+
+<!--- autogenerated options stop -->

docs/content/amazonclouddrive.md

@@ -173,23 +173,65 @@ Let's say you usually use `amazon.co.uk`. When you authenticate with
 rclone it will take you to an `amazon.com` page to log in.  Your
 `amazon.co.uk` email and password should work here just fine.
 
-### Specific options ###
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/amazonclouddrive/amazonclouddrive.go then run make backenddocs -->
+### Standard Options
 
-Here are the command line options specific to this cloud storage
-system.
+Here are the standard options specific to amazon cloud drive (Amazon Drive).
 
-#### --acd-templink-threshold=SIZE ####
+#### --acd-client-id
 
-Files this size or more will be downloaded via their `tempLink`. This
-is to work around a problem with Amazon Drive which blocks downloads
-of files bigger than about 10GB.  The default for this is 9GB which
-shouldn't need to be changed.
+Amazon Application Client ID.
 
-To download files above this threshold, rclone requests a `tempLink`
-which downloads the file through a temporary URL directly from the
-underlying S3 storage.
+- Config:      client_id
+- Env Var:     RCLONE_ACD_CLIENT_ID
+- Type:        string
+- Default:     ""
 
-#### --acd-upload-wait-per-gb=TIME ####
+#### --acd-client-secret
+
+Amazon Application Client Secret.
+
+- Config:      client_secret
+- Env Var:     RCLONE_ACD_CLIENT_SECRET
+- Type:        string
+- Default:     ""
+
+### Advanced Options
+
+Here are the advanced options specific to amazon cloud drive (Amazon Drive).
+
+#### --acd-auth-url
+
+Auth server URL.
+Leave blank to use Amazon's.
+
+- Config:      auth_url
+- Env Var:     RCLONE_ACD_AUTH_URL
+- Type:        string
+- Default:     ""
+
+#### --acd-token-url
+
+Token server url.
+leave blank to use Amazon's.
+
+- Config:      token_url
+- Env Var:     RCLONE_ACD_TOKEN_URL
+- Type:        string
+- Default:     ""
+
+#### --acd-checkpoint
+
+Checkpoint for internal polling (debug).
+
+- Config:      checkpoint
+- Env Var:     RCLONE_ACD_CHECKPOINT
+- Type:        string
+- Default:     ""
+
+#### --acd-upload-wait-per-gb
+
+Additional time per GB to wait after a failed complete upload to see if it appears.
 
 Sometimes Amazon Drive gives an error when a file has been fully
 uploaded but the file appears anyway after a little while.  This
@@ -208,9 +250,34 @@ most likely appear correctly eventually.
 These values were determined empirically by observing lots of uploads
 of big files for a range of file sizes.
 
-Upload with the `-v` flag to see more info about what rclone is doing
+Upload with the "-v" flag to see more info about what rclone is doing
 in this situation.
 
+- Config:      upload_wait_per_gb
+- Env Var:     RCLONE_ACD_UPLOAD_WAIT_PER_GB
+- Type:        Duration
+- Default:     3m0s
+
+#### --acd-templink-threshold
+
+Files >= this size will be downloaded via their tempLink.
+
+Files this size or more will be downloaded via their "tempLink". This
+is to work around a problem with Amazon Drive which blocks downloads
+of files bigger than about 10GB.  The default for this is 9GB which
+shouldn't need to be changed.
+
+To download files above this threshold, rclone requests a "tempLink"
+which downloads the file through a temporary URL directly from the
+underlying S3 storage.
+
+- Config:      templink_threshold
+- Env Var:     RCLONE_ACD_TEMPLINK_THRESHOLD
+- Type:        SizeSuffix
+- Default:     9G
+
+<!--- autogenerated options stop -->
+
 ### Limitations ###
 
 Note that Amazon Drive is case insensitive so you can't have a

docs/content/authors.md

@@ -196,3 +196,15 @@ Contributors
   * Felix Brucker <felix@felixbrucker.com>
   * Santiago Rodríguez <scollazo@users.noreply.github.com>
   * Craig Miskell <craig.miskell@fluxfederation.com>
+  * Antoine GIRARD <sapk@sapk.fr>
+  * Joanna Marek <joanna.marek@u2i.com>
+  * frenos <frenos@users.noreply.github.com>
+  * ssaqua <ssaqua@users.noreply.github.com>
+  * xnaas <me@xnaas.info>
+  * Frantisek Fuka <fuka@fuxoft.cz>
+  * Paul Kohout <pauljkohout@yahoo.com>
+  * dcpu <43330287+dcpu@users.noreply.github.com>
+  * jackyzy823 <jackyzy823@gmail.com>
+  * David Haguenauer <ml@kurokatta.org>
+  * teresy <hi.teresy@gmail.com>
+  * buergi <patbuergi@gmx.de>

docs/content/azureblob.md

@@ -168,39 +168,112 @@ upload which means that there is a limit of 9.5TB of multipart uploads
 in progress as Azure won't allow more than that amount of uncommitted
 blocks.
 
-### Specific options ###
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/azureblob/azureblob.go then run make backenddocs -->
+### Standard Options
 
-Here are the command line options specific to this cloud storage
-system.
+Here are the standard options specific to azureblob (Microsoft Azure Blob Storage).
 
-#### --azureblob-upload-cutoff=SIZE ####
+#### --azureblob-account
 
-Cutoff for switching to chunked upload - must be <= 256MB. The default
-is 256MB.
+Storage Account Name (leave blank to use connection string or SAS URL)
 
-#### --azureblob-chunk-size=SIZE ####
+- Config:      account
+- Env Var:     RCLONE_AZUREBLOB_ACCOUNT
+- Type:        string
+- Default:     ""
 
-Upload chunk size.  Default 4MB.  Note that this is stored in memory
-and there may be up to `--transfers` chunks stored at once in memory.
-This can be at most 100MB.
+#### --azureblob-key
 
-#### --azureblob-list-chunk=SIZE ####
+Storage Account Key (leave blank to use connection string or SAS URL)
 
-List blob limit. Default is the maximum, 5000. `List blobs` requests
-are permitted 2 minutes per megabyte to complete. If an operation is
-taking longer than 2 minutes per megabyte on average, it will time out ( [source](https://docs.microsoft.com/en-us/rest/api/storageservices/setting-timeouts-for-blob-service-operations#exceptions-to-default-timeout-interval) ). This limit the number of blobs items to return, to avoid the time out.
+- Config:      key
+- Env Var:     RCLONE_AZUREBLOB_KEY
+- Type:        string
+- Default:     ""
 
+#### --azureblob-sas-url
 
-#### --azureblob-access-tier=Hot/Cool/Archive ####
+SAS URL for container level access only
+(leave blank if using account/key or connection string)
 
-Azure storage supports blob tiering, you can configure tier in advanced
-settings or supply flag while performing data transfer operations.
-If there is no `access tier` specified, rclone doesn't apply any tier.
-rclone performs `Set Tier` operation on blobs while uploading, if objects
-are not modified, specifying `access tier` to new one will have no effect.
-If blobs are in `archive tier` at remote, trying to perform data transfer
+- Config:      sas_url
+- Env Var:     RCLONE_AZUREBLOB_SAS_URL
+- Type:        string
+- Default:     ""
+
+### Advanced Options
+
+Here are the advanced options specific to azureblob (Microsoft Azure Blob Storage).
+
+#### --azureblob-endpoint
+
+Endpoint for the service
+Leave blank normally.
+
+- Config:      endpoint
+- Env Var:     RCLONE_AZUREBLOB_ENDPOINT
+- Type:        string
+- Default:     ""
+
+#### --azureblob-upload-cutoff
+
+Cutoff for switching to chunked upload (<= 256MB).
+
+- Config:      upload_cutoff
+- Env Var:     RCLONE_AZUREBLOB_UPLOAD_CUTOFF
+- Type:        SizeSuffix
+- Default:     256M
+
+#### --azureblob-chunk-size
+
+Upload chunk size (<= 100MB).
+
+Note that this is stored in memory and there may be up to
+"--transfers" chunks stored at once in memory.
+
+- Config:      chunk_size
+- Env Var:     RCLONE_AZUREBLOB_CHUNK_SIZE
+- Type:        SizeSuffix
+- Default:     4M
+
+#### --azureblob-list-chunk
+
+Size of blob list.
+
+This sets the number of blobs requested in each listing chunk. Default
+is the maximum, 5000. "List blobs" requests are permitted 2 minutes
+per megabyte to complete. If an operation is taking longer than 2
+minutes per megabyte on average, it will time out (
+[source](https://docs.microsoft.com/en-us/rest/api/storageservices/setting-timeouts-for-blob-service-operations#exceptions-to-default-timeout-interval)
+). This can be used to limit the number of blobs items to return, to
+avoid the time out.
+
+- Config:      list_chunk
+- Env Var:     RCLONE_AZUREBLOB_LIST_CHUNK
+- Type:        int
+- Default:     5000
+
+#### --azureblob-access-tier
+
+Access tier of blob: hot, cool or archive.
+
+Archived blobs can be restored by setting access tier to hot or
+cool. Leave blank if you intend to use default access tier, which is
+set at account level
+
+If there is no "access tier" specified, rclone doesn't apply any tier.
+rclone performs "Set Tier" operation on blobs while uploading, if objects
+are not modified, specifying "access tier" to new one will have no effect.
+If blobs are in "archive tier" at remote, trying to perform data transfer
 operations from remote will not be allowed. User should first restore by
-tiering blob to `Hot` or `Cool`.
+tiering blob to "Hot" or "Cool".
+
+- Config:      access_tier
+- Env Var:     RCLONE_AZUREBLOB_ACCESS_TIER
+- Type:        string
+- Default:     ""
+
+<!--- autogenerated options stop -->
 
 ### Limitations ###
 

docs/content/b2.md

@@ -181,6 +181,9 @@ versions of files, leaving the current ones intact.  You can also
 supply a path and only old versions under that path will be deleted,
 eg `rclone cleanup remote:bucket/path/to/stuff`.
 
+Note that `cleanup` does not remove partially uploaded files
+from the bucket.
+
 When you `purge` a bucket, the current and the old versions will be
 deleted then the bucket will be deleted.
 
@@ -262,46 +265,10 @@ start and finish the upload) and another 2 requests for each chunk:
 /b2api/v1/b2_finish_large_file
 ```
 
-### Specific options ###
+#### Versions ####
 
-Here are the command line options specific to this cloud storage
-system.
-
-#### --b2-chunk-size valuee=SIZE ####
-
-When uploading large files chunk the file into this size.  Note that
-these chunks are buffered in memory and there might a maximum of
-`--transfers` chunks in progress at once.  5,000,000 Bytes is the
-minimim size (default 96M).
-
-#### --b2-upload-cutoff=SIZE ####
-
-Cutoff for switching to chunked upload (default 190.735 MiB == 200
-MB). Files above this size will be uploaded in chunks of
-`--b2-chunk-size`.
-
-This value should be set no larger than 4.657GiB (== 5GB) as this is
-the largest file size that can be uploaded.
-
-
-#### --b2-test-mode=FLAG ####
-
-This is for debugging purposes only.
-
-Setting FLAG to one of the strings below will cause b2 to return
-specific errors for debugging purposes.
-
-  * `fail_some_uploads`
-  * `expire_some_account_authorization_tokens`
-  * `force_cap_exceeded`
-
-These will be set in the `X-Bz-Test-Mode` header which is documented
-in the [b2 integrations
-checklist](https://www.backblaze.com/b2/docs/integration_checklist.html).
-
-#### --b2-versions ####
-
-When set rclone will show and act on older versions of files.  For example
+Versions can be viewd with the `--b2-versions` flag. When it is set
+rclone will show and act on older versions of files.  For example
 
 Listing without `--b2-versions`
 
@@ -326,3 +293,109 @@ server to the nearest millisecond appended to them.
 
 Note that when using `--b2-versions` no file write operations are
 permitted, so you can't upload files or delete them.
+
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/b2/b2.go then run make backenddocs -->
+### Standard Options
+
+Here are the standard options specific to b2 (Backblaze B2).
+
+#### --b2-account
+
+Account ID or Application Key ID
+
+- Config:      account
+- Env Var:     RCLONE_B2_ACCOUNT
+- Type:        string
+- Default:     ""
+
+#### --b2-key
+
+Application Key
+
+- Config:      key
+- Env Var:     RCLONE_B2_KEY
+- Type:        string
+- Default:     ""
+
+#### --b2-hard-delete
+
+Permanently delete files on remote removal, otherwise hide files.
+
+- Config:      hard_delete
+- Env Var:     RCLONE_B2_HARD_DELETE
+- Type:        bool
+- Default:     false
+
+### Advanced Options
+
+Here are the advanced options specific to b2 (Backblaze B2).
+
+#### --b2-endpoint
+
+Endpoint for the service.
+Leave blank normally.
+
+- Config:      endpoint
+- Env Var:     RCLONE_B2_ENDPOINT
+- Type:        string
+- Default:     ""
+
+#### --b2-test-mode
+
+A flag string for X-Bz-Test-Mode header for debugging.
+
+This is for debugging purposes only. Setting it to one of the strings
+below will cause b2 to return specific errors:
+
+  * "fail_some_uploads"
+  * "expire_some_account_authorization_tokens"
+  * "force_cap_exceeded"
+
+These will be set in the "X-Bz-Test-Mode" header which is documented
+in the [b2 integrations checklist](https://www.backblaze.com/b2/docs/integration_checklist.html).
+
+- Config:      test_mode
+- Env Var:     RCLONE_B2_TEST_MODE
+- Type:        string
+- Default:     ""
+
+#### --b2-versions
+
+Include old versions in directory listings.
+Note that when using this no file write operations are permitted,
+so you can't upload files or delete them.
+
+- Config:      versions
+- Env Var:     RCLONE_B2_VERSIONS
+- Type:        bool
+- Default:     false
+
+#### --b2-upload-cutoff
+
+Cutoff for switching to chunked upload.
+
+Files above this size will be uploaded in chunks of "--b2-chunk-size".
+
+This value should be set no larger than 4.657GiB (== 5GB).
+
+- Config:      upload_cutoff
+- Env Var:     RCLONE_B2_UPLOAD_CUTOFF
+- Type:        SizeSuffix
+- Default:     200M
+
+#### --b2-chunk-size
+
+Upload chunk size. Must fit in memory.
+
+When uploading large files, chunk the file into this size.  Note that
+these chunks are buffered in memory and there might a maximum of
+"--transfers" chunks in progress at once.  5,000,000 Bytes is the
+minimim size.
+
+- Config:      chunk_size
+- Env Var:     RCLONE_B2_CHUNK_SIZE
+- Type:        SizeSuffix
+- Default:     96M
+
+<!--- autogenerated options stop -->
+

docs/content/box.md

@@ -217,19 +217,54 @@ normally 8MB so increasing `--transfers` will increase memory use.
 Depending on the enterprise settings for your user, the item will
 either be actually deleted from Box or moved to the trash.
 
-### Specific options ###
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/box/box.go then run make backenddocs -->
+### Standard Options
 
-Here are the command line options specific to this cloud storage
-system.
+Here are the standard options specific to box (Box).
 
-#### --box-upload-cutoff=SIZE ####
+#### --box-client-id
 
-Cutoff for switching to chunked upload - must be >= 50MB. The default
-is 50MB.
+Box App Client Id.
+Leave blank normally.
 
-#### --box-commit-retries int ####
+- Config:      client_id
+- Env Var:     RCLONE_BOX_CLIENT_ID
+- Type:        string
+- Default:     ""
 
-Max number of times to try committing a multipart file. (default 100)
+#### --box-client-secret
+
+Box App Client Secret
+Leave blank normally.
+
+- Config:      client_secret
+- Env Var:     RCLONE_BOX_CLIENT_SECRET
+- Type:        string
+- Default:     ""
+
+### Advanced Options
+
+Here are the advanced options specific to box (Box).
+
+#### --box-upload-cutoff
+
+Cutoff for switching to multipart upload (>= 50MB).
+
+- Config:      upload_cutoff
+- Env Var:     RCLONE_BOX_UPLOAD_CUTOFF
+- Type:        SizeSuffix
+- Default:     50M
+
+#### --box-commit-retries
+
+Max number of times to try committing a multipart file.
+
+- Config:      commit_retries
+- Env Var:     RCLONE_BOX_COMMIT_RETRIES
+- Type:        int
+- Default:     100
+
+<!--- autogenerated options stop -->
 
 ### Limitations ###
 

docs/content/cache.md

@@ -290,107 +290,221 @@ Params:
   - **remote** = path to remote **(required)**
   - **withData** = true/false to delete cached data (chunks) as well _(optional, false by default)_
 
-### Specific options ###
+<!--- autogenerated options start - DO NOT EDIT, instead edit fs.RegInfo in backend/cache/cache.go then run make backenddocs -->
+### Standard Options
 
-Here are the command line options specific to this cloud storage
-system.
+Here are the standard options specific to cache (Cache a remote).
 
-#### --cache-db-path=PATH ####
+#### --cache-remote
 
-Path to where the file structure metadata (DB) is stored locally. The remote
-name is used as the DB file name.
+Remote to cache.
+Normally should contain a ':' and a path, eg "myremote:path/to/dir",
+"myremote:bucket" or maybe "myremote:" (not recommended).
 
-**Default**: <rclone default cache path>/cache-backend/<remote name>
-**Example**: /.cache/cache-backend/test-cache
+- Config:      remote
+- Env Var:     RCLONE_CACHE_REMOTE
+- Type:        string
+- Default:     ""
 
-#### --cache-chunk-path=PATH ####
+#### --cache-plex-url
 
-Path to where partial file data (chunks) is stored locally. The remote
-name is appended to the final path.
+The URL of the Plex server
 
-This config follows the `--cache-db-path`. If you specify a custom
-location for `--cache-db-path` and don't specify one for `--cache-chunk-path`
-then `--cache-chunk-path` will use the same path as `--cache-db-path`.
+- Config:      plex_url
+- Env Var:     RCLONE_CACHE_PLEX_URL
+- Type:        string
+- Default:     ""
 
-**Default**: <rclone default cache path>/cache-backend/<remote name>
-**Example**: /.cache/cache-backend/test-cache
+#### --cache-plex-username
 
-#### --cache-db-purge ####
+The username of the Plex user
 
-Flag to clear all the cached data for this remote on start.
+- Config:      plex_username
+- Env Var:     RCLONE_CACHE_PLEX_USERNAME
+- Type:        string
+- Default:     ""
 
-**Default**: not set
+#### --cache-plex-password
 
-#### --cache-chunk-size=SIZE ####
+The password of the Plex user
 
-The size of a chunk (partial file data). Use lower numbers for slower
-connections. If the chunk size is changed, any downloaded chunks will be invalid and cache-chunk-path will need to be cleared or unexpected EOF errors will occur.
+- Config:      plex_password
+- Env Var:     RCLONE_CACHE_PLEX_PASSWORD
+- Type:        string
+- Default:     ""
 
-**Default**: 5M
+#### --cache-chunk-size
 
-#### --cache-chunk-total-size=SIZE ####
+The size of a chunk (partial file data).
 
-The total size that the chunks can take up on the local disk. If `cache`
-exceeds this value then it will start to the delete the oldest chunks until 
-it goes under this value.
+Use lower numbers for slower connections. If the chunk size is
+changed, any downloaded chunks will be invalid and cache-chunk-path
+will need to be cleared or unexpected EOF errors will occur.
 
-**Default**: 10G
+- Config:      chunk_size
+- Env Var:     RCLONE_CACHE_CHUNK_SIZE
+- Type:        SizeSuffix
+- Default:     5M
+- Examples:
+    - "1m"
+        - 1MB
+    - "5M"
+        - 5 MB
+    - "10M"
+        - 10 MB
 
-#### --cache-chunk-clean-interval=DURATION ####
+#### --cache-info-age
 
-How often should `cache` perform cleanups of the chunk storage. The default value
-should be ok for most people. If you find that `cache` goes over `cache-chunk-total-size`
-too often then try to lower this value to force it to perform cleanups more often.
-
-**Default**: 1m
-
-#### --cache-info-age=DURATION ####
-
-How long to keep file structure information (directory listings, file size, 
-mod times etc) locally. 
-
-If all write operations are done through `cache` then you can safely make
+How long to cache file structure information (directory listings, file size, times etc). 
+If all write operations are done through the cache then you can safely make
 this value very large as the cache store will also be updated in real time.
 
-**Default**: 6h
+- Config:      info_age
+- Env Var:     RCLONE_CACHE_INFO_AGE
+- Type:        Duration
+- Default:     6h0m0s
+- Examples:
+    - "1h"
+        - 1 hour
+    - "24h"
+        - 24 hours
+    - "48h"
+        - 48 hours
 
-#### --cache-read-retries=RETRIES ####
+#### --cache-chunk-total-size
+
+The total size that the chunks can take up on the local disk.
+
+If the cache exceeds this value then it will start to delete the
+oldest chunks until it goes under this value.
+
+- Config:      chunk_total_size
+- Env Var:     RCLONE_CACHE_CHUNK_TOTAL_SIZE
+- Type:        SizeSuffix
+- Default:     10G
+- Examples:
+    - "500M"
+        - 500 MB
+    - "1G"
+        - 1 GB
+    - "10G"
+        - 10 GB
+
+### Advanced Options
+
+Here are the advanced options specific to cache (Cache a remote).
+
+#### --cache-plex-token
+
+The plex token for authentication - auto set normally
+
+- Config:      plex_token
+- Env Var:     RCLONE_CACHE_PLEX_TOKEN
+- Type:        string
+- Default:     ""
+
+#### --cache-plex-insecure
+
+Skip all certificate verifications when connecting to the Plex server
+
+- Config:      plex_insecure
+- Env Var:     RCLONE_CACHE_PLEX_INSECURE
+- Type:        string
+- Default:     ""
+
+#### --cache-db-path
+
+Directory to store file structure metadata DB.
+The remote name is used as the DB file name.
+
+- Config:      db_path
+- Env Var:     RCLONE_CACHE_DB_PATH
+- Type:        string
+- Default:     "/home/ncw/.cache/rclone/cache-backend"
+
+#### --cache-chunk-path
+
+Directory to cache chunk files.
+
+Path to where partial file data (chunks) are stored locally. The remote
+name is appended to the final path.
+
+This config follows the "--cache-db-path". If you specify a custom
+location for "--cache-db-path" and don't specify one for "--cache-chunk-path"
+then "--cache-chunk-path" will use the same path as "--cache-db-path".
+
+- Config:      chunk_path
+- Env Var:     RCLONE_CACHE_CHUNK_PATH
+- Type:        string
+- Default:     "/home/ncw/.cache/rclone/cache-backend"
+
+#### --cache-db-purge
+
+Clear all the cached data for this remote on start.
+
+- Config:      db_purge
+- Env Var:     RCLONE_CACHE_DB_PURGE
+- Type:        bool
+- Default:     false
+
+#### --cache-chunk-clean-interval
+
+How often should the cache perform cleanups of the chunk storage.
+The default value should be ok for most people. If you find that the
+cache goes over "cache-chunk-total-size" too often then try to lower
+this value to force it to perform cleanups more often.
+
+- Config:      chunk_clean_interval
+- Env Var:     RCLONE_CACHE_CHUNK_CLEAN_INTERVAL
+- Type:        Duration
+- Default:     1m0s
+
+#### --cache-read-retries
 
 How many times to retry a read from a cache storage.
 
-Since reading from a `cache` stream is independent from downloading file data, 
-readers can get to a point where there's no more data in the cache. 
-Most of the times this can indicate a connectivity issue if `cache` isn't
-able to provide file data anymore.
+Since reading from a cache stream is independent from downloading file
+data, readers can get to a point where there's no more data in the
+cache.  Most of the times this can indicate a connectivity issue if
+cache isn't able to provide file data anymore.
 
 For really slow connections, increase this to a point where the stream is
-able to provide data but your experience will be very stuttering. 
+able to provide data but your experience will be very stuttering.
 
-**Default**: 10
+- Config:      read_retries
+- Env Var:     RCLONE_CACHE_READ_RETRIES
+- Type:        int
+- Default:     10
 
-#### --cache-workers=WORKERS ####
+#### --cache-workers
 
 How many workers should run in parallel to download chunks.
 
-Higher values will mean more parallel processing (better CPU needed) and
-more concurrent requests on the cloud provider. 
-This impacts several aspects like the cloud provider API limits, more stress
-on the hardware that rclone runs on but it also means that streams will 
-be more fluid and data will be available much more faster to readers.
+Higher values will mean more parallel processing (better CPU needed)
+and more concurrent requests on the cloud provider.  This impacts
+several aspects like the cloud provider API limits, more stress on the
+hardware that rclone runs on but it also means that streams will be
+more fluid and data will be available much more faster to readers.
 
-**Note**: If the optional Plex integration is enabled then this setting
-will adapt to the type of reading performed and the value specified here will be used
-as a maximum number of workers to use.
-**Default**: 4
+**Note**: If the optional Plex integration is enabled then this
+setting will adapt to the type of reading performed and the value
+specified here will be used as a maximum number of workers to use.
 
-#### --cache-chunk-no-memory ####
+- Config:      workers
+- Env Var:     RCLONE_CACHE_WORKERS
+- Type:        int
+- Default:     4
 
-By default, `cache` will keep file data during streaming in RAM as well
+#### --cache-chunk-no-memory
+
+Disable the in-memory cache for storing chunks during streaming.
+
+By default, cache will keep file data during streaming in RAM as well
 to provide it to readers as fast as possible.
 
 This transient data is evicted as soon as it is read and the number of
 chunks stored doesn't exceed the number of workers. However, depending
-on other settings like `cache-chunk-size` and `cache-workers` this footprint
+on other settings like "cache-chunk-size" and "cache-workers" this footprint
 can increase if there are parallel streams too (multiple files being read
 at the same time).
 
@@ -398,55 +512,83 @@ If the hardware permits it, use this feature to provide an overall better
 performance during streaming but it can also be disabled if RAM is not
 available on the local machine.
 
-**Default**: not set
+- Config:      chunk_no_memory
+- Env Var:     RCLONE_CACHE_CHUNK_NO_MEMORY
+- Type:        bool
+- Default:     false
 
-#### --cache-rps=NUMBER ####
+#### --cache-rps
 
-This setting places a hard limit on the number of requests per second that `cache`
-will be doing to the cloud provider remote and try to respect that value
-by setting waits between reads.
+Limits the number of requests per second to the source FS (-1 to disable)
 
-If you find that you're getting banned or limited on the cloud provider
-through cache and know that a smaller number of requests per second will
-allow you to work with it then you can use this setting for that.
+This setting places a hard limit on the number of requests per second
+that cache will be doing to the cloud provider remote and try to
+respect that value by setting waits between reads.
 
-A good balance of all the other settings should make this
-setting useless but it is available to set for more special cases.
+If you find that you're getting banned or limited on the cloud
+provider through cache and know that a smaller number of requests per
+second will allow you to work with it then you can use this setting
+for that.
 
-**NOTE**: This will limit the number of requests during streams but other
-API calls to the cloud provider like directory listings will still pass.
+A good balance of all the other settings should make this setting
+useless but it is available to set for more special cases.
 
-**Default**: disabled
+**NOTE**: This will limit the number of requests during streams but
+other API calls to the cloud provider like directory listings will
+still pass.
 
-#### --cache-writes ####
+- Config:      rps
+- Env Var:     RCLONE_CACHE_RPS
+- Type:        int
+- Default:     -1
 
-If you need to read files immediately after you upload them through `cache`
-you can enable this flag to have their data stored in the cache store at the
-same time during upload.
+#### --cache-writes
 
-**Default**: not set
+Cache file data on writes through the FS
 
-#### --cache-tmp-upload-path=PATH ####
+If you need to read files immediately after you upload them through
+cache you can enable this flag to have their data stored in the
+cache store at the same time during upload.
 
-This is the path where `cache` will use as a temporary storage for new files
-that need to be uploaded to the cloud provider.
+- Config:      writes
+- Env Var:     RCLONE_CACHE_WRITES
+- Type:        bool
+- Default:     false
 
-Specifying a value will enable this feature. Without it, it is completely disabled
-and files will be uploaded directly to the cloud provider
+#### --cache-tmp-upload-path
 
-**Default**: empty
+Directory to keep temporary files until they are uploaded.
 
-#### --cache-tmp-wait-time=DURATION ####
+This is the path where cache will use as a temporary storage for new
+files that need to be uploaded to the cloud provider.
+
+Specifying a value will enable this feature. Without it, it is
+completely disabled and files will be uploaded directly to the cloud
+provider
+
+- Config:      tmp_upload_path
+- Env Var:     RCLONE_CACHE_TMP_UPLOAD_PATH
+- Type:        string
+- Default:     ""
+
+#### --cache-tmp-wait-time
+
+How long should files be stored in local cache before being uploaded
 
 This is the duration that a file must wait in the temporary location
 _cache-tmp-upload-path_ before it is selected for upload.
 
-Note that only one file is uploaded at a time and it can take longer to
-start the upload if a queue formed for this purpose.
+Note that only one file is uploaded at a time and it can take longer
+to start the upload if a queue formed for this purpose.
 
-**Default**: 15m
+- Config:      tmp_wait_time
+- Env Var:     RCLONE_CACHE_TMP_WAIT_TIME
+- Type:        Duration
+- Default:     15s
 
-#### --cache-db-wait-time=DURATION ####
+#### --cache-db-wait-time
+
+How long to wait for the DB to be available - 0 is unlimited
 
 Only one process can have the DB open at any one time, so rclone waits
 for this duration for the DB to become available before it gives an
@@ -454,4 +596,9 @@ error.
 
 If you set it to 0 then it will wait forever.
 
-**Default**: 1s
+- Config:      db_wait_time
+- Env Var:     RCLONE_CACHE_DB_WAIT_TIME
+- Type:        Duration
+- Default:     1s
+
+<!--- autogenerated options stop -->

docs/content/changelog.md

@@ -1,11 +1,110 @@
 ---
 title: "Documentation"
 description: "Rclone Changelog"
-date: "2018-09-01"
+date: "2018-10-15"
 ---
 
 # Changelog
 
+## v1.44 - 2018-10-15
+
+* New commands
+    * serve ftp: Add ftp server (Antoine GIRARD)
+    * settier: perform storage tier changes on supported remotes (sandeepkru)
+* New Features
+    * Reworked command line help
+        * Make default help less verbose (Nick Craig-Wood)
+        * Split flags up into global and backend flags (Nick Craig-Wood)
+        * Implement specialised help for flags and backends (Nick Craig-Wood)
+        * Show URL of backend help page when starting config (Nick Craig-Wood)
+    * stats: Long names now split in center (Joanna Marek)
+    * Add --log-format flag for more control over log output (dcpu)
+    * rc: Add support for OPTIONS and basic CORS (frenos)
+    * stats: show FatalErrors and NoRetryErrors in stats (Cédric Connes)
+* Bug Fixes
+    * Fix -P not ending with a new line (Nick Craig-Wood)
+    * config: don't create default config dir when user supplies --config (albertony)
+    * Don't print non-ASCII characters with --progress on windows (Nick Craig-Wood)
+    * Correct logs for excluded items (ssaqua)
+* Mount
+    * Remove EXPERIMENTAL tags (Nick Craig-Wood)
+* VFS
+    * Fix race condition detected by serve ftp tests (Nick Craig-Wood)
+    * Add vfs/poll-interval rc command (Fabian Möller)
+    * Enable rename for nearly all remotes using server side Move or Copy (Nick Craig-Wood)
+    * Reduce directory cache cleared by poll-interval (Fabian Möller)
+    * Remove EXPERIMENTAL tags (Nick Craig-Wood)
+* Local
+    * Skip bad symlinks in dir listing with -L enabled (Cédric Connes)
+    * Preallocate files on Windows to reduce fragmentation (Nick Craig-Wood)
+    * Preallocate files on linux with fallocate(2) (Nick Craig-Wood)
+* Cache
+    * Add cache/fetch rc function (Fabian Möller)
+    * Fix worker scale down (Fabian Möller)
+    * Improve performance by not sending info requests for cached chunks (dcpu)
+    * Fix error return value of cache/fetch rc method (Fabian Möller)
+    * Documentation fix for cache-chunk-total-size (Anagh Kumar Baranwal)
+    * Preserve leading / in wrapped remote path (Fabian Möller)
+    * Add plex_insecure option to skip certificate validation (Fabian Möller)
+    * Remove entries that no longer exist in the source (dcpu)
+* Crypt
+    * Preserve leading / in wrapped remote path (Fabian Möller)
+* Alias
+    * Fix handling of Windows network paths (Nick Craig-Wood)
+* Azure Blob
+    * Add --azureblob-list-chunk parameter (Santiago Rodríguez)
+    * Implemented settier command support on azureblob remote. (sandeepkru)
+    * Work around SDK bug which causes errors for chunk-sized files (Nick Craig-Wood)
+* Box
+    * Implement link sharing. (Sebastian Bünger)
+* Drive
+    * Add --drive-import-formats - google docs can now be imported (Fabian Möller)
+        * Rewrite mime type and extension handling (Fabian Möller)
+        * Add document links (Fabian Möller)
+        * Add support for multipart document extensions (Fabian Möller)
+        * Add support for apps-script to json export (Fabian Möller)
+        * Fix escaped chars in documents during list (Fabian Möller)
+    * Add --drive-v2-download-min-size a workaround for slow downloads (Fabian Möller)
+    * Improve directory notifications in ChangeNotify (Fabian Möller)
+    * When listing team drives in config, continue on failure (Nick Craig-Wood)
+* FTP
+    * Add a small pause after failed upload before deleting file (Nick Craig-Wood)
+* Google Cloud Storage
+    * Fix service_account_file being ignored (Fabian Möller)
+* Jottacloud
+    * Minor improvement in quota info (omit if unlimited) (albertony)
+    * Add --fast-list support (albertony)
+    * Add permanent delete support: --jottacloud-hard-delete (albertony)
+    * Add link sharing support (albertony)
+    * Fix handling of reserved characters. (Sebastian Bünger)
+    * Fix socket leak on Object.Remove (Nick Craig-Wood)
+* Onedrive
+    * Rework to support Microsoft Graph (Cnly)
+        * **NB** this will require re-authenticating the remote
+    * Removed upload cutoff and always do session uploads (Oliver Heyme)
+    * Use single-part upload for empty files (Cnly)
+    * Fix new fields not saved when editing old config (Alex Chen)
+    * Fix sometimes special chars in filenames not replaced (Alex Chen)
+    * Ignore OneNote files by default (Alex Chen)
+    * Add link sharing support (jackyzy823)
+* S3
+    * Use custom pacer, to retry operations when reasonable (Craig Miskell)
+    * Use configured server-side-encryption and storace class options when calling CopyObject() (Paul Kohout)
+    * Make --s3-v2-auth flag (Nick Craig-Wood)
+    * Fix v2 auth on files with spaces (Nick Craig-Wood)
+* Union
+    * Implement union backend which reads from multiple backends (Felix Brucker)
+    * Implement optional interfaces (Move, DirMove, Copy etc) (Nick Craig-Wood)
+    * Fix ChangeNotify to support multiple remotes (Fabian Möller)
+    * Fix --backup-dir on union backend (Nick Craig-Wood)
+* WebDAV
+    * Add another time format (Nick Craig-Wood)
+    * Add a small pause after failed upload before deleting file (Nick Craig-Wood)
+    * Add workaround for missing mtime (buergi)
+    * Sharepoint: Renew cookies after 12hrs (Henning Surmeier)
+* Yandex
+    * Remove redundant nil checks (teresy)
+
 ## v1.43.1 - 2018-09-07
 
 Point release to fix hubic and azureblob backends.

docs/content/commands/rclone.md

@@ -1,56 +1,22 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone"
 slug: rclone
 url: /commands/rclone/
 ---
 ## rclone
 
-Sync files and directories to and from local and remote object stores - v1.43
+Show help for rclone commands, flags and backends.
 
 ### Synopsis
 
 
-Rclone is a command line program to sync files and directories to and
-from various cloud storage systems and using file transfer services, such as:
+Rclone syncs files to and from cloud storage providers as well as
+mounting them, listing them in lots of different ways.
 
-  * Amazon Drive
-  * Amazon S3
-  * Backblaze B2
-  * Box
-  * Dropbox
-  * FTP
-  * Google Cloud Storage
-  * Google Drive
-  * HTTP
-  * Hubic
-  * Jottacloud
-  * Mega
-  * Microsoft Azure Blob Storage
-  * Microsoft OneDrive
-  * OpenDrive
-  * Openstack Swift / Rackspace cloud files / Memset Memstore
-  * pCloud
-  * QingStor
-  * SFTP
-  * Webdav / Owncloud / Nextcloud
-  * Yandex Disk
-  * The local filesystem
+See the home page (https://rclone.org/) for installation, usage,
+documentation, changelog and configuration walkthroughs.
 
-Features
-
-  * MD5/SHA1 hashes checked at all times for file integrity
-  * Timestamps preserved on files
-  * Partial syncs supported on a whole file basis
-  * Copy mode to just copy new/changed files
-  * Sync (one way) mode to make a directory identical
-  * Check mode to check for file hash equality
-  * Can sync to and from network, eg two different cloud accounts
-
-See the home page for installation, usage, documentation, changelog
-and configuration walkthroughs.
-
-  * https://rclone.org/
 
 
 ```
@@ -60,259 +26,277 @@ rclone [flags]
 ### Options
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-  -h, --help                                     help for rclone
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-  -V, --version                                  Print the version number
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+  -h, --help                                       help for rclone
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+  -V, --version                                    Print the version number
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
@@ -345,7 +329,7 @@ rclone [flags]
 * [rclone lsl](/commands/rclone_lsl/)	 - List the objects in path with modification time, size and path.
 * [rclone md5sum](/commands/rclone_md5sum/)	 - Produces an md5sum file for all the objects in the path.
 * [rclone mkdir](/commands/rclone_mkdir/)	 - Make the path if it doesn't already exist.
-* [rclone mount](/commands/rclone_mount/)	 - Mount the remote as a mountpoint. **EXPERIMENTAL**
+* [rclone mount](/commands/rclone_mount/)	 - Mount the remote as file system on a mountpoint.
 * [rclone move](/commands/rclone_move/)	 - Move files from source to dest.
 * [rclone moveto](/commands/rclone_moveto/)	 - Move file or directory from source to dest.
 * [rclone ncdu](/commands/rclone_ncdu/)	 - Explore a remote with a text based user interface.
@@ -356,6 +340,7 @@ rclone [flags]
 * [rclone rmdir](/commands/rclone_rmdir/)	 - Remove the path if empty.
 * [rclone rmdirs](/commands/rclone_rmdirs/)	 - Remove empty directories under the path.
 * [rclone serve](/commands/rclone_serve/)	 - Serve a remote over a protocol.
+* [rclone settier](/commands/rclone_settier/)	 - Changes storage class/tier of objects in remote.
 * [rclone sha1sum](/commands/rclone_sha1sum/)	 - Produces an sha1sum file for all the objects in the path.
 * [rclone size](/commands/rclone_size/)	 - Prints the total size and number of objects in remote:path.
 * [rclone sync](/commands/rclone_sync/)	 - Make source and dest identical, modifying destination only.
@@ -363,4 +348,4 @@ rclone [flags]
 * [rclone tree](/commands/rclone_tree/)	 - List the contents of the remote in a tree like fashion.
 * [rclone version](/commands/rclone_version/)	 - Show the version number.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_about.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone about"
 slug: rclone_about
 url: /commands/rclone_about/
@@ -69,261 +69,279 @@ rclone about remote: [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_authorize.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone authorize"
 slug: rclone_authorize
 url: /commands/rclone_authorize/
@@ -28,261 +28,279 @@ rclone authorize [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_cachestats.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone cachestats"
 slug: rclone_cachestats
 url: /commands/rclone_cachestats/
@@ -27,261 +27,279 @@ rclone cachestats source: [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_cat.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone cat"
 slug: rclone_cat
 url: /commands/rclone_cat/
@@ -49,261 +49,279 @@ rclone cat remote:path [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_check.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone check"
 slug: rclone_check
 url: /commands/rclone_check/
@@ -43,261 +43,279 @@ rclone check source:path dest:path [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018

docs/content/commands/rclone_cleanup.md

@@ -1,5 +1,5 @@
 ---
-date: 2018-09-01T12:54:54+01:00
+date: 2018-10-15T11:00:47+01:00
 title: "rclone cleanup"
 slug: rclone_cleanup
 url: /commands/rclone_cleanup/
@@ -28,261 +28,279 @@ rclone cleanup remote:path [flags]
 ### Options inherited from parent commands
 
 ```
-      --acd-auth-url string                      Auth server URL.
-      --acd-client-id string                     Amazon Application Client ID.
-      --acd-client-secret string                 Amazon Application Client Secret.
-      --acd-templink-threshold SizeSuffix        Files >= this size will be downloaded via their tempLink. (default 9G)
-      --acd-token-url string                     Token server url.
-      --acd-upload-wait-per-gb Duration          Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
-      --alias-remote string                      Remote or path to alias.
-      --ask-password                             Allow prompt for password for encrypted configuration. (default true)
-      --auto-confirm                             If enabled, do not request console confirmation.
-      --azureblob-access-tier string             Access tier of blob, supports hot, cool and archive tiers.
-      --azureblob-account string                 Storage Account Name (leave blank to use connection string or SAS URL)
-      --azureblob-chunk-size SizeSuffix          Upload chunk size. Must fit in memory. (default 4M)
-      --azureblob-endpoint string                Endpoint for the service
-      --azureblob-key string                     Storage Account Key (leave blank to use connection string or SAS URL)
-      --azureblob-sas-url string                 SAS URL for container level access only
-      --azureblob-upload-cutoff SizeSuffix       Cutoff for switching to chunked upload. (default 256M)
-      --b2-account string                        Account ID or Application Key ID
-      --b2-chunk-size SizeSuffix                 Upload chunk size. Must fit in memory. (default 96M)
-      --b2-endpoint string                       Endpoint for the service.
-      --b2-hard-delete                           Permanently delete files on remote removal, otherwise hide files.
-      --b2-key string                            Application Key
-      --b2-test-mode string                      A flag string for X-Bz-Test-Mode header for debugging.
-      --b2-upload-cutoff SizeSuffix              Cutoff for switching to chunked upload. (default 190.735M)
-      --b2-versions                              Include old versions in directory listings.
-      --backup-dir string                        Make backups into hierarchy based in DIR.
-      --bind string                              Local address to bind to for outgoing connections, IPv4, IPv6 or name.
-      --box-client-id string                     Box App Client Id.
-      --box-client-secret string                 Box App Client Secret
-      --box-commit-retries int                   Max number of times to try committing a multipart file. (default 100)
-      --box-upload-cutoff SizeSuffix             Cutoff for switching to multipart upload. (default 50M)
-      --buffer-size int                          In memory buffer size when reading files for each --transfer. (default 16M)
-      --bwlimit BwTimetable                      Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
-      --cache-chunk-clean-interval Duration      Interval at which chunk cleanup runs (default 1m0s)
-      --cache-chunk-no-memory                    Disable the in-memory cache for storing chunks during streaming
-      --cache-chunk-path string                  Directory to cache chunk files (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-chunk-size SizeSuffix              The size of a chunk. Lower value good for slow connections but can affect seamless reading. (default 5M)
-      --cache-chunk-total-size SizeSuffix        The maximum size of stored chunks. When the storage grows beyond this size, the oldest chunks will be deleted. (default 10G)
-      --cache-db-path string                     Directory to cache DB (default "/home/ncw/.cache/rclone/cache-backend")
-      --cache-db-purge                           Purge the cache DB before
-      --cache-db-wait-time Duration              How long to wait for the DB to be available - 0 is unlimited (default 1s)
-      --cache-dir string                         Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
-      --cache-info-age Duration                  How much time should object info (file size, file hashes etc) be stored in cache. (default 6h0m0s)
-      --cache-plex-password string               The password of the Plex user
-      --cache-plex-url string                    The URL of the Plex server
-      --cache-plex-username string               The username of the Plex user
-      --cache-read-retries int                   How many times to retry a read from a cache storage (default 10)
-      --cache-remote string                      Remote to cache.
-      --cache-rps int                            Limits the number of requests per second to the source FS. -1 disables the rate limiter (default -1)
-      --cache-tmp-upload-path string             Directory to keep temporary files until they are uploaded to the cloud storage
-      --cache-tmp-wait-time Duration             How long should files be stored in local cache before being uploaded (default 15s)
-      --cache-workers int                        How many workers should run in parallel to download chunks (default 4)
-      --cache-writes                             Will cache file data on writes through the FS
-      --checkers int                             Number of checkers to run in parallel. (default 8)
-  -c, --checksum                                 Skip based on checksum & size, not mod-time & size
-      --config string                            Config file. (default "/home/ncw/.rclone.conf")
-      --contimeout duration                      Connect timeout (default 1m0s)
-  -L, --copy-links                               Follow symlinks and copy the pointed to item.
-      --cpuprofile string                        Write cpu profile to file
-      --crypt-directory-name-encryption          Option to either encrypt directory names or leave them intact. (default true)
-      --crypt-filename-encryption string         How to encrypt the filenames. (default "standard")
-      --crypt-password string                    Password or pass phrase for encryption.
-      --crypt-password2 string                   Password or pass phrase for salt. Optional but recommended.
-      --crypt-remote string                      Remote to encrypt/decrypt.
-      --crypt-show-mapping                       For all files listed show how the names encrypt.
-      --delete-after                             When synchronizing, delete files on destination after transfering (default)
-      --delete-before                            When synchronizing, delete files on destination before transfering
-      --delete-during                            When synchronizing, delete files during transfer
-      --delete-excluded                          Delete files on dest excluded from sync
-      --disable string                           Disable a comma separated list of features.  Use help to see a list.
-      --drive-acknowledge-abuse                  Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
-      --drive-alternate-export                   Use alternate export URLs for google documents export.
-      --drive-auth-owner-only                    Only consider files owned by the authenticated user.
-      --drive-chunk-size SizeSuffix              Upload chunk size. Must a power of 2 >= 256k. (default 8M)
-      --drive-client-id string                   Google Application Client Id
-      --drive-client-secret string               Google Application Client Secret
-      --drive-formats string                     Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
-      --drive-impersonate string                 Impersonate this user when using a service account.
-      --drive-keep-revision-forever              Keep new head revision forever.
-      --drive-list-chunk int                     Size of listing chunk 100-1000. 0 to disable. (default 1000)
-      --drive-root-folder-id string              ID of the root folder
-      --drive-scope string                       Scope that rclone should use when requesting access from drive.
-      --drive-service-account-file string        Service Account Credentials JSON file path
-      --drive-shared-with-me                     Only show files that are shared with me
-      --drive-skip-gdocs                         Skip google documents in all listings.
-      --drive-trashed-only                       Only show files that are in the trash
-      --drive-upload-cutoff SizeSuffix           Cutoff for switching to chunked upload (default 8M)
-      --drive-use-created-date                   Use created date instead of modified date.
-      --drive-use-trash                          Send files to the trash instead of deleting permanently. (default true)
-      --dropbox-chunk-size SizeSuffix            Upload chunk size. Max 150M. (default 48M)
-      --dropbox-client-id string                 Dropbox App Client Id
-      --dropbox-client-secret string             Dropbox App Client Secret
-  -n, --dry-run                                  Do a trial run with no permanent changes
-      --dump string                              List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
-      --dump-bodies                              Dump HTTP headers and bodies - may contain sensitive info
-      --dump-headers                             Dump HTTP bodies - may contain sensitive info
-      --exclude stringArray                      Exclude files matching pattern
-      --exclude-from stringArray                 Read exclude patterns from file
-      --exclude-if-present string                Exclude directories if filename is present
-      --fast-list                                Use recursive list if available. Uses more memory but fewer transactions.
-      --files-from stringArray                   Read list of source-file names from file
-  -f, --filter stringArray                       Add a file-filtering rule
-      --filter-from stringArray                  Read filtering patterns from a file
-      --ftp-host string                          FTP host to connect to
-      --ftp-pass string                          FTP password
-      --ftp-port string                          FTP port, leave blank to use default (21)
-      --ftp-user string                          FTP username, leave blank for current username, ncw
-      --gcs-bucket-acl string                    Access Control List for new buckets.
-      --gcs-client-id string                     Google Application Client Id
-      --gcs-client-secret string                 Google Application Client Secret
-      --gcs-location string                      Location for the newly created buckets.
-      --gcs-object-acl string                    Access Control List for new objects.
-      --gcs-project-number string                Project number.
-      --gcs-service-account-file string          Service Account Credentials JSON file path
-      --gcs-storage-class string                 The storage class to use when storing objects in Google Cloud Storage.
-      --http-url string                          URL of http host to connect to
-      --hubic-client-id string                   Hubic Client Id
-      --hubic-client-secret string               Hubic Client Secret
-      --ignore-checksum                          Skip post copy check of checksums.
-      --ignore-errors                            delete even if there are I/O errors
-      --ignore-existing                          Skip all files that exist on destination
-      --ignore-size                              Ignore size when skipping use mod-time or checksum.
-  -I, --ignore-times                             Don't skip files that match size and time - transfer all files
-      --immutable                                Do not modify files. Fail if existing files have been modified.
-      --include stringArray                      Include files matching pattern
-      --include-from stringArray                 Read include patterns from file
-      --jottacloud-md5-memory-limit SizeSuffix   Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
-      --jottacloud-mountpoint string             The mountpoint to use.
-      --jottacloud-pass string                   Password.
-      --jottacloud-user string                   User Name
-      --local-no-check-updated                   Don't check to see if the files change during upload
-      --local-no-unicode-normalization           Don't apply unicode normalization to paths and filenames
-      --local-nounc string                       Disable UNC (long path names) conversion on Windows
-      --log-file string                          Log everything to this file
-      --log-level string                         Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
-      --low-level-retries int                    Number of low level retries to do. (default 10)
-      --max-age duration                         Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --max-backlog int                          Maximum number of objects in sync or check backlog. (default 10000)
-      --max-delete int                           When synchronizing, limit the number of deletes (default -1)
-      --max-depth int                            If set limits the recursion depth to this. (default -1)
-      --max-size int                             Only transfer files smaller than this in k or suffix b|k|M|G (default off)
-      --max-transfer int                         Maximum size of data to transfer. (default off)
-      --mega-debug                               Output more debug from Mega.
-      --mega-hard-delete                         Delete files permanently rather than putting them into the trash.
-      --mega-pass string                         Password.
-      --mega-user string                         User name
-      --memprofile string                        Write memory profile to file
-      --min-age duration                         Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
-      --min-size int                             Only transfer files bigger than this in k or suffix b|k|M|G (default off)
-      --modify-window duration                   Max time diff to be considered the same (default 1ns)
-      --no-check-certificate                     Do not verify the server SSL certificate. Insecure.
-      --no-gzip-encoding                         Don't set Accept-Encoding: gzip.
-      --no-traverse                              Obsolete - does nothing.
-      --no-update-modtime                        Don't update destination mod-time if files identical.
-  -x, --one-file-system                          Don't cross filesystem boundaries (unix/macOS only).
-      --onedrive-chunk-size SizeSuffix           Chunk size to upload files with - must be multiple of 320k. (default 10M)
-      --onedrive-client-id string                Microsoft App Client Id
-      --onedrive-client-secret string            Microsoft App Client Secret
-      --opendrive-password string                Password.
-      --opendrive-username string                Username
-      --pcloud-client-id string                  Pcloud App Client Id
-      --pcloud-client-secret string              Pcloud App Client Secret
-  -P, --progress                                 Show progress during transfer.
-      --qingstor-access-key-id string            QingStor Access Key ID
-      --qingstor-connection-retries int          Number of connnection retries. (default 3)
-      --qingstor-endpoint string                 Enter a endpoint URL to connection QingStor API.
-      --qingstor-env-auth                        Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
-      --qingstor-secret-access-key string        QingStor Secret Access Key (password)
-      --qingstor-zone string                     Zone to connect to.
-  -q, --quiet                                    Print as little stuff as possible
-      --rc                                       Enable the remote control server.
-      --rc-addr string                           IPaddress:Port or :Port to bind server to. (default "localhost:5572")
-      --rc-cert string                           SSL PEM key (concatenation of certificate and CA certificate)
-      --rc-client-ca string                      Client certificate authority to verify clients with
-      --rc-htpasswd string                       htpasswd file - if not provided no authentication is done
-      --rc-key string                            SSL PEM Private key
-      --rc-max-header-bytes int                  Maximum size of request header (default 4096)
-      --rc-pass string                           Password for authentication.
-      --rc-realm string                          realm for authentication (default "rclone")
-      --rc-server-read-timeout duration          Timeout for server reading data (default 1h0m0s)
-      --rc-server-write-timeout duration         Timeout for server writing data (default 1h0m0s)
-      --rc-user string                           User name for authentication.
-      --retries int                              Retry operations this many times if they fail (default 3)
-      --retries-sleep duration                   Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
-      --s3-access-key-id string                  AWS Access Key ID.
-      --s3-acl string                            Canned ACL used when creating buckets and/or storing objects in S3.
-      --s3-chunk-size SizeSuffix                 Chunk size to use for uploading (default 5M)
-      --s3-disable-checksum                      Don't store MD5 checksum with object metadata
-      --s3-endpoint string                       Endpoint for S3 API.
-      --s3-env-auth                              Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
-      --s3-force-path-style                      If true use path style access if false use virtual hosted style. (default true)
-      --s3-location-constraint string            Location constraint - must be set to match the Region.
-      --s3-provider string                       Choose your S3 provider.
-      --s3-region string                         Region to connect to.
-      --s3-secret-access-key string              AWS Secret Access Key (password)
-      --s3-server-side-encryption string         The server-side encryption algorithm used when storing this object in S3.
-      --s3-sse-kms-key-id string                 If using KMS ID you must provide the ARN of Key.
-      --s3-storage-class string                  The storage class to use when storing objects in S3.
-      --s3-upload-concurrency int                Concurrency for multipart uploads. (default 2)
-      --sftp-ask-password                        Allow asking for SFTP password when needed.
-      --sftp-disable-hashcheck                   Disable the execution of SSH commands to determine if remote file hashing is available.
-      --sftp-host string                         SSH host to connect to
-      --sftp-key-file string                     Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
-      --sftp-pass string                         SSH password, leave blank to use ssh-agent.
-      --sftp-path-override string                Override path used by SSH connection.
-      --sftp-port string                         SSH port, leave blank to use default (22)
-      --sftp-set-modtime                         Set the modified time on the remote if set. (default true)
-      --sftp-use-insecure-cipher                 Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
-      --sftp-user string                         SSH username, leave blank for current username, ncw
-      --size-only                                Skip based on size only, not mod-time or checksum
-      --skip-links                               Don't warn about skipped symlinks.
-      --stats duration                           Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
-      --stats-file-name-length int               Max file name length in stats. 0 for no limit (default 40)
-      --stats-log-level string                   Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
-      --stats-one-line                           Make the stats fit on one line.
-      --stats-unit string                        Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
-      --streaming-upload-cutoff int              Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
-      --suffix string                            Suffix for use with --backup-dir.
-      --swift-auth string                        Authentication URL for server (OS_AUTH_URL).
-      --swift-auth-token string                  Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
-      --swift-auth-version int                   AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
-      --swift-chunk-size SizeSuffix              Above this size files will be chunked into a _segments container. (default 5G)
-      --swift-domain string                      User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
-      --swift-endpoint-type string               Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
-      --swift-env-auth                           Get swift credentials from environment variables in standard OpenStack form.
-      --swift-key string                         API key or password (OS_PASSWORD).
-      --swift-region string                      Region name - optional (OS_REGION_NAME)
-      --swift-storage-policy string              The storage policy to use when creating a new container
-      --swift-storage-url string                 Storage URL - optional (OS_STORAGE_URL)
-      --swift-tenant string                      Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
-      --swift-tenant-domain string               Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
-      --swift-tenant-id string                   Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
-      --swift-user string                        User name to log in (OS_USERNAME).
-      --swift-user-id string                     User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
-      --syslog                                   Use Syslog for logging
-      --syslog-facility string                   Facility for syslog, eg KERN,USER,... (default "DAEMON")
-      --timeout duration                         IO idle timeout (default 5m0s)
-      --tpslimit float                           Limit HTTP transactions per second to this.
-      --tpslimit-burst int                       Max burst of transactions for --tpslimit. (default 1)
-      --track-renames                            When synchronizing, track file renames and do a server side move if possible
-      --transfers int                            Number of file transfers to run in parallel. (default 4)
-  -u, --update                                   Skip files that are newer on the destination.
-      --use-server-modtime                       Use server modified time instead of object metadata
-      --user-agent string                        Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.43")
-  -v, --verbose count                            Print lots more stuff (repeat for more)
-      --webdav-bearer-token string               Bearer token instead of user/pass (eg a Macaroon)
-      --webdav-pass string                       Password.
-      --webdav-url string                        URL of http host to connect to
-      --webdav-user string                       User name
-      --webdav-vendor string                     Name of the Webdav site/service/software you are using
-      --yandex-client-id string                  Yandex Client Id
-      --yandex-client-secret string              Yandex Client Secret
+      --acd-auth-url string                        Auth server URL.
+      --acd-client-id string                       Amazon Application Client ID.
+      --acd-client-secret string                   Amazon Application Client Secret.
+      --acd-templink-threshold SizeSuffix          Files >= this size will be downloaded via their tempLink. (default 9G)
+      --acd-token-url string                       Token server url.
+      --acd-upload-wait-per-gb Duration            Additional time per GB to wait after a failed complete upload to see if it appears. (default 3m0s)
+      --alias-remote string                        Remote or path to alias.
+      --ask-password                               Allow prompt for password for encrypted configuration. (default true)
+      --auto-confirm                               If enabled, do not request console confirmation.
+      --azureblob-access-tier string               Access tier of blob: hot, cool or archive.
+      --azureblob-account string                   Storage Account Name (leave blank to use connection string or SAS URL)
+      --azureblob-chunk-size SizeSuffix            Upload chunk size (<= 100MB). (default 4M)
+      --azureblob-endpoint string                  Endpoint for the service
+      --azureblob-key string                       Storage Account Key (leave blank to use connection string or SAS URL)
+      --azureblob-list-chunk int                   Size of blob list. (default 5000)
+      --azureblob-sas-url string                   SAS URL for container level access only
+      --azureblob-upload-cutoff SizeSuffix         Cutoff for switching to chunked upload (<= 256MB). (default 256M)
+      --b2-account string                          Account ID or Application Key ID
+      --b2-chunk-size SizeSuffix                   Upload chunk size. Must fit in memory. (default 96M)
+      --b2-endpoint string                         Endpoint for the service.
+      --b2-hard-delete                             Permanently delete files on remote removal, otherwise hide files.
+      --b2-key string                              Application Key
+      --b2-test-mode string                        A flag string for X-Bz-Test-Mode header for debugging.
+      --b2-upload-cutoff SizeSuffix                Cutoff for switching to chunked upload. (default 200M)
+      --b2-versions                                Include old versions in directory listings.
+      --backup-dir string                          Make backups into hierarchy based in DIR.
+      --bind string                                Local address to bind to for outgoing connections, IPv4, IPv6 or name.
+      --box-client-id string                       Box App Client Id.
+      --box-client-secret string                   Box App Client Secret
+      --box-commit-retries int                     Max number of times to try committing a multipart file. (default 100)
+      --box-upload-cutoff SizeSuffix               Cutoff for switching to multipart upload (>= 50MB). (default 50M)
+      --buffer-size int                            In memory buffer size when reading files for each --transfer. (default 16M)
+      --bwlimit BwTimetable                        Bandwidth limit in kBytes/s, or use suffix b|k|M|G or a full timetable.
+      --cache-chunk-clean-interval Duration        How often should the cache perform cleanups of the chunk storage. (default 1m0s)
+      --cache-chunk-no-memory                      Disable the in-memory cache for storing chunks during streaming.
+      --cache-chunk-path string                    Directory to cache chunk files. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-chunk-size SizeSuffix                The size of a chunk (partial file data). (default 5M)
+      --cache-chunk-total-size SizeSuffix          The total size that the chunks can take up on the local disk. (default 10G)
+      --cache-db-path string                       Directory to store file structure metadata DB. (default "/home/ncw/.cache/rclone/cache-backend")
+      --cache-db-purge                             Clear all the cached data for this remote on start.
+      --cache-db-wait-time Duration                How long to wait for the DB to be available - 0 is unlimited (default 1s)
+      --cache-dir string                           Directory rclone will use for caching. (default "/home/ncw/.cache/rclone")
+      --cache-info-age Duration                    How long to cache file structure information (directory listings, file size, times etc). (default 6h0m0s)
+      --cache-plex-insecure string                 Skip all certificate verifications when connecting to the Plex server
+      --cache-plex-password string                 The password of the Plex user
+      --cache-plex-url string                      The URL of the Plex server
+      --cache-plex-username string                 The username of the Plex user
+      --cache-read-retries int                     How many times to retry a read from a cache storage. (default 10)
+      --cache-remote string                        Remote to cache.
+      --cache-rps int                              Limits the number of requests per second to the source FS (-1 to disable) (default -1)
+      --cache-tmp-upload-path string               Directory to keep temporary files until they are uploaded.
+      --cache-tmp-wait-time Duration               How long should files be stored in local cache before being uploaded (default 15s)
+      --cache-workers int                          How many workers should run in parallel to download chunks. (default 4)
+      --cache-writes                               Cache file data on writes through the FS
+      --checkers int                               Number of checkers to run in parallel. (default 8)
+  -c, --checksum                                   Skip based on checksum & size, not mod-time & size
+      --config string                              Config file. (default "/home/ncw/.rclone.conf")
+      --contimeout duration                        Connect timeout (default 1m0s)
+  -L, --copy-links                                 Follow symlinks and copy the pointed to item.
+      --cpuprofile string                          Write cpu profile to file
+      --crypt-directory-name-encryption            Option to either encrypt directory names or leave them intact. (default true)
+      --crypt-filename-encryption string           How to encrypt the filenames. (default "standard")
+      --crypt-password string                      Password or pass phrase for encryption.
+      --crypt-password2 string                     Password or pass phrase for salt. Optional but recommended.
+      --crypt-remote string                        Remote to encrypt/decrypt.
+      --crypt-show-mapping                         For all files listed show how the names encrypt.
+      --delete-after                               When synchronizing, delete files on destination after transfering (default)
+      --delete-before                              When synchronizing, delete files on destination before transfering
+      --delete-during                              When synchronizing, delete files during transfer
+      --delete-excluded                            Delete files on dest excluded from sync
+      --disable string                             Disable a comma separated list of features.  Use help to see a list.
+      --drive-acknowledge-abuse                    Set to allow files which return cannotDownloadAbusiveFile to be downloaded.
+      --drive-allow-import-name-change             Allow the filetype to change when uploading Google docs (e.g. file.doc to file.docx). This will confuse sync and reupload every time.
+      --drive-alternate-export                     Use alternate export URLs for google documents export.,
+      --drive-auth-owner-only                      Only consider files owned by the authenticated user.
+      --drive-chunk-size SizeSuffix                Upload chunk size. Must a power of 2 >= 256k. (default 8M)
+      --drive-client-id string                     Google Application Client Id
+      --drive-client-secret string                 Google Application Client Secret
+      --drive-export-formats string                Comma separated list of preferred formats for downloading Google docs. (default "docx,xlsx,pptx,svg")
+      --drive-formats string                       Deprecated: see export_formats
+      --drive-impersonate string                   Impersonate this user when using a service account.
+      --drive-import-formats string                Comma separated list of preferred formats for uploading Google docs.
+      --drive-keep-revision-forever                Keep new head revision of each file forever.
+      --drive-list-chunk int                       Size of listing chunk 100-1000. 0 to disable. (default 1000)
+      --drive-root-folder-id string                ID of the root folder
+      --drive-scope string                         Scope that rclone should use when requesting access from drive.
+      --drive-service-account-credentials string   Service Account Credentials JSON blob
+      --drive-service-account-file string          Service Account Credentials JSON file path
+      --drive-shared-with-me                       Only show files that are shared with me.
+      --drive-skip-gdocs                           Skip google documents in all listings.
+      --drive-team-drive string                    ID of the Team Drive
+      --drive-trashed-only                         Only show files that are in the trash.
+      --drive-upload-cutoff SizeSuffix             Cutoff for switching to chunked upload (default 8M)
+      --drive-use-created-date                     Use file created date instead of modified date.,
+      --drive-use-trash                            Send files to the trash instead of deleting permanently. (default true)
+      --drive-v2-download-min-size SizeSuffix      If Object's are greater, use drive v2 API to download. (default off)
+      --dropbox-chunk-size SizeSuffix              Upload chunk size. (< 150M). (default 48M)
+      --dropbox-client-id string                   Dropbox App Client Id
+      --dropbox-client-secret string               Dropbox App Client Secret
+  -n, --dry-run                                    Do a trial run with no permanent changes
+      --dump string                                List of items to dump from: headers,bodies,requests,responses,auth,filters,goroutines,openfiles
+      --dump-bodies                                Dump HTTP headers and bodies - may contain sensitive info
+      --dump-headers                               Dump HTTP bodies - may contain sensitive info
+      --exclude stringArray                        Exclude files matching pattern
+      --exclude-from stringArray                   Read exclude patterns from file
+      --exclude-if-present string                  Exclude directories if filename is present
+      --fast-list                                  Use recursive list if available. Uses more memory but fewer transactions.
+      --files-from stringArray                     Read list of source-file names from file
+  -f, --filter stringArray                         Add a file-filtering rule
+      --filter-from stringArray                    Read filtering patterns from a file
+      --ftp-host string                            FTP host to connect to
+      --ftp-pass string                            FTP password
+      --ftp-port string                            FTP port, leave blank to use default (21)
+      --ftp-user string                            FTP username, leave blank for current username, ncw
+      --gcs-bucket-acl string                      Access Control List for new buckets.
+      --gcs-client-id string                       Google Application Client Id
+      --gcs-client-secret string                   Google Application Client Secret
+      --gcs-location string                        Location for the newly created buckets.
+      --gcs-object-acl string                      Access Control List for new objects.
+      --gcs-project-number string                  Project number.
+      --gcs-service-account-file string            Service Account Credentials JSON file path
+      --gcs-storage-class string                   The storage class to use when storing objects in Google Cloud Storage.
+      --http-url string                            URL of http host to connect to
+      --hubic-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --hubic-client-id string                     Hubic Client Id
+      --hubic-client-secret string                 Hubic Client Secret
+      --ignore-checksum                            Skip post copy check of checksums.
+      --ignore-errors                              delete even if there are I/O errors
+      --ignore-existing                            Skip all files that exist on destination
+      --ignore-size                                Ignore size when skipping use mod-time or checksum.
+  -I, --ignore-times                               Don't skip files that match size and time - transfer all files
+      --immutable                                  Do not modify files. Fail if existing files have been modified.
+      --include stringArray                        Include files matching pattern
+      --include-from stringArray                   Read include patterns from file
+      --jottacloud-hard-delete                     Delete files permanently rather than putting them into the trash.
+      --jottacloud-md5-memory-limit SizeSuffix     Files bigger than this will be cached on disk to calculate the MD5 if required. (default 10M)
+      --jottacloud-mountpoint string               The mountpoint to use.
+      --jottacloud-pass string                     Password.
+      --jottacloud-unlink                          Remove existing public link to file/folder with link command rather than creating.
+      --jottacloud-user string                     User Name
+      --local-no-check-updated                     Don't check to see if the files change during upload
+      --local-no-unicode-normalization             Don't apply unicode normalization to paths and filenames (Deprecated)
+      --local-nounc string                         Disable UNC (long path names) conversion on Windows
+      --log-file string                            Log everything to this file
+      --log-format string                          Comma separated list of log format options (default "date,time")
+      --log-level string                           Log level DEBUG|INFO|NOTICE|ERROR (default "NOTICE")
+      --low-level-retries int                      Number of low level retries to do. (default 10)
+      --max-age duration                           Only transfer files younger than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --max-backlog int                            Maximum number of objects in sync or check backlog. (default 10000)
+      --max-delete int                             When synchronizing, limit the number of deletes (default -1)
+      --max-depth int                              If set limits the recursion depth to this. (default -1)
+      --max-size int                               Only transfer files smaller than this in k or suffix b|k|M|G (default off)
+      --max-transfer int                           Maximum size of data to transfer. (default off)
+      --mega-debug                                 Output more debug from Mega.
+      --mega-hard-delete                           Delete files permanently rather than putting them into the trash.
+      --mega-pass string                           Password.
+      --mega-user string                           User name
+      --memprofile string                          Write memory profile to file
+      --min-age duration                           Only transfer files older than this in s or suffix ms|s|m|h|d|w|M|y (default off)
+      --min-size int                               Only transfer files bigger than this in k or suffix b|k|M|G (default off)
+      --modify-window duration                     Max time diff to be considered the same (default 1ns)
+      --no-check-certificate                       Do not verify the server SSL certificate. Insecure.
+      --no-gzip-encoding                           Don't set Accept-Encoding: gzip.
+      --no-traverse                                Obsolete - does nothing.
+      --no-update-modtime                          Don't update destination mod-time if files identical.
+  -x, --one-file-system                            Don't cross filesystem boundaries (unix/macOS only).
+      --onedrive-chunk-size SizeSuffix             Chunk size to upload files with - must be multiple of 320k. (default 10M)
+      --onedrive-client-id string                  Microsoft App Client Id
+      --onedrive-client-secret string              Microsoft App Client Secret
+      --onedrive-drive-id string                   The ID of the drive to use
+      --onedrive-drive-type string                 The type of the drive ( personal | business | documentLibrary )
+      --onedrive-expose-onenote-files              Set to make OneNote files show up in directory listings.
+      --opendrive-password string                  Password.
+      --opendrive-username string                  Username
+      --pcloud-client-id string                    Pcloud App Client Id
+      --pcloud-client-secret string                Pcloud App Client Secret
+  -P, --progress                                   Show progress during transfer.
+      --qingstor-access-key-id string              QingStor Access Key ID
+      --qingstor-connection-retries int            Number of connnection retries. (default 3)
+      --qingstor-endpoint string                   Enter a endpoint URL to connection QingStor API.
+      --qingstor-env-auth                          Get QingStor credentials from runtime. Only applies if access_key_id and secret_access_key is blank.
+      --qingstor-secret-access-key string          QingStor Secret Access Key (password)
+      --qingstor-zone string                       Zone to connect to.
+  -q, --quiet                                      Print as little stuff as possible
+      --rc                                         Enable the remote control server.
+      --rc-addr string                             IPaddress:Port or :Port to bind server to. (default "localhost:5572")
+      --rc-cert string                             SSL PEM key (concatenation of certificate and CA certificate)
+      --rc-client-ca string                        Client certificate authority to verify clients with
+      --rc-htpasswd string                         htpasswd file - if not provided no authentication is done
+      --rc-key string                              SSL PEM Private key
+      --rc-max-header-bytes int                    Maximum size of request header (default 4096)
+      --rc-pass string                             Password for authentication.
+      --rc-realm string                            realm for authentication (default "rclone")
+      --rc-server-read-timeout duration            Timeout for server reading data (default 1h0m0s)
+      --rc-server-write-timeout duration           Timeout for server writing data (default 1h0m0s)
+      --rc-user string                             User name for authentication.
+      --retries int                                Retry operations this many times if they fail (default 3)
+      --retries-sleep duration                     Interval between retrying operations if they fail, e.g 500ms, 60s, 5m. (0 to disable)
+      --s3-access-key-id string                    AWS Access Key ID.
+      --s3-acl string                              Canned ACL used when creating buckets and/or storing objects in S3.
+      --s3-chunk-size SizeSuffix                   Chunk size to use for uploading. (default 5M)
+      --s3-disable-checksum                        Don't store MD5 checksum with object metadata
+      --s3-endpoint string                         Endpoint for S3 API.
+      --s3-env-auth                                Get AWS credentials from runtime (environment variables or EC2/ECS meta data if no env vars).
+      --s3-force-path-style                        If true use path style access if false use virtual hosted style. (default true)
+      --s3-location-constraint string              Location constraint - must be set to match the Region.
+      --s3-provider string                         Choose your S3 provider.
+      --s3-region string                           Region to connect to.
+      --s3-secret-access-key string                AWS Secret Access Key (password)
+      --s3-server-side-encryption string           The server-side encryption algorithm used when storing this object in S3.
+      --s3-session-token string                    An AWS session token
+      --s3-sse-kms-key-id string                   If using KMS ID you must provide the ARN of Key.
+      --s3-storage-class string                    The storage class to use when storing new objects in S3.
+      --s3-upload-concurrency int                  Concurrency for multipart uploads. (default 2)
+      --s3-v2-auth                                 If true use v2 authentication.
+      --sftp-ask-password                          Allow asking for SFTP password when needed.
+      --sftp-disable-hashcheck                     Disable the execution of SSH commands to determine if remote file hashing is available.
+      --sftp-host string                           SSH host to connect to
+      --sftp-key-file string                       Path to unencrypted PEM-encoded private key file, leave blank to use ssh-agent.
+      --sftp-pass string                           SSH password, leave blank to use ssh-agent.
+      --sftp-path-override string                  Override path used by SSH connection.
+      --sftp-port string                           SSH port, leave blank to use default (22)
+      --sftp-set-modtime                           Set the modified time on the remote if set. (default true)
+      --sftp-use-insecure-cipher                   Enable the use of the aes128-cbc cipher. This cipher is insecure and may allow plaintext data to be recovered by an attacker.
+      --sftp-user string                           SSH username, leave blank for current username, ncw
+      --size-only                                  Skip based on size only, not mod-time or checksum
+      --skip-links                                 Don't warn about skipped symlinks.
+      --stats duration                             Interval between printing stats, e.g 500ms, 60s, 5m. (0 to disable) (default 1m0s)
+      --stats-file-name-length int                 Max file name length in stats. 0 for no limit (default 40)
+      --stats-log-level string                     Log level to show --stats output DEBUG|INFO|NOTICE|ERROR (default "INFO")
+      --stats-one-line                             Make the stats fit on one line.
+      --stats-unit string                          Show data rate in stats as either 'bits' or 'bytes'/s (default "bytes")
+      --streaming-upload-cutoff int                Cutoff for switching to chunked upload if file size is unknown. Upload starts after reaching cutoff or when file ends. (default 100k)
+      --suffix string                              Suffix for use with --backup-dir.
+      --swift-auth string                          Authentication URL for server (OS_AUTH_URL).
+      --swift-auth-token string                    Auth Token from alternate authentication - optional (OS_AUTH_TOKEN)
+      --swift-auth-version int                     AuthVersion - optional - set to (1,2,3) if your auth URL has no version (ST_AUTH_VERSION)
+      --swift-chunk-size SizeSuffix                Above this size files will be chunked into a _segments container. (default 5G)
+      --swift-domain string                        User domain - optional (v3 auth) (OS_USER_DOMAIN_NAME)
+      --swift-endpoint-type string                 Endpoint type to choose from the service catalogue (OS_ENDPOINT_TYPE) (default "public")
+      --swift-env-auth                             Get swift credentials from environment variables in standard OpenStack form.
+      --swift-key string                           API key or password (OS_PASSWORD).
+      --swift-region string                        Region name - optional (OS_REGION_NAME)
+      --swift-storage-policy string                The storage policy to use when creating a new container
+      --swift-storage-url string                   Storage URL - optional (OS_STORAGE_URL)
+      --swift-tenant string                        Tenant name - optional for v1 auth, this or tenant_id required otherwise (OS_TENANT_NAME or OS_PROJECT_NAME)
+      --swift-tenant-domain string                 Tenant domain - optional (v3 auth) (OS_PROJECT_DOMAIN_NAME)
+      --swift-tenant-id string                     Tenant ID - optional for v1 auth, this or tenant required otherwise (OS_TENANT_ID)
+      --swift-user string                          User name to log in (OS_USERNAME).
+      --swift-user-id string                       User ID to log in - optional - most swift systems use user and leave this blank (v3 auth) (OS_USER_ID).
+      --syslog                                     Use Syslog for logging
+      --syslog-facility string                     Facility for syslog, eg KERN,USER,... (default "DAEMON")
+      --timeout duration                           IO idle timeout (default 5m0s)
+      --tpslimit float                             Limit HTTP transactions per second to this.
+      --tpslimit-burst int                         Max burst of transactions for --tpslimit. (default 1)
+      --track-renames                              When synchronizing, track file renames and do a server side move if possible
+      --transfers int                              Number of file transfers to run in parallel. (default 4)
+      --union-remotes string                       List of space separated remotes.
+  -u, --update                                     Skip files that are newer on the destination.
+      --use-server-modtime                         Use server modified time instead of object metadata
+      --user-agent string                          Set the user-agent to a specified string. The default is rclone/ version (default "rclone/v1.44")
+  -v, --verbose count                              Print lots more stuff (repeat for more)
+      --webdav-bearer-token string                 Bearer token instead of user/pass (eg a Macaroon)
+      --webdav-pass string                         Password.
+      --webdav-url string                          URL of http host to connect to
+      --webdav-user string                         User name
+      --webdav-vendor string                       Name of the Webdav site/service/software you are using
+      --yandex-client-id string                    Yandex Client Id
+      --yandex-client-secret string                Yandex Client Secret
 ```
 
 ### SEE ALSO
 
-* [rclone](/commands/rclone/)	 - Sync files and directories to and from local and remote object stores - v1.43
+* [rclone](/commands/rclone/)	 - Show help for rclone commands, flags and backends.
 
-###### Auto generated by spf13/cobra on 1-Sep-2018
+###### Auto generated by spf13/cobra on 15-Oct-2018