Nick Craig-Wood 3a5ddfcd3c azureblob: implement multipart server side copy ...

This implements multipart server side copy to improve copying from one
azure region to another by orders of magnitude (from 30s for a 100M
file to 10s for a 10G file with --azureblob-upload-concurrency 500).

- Add `--azureblob-copy-cutoff` to control the cutoff from single to multipart copy
- Add `--azureblob-copy-concurrency` to control the copy concurrency
- Add ServerSideAcrossConfigs flag as this now works properly
- Implement multipart copy using put block list API
- Shortcut multipart copy for same storage account
- Override with `--azureblob-use-copy-blob`

Fixes #8249

2025-01-22 11:56:05 +00:00

..

alias

config: make getting config values more consistent

2024-08-08 13:41:31 +01:00

all

cloudinary: add cloudinary backend - fixes #7989

2025-01-06 10:54:03 +00:00

azureblob

azureblob: implement multipart server side copy

2025-01-22 11:56:05 +00:00

azurefiles

azurefiles: add --azurefiles-use-az and --azurefiles-disable-instance-discovery

2025-01-22 11:11:18 +00:00

b2

b2: add SkipDestructive handling to backend commands - fixes #8194

2025-01-17 15:47:01 +00:00

box

box: fix panic when decoding corrupted PEM from JWT file

2025-01-11 18:39:15 +00:00

cache

build: update logging statements to make json log work - fixes #6038

2024-09-06 17:04:18 +01:00

chunker

build: fix gosimple lint errors with golangci-lint v1.60.1

2024-08-14 17:46:12 +01:00

cloudinary

cloudinary: add cloudinary backend - fixes #7989

2025-01-06 10:54:03 +00:00

combine

fs: define the optional interface SetMetadata and implement it in wrapping backends

2024-05-14 12:51:03 +01:00

compress

chunkedreader: add --vfs-read-chunk-streams to parallel read chunks

2024-08-14 21:13:09 +01:00

crypt

build: fix gocritic lint issue underef

2024-08-15 22:08:34 +01:00

drive

drive: added backend moveid command

2025-01-14 19:21:13 +00:00

dropbox

dropbox: fix return status when full to be fatal error

2025-01-11 18:39:15 +00:00

fichier

fichier: fix server side move - fixes #7856

2024-09-06 18:20:10 +01:00

filefabric

filefabric: use atomic types

2023-08-22 12:52:13 +01:00

filescom

filescom: don't make an extra fetch call on each item in a list response

2024-08-19 22:31:57 +02:00

ftp

ftp: implement --ftp-no-check-upload to allow upload to write only dirs

2024-09-18 12:57:01 +01:00

gofile

gofile: fix server side copying over existing object

2024-11-08 14:01:51 +00:00

googlecloudstorage

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

googlephotos

fs: fix confusing "didn't find section in config file" error

2025-01-15 16:32:59 +00:00

hasher

fs: define the optional interface SetMetadata and implement it in wrapping backends

2024-05-14 12:51:03 +01:00

hdfs

build: fix linting issues reported by running golangci-lint with different GOOS

2024-04-22 19:29:12 +02:00

hidrive

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

http

http: fix incorrect URLs with initial slash

2025-01-09 17:40:00 +00:00

iclouddrive

docs: fix typos found by codespell in docs and code comments

2025-01-16 10:39:01 +01:00

imagekit

docs: fix typos found by codespell in docs and code comments

2025-01-16 10:39:01 +01:00

internetarchive

internetarchive: add --internetarchive-metadata="key=value" for setting item metadata

2025-01-17 16:00:34 +00:00

jottacloud

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

koofr

backend koofr: remove trailing bracket - fixes #7600

2024-04-04 20:03:26 +01:00

linkbox

linkbox: fix list paging and optimized synchronization.

2024-03-24 12:05:58 +00:00

local

Replace Windows-specific NewLazyDLL with NewLazySystemDLL

2025-01-08 17:35:00 +01:00

mailru

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

mega

docs: fix typos found by codespell in docs and code comments

2023-09-23 12:20:01 +01:00

memory

memory: fix incorrect list entries when rooted at subdirectory

2024-03-27 11:43:26 -04:00

netstorage

build: fix gocritic lint issue valswap

2024-08-15 22:08:34 +01:00

onedrive

onedrive: mark German (de) region as deprecated

2025-01-22 11:00:37 +00:00

opendrive

opendrive: add about support to backend

2024-09-17 17:20:42 +01:00

oracleobjectstorage

azureblob,oracleobjectstorage,s3: quit multipart uploads if the context is cancelled

2025-01-09 18:55:18 +00:00

pcloud

docs: fix typos found by codespell in docs and code comments

2025-01-16 10:39:01 +01:00

pikpak

pikpak: add option to use original file links - fixes #8246

2024-12-16 01:17:58 +09:00

pixeldrain

Add pixeldrain backend

2024-08-12 13:35:44 +01:00

premiumizeme

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

protondrive

backend/protondrive: improve performance of Proton Drive backend

2024-09-18 18:15:24 +01:00

putio

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

qingstor

build: fix linting issues reported by running golangci-lint with different GOOS

2024-04-22 19:29:12 +02:00

quatrix

quatrix: fix f.String() not including subpath

2024-05-13 18:32:41 +01:00

s3

s3: Added new storage class to magalu provider

2025-01-17 15:54:34 +00:00

seafile

build: fix gosimple lint errors with golangci-lint v1.60.1

2024-08-14 17:46:12 +01:00

sftp

serve sftp: update github.com/pkg/sftp to v1.13.7 and fix deadlock in tests

2024-11-11 18:15:00 +00:00

sharefile

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

sia

rclone config redacted: implement support mechanism for showing redacted config

2023-07-07 16:25:14 +01:00

smb

smb: add support for kerberos authentication

2025-01-14 19:24:31 +00:00

storj

build: fix linting issues reported by running golangci-lint with different GOOS

2024-04-22 19:29:12 +02:00

sugarsync

sugarsync: fix server side copying over existing object

2024-11-08 18:17:55 +00:00

swift

swift: add total/free space info in about command.

2024-09-06 12:46:51 +01:00

ulozto

ulozto: fix upload of > 2GB files on 32 bit platforms - fixes #7960

2024-07-20 11:29:34 +01:00

union

build: fix gocritic lint issue assignop

2024-08-15 22:08:34 +01:00

uptobox

rclone config redacted: implement support mechanism for showing redacted config

2023-07-07 16:25:14 +01:00

webdav

webdav: make --webdav-auth-redirect to fix 401 unauthorized on redirect

2025-01-11 18:39:15 +00:00

yandex

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00

zoho

lib/oauthutil: add support for OAuth client credential flow

2024-12-13 11:34:11 +00:00