Gilbert Chen
7f834e84f6
Don't attemp to load verified_chunks when it doesn't exist.
2020-10-09 14:22:45 -04:00
Gilbert Chen
d7c1903d5a
Skip chunks already verified in previous runs for check -chunks.
...
This is done by storing the list of verified chunks in a file
`.duplicacy/cache/<storage>/verified_chunks`.
2020-10-08 19:59:39 -04:00
Gilbert Chen
7da58c6d49
Bump version to 2.7.1
2020-10-01 21:59:48 -04:00
gilbertchen
4402be6763
Update README.md
2020-10-01 14:38:10 -04:00
gilbertchen
3abec4e37a
Update README.md
2020-10-01 14:36:04 -04:00
gilbertchen
dd40d4cd2f
Update README.md
2020-10-01 13:26:50 -04:00
gilbertchen
923e906b7e
Merge pull request #609 from lokeshsammeta/master
...
Update README.md
2020-10-01 13:13:20 -04:00
Gilbert Chen
0da55f95ab
Fixed a 64-bit integer alighment problem on 32-bit OS
...
A new variable was added previosuly which caused a 64-bit variable to be not
aligned on a 8-byte boundary. Go still can't handle such variables on 32-bit
OS.
2020-10-01 10:35:59 -04:00
Gilbert Chen
2f407d6af9
Another change needed for symlinked chunk subdirectories
2020-10-01 09:27:20 -04:00
lokeshsammeta
bb680538ee
Update README.md
...
some grammatical errors are modified,
2020-10-01 07:04:36 +05:30
Gilbert Chen
7e372edd68
Allow chunks subdirectories in the disk storage to be symlinks.
2020-09-29 13:15:45 -04:00
Gilbert Chen
836a785798
Add src/duplicacy_utils_freebsd.go
2020-09-26 21:22:49 -04:00
Gilbert Chen
e0a72efb34
Bump version to 2.7.0
2020-09-26 20:52:04 -04:00
Gilbert Chen
d839f26b5a
Add new dependency requirements
2020-09-26 20:49:50 -04:00
Gilbert Chen
6ad698328f
Fixed test build errors caused by previous merges
2020-09-26 12:01:38 -04:00
Gilbert Chen
ace1ba5848
Remove runtime OS check for excluding by attributes
2020-09-25 22:37:54 -04:00
gilbertchen
04a858b555
Merge pull request #498 from plasticrake/mac-exclude
...
Add exclude_by_attribute preference to exclude files based on xattr
2020-09-25 20:15:20 -04:00
gilbertchen
1fedfd1b1a
Merge branch 'master' into mac-exclude
2020-09-25 20:13:43 -04:00
gilbertchen
3fd3f6b267
Merge pull request #606 from gilbertchen/erasure_coding
...
Implement Erasure Coding
2020-09-25 14:30:39 -04:00
Gilbert Chen
e3e3e97046
Improvements for the WebDAV backend
...
* CreateDirectory() looks up the directory in the cache first and don't create
it if found in cache
* ListFiles() puts subdirectories in the cache
* If CreateDirectory() encounters EOF, assume the directory already exists
2020-09-25 13:56:44 -04:00
Gilbert Chen
3f29ec2ffb
File metedata must be restored even if the content is unchanged.
2020-09-24 22:44:43 -04:00
Gilbert Chen
947006411b
Improvements for the copy command
...
* Added a `-download-threads` option for specifying the number of downloading
threads
* Show progress log messages during copy
2020-09-24 14:56:19 -04:00
Gilbert Chen
6841c989c6
Fixed a bug that caused check -chunks -persist to succeed with broken chunks
...
The bug was not setting the `isBroken` flag in WaitForChunk()
2020-09-24 14:53:42 -04:00
Gilbert Chen
d0b3b5dc2e
Print progress logs when verifying chunks (check -chunks)
2020-09-23 09:02:53 -04:00
Gilbert Chen
73ae3f809e
Revert "Add a -max-list-rate option to backup to slow down the listing"
...
This reverts commit 67a3103467
2020-09-22 22:08:43 -04:00
Gilbert Chen
67a3103467
Add a -max-list-rate option to backup to slow down the listing
...
This option sets the maximum number of files that can be listed in one
second.
2020-09-22 08:27:09 -04:00
Gilbert Chen
6ee01a2e74
Allow RSA keys to be passed directly via CML instead of a file
...
This change is intended to be used by the web GUI to create an RSA encrypted
storage.
2020-09-20 20:03:52 -04:00
Gilbert Chen
b7d820195a
Remove a debug log message accidentally checked in
2020-09-18 14:59:44 -04:00
Gilbert Chen
16d2c14c5a
Follow-up changes for the -persist PR
...
* Restore/check should report an error instead of a success at the end if there
were any errors and -persist is specified
* Don't compute the file hash before passing the file to the chunk maker; this is
redundant as the chunk maker will produce the file hash
* Add a LOG_WERROR function to switch between LOG_WARN and LOG_ERROR dynamically
2020-09-18 11:23:35 -04:00
Gilbert Chen
eecbb8fa99
Fix OneDrive Business and improve retry mechanism.
...
* Switch to the upload-by-session api for OneDrive Bussiness as their servers
may keep incomplete files when an upload is aborted when the simple upload API
is used
* Use the delay value in the http Retry-After header if there is one
* Decorate the https traffic in the hope of less rate limiting.
2020-09-18 10:19:03 -04:00
Gilbert Chen
97bae5f1a3
Close the response body when 301 is returned in the WebDAV backend
2020-09-14 11:36:22 -04:00
Gilbert Chen
40243fb043
Fixed a compile error in previous checkin
2020-09-12 11:39:46 -04:00
Gilbert Chen
403df1fd06
Added a call to discard http response where it was missed in previous fixes.
...
Also added a missing import "io/ioutil".
2020-09-09 21:47:01 -04:00
gilbertchen
4369bcfc0b
Merge pull request #549 from Jos635/master
...
Improve WebDAV performance
2020-09-09 16:02:36 -04:00
gilbertchen
d2b08aebee
Merge pull request #594 from alecuyer/fix/swift
...
Call Authenticate() before using Swift storage
2020-09-09 15:48:36 -04:00
gilbertchen
948994c2b6
Merge pull request #595 from twlee79/add_persist_pr
...
Adds -persist option to check and restore commands to continue despite errors
2020-09-09 15:42:46 -04:00
gilbertchen
ca4d004aca
Merge branch 'master' into add_persist_pr
2020-09-09 15:42:01 -04:00
Gilbert Chen
ce472fe375
Show erasure coding/rsa encryption if enabled for backup and copy
2020-09-04 10:43:37 -04:00
Gilbert Chen
923a6fbc5b
Implement Erasure Coding
2020-09-03 12:54:48 -04:00
Gilbert Chen
670cbcd776
Bump version to 2.6.2
2020-08-30 22:14:58 -04:00
Gilbert Chen
fd469bae9e
Check the returned value of Close() when uploading a chunk file via SFTP.
2020-08-29 22:22:51 -04:00
Gilbert Chen
acef01770a
Bump version to 2.6.1
2020-07-07 23:27:11 -04:00
Gilbert Chen
1eb1fb14a8
Don't throw an error on 0-byte chunk files with suffix '.tmp'.
2020-07-07 23:25:09 -04:00
Gilbert Chen
8b489f04eb
Bump version to 2.6.0
2020-07-05 21:27:44 -04:00
Gilbert Chen
089e19f8e6
Add a -key-passphrase option to pass in passphrase for RSA private key
...
This option is mainly for the web GUI which currently doesn't have a way to
specify the passphrase to decrypt the RSA private key.
2020-07-05 20:58:07 -04:00
Gilbert Chen
1da7e2b536
Fix a crash when a username is not specified with the WebDAV backend
2020-07-03 12:29:53 -04:00
Gilbert Chen
ed8b4393be
Add a new backend for StorageMadeEasy's File Fabric storage.
...
The storage url is fabric://username@storagemadeeasy.com/path/to/storage.
2020-07-03 12:07:33 -04:00
Gilbert Chen
5e28dc4911
Update go-dropbox dependency to fix 0-byte file uploading.
...
Incorporate gilbertchen/go-dropbox/commit/0baa9015ac2547d8b69b2e88c709aa90cfb8fbc1.
2020-07-03 11:52:16 -04:00
Gilbert Chen
f2f07a120d
Retry on "unexpected EOF" errors for the webdav backend.
2020-07-03 11:48:30 -04:00
Gilbert Chen
153f6a2d20
Use multiple threads to list the chunks directory for Google Drive
2020-06-15 12:49:13 -04:00
