Gilbert Chen
a953c4ec28
Don't parse test parameters in init()
...
This is to make test parameter parsing work with newer versions
of Go
2022-04-07 22:31:18 -04:00
Gilbert Chen
68b60499d7
Add a global option to print memory usage
...
This option, -print-memory-usage, will print memory usage every second while
the program is running.
2021-10-15 20:45:53 -04:00
Gilbert Chen
cacf6618d2
Download a fossil directly instead of turning it back to a chunk first
...
This is to avoid the read-after-rename consistency issue where the effect
of renaming may not be observed by the subsequent attempt to download the
just renamed chunk.
2021-10-08 14:04:56 -04:00
Gilbert Chen
e43e848d47
Find the storage path in shared folders first when connecting to Google Drive
...
When connecting to Google Drive with a service account key, only files in the
service account's own hidden drive space are listable. This change finds
the given storage path among shared folders first so that folders from the user
space can be made accessible via service account.
2021-03-09 22:46:23 -05:00
gilbertchen
fd1b7e1d20
Merge pull request #612 from gilbertchen/gcd_impersonate
...
Support GCD impersonation via modified service account file
2021-03-09 10:24:08 -05:00
Gilbert Chen
f83e4f3c44
Fix SNAPSHOT_INACTIVE log message
2021-01-28 00:06:49 -05:00
gilbertchen
ecf5191400
Update README.md
2021-01-04 14:19:51 -05:00
gilbertchen
ba091fbe42
Add a link to the paper
2021-01-04 14:17:48 -05:00
Gilbert Chen
ee9355b974
Check in the paper accepted to IEEE Transactions on Cloud Computing
2021-01-04 10:18:04 -05:00
Gilbert Chen
4cfecf12f8
Show the path in the error when a subdirectory can't be listed
2021-01-04 10:17:11 -05:00
Gilbert Chen
4104c2f934
Exit with code 2 when an invalid command is provided
2021-01-04 10:16:10 -05:00
Gilbert Chen
41a8f657c4
Add test storage for StorageMadeEasy's File Fabric
2020-11-23 14:38:15 -05:00
Gilbert Chen
474f07e5cc
Support GCD impersonation via modified service account file
2020-11-23 09:44:10 -05:00
Gilbert Chen
175adb14cb
Bump version to 2.7.2
2020-11-15 23:20:11 -05:00
Gilbert Chen
ae706e3dcf
Update dependency (for gilbertchen/go-dropbox and github.com/pkg/xattr)
2020-11-15 23:19:20 -05:00
Gilbert Chen
5eed6c65f6
Validate the repository id for the init and add command
...
Only letter, numbers, dashes, and underscores are allowed.
2020-11-04 21:32:07 -05:00
Gilbert Chen
bec3a0edcd
Fixed a bug that caused a fresh restore to fail without the -overwrite option
...
When restoring a file that doesn't exit locally, if the file is large (>100M)
Duplicacy will create an empty sparse file. But this newly created file will
be mistaken for a local copy and hence the restore will fail with a message
suggesting the -overwrite option.
2020-11-03 10:57:47 -05:00
Gilbert Chen
b392302c06
Use github.com/pkg/xattr for reading/writing extended attributes.
...
The one previously used, github.com/redsift/xattr, is old and can only process
user-defined extended attributes, not system ones.
2020-10-16 21:16:05 -04:00
Gilbert Chen
7c36311aa9
Change snapshot source path from / to /System/Volumes/Data
...
Also use a regex to extract the snapshot date from tmutil output.
2020-10-11 15:23:09 -04:00
Gilbert Chen
7f834e84f6
Don't attemp to load verified_chunks when it doesn't exist.
2020-10-09 14:22:45 -04:00
Gilbert Chen
d7c1903d5a
Skip chunks already verified in previous runs for check -chunks.
...
This is done by storing the list of verified chunks in a file
`.duplicacy/cache/<storage>/verified_chunks`.
2020-10-08 19:59:39 -04:00
Gilbert Chen
7da58c6d49
Bump version to 2.7.1
2020-10-01 21:59:48 -04:00
gilbertchen
4402be6763
Update README.md
2020-10-01 14:38:10 -04:00
gilbertchen
3abec4e37a
Update README.md
2020-10-01 14:36:04 -04:00
gilbertchen
dd40d4cd2f
Update README.md
2020-10-01 13:26:50 -04:00
gilbertchen
923e906b7e
Merge pull request #609 from lokeshsammeta/master
...
Update README.md
2020-10-01 13:13:20 -04:00
Gilbert Chen
0da55f95ab
Fixed a 64-bit integer alighment problem on 32-bit OS
...
A new variable was added previosuly which caused a 64-bit variable to be not
aligned on a 8-byte boundary. Go still can't handle such variables on 32-bit
OS.
2020-10-01 10:35:59 -04:00
Gilbert Chen
2f407d6af9
Another change needed for symlinked chunk subdirectories
2020-10-01 09:27:20 -04:00
lokeshsammeta
bb680538ee
Update README.md
...
some grammatical errors are modified,
2020-10-01 07:04:36 +05:30
Gilbert Chen
7e372edd68
Allow chunks subdirectories in the disk storage to be symlinks.
2020-09-29 13:15:45 -04:00
Gilbert Chen
836a785798
Add src/duplicacy_utils_freebsd.go
2020-09-26 21:22:49 -04:00
Gilbert Chen
e0a72efb34
Bump version to 2.7.0
2020-09-26 20:52:04 -04:00
Gilbert Chen
d839f26b5a
Add new dependency requirements
2020-09-26 20:49:50 -04:00
Gilbert Chen
6ad698328f
Fixed test build errors caused by previous merges
2020-09-26 12:01:38 -04:00
Gilbert Chen
ace1ba5848
Remove runtime OS check for excluding by attributes
2020-09-25 22:37:54 -04:00
gilbertchen
04a858b555
Merge pull request #498 from plasticrake/mac-exclude
...
Add exclude_by_attribute preference to exclude files based on xattr
2020-09-25 20:15:20 -04:00
gilbertchen
1fedfd1b1a
Merge branch 'master' into mac-exclude
2020-09-25 20:13:43 -04:00
gilbertchen
3fd3f6b267
Merge pull request #606 from gilbertchen/erasure_coding
...
Implement Erasure Coding
2020-09-25 14:30:39 -04:00
Gilbert Chen
e3e3e97046
Improvements for the WebDAV backend
...
* CreateDirectory() looks up the directory in the cache first and don't create
it if found in cache
* ListFiles() puts subdirectories in the cache
* If CreateDirectory() encounters EOF, assume the directory already exists
2020-09-25 13:56:44 -04:00
Gilbert Chen
3f29ec2ffb
File metedata must be restored even if the content is unchanged.
2020-09-24 22:44:43 -04:00
Gilbert Chen
947006411b
Improvements for the copy command
...
* Added a `-download-threads` option for specifying the number of downloading
threads
* Show progress log messages during copy
2020-09-24 14:56:19 -04:00
Gilbert Chen
6841c989c6
Fixed a bug that caused check -chunks -persist to succeed with broken chunks
...
The bug was not setting the `isBroken` flag in WaitForChunk()
2020-09-24 14:53:42 -04:00
Gilbert Chen
d0b3b5dc2e
Print progress logs when verifying chunks (check -chunks)
2020-09-23 09:02:53 -04:00
Gilbert Chen
73ae3f809e
Revert "Add a -max-list-rate option to backup to slow down the listing"
...
This reverts commit 67a3103467
2020-09-22 22:08:43 -04:00
Gilbert Chen
67a3103467
Add a -max-list-rate option to backup to slow down the listing
...
This option sets the maximum number of files that can be listed in one
second.
2020-09-22 08:27:09 -04:00
Gilbert Chen
6ee01a2e74
Allow RSA keys to be passed directly via CML instead of a file
...
This change is intended to be used by the web GUI to create an RSA encrypted
storage.
2020-09-20 20:03:52 -04:00
Gilbert Chen
b7d820195a
Remove a debug log message accidentally checked in
2020-09-18 14:59:44 -04:00
Gilbert Chen
16d2c14c5a
Follow-up changes for the -persist PR
...
* Restore/check should report an error instead of a success at the end if there
were any errors and -persist is specified
* Don't compute the file hash before passing the file to the chunk maker; this is
redundant as the chunk maker will produce the file hash
* Add a LOG_WERROR function to switch between LOG_WARN and LOG_ERROR dynamically
2020-09-18 11:23:35 -04:00
Gilbert Chen
eecbb8fa99
Fix OneDrive Business and improve retry mechanism.
...
* Switch to the upload-by-session api for OneDrive Bussiness as their servers
may keep incomplete files when an upload is aborted when the simple upload API
is used
* Use the delay value in the http Retry-After header if there is one
* Decorate the https traffic in the hope of less rate limiting.
2020-09-18 10:19:03 -04:00
Gilbert Chen
97bae5f1a3
Close the response body when 301 is returned in the WebDAV backend
2020-09-14 11:36:22 -04:00
