【duplicityインストール】
duplicityは個人データのバックアップとして使えるツールです。
■特徴は3つ
・バックアップ中の履歴を古い状態から新しい状態への増分で記録し、複数のフルバックアップも取れる
・GnuPGを使って暗号化する機能がある
・SSH以外のネットワーク機能にも対応している(FTPやWebDAV,S3など)
今回はFTPでの接続が必要だったのでduplicityを選びました。
■今回のサーバのバージョン
# cat /etc/redhat-release CentOS release 6.3 (Final)
以下からインストールの説明
■最新のバージョンをダウンロードしてくる(2012/12/21の時点では0.6.20)
# pwd /root/tmp # mkdir tmp # cd tmp/ # wget http://code.launchpad.net/duplicity/0.6-series/0.6.20/+download/duplicity-0.6.20.tar.gz --2012-12-21 19:56:24-- http://code.launchpad.net/duplicity/0.6-series/0.6.20/+download/duplicity-0.6.20.tar.gz code.launchpad.net をDNSに問いあわせています... 91.189.89.224, 91.189.89.225 code.launchpad.net|91.189.89.224|:80 に接続しています... 接続しました。 HTTP による接続要求を送信しました、応答を待っています... 302 Found 場所: https://code.launchpad.net/duplicity/0.6-series/0.6.20/+download/duplicity-0.6.20.tar.gz [続く] --2012-12-21 19:56:24-- https://code.launchpad.net/duplicity/0.6-series/0.6.20/+download/duplicity-0.6.20.tar.gz code.launchpad.net|91.189.89.224|:443 に接続しています... 接続しました。 HTTP による接続要求を送信しました、応答を待っています... 302 Moved Temporarily 場所: https://launchpadlibrarian.net/121487466/duplicity-0.6.20.tar.gz [続く] --2012-12-21 19:56:26-- https://launchpadlibrarian.net/121487466/duplicity-0.6.20.tar.gz launchpadlibrarian.net をDNSに問いあわせています... 91.189.89.228, 91.189.89.229 launchpadlibrarian.net|91.189.89.228|:443 に接続しています... 接続しました。 HTTP による接続要求を送信しました、応答を待っています... 200 OK 長さ: 1142460 (1.1M) [application/x-tar] `duplicity-0.6.20.tar.gz' に保存中 100%[===================================================================================================================>] 1,142,460 149K/s 時間 8.6s 2012-12-21 19:56:36 (130 KB/s) - `duplicity-0.6.20.tar.gz' へ保存完了 [1142460/1142460]
■python-devel,libsync-devel,libsyncを入れる（epelリポジトリ使用）
# yum install python-devel librsync-devel librsync Loaded plugins: fastestmirror Determining fastest mirrors epel/metalink | 5.6 kB 00:00 * base: ftp.tsukuba.wide.ad.jp * epel: ftp.tsukuba.wide.ad.jp * extras: ftp.tsukuba.wide.ad.jp * updates: ftp.tsukuba.wide.ad.jp base | 3.7 kB 00:00 epel | 4.3 kB 00:00 epel/primary_db | 4.1 MB 00:00 extras | 3.5 kB 00:00 extras/primary_db | 24 kB 00:00 jenkins | 951 B 00:00 jenkins/primary | 18 kB 00:00 jenkins 167/167 updates | 3.5 kB 00:00 updates/primary_db | 4.3 MB 00:00 Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package librsync.i686 0:0.9.7-15.el6 will be installed ---> Package librsync-devel.i686 0:0.9.7-15.el6 will be installed ---> Package python-devel.i686 0:2.6.6-29.el6_3.3 will be installed --> Finished Dependency Resolution Dependencies Resolved ============================================================================================================================================================= Package Arch Version Repository Size ============================================================================================================================================================= Installing: librsync i686 0.9.7-15.el6 epel 44 k librsync-devel i686 0.9.7-15.el6 epel 12 k python-devel i686 2.6.6-29.el6_3.3 updates 167 k Transaction Summary ============================================================================================================================================================= Install 3 Package(s) Total download size: 223 k Installed size: 564 k Is this ok [y/N]: y Downloading Packages: (1/3): librsync-0.9.7-15.el6.i686.rpm | 44 kB 00:00 (2/3): librsync-devel-0.9.7-15.el6.i686.rpm | 12 kB 00:00 (3/3): python-devel-2.6.6-29.el6_3.3.i686.rpm | 167 kB 00:00 ------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 514 kB/s | 223 kB 00:00 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : librsync-0.9.7-15.el6.i686 1/3 Installing : librsync-devel-0.9.7-15.el6.i686 2/3 Installing : python-devel-2.6.6-29.el6_3.3.i686 3/3 Verifying : python-devel-2.6.6-29.el6_3.3.i686 1/3 Verifying : librsync-0.9.7-15.el6.i686 2/3 Verifying : librsync-devel-0.9.7-15.el6.i686 3/3 Installed: librsync.i686 0:0.9.7-15.el6 librsync-devel.i686 0:0.9.7-15.el6 python-devel.i686 0:2.6.6-29.el6_3.3 Complete!
■duplicityのtar.gzを展開してコンパイルしてインストールする
# tar -xzvf duplicity-0.6.20.tar.gz duplicity-0.6.20/ duplicity-0.6.20/po/ duplicity-0.6.20/po/LINGUAS duplicity-0.6.20/po/de/ duplicity-0.6.20/po/de/de.po ・・・・ # cd duplicity-0.6.20 # ll 合計 292 -rw------- 1 1000 1000 67959 10月 28 21:23 2012 CHANGELOG -rw------- 1 1000 1000 17987 10月 28 21:23 2012 COPYING -rw------- 1 1000 1000 160119 10月 28 21:23 2012 Changelog.GNU -rw------- 1 1000 1000 2759 10月 28 21:23 2012 README -rw------- 1 1000 1000 1225 10月 28 21:23 2012 README-LOG -rw------- 1 1000 1000 809 10月 28 21:23 2012 README-REPO drwxr-xr-x 2 1000 1000 4096 10月 28 21:23 2012 bin drwxr-xr-x 2 1000 1000 4096 10月 28 21:23 2012 dist drwxr-xr-x 3 1000 1000 4096 10月 28 21:23 2012 duplicity drwxr-xr-x 27 1000 1000 4096 10月 28 21:23 2012 po -rwxr-xr-x 1 1000 1000 3233 10月 28 21:23 2012 setup.py -rw------- 1 1000 1000 102 10月 28 21:23 2012 tarfile-CHANGES -rw------- 1 1000 1000 2814 10月 28 21:23 2012 tarfile-LICENSE drwxr-xr-x 6 1000 1000 4096 10月 28 21:23 2012 testing [root@192 duplicity-0.6.20]# python ./setup.py build running build running build_py creating build creating build/lib.linux-i686-2.6 creating build/lib.linux-i686-2.6/duplicity ・・・ [root@192 duplicity-0.6.20]# python ./setup.py install running install running build running build_py running build_ext running build_scripts ・・・
■duplicityのバージョンを確認してみる。
# duplicity --version duplicity 0.6.20
■FTPも利用する場合はncftpもインストールする（epelリポジトリ使用）
# yum search ncftp Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: ftp.tsukuba.wide.ad.jp * epel: ftp.tsukuba.wide.ad.jp * extras: ftp.tsukuba.wide.ad.jp * updates: ftp.tsukuba.wide.ad.jp epel/pkgtags | 325 B 00:00 ==================================================================== N/S Matched: ncftp ===================================================================== ncftp.i686 : Improved console FTP client Name and summary matches only, use "search all" for everything. [root@192 duplicity-0.6.20]# yum install ncftp Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: ftp.tsukuba.wide.ad.jp * epel: ftp.tsukuba.wide.ad.jp * extras: ftp.tsukuba.wide.ad.jp * updates: ftp.tsukuba.wide.ad.jp Setting up Install Process Resolving Dependencies --> Running transaction check ---> Package ncftp.i686 2:3.2.4-1.el6 will be installed --> Finished Dependency Resolution Dependencies Resolved ============================================================================================================================================================= Package Arch Version Repository Size ============================================================================================================================================================= Installing: ncftp i686 2:3.2.4-1.el6 epel 315 k Transaction Summary ============================================================================================================================================================= Install 1 Package(s) Total download size: 315 k Installed size: 1.3 M Is this ok [y/N]: y Downloading Packages: ncftp-3.2.4-1.el6.i686.rpm | 315 kB 00:00 Running rpm_check_debug Running Transaction Test Transaction Test Succeeded Running Transaction Installing : 2:ncftp-3.2.4-1.el6.i686 1/1 Verifying : 2:ncftp-3.2.4-1.el6.i686 1/1 Installed: ncftp.i686 2:3.2.4-1.el6 Complete!
■ncftpのバージョンを見てみる
# ncftp --version NcFTP 3.2.4 (Apr 07, 2010) by Mike Gleason (http://www.NcFTP.com/contact/).
ここまででインストールは完了。
■ローカル内でのバックアップ例
○作業場所例
$ pwd /home/user
○バックアップ元
$ ls -al ./work/ 合計 12 drwxrwxr-x 2 user user 4096 12月 21 20:29 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:32 2012 ../ -rw-rw-r-- 1 user user 11 12月 21 20:29 2012 first.txt
○バックアップ先
$ ls -al dup_backup_test/ 合計 8 drwxrwxr-x 2 user user 4096 12月 21 20:33 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:32 2012 ../
○初回フルバックアップ
$ duplicity ./work file:///home/user/dup_backup_test Import of duplicity.backends.u1backend Failed: No module named httplib2 Local and Remote metadata are synchronized, no sync needed. Last full backup date: none GnuPG passphrase: Retype passphrase to confirm: No signatures found, switching to full backup. --------------[ Backup Statistics ]-------------- StartTime 1356089561.48 (Fri Dec 21 20:32:41 2012) EndTime 1356089561.49 (Fri Dec 21 20:32:41 2012) ElapsedTime 0.01 (0.01 seconds) SourceFiles 2 SourceFileSize 4107 (4.01 KB) NewFiles 2 NewFileSize 4107 (4.01 KB) DeletedFiles 0 ChangedFiles 0 ChangedFileSize 0 (0 bytes) ChangedDeltaSize 0 (0 bytes) DeltaEntries 2 RawDeltaSize 11 (11 bytes) TotalDestinationSizeChange 234 (234 bytes) Errors 0 -------------------------------------------------
○初回バックアップ後のバックアップ先
$ ls -al ./dup_backup_test/ 合計 20 drwxrwxr-x 2 user user 4096 12月 21 20:36 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:32 2012 ../ -rw------- 1 user user 261 12月 21 20:36 2012 duplicity-full-signatures.20121221T113556Z.sigtar.gpg -rw------- 1 user user 196 12月 21 20:36 2012 duplicity-full.20121221T113556Z.manifest.gpg -rw------- 1 user user 234 12月 21 20:36 2012 duplicity-full.20121221T113556Z.vol1.difftar.gpg
○バックアップ元を変更する
$ ls -al ./work/ 合計 16 drwxrwxr-x 2 user user 4096 12月 21 20:37 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:37 2012 ../ -rw-rw-r-- 1 user user 11 12月 21 20:29 2012 first.txt -rw-rw-r-- 1 user user 12 12月 21 20:37 2012 second.txt
○2回目のバックアップ
$ duplicity ./work file:///home/user/dup_backup_test Import of duplicity.backends.u1backend Failed: No module named httplib2 Local and Remote metadata are synchronized, no sync needed. Last full backup date: Fri Dec 21 20:35:56 2012 GnuPG passphrase: Retype passphrase to confirm: --------------[ Backup Statistics ]-------------- StartTime 1356089881.33 (Fri Dec 21 20:38:01 2012) EndTime 1356089881.34 (Fri Dec 21 20:38:01 2012) ElapsedTime 0.01 (0.01 seconds) SourceFiles 3 SourceFileSize 4119 (4.02 KB) NewFiles 2 NewFileSize 4108 (4.01 KB) DeletedFiles 0 ChangedFiles 0 ChangedFileSize 0 (0 bytes) ChangedDeltaSize 0 (0 bytes) DeltaEntries 2 RawDeltaSize 12 (12 bytes) TotalDestinationSizeChange 233 (233 bytes) Errors 0 -------------------------------------------------
○2回目バックアップ後のバックアップ先
$ ls -al ./dup_backup_test/ 合計 32 drwxrwxr-x 2 user user 4096 12月 21 20:38 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:37 2012 ../ -rw------- 1 user user 261 12月 21 20:36 2012 duplicity-full-signatures.20121221T113556Z.sigtar.gpg -rw------- 1 user user 196 12月 21 20:36 2012 duplicity-full.20121221T113556Z.manifest.gpg -rw------- 1 user user 234 12月 21 20:36 2012 duplicity-full.20121221T113556Z.vol1.difftar.gpg -rw------- 1 user user 196 12月 21 20:38 2012 duplicity-inc.20121221T113556Z.to.20121221T113757Z.manifest.gpg -rw------- 1 user user 233 12月 21 20:38 2012 duplicity-inc.20121221T113556Z.to.20121221T113757Z.vol1.difftar.gpg -rw------- 1 user user 263 12月 21 20:38 2012 duplicity-new-signatures.20121221T113556Z.to.20121221T113757Z.sigtar.gpg
○バックアップ状態の確認
$ duplicity collection-status file:///home/user/dup_backup_test
Import of duplicity.backends.u1backend Failed: No module named httplib2
Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Fri Dec 21 20:35:56 2012
Collection Status
-----------------
Connecting with backend: LocalBackend
Archive dir: /home/user/.cache/duplicity/8716bfe8333e4b5eaeabee4eec99bcbf
Found 0 secondary backup chains.
Found primary backup chain with matching signature chain:
-------------------------
Chain start time: Fri Dec 21 20:35:56 2012
Chain end time: Fri Dec 21 20:37:57 2012
Number of contained backup sets: 2
Total number of contained volumes: 2
Type of backup set: Time: Num volumes:
Full Fri Dec 21 20:35:56 2012 1
Incremental Fri Dec 21 20:37:57 2012 1
-------------------------
No orphaned or incomplete backup sets found.
■レストアしてみる
workの下を空にしておく
$ ls -al ./work/ 合計 8 drwxrwxr-x 2 user user 4096 12月 21 20:42 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:37 2012 ../
レストアする
$ duplicity file:///home/user/dup_backup_test /home/user/work Import of duplicity.backends.u1backend Failed: No module named httplib2 Local and Remote metadata are synchronized, no sync needed. Last full backup date: Fri Dec 21 20:35:56 2012 GnuPG passphrase: $ ls -al ./work/ 合計 16 drwxrwxr-x 2 user user 4096 12月 21 20:37 2012 ./ drwxrwxrwx. 14 user user 4096 12月 21 20:37 2012 ../ -rw-rw-r-- 1 user user 11 12月 21 20:29 2012 first.txt -rw-rw-r-- 1 user user 12 12月 21 20:37 2012 second.txt
復元する日時を指定した場合は–restore-time(-t)をオプションとして日時を指定して実行する。
特定のディレクトリだけ復元したい場合は–file-to-restoreオプションでパス名を指定する。
すでにあるディレクトリに上書きする形で復元したいときは–forceオプションをつける
■GnuPGでパスフレーズを毎回求められるのが面倒な場合
事前にexportしておくと楽かも。
export PASSPHRASE=gpgpassphrase
■古いバックアップの削除
5組のバックアップを残してそれ以前のものを削除する場合
$ duplicity remove-all-but-n-full 5 /home/user/dup_backup_test
ある日以前のバックアップを削除する場合
$ duplicity remove-older-than 3M /home/user/dup_backup_test
■年月日の指定方法
○年月日と時間の指定（日本時間の2008年9月4日 18:57:11）
2008-09-04T18:57:11+09:00
○年月日の指定(2008年9月4日)
2008-09-04
2008/09/04
09/04/2008
09-04-2008
○相対的な指定
3D5h45m(3日前と5時間45分前)
5Y4M15s(5年4ヶ月と15秒前)
○現在
now
■duplicityがサポートするアクセス方法と対応するURLのフォーマット
| cf+http://container_name |
| file:///some_dir |
| ftp://user[:password]@other.host[:port]/some_dir |
| ftps://user[:password]@other.host[:port]/some_dir |
| hsi://user[:password]@other.host[:port]/some_dir |
| imap://user[:password]@other.host[:port]/some_dir |
| rsync://user[:password]@other.host[:port]::/module/some_dir |
| rsync://user[:password]@other.host[:port]/relative_path |
| rsync://user[:password]@other.host[:port]//absolute_path |
| s3://other.host/bucket_name[/prefix] |
| s3+http://bucket_name[/prefix] |
| scp://user[:password]@other.host[:port]/some_dir |
| ssh://user[:password]@other.host[:port]/some_dir |
| tahoe://alias/directory |
| webdav://user[:password]@other.host/some_dir |
| webdavs://user[:password]@other.host/some_dir |
| gdocs://user[:password]@other.host/some_dir |
■その他
使い方: duplicity [full|incremental] [options] source_dir target_url duplicity [restore] [options] source_url target_dir duplicity verify [options] source_url target_dir duplicity collection-status [options] target_url duplicity list-current-files [options] target_url duplicity cleanup [options] target_url duplicity remove-older-than time [options] target_url duplicity remove-all-but-n-full count [options] target_url duplicity remove-all-inc-of-but-n-full count [options] target_url コマンド: cleanup collection-status full incr list-current-files restore remove-older-than <time> remove-all-but-n-full remove-all-inc-of-but-n-full verify オプション: -h, --help show this help message and exit --allow-source-mismatch --archive-dir=path --asynchronous-upload --dry-run --encrypt-key=gpg-key-id --encrypt-secret-keyring=path --encrypt-sign-key=gpg-key-id --exclude=shell_pattern --exclude-device-files --exclude-filelist=filename --exclude-filelist-stdin --exclude-globbing-filelist=filename --exclude-if-present=filename --exclude-other-filesystems --exclude-regexp=regular_expression --extra-clean --file-prefix=FILE_PREFIX -r path, --file-to-restore=path --force --ftp-passive --ftp-regular --full-if-older-than=time --gio --gpg-options=options --ignore-errors --imap-mailbox=imap_mailbox --include=shell_pattern --include-filelist=filename --include-filelist-stdin --include-globbing-filelist=filename --include-regexp=regular_expression --log-fd=file_descriptor --log-file=filename --name=backup name --no-encryption --no-compression --no-print-statistics --null-separator --num-retries=number --numeric-owner --old-filenames --pydevd --rename=RENAME -t time, --restore-time=time, --time=time --rsync-options=options --s3-european-buckets --s3-use-rrs --s3-use-new-style --s3-unencrypted-connection --s3-multipart-chunk-size=number --s3-use-multiprocessing --scp-command=command --sftp-command=command --short-filenames --sign-key=gpg-key-id --ssh-askpass --ssh-backend=paramiko|pexpect --ssh-options=options --tempdir=path --timeout=seconds --time-separator=char --use-agent --use-scp -v [0-9], --verbosity=[0-9] -V, --version --volsize=number
■参考URL
duplicity本家
[CentOS] How to install Duplicity on your VPS/Dedicated Server
Duplicity – secure incremental backup