WIKI Liberasys

Cette page est en lecture seule. Vous pouvez afficher le texte source, mais ne pourrez pas le modifier. Contactez votre administrateur si vous pensez qu'il s'agit d'une erreur.
<code bash>
apt-get install libssl-dev build-essential zlib1g-dev git
git clone http://www.slac.stanford.edu/~abh/bbcp/bbcp.git 
cd bbcp/src
vi Makefile
</code>

Line :         @+make makeLinux`/bin/uname -i`\\
Replace by :         @+make makeLinuxx86_64

<code bash>
make Linux
cd ..
sudo cp bin/amd64_linux/bbcp /bin
sudo chown root:root /bin/bbcp
sudo chmod 755 /bin/bbcp
</code>

===== Howto use =====

http://pcbunn.cithep.caltech.edu/bbcp/using_bbcp.htm\\
doc : http://www.slac.stanford.edu/~abh/bbcp\\
gist : https://gist.github.com/brianv0/a3bc98bf1fb6fe63d16a7a7cc2ab2a96

===== Upload =====
<code bash>
  # bbcp --ipv4 --port 7777 --verbose --progress 5 --streams 60 --windowsz 128K --append --gross --mkdir --readable --recursive --symlinks keep --sync dd --xfrrate 50M /home/user/isos/plop/tmp/14393.0.161119-1705.RS1_REFRESH_SERVER_EVAL_X64FRE_FR-FR.ISO root@example.com:/root/tmp/
</code>

  bbcp: Indexing files to be copied...
  bbcp: Copying 0 files and 0 links in 0 directories.
  bbcp: Appending to /root/tmp/14393.0.161119-1705.RS1_REFRESH_SERVER_EVAL_X64FRE_FR-FR.ISO at offset 0
  bbcp: 180515 15:52:30  2% done; 38.2 MB/s, avg 38.2 MB/s
  bbcp: 180515 15:52:34  5% done; 38.8 MB/s, avg 38.5 MB/s
  bbcp: 180515 15:52:38  7% done; 38.9 MB/s, avg 38.6 MB/s

===== Download =====
<code bash>
  # bbcp --reverse --ipv4 --port 7777 --verbose --progress 5 --streams 60 --windowsz 512K --append --gross --mkdir --readable --recursive --symlinks keep --sync dd --xfrrate 50M root@example.com:/root/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo /home/user/isos/plop/tmp/
</code>

  bbcp: Indexing files to be copied...
  bbcp: Copying 0 files and 0 links in 0 directories.
  bbcp: Sink I/O buffers (552960K) > 25% of available free memory (126160K); copy may be slow
  bbcp: Appending to /home/user/isos/plop/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo at offset 0
  bbcp: 180515 16:09:31  12% done; 46.8 MB/s, avg 46.8 MB/s
  bbcp: 180515 16:09:35  21% done; 41.3 MB/s, avg 44.3 MB/s
  bbcp: 180515 16:09:39  30% done; 44.5 MB/s, avg 44.4 MB/s
  bbcp: 180515 16:09:43  40% done; 46.4 MB/s, avg 44.9 MB/s
  bbcp: 180515 16:09:47  52% done; 52.6 MB/s, avg 46.3 MB/s
  bbcp: 180515 16:09:51  63% done; 54.3 MB/s, avg 47.6 MB/s
  bbcp: 180515 16:09:55  76% done; 57.5 MB/s, avg 49.0 MB/s
  bbcp: 180515 16:09:59  87% done; 51.6 MB/s, avg 49.3 MB/s
  bbcp: 180515 16:10:03  98% done; 50.6 MB/s, avg 49.5 MB/s

===== Sans limit rate download =====

<code bash>
  # bbcp --reverse --ipv4 --port 7777 --verbose --progress 5 --streams 30 --windowsz 512K --append --gross --mkdir --readable --recursive --symlinks keep --sync dd root@example.com:/root/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo /home/user/isos/plop/tmp/
</code>

  bbcp: Indexing files to be copied...
  bbcp: Copying 0 files and 0 links in 0 directories.
  bbcp: Appending to /home/user/isos/plop/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo at offset 0
  bbcp: 180515 16:16:06  14% done; 64.0 MB/s, avg 64.0 MB/s
  bbcp: 180515 16:16:10  29% done; 69.7 MB/s, avg 66.8 MB/s
  bbcp: 180515 16:16:14  43% done; 65.5 MB/s, avg 66.4 MB/s
  bbcp: 180515 16:16:18  58% done; 67.3 MB/s, avg 66.6 MB/s
  bbcp: 180515 16:16:22  72% done; 65.5 MB/s, avg 66.4 MB/s
  bbcp: 180515 16:16:26  86% done; 66.8 MB/s, avg 66.5 MB/s
  File /home/user/isos/plop/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo created; 1944213734 bytes at 66.6 MB/s
  1 file copied at effectively 63.1 MB/s

===== Sans limit rate upload =====

<code bash>
  # bbcp --ipv4 --port 7777 --verbose --progress 5 --streams 30 --windowsz 512K --append --gross --mkdir --readable --recursive --symlinks keep --sync dd /home/user/isos/plop/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo root@example.com:/root/tmp/
</code>

  bbcp: Source I/O buffers (46080K) > 25% of available free memory (132084K); copy may be slow
  bbcp: Indexing files to be copied...
  bbcp: Copying 0 files and 0 links in 0 directories.
  bbcp: Appending to /root/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo at offset 0
  bbcp: 180515 16:17:58  7% done; 32.0 MB/s, avg 32.0 MB/s
  bbcp: 180515 16:18:02  14% done; 30.6 MB/s, avg 31.4 MB/s
  bbcp: 180515 16:18:06  21% done; 33.0 MB/s, avg 31.9 MB/s
  bbcp: 180515 16:18:10  28% done; 31.3 MB/s, avg 31.7 MB/s
  bbcp: 180515 16:18:14  35% done; 32.4 MB/s, avg 31.9 MB/s
  bbcp: 180515 16:18:18  42% done; 35.0 MB/s, avg 32.4 MB/s
  bbcp: 180515 16:18:22  49% done; 32.9 MB/s, avg 32.4 MB/s
  bbcp: 180515 16:18:26  57% done; 33.6 MB/s, avg 32.6 MB/s
  bbcp: 180515 16:18:30  63% done; 30.6 MB/s, avg 32.4 MB/s
  bbcp: 180515 16:18:34  70% done; 32.6 MB/s, avg 32.4 MB/s
  bbcp: 180515 16:18:38  77% done; 32.7 MB/s, avg 32.4 MB/s
  bbcp: 180515 16:18:42  85% done; 34.1 MB/s, avg 32.6 MB/s
  bbcp: 180515 16:18:46  92% done; 31.4 MB/s, avg 32.5 MB/s
  bbcp: 180515 16:18:50  99% done; 35.8 MB/s, avg 32.7 MB/s
  File /root/tmp/vzdump-qemu-60001-2018_05_15-07_16_43.vma.lzo created; 1944213734 bytes at 32.2 MB/s
  1 file copied at effectively 31.4 MB/s

--idfile fname
specifies the name of the ssh identity file if one has been specifically created for bbcp. The identity filename, prefixed by –i, is included in the ssh command line when starting the source and target nodes.