1 / 16

RSYNC

RSYNC. Michael Martys Automation Officer mmartys@loc.gov. What is rsync. rsync is a software application for Unix and Windows systems that synchronizes files and directories from one location to another in an efficient manner. Why use rsync. You want to shadow the BARD collection

llomeli
Download Presentation

RSYNC

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. RSYNC Michael Martys Automation Officer mmartys@loc.gov

  2. What is rsync • rsync is a software application for Unix and Windows systems that synchronizes files and directories from one location to another in an efficient manner

  3. Why use rsync • You want to shadow the BARD collection • You would like to do so with minimal effort • Some sort of automation

  4. What is necessary • Need some technical skills • A computer to run it on • A reasonable network connection • Storage for the books

  5. Steps to get setup • No need for notes– I’ll email it to you if you contact me • First step is to express interest to NLS

  6. Sign agreement with NLS • Basically covers intended use • Email Steve Prine (spri@loc.gov)

  7. Send NLS critical information • NLS needs to open up our firewall to allow access by your computer

  8. What we need: • Library Name • Street Address for (a) • Contact Name/s for (a) • email address for (a) • Phone(s) for (a)

  9. What we need: • IP Address (or range) of computer that will be used to access rsync server • Contact Name/s responsible for the computer in (f) • email address for (g) • Phone(s) for (g) • Street Address where computer located

  10. Hardware and software • A PC will work fine • Linux based – rsync included • Windows based – need cygwin (www.cygwin.com)

  11. Acquire storage • BARD no longer fits on a 3 terabyte drive • Four terabyte drives are available now • Drive array (amazon has a number - search for 4 or 6TB ) • Logical volumes (bind multiple drives together)

  12. Generate ssh rsa key pair • We run rsync over ssh • No pass phrase • Send me the public key file via email ( id_rsa.pub) • Google ssh-keygen to find out how to generate key • I will load key into our server

  13. Starter brick • Copy of BARD to bootstrap your collection • Otherwise it can take months to sync • We will send you a drive with BARD on it • You copy the files to your system and send it back

  14. You are ready to start • We ask that you do your syncing during BARD’s least busy times • Midnight to noon • A tool called cron is used to run rsync automatically • Command to use: /usr/local/bin/rsync --rsh=/usr/bin/ssh --delete-after --rsync-path=/usr/local/bin/rsync -ravzL rs3.loc.gov:dtb /mylocaldirectory/dtb

  15. A word about stats • Rsync is separate from BARD • Not part of BARD stats • Library needs to handle stats for titles circulated out of local copy

  16. How much effort? • Probably best to ask libraries that have done it • MA1A

More Related