1. 25 Jul, 2014 40 commits
    • Joakim Tosteberg's avatar
      Don't backup for expired members. · bec429ce
      Joakim Tosteberg authored and Per Cederqvist's avatar Per Cederqvist committed
      bec429ce
    • Joakim Tosteberg's avatar
      Lysator config update. · 4f97d0b8
      Joakim Tosteberg authored and Per Cederqvist's avatar Per Cederqvist committed
      Removed sedesopim. Added perlis. Moved ftp to kelvin. Moved jabber to
      dijkstra. Removed eureka until properly configured.
      4f97d0b8
    • Per Jonsson's avatar
      Minor fix in condition for not pruneing. · 5c1a083a
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * backup-one-task: Minor fix in condition for not pruneing.
      5c1a083a
    • Per Jonsson's avatar
      Implement the last change correctly. · b33d0ee9
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      b33d0ee9
    • Per Jonsson's avatar
      Minor fix in status the first time a task is backed up. · 126d93dd
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * backup-one-task: Do not run pruneing step the first time a task
        is run. This removes an incorrect warning for task.
      126d93dd
    • Per Jonsson's avatar
      Updated the config for Lysator · 7134b710
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * fetch-backup-work: Remove backups of lenin and kilauea. Fetch
        stuff from stalhein instead of retired koeberg.
      7134b710
    • Per Cederqvist's avatar
      Initial support for restoring backups. · df0538ac
      Per Cederqvist authored
      * lysrdiff-restore: Initial commit of a script that can restore a
        single task in a reasonably controlled manner.
      df0538ac
    • Per Cederqvist's avatar
      Updated the config for Ryttargardskyrkan. · 47c9e0f9
      Per Cederqvist authored
      * fetch-work-pcfritz: Several partitions has moved from david to
        zfshomes.
      47c9e0f9
    • Per Cederqvist's avatar
      Minor status summary fix. · 84e9559d
      Per Cederqvist authored
      * lysrdiff-status: Use -mtime instead of -ctime when computing the
        status summary, so that the info is correct even just after users
        have moved from one disk to another.
      84e9559d
    • Per Jonsson's avatar
      Updated the config for Lysator. · 4b093966
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * fetch-backup-work: For mail, backup from bernadotte instead of
        lenin.
      4b093966
    • Per Cederqvist's avatar
      Updated the config for Lysator. · 0b9d6a06
      Per Cederqvist authored
      * fetch-backup-work: Fetch stuff from koeberg instead of the retired
        nema. Don't back up deleted mail accounts. Back up eureka.
      0b9d6a06
    • Per Cederqvist's avatar
      Lysator config update. · 358ff542
      Per Cederqvist authored
      Fetch stuff from koeberg instead of the retired nema.
      
      Don't back up deleted mail accounts.
      
      Back up eureka.
      358ff542
    • Per Cederqvist's avatar
      Updated the config for Ryttargardskyrkan. · 7a384480
      Per Cederqvist authored
      * fetch-work-pcfritz: Remove /home/profiles.
      7a384480
    • Per Jonsson's avatar
      Added the update-origin-server utility. · bee693e4
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * update-origin-server: New script. Updates the server part of the
        origin files for a category on a partion when the category has been
        moved to a new server.
      * Makefile (install): Added update-origin-server
      bee693e4
    • Per Jonsson's avatar
      Better handling of "stop" and "finish", and related changes. · 75400987
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      Give info when exiting due to "finish" and "stop" files. Make
      location of "finish", "stop" and "hold" files configurable.
      
      * lysrdiff-settings: New script containing settings on "finish",
        "stop" and "hold" file location
      * backup-repeatedly: Load new settings file. Use configurable file
        locations. Give message regarding cause of exit. When exiting before
        a backup run has been started, regard it as an error.
      * backup-all: Load new settings file. Use configurable file locations.
      * Makefile (install): Added lysrdiff-settings.
      75400987
    • Per Jonsson's avatar
      Move lyscvs and lsvn. · 22a6d9dc
      Per Jonsson authored and Per Cederqvist's avatar Per Cederqvist committed
      * fetch-backup-work: lyscvs and lsvn comes from plantagenet, not
        stalingrad.
      22a6d9dc
    • Per Cederqvist's avatar
      Don't start work when requested to stop. · 77f050da
      Per Cederqvist authored
      * backup-repeatedly: Check for the "finish" and "stop" files after
        sleeping.
      77f050da
    • Per Cederqvist's avatar
    • Per Cederqvist's avatar
      1337906f
    • Per Cederqvist's avatar
      1e32dfc2
    • Per Cederqvist's avatar
      The --warn option is not named --warning. · a6332a17
      Per Cederqvist authored
      a6332a17
    • Per Cederqvist's avatar
    • Per Cederqvist's avatar
      Fix pruning of old data. Allow backup jobs to override the max age. · 51ecf372
      Per Cederqvist authored
      * backup-one-task: The removal of old increments did not work due
        to a bug in the rdiff-backup command line.
        (age): New constant.  If the file "age" exists, it should contain
          something like "90D" and it will override the default of 120D.
      51ecf372
    • Per Cederqvist's avatar
      Prepare for displaying status of different clones. · c640f500
      Per Cederqvist authored
      * lysrdiff-status: Use $CLONE instead of hardcoding "perm" when
        selecting which clone to display status for.  The CLONE variable is
        still a hardcoded constant. :-)
      c640f500
    • Per Cederqvist's avatar
      Make backup-one-task more robust against hung servers. · d852b244
      Per Cederqvist authored
      * backup-one-task: Use BatchMode and ServerAliveInterval when fetching
        the exclude file, to avoid hangs.
      d852b244
    • Per Cederqvist's avatar
      Fix --start-time. · efcf20fb
      Per Cederqvist authored
      The "start immediately if the previous backup took more than 24
      hours" logic did not work since the flag file was never created.
      
      * backup-repeatedly: Touch the $LASTSTART flag file when a backup run
        starts, so that the --start-time option can work as intended.
      efcf20fb
    • Per Cederqvist's avatar
      Improve the --start-time option. · 317f1cbd
      Per Cederqvist authored
      * backup-repeatedly: Exit immediately if the finish or stop file
        exists, and not after the long wait implied by --start-time.
      317f1cbd
    • Per Cederqvist's avatar
      Added support for starting the backups at a predefined time. · a0c5e1ca
      Per Cederqvist authored
      * backup-repeatedly: New option: --start-time, that specifies the hour
        and minute when the backup should start.
      a0c5e1ca
    • Per Cederqvist's avatar
      Added fetch-work-pcfritz. · a93278d9
      Per Cederqvist authored
      * fetch-work-pcfritz: New file, for the installation at
        Ryttargårdskyrkan.
      * Makefile (install): Install it.
      a93278d9
    • Per Cederqvist's avatar
      Added the lysrdiff-sizechange utility. · 5c7f0810
      Per Cederqvist authored
      * lysrdiff-sizechange.py: New script.  Report the most recent size
        change of each backup task.
      
      * Makefile (install): Added lysrdiff-sizechange.py.
      5c7f0810
    • Per Cederqvist's avatar
      Added --continue and --only-clone. Improved lysrdiff-monitord. · 6b5c9834
      Per Cederqvist authored
      New options --continue and --only-clone.  Better remote watching of
      the status.
      
      * backup-one-task: Handle --only-clone.  Adjusted to the new CLI
        of lysrdiff-set-status.
      
      * lysrdiff-set-status.py
        (open_socket): New function.
        (sendmsg): Use it to simplify code.
        (completion): New function.
        (Top level): New mandatory first argument: --status, --ok, --warning
          or --fail.
      
      * backup-all: Added --continue and --only-clone.
      
      * lysrdiff-monitord.py
        (now): New function.
        (Client.__init__): New API: use sock and peer arguments instead of
          accept_retval.  Renamed the input buffer from __readbuf to
          _readbuf so that derived classes can use it.
        (Client.read_event): Fixed misnamed errno name.  Track name change
          of _readbuf.
        (Client.got_eof): Track name change of _readbuf.
        (Client.write_event): Handle EAGAIN, ETIMEDOUT and EHOSTUNREACH errors.
        (Client.parse): Track name change of _readbuf.
        (Client.handle_cmd): New command: completed.
        (Client.dispatcher): New method.
        (Server.read_event): Track API change of Client.  Set the new client
          socket nonblocking.
        (Vt100Client.__init__): Negotiate telnet to get a raw byte channel
          using WILL ECHO, WILL SuppressGoahead, DO SuppressGoahead.  Use
          vt100 escape sequences to disable line wrap and query the screen
          size.  Don't register with the dispatcher.
        (Vt100Client.parse): New method.  Register with the dispatcher once
          the screen size report has arrived from the client.
        (Dispatcher.toploop): Write the curren time to vt100 clients every
          second.
        (Dispatcher.register_vt100): Position the cursor at the command line
          position.
        (Dispatcher.write_monitor_status): Format the status separately for
          each client, as their screen sizes may vary.
        (Dispatcher.format_monitor_status): New argument: client.
          Position the cursor properly.
        (Dispatcher.set_status): Use now() to simplify code.  Don't crash if
          a client connection is found to be broken.  Format the status
          separately for each client, as their screen sizes may vary.
        (Dispatcher.format_status_vt100): New argument: client.  Truncate
          the status to the line length reported by the client.  Position
          the cursor at the command line position.
        (Dispatcher.completed): New method.
      6b5c9834
    • Per Cederqvist's avatar
      More categories. · 74dfe37f
      Per Cederqvist authored
      * fetch-backup-work: New categories: quota1, shafan and vesuvius.
      74dfe37f
    • Per Cederqvist's avatar
      Port to GNU find 4.3.3. · 0c8dd198
      Per Cederqvist authored
      * lysrdiff-status: Handle GNU find version 4.3.3 and newer.
      0c8dd198
    • Per Cederqvist's avatar
      Install lysrdiff-move-job. · 337f97f6
      Per Cederqvist authored
      * Makefile (install): Added lysrdiff-move-job.
      337f97f6
    • Per Cederqvist's avatar
      Cleanup: Remove no longer needed special cases. · c97d1510
      Per Cederqvist authored
      * backup-one-task: Removed special-case setting of remoterdiff for
        wrath (a local installation now exists) and manhattan (no backups
        are currently being taken).
      c97d1510
    • Per Cederqvist's avatar
      Install the programs and files using a more sane prefix. · ec07b599
      Per Cederqvist authored
      * Makefile (BINDIR): Changed to /opt/LYSrdiff.
      * backup-all: Changed prefix to /opt/LYSrdiff.
      * backup-one-task: Ditto.
      * backup-repeatedly: Ditto.
      * distribute-tasks: Ditto.
      * fetch-backup-work: Ditto.
      * lysrdiff-move-job: Ditto.
      ec07b599
    • Per Cederqvist's avatar
      Cloning of backups, multi-partition backup disks, and more. · 1b09bfc7
      Per Cederqvist authored
      LYSrdiff partitions are now named after both the disk and the
      partition, such as "2/0".  Support cloning.  Support watching the
      backup activity remotely.  Various other fixes and improvements.
      
      * lysrdiff-status: Adapted to the new disk/part scheme, and the new
        double "--" in state files.  Have a per-user state file, so that
        many users can use this script.
      
      * lysrdiff-set-status.py: New.  Talk to lysrdiff-monitord.py.
      
      * lysrdiff-move-obsolete: New option: --auto-confirm.  Adapted to the
        new disk/part scheme, and the new double "--" in state files.
      
      * lysrdiff-move-job: New.  Move a job from one disk to another.
        (Actually, the old backup copy is left in place.  Use
        lysrdiff-move-obsolete to deal with it.)
      
      * lysrdiff-monitord.py: New.  Keep track of what each disk is doing,
        and provide a vt100-over-telnet interface to watch it remotely.
      
      * lysrdiff-label-disk: New.  Create the lysrdiff.id file and the basic
        directory structure.  Create space filler files that can be removed
        in an emergency.
      
      * lysrdiff-df: New.  Run df on all mounted lysrdiff partitions.
      
      * fetch-backup-work: Fetch all of lenin:/home.
      
      * distribute-tasks: The lysrdiff argument is now on the form
        disk/part.
      
      * Makefile
        (install): Added lysrdiff-label-disk and lysrdiff-df.
        (install-one-task): Added lysrdiff-set-status.py and
          lysrdiff-monitord.
      
      * backup-one-task: Replaced the lysrdiffpart argument with disk and
        part arguments.  Handle --only-prune.  Log status using
        lysrdiff-set-status.py.  Removed special-case remoterdiff for
        sedesopim.  The parts of state file names are now separated by "--"
        intead of "-", to avoid confusion with categories and subcategories
        that contain a "-".  Remove increments older than 120 days.  Log the
        disk usage after a backup completes.  Clone the backup to all
        mounted copies.
      
      * backup-all: Added --only-prune.  The part argument is now a
        disk/part string, and the format of the lysrdiff.id file has
        changed.
      1b09bfc7
    • Per Cederqvist's avatar
      Removed special cases. · 56ee89f8
      Per Cederqvist authored
      * fetch-backup-work: Removed some special cases for lyswww that are no
        longer needed, since the source directory has been cleaned up.
      56ee89f8
    • Per Cederqvist's avatar
      Install lysrdiff-move-obsolete. · 73abad45
      Per Cederqvist authored
      * Makefile (install): Install lysrdiff-move-obsolete.
      73abad45
    • Per Cederqvist's avatar
      Added a README. · f996d307
      Per Cederqvist authored
      * README: Document how to test that the ssh setup to a remote host is
        working.
      f996d307