Skip to content
Snippets Groups Projects
  1. Jul 25, 2014
    • Per Cederqvist's avatar
      Added a README. · f996d307
      Per Cederqvist authored
      * README: Document how to test that the ssh setup to a remote host is
        working.
      f996d307
    • Per Cederqvist's avatar
      Back up more often. · 866c6060
      Per Cederqvist authored
      * backup-repeatedly: Don't sleep between backups.  Print number of
        cycles completed.  Don't retry backups with warnings, as that takes
        too much time.
      866c6060
    • Per Cederqvist's avatar
      Back up the entire datorhandbok system. · 2c6cdfbe
      Per Cederqvist authored
      * fetch-backup-work: Back up kilauea:/boot.
      2c6cdfbe
    • Per Cederqvist's avatar
      Back up datorhandbok. · eee3b77a
      Per Cederqvist authored
      * fetch-backup-work: Back up kilauea, which contains the datorhandbok
        site.
      eee3b77a
    • Per Cederqvist's avatar
      File exclusion on /, use local rdiff-backup. · 6e4d07b0
      Per Cederqvist authored
      File exclusion on root filesystems didn't work.
      
      * backup-one-task: Don't produce a garbage exclude file when a
        .lysrdiff-exclude file is present on the / file system.
      
      Use our own rdiff-backup program.
      
      * backup-one-task: Use /opt/LYSrdiff/bin/rdiff-backup to perform
        the backup.
      6e4d07b0
    • Per Cederqvist's avatar
      Lysator configuration tweaks. · 08db3c07
      Per Cederqvist authored
      08db3c07
    • Per Cederqvist's avatar
      Back up parts of the maial server. · 6db4bbb7
      Per Cederqvist authored
      * fetch-backup-work: Back up parts of lenin.
      6db4bbb7
    • Per Cederqvist's avatar
      Make backup-repeatedly exit quicker. · 01e43c40
      Per Cederqvist authored
      * backup-repeatedly: Test for stop and finish flags more often.
      01e43c40
    • Per Cederqvist's avatar
      Print the most stale and freshest job per partition. · 64b660c4
      Per Cederqvist authored
      * lysrdiff-status: Do it.
      64b660c4
    • Per Cederqvist's avatar
      Print job number when holding or stopping. · c2a011c9
      Per Cederqvist authored
      * backup-all: Print job number and total number of jobs when stopping
        or holding.
      c2a011c9
    • Per Cederqvist's avatar
      Run distribute-tasks interactively and have the operator confirm · 6c719c08
      Per Cederqvist authored
      any changes.  Better handling of changed origins.
      
      * distribute-tasks
        (JobInfo.__init__): Initialize __active.
        (JobInfo.set_active): New method.
        (JobInfo.active): New method.
        (JobInfo.destination): New method.
        (tasks_per_destination): New global variable.
        (interactive): New global variable.
        (read_tasks): Update tasks_per_destination.
        (read_new_tasks): Use JobInfo.source() to simplify code.  Update
          tasks_per_destination.  Set lysrdiffpart of info if the source is
          already backed up, to avoid moving a backed up directory to a
          different partition.  Report a fatal error if the destination
          changes.
        (write_task_lists): Only skip jobs if running interactively.  Only
          reorder tasks if running non-interactively.  Have the user confirm
          changes if running interactively.
        (main): New argument: -i (--interactive).  Only read new tasks if
          running interactively.
      6c719c08
    • Per Cederqvist's avatar
      Syslog, backup origin, crashed server recovery, and more. · 5a283c38
      Per Cederqvist authored
      Use syslog.  Keep track of the origin of backups.  Removed
      workaround for manhattan.  Detect crashed servers faster.
      
      * backup-one-task: Removed special case for manhattan.  Store the
        origin of a backup in the origin file, and refuse to back up from a
        different origin (but tell the administrator how to proceed).  Use
        ServerAliveInterval to speed up detection of a crashed server.  Log
        a message to syslog when a backup completes.
      5a283c38
    • Per Cederqvist's avatar
      Added a top-level script that runs backups repeatedly. · 7433a9bf
      Per Cederqvist authored
      * backup-repeatedly: New file.
      7433a9bf
    • Per Cederqvist's avatar
      Get rid of obsolete status files and backups. · 30f7d067
      Per Cederqvist authored
      * lysrdiff-move-obsolete: New script.  Move backups that are no
        longer mentioned in the task file to a separate place.
      30f7d067
    • Per Cederqvist's avatar
      Better handling of new backup jobs, and more. · a082359f
      Per Cederqvist authored
      Guard against running two fetch-backup-work instances at the same
      time, and have the operator confirm any changes it finds.
      * fetch-backup-work: Atomically replace the list of backup tasks.
        Ask for confirmation before doing so.
      
      Don't backup snes9x-rediffbackup.
      * fetch-backup-work: Don't back up snes9x-rediffbackup, which
        seems to be an old backup in itself.
      
      Back up ftp-pub and medreg.
      * fetch-backup-work: Back up and / ftp-pub from hanna, and an
        sqldump of medreg from wrath.
      * backup-one-task: wrath uses rdiff-backup stored in /usr/bin.
      
      Added support for the --new option, which only runs backup jobs
      that have never completed.
      * backup-all: New option: --new.
      * backup-one-task: New option: --new.
      a082359f
    • Per Cederqvist's avatar
      Back up lyssvn. · fd649e31
      Per Cederqvist authored
      * fetch-backup-work: Back up / and /var of poseidon, and all the
        lyssvn repositories of poseidon.
      fd649e31
    • Per Cederqvist's avatar
      Handle warnings and parallell backups. · ca90b8dd
      Per Cederqvist authored
      Better handling of warnings.
      
      * backup-all: New option: --retry.  Only run df on the specified
        partitions.  Added handling of a "hold" file.
      
      * backup-one-task: New option: --retry.  Added -warn, -nowarn and
        -neverwarnfree status files.
      
      * lysrdiff-status: Print number of warnings per partition, and list
        all warnings.
      
      Support starting two "backup-all" at the same time.
      
      * distribute-tasks
        (write_task_lists): New argument: partitions.  Only output data for
          the specified partitions.  Create a lock directory to ensure that
          two distribute-tasks processes cannot clobber the same file.
        (main): Expect partition number on the command line.
      
      Minor.
      
      * Makefile (install-one-task): New target, extracted from install.
      ca90b8dd
    • Per Cederqvist's avatar
      Progress indication, stop and lock files, and more. · 06a8c731
      Per Cederqvist authored
      Progress indication.  Lock files.  More output.  Run ssh in batch
      mode.  Support --failed.  Support a stop file.
      
      * backup-one-task: New argument: msg.  New optional argument --failed.
        Default remoterdiff to /opt/LYSrdiff/bin/rdiff-backup, and add
        special cases for sedesopim, home and uhumhummy.  Remove special
        case for stalingrad.  Handle exclusion files.  Create
        rdiff-backup.out and backup-summary.txt.  Lock the result directory.
        Unset SSH_ASKPASS and SSH_AUTH_SOCK.  Run ssh in batch mode, to
        avoid password prompts.  Print status message including ETA while a
        backup runs.  Use the --force argument to rdiff-backup to make it
        easier to recover from an initial failure.
      
      * backup-all: New optional argument --failed.  Count the number of
        jobs to run, and pass a running total as the msg argument of
        backup-one-task, to get a nice progress indication.  Stop cleanly if
        the file /nobackup/backup.lysator/etc/stop is found.
      06a8c731
    • Per Cederqvist's avatar
      Back up sedesopim. · 5d1dffe0
      Per Cederqvist authored
      * fetch-backup-work: Back up sedesopim.
      5d1dffe0
    • Per Cederqvist's avatar
      Fixed crash in distribute-tasks. · e4455e8f
      Per Cederqvist authored
      * distribute-tasks (read_new_tasks): Added missing global declaration.
      e4455e8f
    • Per Cederqvist's avatar
      Provide a makefile that can install the system. · c1724bdc
      Per Cederqvist authored
      * Makefile: New file
        (BINDIR): New constant.
        (all): New target.  Do nothing.
        (install): New target.
      c1724bdc
    • Per Cederqvist's avatar
      Print status. · ef7919b1
      Per Cederqvist authored
      * lysrdiff-status: New file.  Print some status information about the
        backup system.
      ef7919b1
    • Per Cederqvist's avatar
      Randomize new jobs. · 543b0b21
      Per Cederqvist authored
      * distribute-tasks (read_new_tasks): Randomize the new tasks before
        inserting them first.
      543b0b21
    • Per Cederqvist's avatar
      Prefer new jobs to old jobs. · f08f9202
      Per Cederqvist authored
      * distribute-tasks (read_new_tasks): Insert new tasks first, on the
        assumption that it is more important to back up new areas than to
        refresh old areas.
      f08f9202
    • Per Cederqvist's avatar
      LYSrdiff now randomizes the backup order a bit less. · efce8eff
      Per Cederqvist authored
      * distribute-tasks (ordered_tasks): New global variable.
        (read_tasks): Store the job in it as well.
        (read_new_tasks): Ditto.
        (write_task_lists): Retain roughly the old order, but move a few
          random jobs to the front of the job queue.
      efce8eff
    • Per Cederqvist's avatar
      More backups, to separate partitions. · 39881334
      Per Cederqvist authored
      LYSrdiff can now backup up to separate partitions, creates more state
      timestamp files, randomizes the backup order, and backs up most user
      data.
      
      * fetch-backup-work: Fetch all lsvn, lyscvs, lyswww and home tasks,
        not just a select few.  Fetch roxen tasks.
      
      * backup-all: New arguments: a list of lysrdiffpart partitions to run.
        Check that the correct filesystems are mounted before doing
        anything.
      
      * backup-one-task: New argument: lysrdiffpart.  That argument
        specifies which lysrdiff partition that the backup should be stored
        on.  It is a small integer.  Adjusted the paths to handle it.  Skip
        manhattan, since it is (temporarily) dead.  Store state information
        in a separate directory, and touch flag files for when a backup
        starts and ends, fails and is being attempted.
      
      * distribute-tasks: New script.  This script is responsible for
        assigning new tasks to lysrdiff partitions.  It also randomizes the
        order of the tasks, to make the backup more fair.
      39881334
    • Per Cederqvist's avatar
      Initial checkin of lysrdiff. · 2dea8036
      Per Cederqvist authored
      Initial checkin of the proof-of-concept scripts used to backup
      some of the most important data on Lysator to sedesopim.
      
      * fetch-backup-work: New script.  Define all backup tasks by quering
        auto_home on nema, and listing certain directories on stalingrad and
        uhumhummy.  As set up, this will find home directories, user www
        directories that use Apache (not Roxen), and CVS and SVN projects on
        the stalingrad server.  Note, however, that only a select few of the
        tasks are actually selected, due to the current disc shortage on
        sedesopim.
      
      * backup-one-task: New script.  Run rdiff-backup to back up one task.
      
      * backup-all: New script.  This script repeatedly calls
        backup-one-task for all defined tasks.
      2dea8036
Loading