Information about me

Chicago, Illinois, United States
I have worked to improve professionals and international interaction centers since the mid-90s. I have worked with organizations to grow newly formed organizations to 300% their initial inflow of customers and support personnel and helped others reduce the life of open issues by 1/3. I have aided multiple start-up ventures through planning and initial phases of opening their doors. Occasionally, I work with individuals on improving their resumes, interviewing skills and professional presentation. I believe in a core principle that you should always be looking for the next rung above you and guiding somebody to make a change in their lives as they approach where you have been. Kaizen is the Japanese principle of continual improvement, I call mine ‘the next one up’.

Thursday, July 05, 2012

Toss the Tapes, I'm Backing Up & Working on Business Continuity

My new concern/consideration for the idea of backups is many of today's applications use live data that does not fit into the static idea of 'copy LOCATION X to TAPE Y'.  With each of these applications kindly (read the sarcasm) providing their own methodology for backing up, certainly outside the standard for your enterprise.

All of these applications have a method for delivering a static copy of the data but you need to evaluate if this is required.  Considerations are (a) memory dumps to store what hasn't been written to disk, (b) transaction logs that allow you to replace transactions from a time period and (c) general ability to sync data to disk, at which point a storage solution snapshot can take over.

As well as utilizing the application, I hit on the key functionality of storage solutions and created a business continuity methodology, reusing older storage devices.  I worked my way from disk to RAM to understand the application and then flipped that to determine the right approach.  The disk has a copy of the data but there were items in memory and it had an option to maintain a transaction log.  A large DB takes a big amount of time to back up so I needed a large window for a full backup.  This also means I can't do a full backup during most of the business week.

Digging in the configuration files and the documentation, I found a few settings that are of value in this situation.  First, I could send a command that forces all the writes in memory to be put into the DB stored on disk.  Second, I found the flag that turns on transaction logging and specifications necessary to construct this.  These were the two points I needed to start developing my plan.

Recovery time... I can replace a full day in about 2 hours, thus I could recover nearly two weeks in one day if I had to.

The plan of attack:

  • Do a full back-up via application on Sunday when activity is low
  • Each night do a backup of the transaction logs so we can 'replay the day'
  • Take both of these and store on a separate NAS
Even better, we found an old NAS serving limited purpose, migrated that destination to high powered storage and reused it, as well as migrated it to a secondary location, giving us some level of business continuity.