• AEON
    • Finish and verify data copies of comm area
    • Todd's adapted immoments script
    • 10x clustre nodes mounted and running batch pipeline jobs
  • AEON
    • 17:00 EDT Friday
    • Disconnect desktop clients, non-NAASC server clients
    • Disconnect cvpost lustre clients
    • Disconnect remaining NAASC server clients (excluding lustre data movers)
    • Disable write access to /.lustre/naasc OSTs (i.e., unmount and remount with 'ro' option)
    • Run final rsyncs of the ~18 filesystem "pieces"
    • Run final global sync (echo "rsync -vaW --stats --links /.lustre/naasc/* /.lustre/aeon/" | at -m -t 201805111730.00)
    • 09:30 EDT Saturday
    • Update /etc/sysconfig/network-scripts/ on LNET routers (terminus, trantor) and validate
    • Update /etc/fstab and reboot cvpost-master, cvpost-serv-1, skidmark
    • Validate successful changeover on hex, elwood
    • Validate successful changeover on cambryn, cvpost[061-064]
    • Validate successful changeover on mano, osiris, cvpost[101-104]
    • Validate successful changeover on valkyrie
    • After validation, reenable full service
      • Boot servers
      • Boot cluster
      • Boot workstations
    • Uptime notification emails to NAASC (staff and visitors) and cvlinux (to catch bcotton++)
  • AEON
    • Ensure closed access to old lustre - disable MDS (asimov)
    • Test/enable cron jobs that use lustre
    • cubach operational validation
    • Enable inventory script on all servers
    • Add user 'apache' to /etc/[shadow,passwd] on MDS pair
    • thunter development benchmarking
    • bemonts performance benchmarking
    • Configure and enable BackupPC on all servers
    • Configure and enable nrpe/Nagios on all servers
    • Configure and enable logwatch on all servers
    • Configure and enable rsyslog on all servers
    • Enable quotas for observers
    • Configure MDT ring to enable changelogs so Robinhood can run against new file system
    • ~30 days after cutover, de-installation of old lustre
-- Created 2018-05-03
Topic revision: r4 - 2018-05-14, AndrewMcNichols
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback