WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoDifxOsPatch2. *con...
HPC Web Preferences The following settings are web preferences of the HPC web. These preferences overwrite the site level preferences in . and , and can b...
Release disk space The paths below include old images and directories with old updates on server 1 and server 2. These old images are kept as a backup and roll ba...
USNO 3rd Generation DiFX Correlator * USNO Project Book 3 (at Staff Wiki): Information about the 3rd generation USNO correlator to be installed in 2024 USNO C...
This project book is the home page for the 3rd generation USNO correlator build. USNO 3rd Generation DiFX Correlator Project Book A. Project Vision To implemen...
USNO Correlator Documentation Wiki (Legacy) This Wiki section serves as the primary documentation for the NRAO project to provide a DiFX correlator to USNO. It is...
August 3rd 11am MDT/1pm EDT USNO Attendees: David, Nicole, Ken, Chris, Dave Hall NRAO Attendees: James, Kscott, Walter, Jeff Agenda * Budget and Production cl...
June 14th 11am MDT/1pm EDT USNO Attendees: David, Nicole, John Spitzak, Chris, Dave Hall NRAO Attendees: John, Kscott, Walter, James Agenda * Budget and Produ...
USNO Correlator schedule Monthly schedules with bulleted list at bottom of page. More target dates will be added as project progresses. Bulleted list * 2 Apr...
SCAP Instructions This document explains how to install and configure the SCAP tool. It briefly describes how to run a scan and how to analyze results. Get new t...
RADIUS Service RADIUS is an authentication service often supported by simpler devices such as switches. The servers run a systemd service named radiusd that the ...
Mellanox (Infiniband) Switch Software information * Collected 1/30/2024 by Mark Wainright data m6036 1 standalone: master show version Product name: M...
Mail Service Overview Since the correlator is effectively a compute device, very little email service is required. The only exception is that the system administ...
LSI MegaRAID Install The MegaRAID software installs /usr/local but we actually want it in /opt/services. So we make a symlink. $ To install the software, be ...
Installing DiFX Quick help To get usage instructions: difxbuild h To get in line documentation printed to your terminal: difxbuild d Introduction This DiFX in...
Fringing Host (test cluster only) Overview In addition to the normal correlation work, some other analytical work is done. At the USNO, they have two fringing...
Contents Networking As of this writing the plan is to fold the new correlator into the existing correlator network layout. This will facilitate keeping the two i...
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoDifxPatch2Draft. *...
USNO Maintenance Log 2 This log page allows significant maintenance/administration events to be logged for future use. The goal is to record information that migh...
KVM Console/Switchs (jhj 1/15/21) Currently two of the KVM retained from the old correlator are not on the net. These are the KVM in the second rack of SWCs and...
Environment Monitor The environment monitor is positioned to read the temperature and humidity via a sensor mounted above the rack containing the correlator nodes...
Host SSH Aliases In root's .bashrc are defined a number of aliases to make it a bit quicker to do commands to a single host. Basically it aliases the host name wi...
Ping Diskless The custom python3 utility ping diskless was originally designed to ping the SWCs to watch them through the reboot cycle. It has evolved such that ...
Nagios Nagios is a watchdog daemon that can be configured to check on various properties of a computer system and issue warnings and/or alarms if one of the prope...
Client (SWC) Installation The initial client installation was performed using the hard disk drive that came with SWC 001. The host was booted via PXE boot and the...
BGFS Installation The BGFS hosts were installed by vendor. They were then modified by us to meet the most pressing requirements (i.e., "critical" and "high" find...
Logging Rsyslog Server 1 runs rsyslogd via the systemd rsyslog.service; the main configuration for the rsyslod is /etc/rsyslog.conf. DHCP Logging DHCPD messages...
Time Service Overview Time services is provided primarily by server 1 using the chronyd daemon. The configuration file for chronyd is /etc/chrony.conf. Service...
BGFS File Servers Overview The new correlator is using BEEGFS (bgfs) in place of Lustre to provide a high speed, high capacity file system. The bgfs servers are ...
Compute Nodes Basic System Specs The SWC (SoftWare Correlator) hosts are Dell R640 systems. These have two Intel Xeon Gold 6132 CPUs which run at 2.60 GHz; each ...
Infiniband Switches Overview The correlators use Infiniband (IB) network connections to pass data between the correlator nodes (SWCs) and also with the file serv...
Admin Servers Introduction Each correlator has two administrative servers, server 1 and server 2. The servers are used to administer the correlator and take no d...
USNO Correlator II Overview Production Correlator The USNO uses a computing cluster built and maintained by NRAO for performing correlations using DiFX. In 2019...
Neo Correlator Patching The patch process for the Neo correlator (installed at USNO on November 2019) is outlined below. A set of "checkboxes" is provided to assi...
AIDE AIDE is a program that scans important files in the system and reports any changes in the files relative to the accepted baseline. The security STIG require...
Shutting off Nagios Alarms When a nagios problem can't be fixed right away it can get tiresome to have the alarm message coming out every hour or so. Almost the s...
Pty Allocation Problem So far, this problem has mostly occurred on server 1 on both clusters, probably because it gets the most login traffic suring maintenance. ...
Debugging SE Linux Both server 1..2 and the BGFS hosts are running SE Linux in targeted mode; the SWCs are not running SE Linux although since the images are host...
Correlator DNS Service Server Configuration Both server 1 and server 2 provide DNS service to the correlator. Server 2 should be considered a backup to server 1....
File Transfer From an NRAO Host The hosts on either correlator can be reached via the NRAO DNS, file transfer can be initiated from an NRAO host in a pretty stra...
Do on hosts This python script is designed to execute a command on a set of cluster hosts. It is invoked via the link do on hosts located in /opt/services/bin wh...
Host Status Tool The host status tool can be used to summarize important attributes for all hosts in the system. It is invoked by doing host status all on one of...