1000 recent changes in HPC Web retrieved at 14:43 (Local)

UsnoDifxOsPatch2ChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoDifxOsPatch2. *con...
UsnoMaintenanceLog2
USNO Maintenance Log 2 This log page allows significant maintenance/administration events to be logged for future use. The goal is to record information that migh...
UsnoDifxKVM2
KVM Console/Switchs (jhj 1/15/21) Currently two of the KVM retained from the old correlator are not on the net. These are the KVM in the second rack of SWCs and...
UsnoDifxEnvSensor2
Environment Monitor The environment monitor is positioned to read the temperature and humidity via a sensor mounted above the rack containing the correlator nodes...
UsnoHostAliases2
Host SSH Aliases In root's .bashrc are defined a number of aliases to make it a bit quicker to do commands to a single host. Basically it aliases the host name wi...
UsnoPingDiskless2
Ping Diskless The custom python3 utility ping diskless was originally designed to ping the SWCs to watch them through the reboot cycle. It has evolved such that ...
UsnoDifxNagios2
Nagios Nagios is a watchdog daemon that can be configured to check on various properties of a computer system and issue warnings and/or alarms if one of the prope...
UsnoDifxClientOSInstall2
Client (SWC) Installation The initial client installation was performed using the hard disk drive that came with SWC 001. The host was booted via PXE boot and the...
UsnoDifxLusterOSInstall2
BGFS Installation The BGFS hosts were installed by vendor. They were then modified by us to meet the most pressing requirements (i.e., "critical" and "high" find...
UsnoDifxLogging2
Logging Rsyslog Server 1 runs rsyslogd via the systemd rsyslog.service; the main configuration for the rsyslod is /etc/rsyslog.conf. DHCP Logging DHCPD messages...
UsnoDifxNTP2
Time Service Overview Time services is provided primarily by server 1 using the chronyd daemon. The configuration file for chronyd is /etc/chrony.conf. Service...
UsnoDifxNetworking2
Contents Networking As of this writing the plan is to fold the new correlator into the existing correlator network layout. This will facilitate keeping the two i...
UsnoDifxNetworkingDiagram2
Main.JimJacobs 2018 12 11
UsnoDifxBgfsServer2
BGFS File Servers Overview The new correlator is using BEEGFS (bgfs) in place of Lustre to provide a high speed, high capacity file system. The bgfs servers are ...
UsnoDifxComputeNodes2
Compute Nodes Basic System Specs The SWC (SoftWare Correlator) hosts are Dell R640 systems. These have two Intel Xeon Gold 6132 CPUs which run at 2.60 GHz; each ...
USNODifxCorrelator
USNO Correlator Documentation Wiki This Wiki section serves as the primary documentation for the NRAO project to provide a DifX correlator to USNO. It is intentio...
UsnoDifxFringe2
Fringing Host (test cluster only) Overview In addition to the normal correlation work, some other analytical work is done. At the USNO, they have two fringing...
UsnoDifxInfiniband2
Infiniband Switches Overview The correlators use Infiniband (IB) network connections to pass data between the correlator nodes (SWCs) and also with the file serv...
UsnoDifxRADIUS2
RADIUS Service RADIUS is an authentication service often supported by simpler devices such as switches. The servers run a systemd service named radiusd that the ...
UsnoDifxServers2
Admin Servers Introduction Each correlator has two administrative servers, server 1 and server 2. The servers are used to administer the correlator and take no d...
UsnoDifxOverview2
USNO Correlator II Overview Production Correlator The USNO uses a computing cluster built and maintained by NRAO for performing correlations using DiFX. In 2019...
UsnoDifxPatch2Draft
Neo Correlator Patching The patch process for the Neo correlator (installed at USNO on November 2019) is outlined below. A set of "checkboxes" is provided to assi...
UsnoDifxAide2
AIDE AIDE is a program that scans important files in the system and reports any changes in the files relative to the accepted baseline. The security STIG require...
UsnoDifxServerNagiosAck2
Shutting off Nagios Alarms When a nagios problem can't be fixed right away it can get tiresome to have the alarm message coming out every hour or so. Almost the s...
UsnoDifx2-200924
17:38 root@bg mds 1 T ~ # yum install mlnx ofed all Loaded plugins: langpacks, product...
UsnoDifxPtyFix2
Pty Allocation Problem So far, this problem has mostly occurred on server 1 on both clusters, probably because it gets the most login traffic suring maintenance. ...
UsnoDifxServerDebuggingSeLinux2
Debugging SE Linux Both server 1..2 and the BGFS hosts are running SE Linux in targeted mode; the SWCs are not running SE Linux although since the images are host...
UsnoDifxDNS2
Correlator DNS Service Server Configuration Both server 1 and server 2 provide DNS service to the correlator. Server 2 should be considered a backup to server 1....
UsnoDifxSMTP2
Mail Service Overview Since the correlator is effectively a compute device, very little email service is required. The only exception is that the system administ...
UsnoFileTransfer2
File Transfer From an NRAO Host The hosts on either correlator can be reached via the NRAO DNS, file transfer can be initiated from an NRAO host in a pretty stra...
UsnoDoOnHosts2
Do on hosts This python script is designed to execute a command on a set of cluster hosts. It is invoked via the link do on hosts located in /opt/services/bin wh...
UsnoHostStatus2
Host Status Tool The host status tool can be used to summarize important attributes for all hosts in the system. It is invoked by doing host status all on one of...
UsnoDifxOsPatchChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoDifxOsPatch. *cont...
UsnoDifxS1pS1tLink2
The file ~/.ssh/jjacobs s1t.config This is an instance of a user specific file to create the linkage from server 1p to server 1t. It currently hops to usno serv 1...
UsnoDifxInfinibandSoftwareInfo2
Mellanox (Infiniband) Switch Software information * Collected 5/15/20 by Jim Jacobs data m6036 1 standalone: master show version Product name: MLNX OS...
UsnoNodeBootMechanism2
Main.JimJacobs 2020 03 27
UsnoDifxServerDiskLayout2
Disk Layout Server Disk Partitioning The disk layout is shown below as displayed using lsblk. The two disks are partitioned somewhat in parallel although the fir...
UsnoDifxDHCP2
DHCP Overview Server 1 provides DHCP service on the network admin network. The setting for the daemon are in /etc/dhcp/dhcpd.conf. The IP addresses on all of ne...
UsnoDifxTFTP2
Main.JimJacobs 2020 01 23
UsnoVNC2
VNC and X Window Connections To launch an X application, make an ssh tunnel and then launch the X app an it'll appear locally. * ssh X J admin@usno serv 1t ...
Rhel7Stig055Production
This rule requires the installation and continuous execution of a host based intrusion detection system. The preferred package is McAfee but apparently something ...
UsnoRhel7Stig2ProductionChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoRhel7Stig2Productio...
Rhel7Stig001Production
Done, though future fiddling might throw it off.
Rhel7Stig242Production
Pending on firewall implementation.
Rhel7Stig245Production
The STIG requires multifactor access for all privleged accounts; it mentions using two government approved mechanisms (one is CAC) as examples. It's possible that...
Rhel7Stig241Production
This will occur as part of setting up the firewall.
Rhel7Stig239Production
The twoservers do not mount any NFS volumes. The SWCs have two mounts to server 1. We'll have to see if this causes any heartburn when it's enabled on the SWCs.
Rhel7Stig238Production
None of the hosts are currently doing any packet forwarding. On the old cluster the firewall had to be modified to allow packet forwarding to support some of the ...
Rhel7Stig237Production
Xwindows is used for remote administration purposes on server 1 and server 2. It is not installed on the SWCs.
Rhel7Stig236Production
The tftp server package is not installed on the SWCs. On the two servers, the service file is located in /etc/systemd/system/tftp.service and this starts the serv...
Rhel7Stig234Production
The two servers need TFTP server functionality to support diskless bootup. The daemon is invoked with a root, /opt/services/tftpboot, which limits its scope. The ...
Rhel7Stig216Production
Set it to 500 on the servers and at the 1000 limit on the SWCs as I'm worried that there might be a lot of traffic on them.
Rhel7Stig215Production
We'll need to tunnel back to the NRAO to get a clock sync. The SWCs will get their time from server 1.
Rhel7Stig204Production
Apply this one last since it'll make setup a lot harder.
Rhel7Stig190Production
FIPS stuff is on hold right now.
Rhel7Stig189Production
This rule should be revisited as part of firewall setup.
Rhel7Stig187Production
The servers provide SMTP service but act as relays so that alarm messages from within the cluster can propagate outside of the cluster to system administrators, e...
Rhel7Stig186Production
The two servers do allow remote messages over TCP. This allows them to capture syslog messages from the SWCs and other devices on the system. Thus they serve as l...
Rhel7Stig127Production
The config files for audit have changed since the STIG. They are now located in /etc/audit/rules.d though I think they're actually "compiled" into /etc/audit/audi...
Rhel7Stig115Production
Auditting is enabled on the systems and will be tweaked per STIG specs about coverage. The system must have high availability, so having a doomsday switch on audi...
Rhel7Stig112Production
There are a couple of other grub.cfg files located under /opt. These are served up to the diskless systems and are not part of the boot process for the server's t...
Rhel7Stig111Production
This appears to be related to FIPS installation, which we're skipping for the time being.
Rhel7Stig108Production
As soon as we do this one we'll lose the ability to use Radius to the switches, etc. Let's hold off for now.
Rhel7Stig105Production
The hard drives on the servers have a separate partition for /var. I'm not sure that this rule applies to the diskless systems since they have no disks.
Rhel7Stig057Production
The aide program is installed on server {1,2} and the swc diskless image. Cron should run it once a day on the servers. An email message will go out to usno admin...
Rhel7Stig056Production
This rule is moot if McAfee is installed and active; otherwise SELinux needs to be enabled and then configured appropriately.
Rhel7Stig052Production
Mandatory multifactor authentication is likely to be problematic for the cluster both for administration and DiFX usage because both actions require easy login to...
Rhel7Stig051Production
Applying this rule will end up requiring console access to complete a reboot which is not appropriate for either a cluster and for a remotely administrated system...
Rhel7Stig040Production
Made mod using polkit scheme to allow passwordless reboot on the swcs creating /etc/polkit 1/rules.d/51 wheel.rules.
Rhel7Stig038Production
This rule appears to need application hwover, the instructions are such that I'm not sure exactly what should be done.
Rhel7Stig002Production
Server 1 only had config file mods as expected. Server 2 has a mods to /etc/NetworkManager/dispatcher.d/20 chrony; I think a system update did this? The SWCs have...
CHTCSiteVisit
Wiki page to track August 26/27 CHTC site visit to NRAO Date: August 26 27 2019 Locations: SO Auditorium, CV Auditorium(Monday) and ER 245 (Tuesday) Connection In...
UsnoRhel7Stig2ChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic UsnoRhel7Stig2. *conte...
Rhel7Stig245
System is not currently using the sssd functionality.
Rhel7Stig241
This is on hold until the firewall is configured.
Rhel7Stig239
Server 1 only nfs mounts usno serv 1. This mount should be removed after the system is read to be put into production.
Rhel7Stig237
The x windows server is installed and is need to allow remote administration of the system. This needs to be in the ISSO document.
Rhel7Stig236
The commands provided are not appropriate for this system given it's version of RHEL 7.6. Use systemctl status tftp l to see that the tftp daemon is started in a...
Rhel7Stig234
Server 1 has tftpd installed and it's used for booting of the diskless hosts (swc xxx). It is set up to only transfer files located below /opt/services/tftpboot. ...
Rhel7Stig232
I believe that postfix on server 1 is configured to only relay messages from hosts on 10.1.36.* but it's not using, nor does it even show, the parameter described...
Rhel7Stig221
Need to better understand this one.
Rhel7Stig217
Activate firewall once stability is achieved.
Rhel7Stig215
This rule is tied tightly to NTP whereas RHEL is using chrony. This will take some research, probably. Also we'llhave to find a direct, acceptable official clock ...
Rhel7Stig204
Wait until stability.
Rhel7Stig201
Wait for stability.
Rhel7Stig199
Implement after stability reached.
Rhel7Stig192
Do this one last as its annoying during development.
Rhel7Stig191
This one terminates network sessions after 10 minutes of inactivity. Leave this until things are stable.
Rhel7Stig189
This is about setting up the firewall. It can wait a little bit yet.
Rhel7Stig187
There is no expectation that users will receive mail on server 1. It serves as a way to forward mail off of the cluster (e.g., sending notifications back to the s...
Rhel7Stig186
Need to "document" that server 1 aggregates logs for the other hosts in the cluster.
Rhel7Stig127
DId cp /usr/share/doc/audit 2.8.4/rules/30 stig.rules stig.rules= to put these rules into /etc/audit/rules.d. Then restarted service using service auditd restart....
Rhel7Stig120
This can be done but we'll have to find a place to upload them to. Maybe an NRAO site?
Rhel7Stig118
See note for RHEL 07 030210.
Rhel7Stig116
This requirement seems to be aimed at sending audit messages off the machine. However, server 1 doesn't really have anywhere to send them. This feature is more ap...
Rhel7Stig115
The requirement for high availability will need to be documented and some sort of notification upon audit failure will have to be configured.
Rhel7Stig113
Removed the installed telnet server package.
Rhel7Stig108
This one works pretty much as the directions describe. I suggest copying the linux image (vmlinuz...) and the ram disk image (initramfs...) and /boot/efi/EFI/redh...
Rhel7Stig089
Better first search is find / xdev perm 002 type f perm /111 exec ls ld {} \; more since this will only return executable files that are world writable.
Rhel7Stig112
Looks like there is no entry to boot from removable media.
Rhel7Stig111
Most rules had sha256 already. Changed them to sha512.
Rhel7Stig110
It appears that xattr status is given to most of the watched files.
Rhel7Stig109
Installed the aide package and looked at its config file. It appears to have "acl" in most of its rules.
Rhel7Stig107
Either /tmp has to be mounted in its own partition or it has to be a memory resident beastie(?).
Rhel7Stig105
They want the /var to be in a separate filesystem (i.e. partition). Argh!
Rhel7Stig097
Made entry in /etc/fstab: tmpfs /dev/shm tmpfs defaults,rw,nosuid,nodev,noexec 0 0.
Rhel7Stig095
It is mounted outside of /etc/fstab but has nodev option.
Rhel7Stig094
No problem on server * but the swcs will require documented necessity.
Rhel7Stig090
Revisit after enabling selinux.
Rhel7Stig084
The checking logic provided seems to prevent any file sharing except by group which is not really consistent with the collaborative nature of this system's usage....
Rhel7Stig055
This appears to require that a MacAfee HBSS package be installed.
Rhel7Stig031
Edited /etc/login.defs and set PASS_MAX_DAYS to 60
Rhel7Stig029
Edited /etc/login.defs and set PASS_MIN_DAYS 1.
Rhel7Stig064
Edited /etc/yum.conf and added line "clean_requirements_on_remove=1".
Rhel7Stig063
The autofs service is currently disabled.
Rhel7Stig056
This is a configuration issue for SE Linux; defer until SE Linux issue is addressed.
Rhel7Stig053
The rsh server package is not installed.
Rhel7Stig052
Smartcard support is required for this. Not sure, yet, how to handle this.
Rhel7Stig050
Save this one until system is stable.
Rhel7Stig049
The systems are booting under UEFI so this rule does not apply.
Rhel7Stig048
System comes this way it appears.
Rhel7Stig047
This system is RHEL 7.6 and thus this rule is not applicable.
Rhel7Stig046
Edited /etc/ssh/sshd_config and uncommented "HostbasedAuthentication no". This was probably the default, but...
Rhel7Stig044
The gdm package is not installed.
Rhel7Stig043
The gdm package is not installed.
Rhel7Stig042
Edited /etc/login.defs and added line "FAIL_DELAY 4".
Rhel7Stig040
No account is given password free sudo.
Rhel7Stig039
Do this one at the last moment to keep usage reasonable.
Rhel7Stig038
Do this awful thing at the last moment.
Rhel7Stig037
Edited /etc/default/useradd setting "INACTIVE=0".
Rhel7Stig036
Edited /etc/ssh/sshd_config to uncomment "PermitEmptyPasswords no". This was already the default setting, but need to make autior happy : (.
Rhel7Stig035
Rule's query came back without anything of interest.
Rhel7Stig034
In /etc/security/pwquality.conf set minlen to 15.
Rhel7Stig033
Added line "password requisite pam_pwhistory.so use_authtok remember=5 retry=3" to /etc/pam.d/{system auth,password auth} as directed in rule.
Rhel7Stig032
Using "chage M 60 theUser" on pch,ajs,oper,difxmgr to meet this requirement.
Rhel7Stig030
Changed password aging for pch, ajs, difxmgr and oper accouts so that they are 1 rather than zero.
Rhel7Stig028
Performed query and got expected results.
Rhel7Stig027
Executing rule's grep command shows the expected result.
Rhel7Stig026
Verified that only sha512 hashes are allowed using the rule's command.
Rhel7Stig025
Set maxlassrepeat = 4 in /etc/security/pwquality.conf.
Rhel7Stig024
Set maxrepeat to 3 in /etc/security/pwquality.conf.
Rhel7Stig023
Set minclass = 4 in /etc/security/pwquality.conf.
Rhel7Stig022
In /etc/security/pwquality.conf set difok to 8.
Rhel7Stig021
Edited /etc/security/pwquality.conf setting ocredit to 1.
Rhel7Stig017
Doing cat /etc/pam.d/system auth pipe grep pam_pwquality returns password requisite pam_pwquality.so try_first_pass local_users_only retry=3 authtok_type as ...
Rhel7Stig016
Rule command returns "password substack system auth" as required.
Rhel7Stig020
Edited /etc/security/pwquality.conf and set dcredit to 1 to require at least one digit character.
Rhel7Stig019
Edited /etc/security/pwquality.conf and set lcredit to 1 to require at least one uppercase character.
Rhel7Stig018
Edited /etc/security/pwquality.conf and set ucredit to 1 to require at least one uppercase character.
Rhel7Stig015
Implied by 010081.
Rhel7Stig014
The setting org.gnome.desktop.screensaver idle activation enable is deprecated and ignored according to =gsettings".
Rhel7Stig012
Doing yum list installed screen shows that this packages is installed.
Rhel7Stig011
Implied by rule 010070.
Rhel7Stig010
Doing gsettings get org.gnome.desktop.screensaver lock delay returns zero which means that the screen is locked when the sceensaver activates.
Rhel7Stig009
Performed gsettings set org.gnome.desktop.session idle delay 900 to apply the 15 minute idle setting.
Rhel7Stig008
This appears to require the same actions as rule 010060 and meeting that one (which is the case) implies meeting this one.
Rhel7Stig006
This is the default setting which can be demonstrated by doing gsettings get org.gnome.desktop.screensaver lock enabled which returns "true"
Rhel7Stig001
Waiting until the system installation has solidified.
Rhel7Stig005
Gross boiler plate so add this at the end before cloning.
Rhel7Stig004
Gross boiler plate so add this at the end before cloning.
Rhel7Stig003
Gross boiler plate so add this at the end before cloning.
WebStatistics
Statistics for HPC Web Month: Topic views: Topic saves: File uploads: Most popular topic views: Top contributors for topic save and uploads: ...
CatchAndRelease
Catch and Release %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% TL;DR remove an OST from a pool on CV lustr...
UsnoDifxEnvSensor
Environment Monitor The environment monitor is positioned to read the temperature and humidity via a sensor mounted above the rack containing the correlator nodes...
UsnoA7050Interfaces
usno a7050 show interfaces Ethernet1 is up, line protocol is up (connected) Hardware is Ethernet, address is 001c.7318.2adb (bia 001c.7318.2adb) Description: ...
ALMABenchmarking
Points of Contact ALMA Science Tony Remijan aremijan@ ALMA Systems Mike Hatz mhatz@ Background This page establishes a set of benchmarks that can be used...
UsnoDifxOperatingSystem2
Correlator Operating System The all the computing hardware will be running a version of RHEL 7.x. Because of security issues, the installed version will track th...
HPCSupport
GBO / LBO / JAO / NRAO HPC (High Performance Computing) Support Wiki Introduction This wiki is to track open tasks and to collect detailed logs for HPC relate...
WebHome
This is a wiki home for high performance computing at the NRAO. The area is still undergoing organizational changes but content in the Categories section is eith...
UsnoDifxNagios
Nagios We install service software in /opt/services instead of the normal location. This seperates it from the OS install and allows us to re install and/or upgr...
UsnoVNC
Connecting to the USNO Using VNC * Login to usno serv 1 ext and start VNC ssh admin@usno serv 1 ext vncserver * Start VNC on local machine vncviewer via a...
UsnoSshUser
Creating a new SSH user Access to the cluster from the outside is only permitted using ssh with a public key. This page describes how to add a new account as wel...
AutomateLustreClientBuild
Thoughts on automating Lustre Client module builds. * Keep a copy of the current lustre package under /opt/services/lustre client on usno serv 1t. (Had to inst...
SmileyTestChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic SmileyTest. context ...
SmileyTest
Main.JimJacobs 2017 05 23 Checkbox
CheckboxTest
Title One Two Main.JimJacobs 2017 05 15
CheckboxTestChecklistItemState
WARNING! THIS TOPIC IS GENERATED BY System.ChecklistPlugin PLUGIN. DO NOT EDIT THIS TOPIC (except table data)! Back to the checklist topic CheckboxTest. *context...
HeraLibrarian
HERA Librarian software Instructions on configuring the hardware can be found at https://staff.nrao.edu/wiki/bin/view/CIS/Documentation/Herastore01 Installation...
HERA
HERA * HeraLibrarian
FidindirectActivity
Summary of NAASC Lustre FID in direct Activation Activity This page provides a summary of the activity conducted at NAASC on Fri/Sat April 21/22, 2017. %TWISTY{ ...
UsnoDifxMegaRAID
LSI MegaRAID Install The MegaRAID software installs /usr/local but we actually want it in /opt/services. So we make a symlink. $ To install the software, be...
UsnoNodeBootMechanism
Node Boot Mechanism Configure BIOS $ Disable Hyper Threading: Hyper Threading is a very cheap trick to simulate dual CPUs. All it does is create a second ent...
UsnoDifxDHCP
DHCP Install DHCP Retrieve DHCP from http://isc.org/products/DHCP/ The latest release as of2012 06 26is DHCP 4.2.4. Looks like they still can't write a good mak...
LustreRoundRobin
File distribution across OSTs (Applies to Lustre 2.5.3) %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # The...
LustreBugABoo
Tracking Lustre Bugs %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # A table of bugs we care about Link ...
HPC20170301
HPC Meeting: 2017/03/01 Participants * NRAO: * David Halstead * Jessica Ottey * Patrick Murphy * Mike Hatz * James Robnett * ...
HPCMeetings
Meetings * HPC: 2017/03/01
LustreLessons
%TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # Key points * Lustre clients require lustre modules, while M...
NaascLustreUpgradeToaster
Naasc Lustre Upgrade 'Toaster' Notes %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # What is the toaster? ...
UsnoDifxInstallation
Installing DiFX Quick help To get usage instructions: difxbuild h To get in line documentation printed to your terminal: difxbuild d Introduction This DiFX in...
CasaParallelTaskList
CASA Parallelization Task List Item No. System Element Description Status Prerequisites People Target Cycle Notes 1 Environment Management ...
NagiosOstFullness
Using Nagios to monitor OST capacity %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # How to use this plugin...
AnsibledOssBuild
Building an OST using Ansible (Lustre 2.x) %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # Editing the temp...
JAOpostClientesGotKERNELPANIC
Hi all, SInce last Wednesday (2016 12 07) we at jao started having reports of some jaopost client machines (around 10 in 4 days) that got frozen during Pipeline R...
HPCTroubleshootingRequests
When you log a troubleshooting request, please remember to include relevant logs: 1 MDS log as an attachment 1 OSS log(s) as an attachment 1 Client log(s...
JaoFailedExecutionRepeat
In NRAO RHEL 6.5 image. Execute: /opt/sacm/bin/calPipeIF mous=uid://A001/X2d8/X367 Repeatedly fails with: /usr/bin/xvfb run: line 166: 42615 Segmentation fault ...
NAASC_Lustre_2016-11-22
Description NAASC MDS freezes due to being out of memory. More RAM is installed taking it from 12 GB to 48 GB. On a subsequent reboot, the MDS cannot mount the M...
64GBPipeline-20161031
Description Some CASA Pipeline jobs do not complete successfully at JAO on 64 GB cluster machines, but do on machines with more memory at JAO and the NAASC. This ...
JAOPOST020-20161103
Description Phone call from Maxs stating they were having problems with JAOPOST020 not being able to run CASA when connected to sciops lustre. Who JAO Maxs Sim...
UsnoDifxRHN
Red Hat Network Configuration Sep. 1, 2016 krowe: We setup usno serv 1 in the test cluster to download all available updates from the Red Hat Network. This was d...
LustreFilesystem
Documentation for Lustre filesystem. Very much in progress. Installation The following pages cover various steps in installation of a Lustre filesystem simil...
UsnoDifxJun2016Patch
* Instructions down say anything about updating /etc/exports on usno serv 1{t}. They should or we should stop doing it per version (appears to be needed the way ...
NaascLustreUpgradePath
NAASC Lustre 2.x Activities %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% Background The version of Lustre ...
ClusterInfoPublic
Clever Notes on the Cluster Nodes %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% # Know your Nodes (Tech Spe...
LardFileSystems
LARD Project Notes, Part 3 %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgright="" hideimgright="" }% * PART THREE INCLUDES: * L...
LardLustreInstall
LARD Project Notes, Part 1 * PART ONE INCLUDES: * OSS install * IB setup * Raid sets * Installation of lustre packages %TWISTY{ s...
LardLustrePerformMain
LARD Project Notes, Part 2 * PART TWO INCLUDES: * Performance Testing # Performance Testing Applies to OSSes ## Look at your devices root@la...
ZfsExperiment
Experiment with ZFS %TWISTY{ showlink="Show TOC" hidelink="Hide TOC" showimgleft="" hideimgleft="" }% # Good intro doc * I found this write up...
ChunkSize64
Chunk Size 64 Lard Test Results # xdd root@lard oss 2 bin # ./xdd.linux op read targets 1 /dev/sdc queuedepth 1 blocksize 512 reqsize 2048 mbytes 131072...
ChunkSize256
Chunk Size 256 K Lard Test Results # iozone * Run iozone cd /mnt/sdc; /tmp/root/iozone3_434/src/current/iozone ec t 1 r 1M s 128g n i 0 i 1 * Result...
ChunkSize128
Chunk Size 128 K Lard Test Results # iozone * Run iozone cd /mnt/sdd; /tmp/root/iozone3_434/src/current/iozone ec t 1 r 1M s 128g n i 0 i 1 * Result...
UsnoDifxFeb2016Patch
Notes from the February 2016 patching Changes * Migrated to scripted form of patching * New version is 6.7.1.1 on all systems * Migrated Lustre servers ...
RawPerformanceTests
Lustre Disk Performance Tests Performance tests listed here should be done prior to creating actual Lustre filesystems. The tests are either destructive, dd and ...
LustreSoftware
Install and Configure Lustre Software Lustre Server RPM install $ Download the following RPMs, matching your lustre version, OS, and kernel. Source: Intel's ...
InfinibandInstall
Installing Infiniband for Lustre Installing Mellanox switch * They do not do DHCP by default so you will need a serial console configured to 8N1 with hardwar...
Mar0316
Main.SandraCastro 2016 03 01 Casa HPC/Parallelization meeting agenda/minutes Thursday 03/03/2016 , ESO Pavo, A.2.01 , 16:00 UT How to connect * Dia...
CasaParallelization
CASA Parallelization Wiki area for discussion and tracking of various CASA parallelization issues and targets. Planning Information * Project Scope ...
UsnoErrataIssues
Errata and Issues * The usno serv host may need to be able to be a mail server and devices like the PDUs can send email to it and it can relay out. Mail from ...
UsnoDifxSMTP
SMTP (sendmail) Install Sendmail We use the sendmail that comes stock with RHEL. Configure Sendmail on usno serv * servers $ edit /etc/mail/sendmail.mc: ...
Feb0216
Main.SandraCastro 2016 01 27 Casa HPC/Parallelization meeting agenda/minutes Thursday 02/02/2015 , ESO Pavo, A.2.01 , 16:00 UT How to connect * Dia...
UsnoDifxUpdateDisklessImage
DEPRECATED, WILL LIKELY DELETE This page documents creating a new USNO correlator client OS cluster image with new security RPMS. Rather than applying patches dir...
Dec1015
Casa HPC/Parallelization meeting agenda/minutes Thursday 10/12/2015 , ESO Centaurus, C.2.01 , 16:00 UT How to connect * Dial in: 49 89 307 6832 *...
UsnoDifxOsUpdate
Updating the OS All work on the OS should be done on the test usno cluster at the NRAO in Socorro, NM. This way it can be tested before copied to the real USNO c...
CurrentStatus
Current Status Known Work Remaining Updated: March 2, 2015 * Environment Management Infrastructure * MPI Framework is in place. MPI rpm packages are ...
ConceptOfOperation
Main.SandraCastro 2015 04 13 Use Case 1: Run on a cluster, on interactive node Description Run CASA from a self contained binary package. Run CASA in parallel u...
Aug0615
Casa HPC/Parallelization meeting agenda/minutes Thursday 6th Aug 2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect * Dial in: 49 89 6834 * V...
UsnoHttpd
HTTP Eventually we may want to use our regular apache/http installation but for now, I am just going to use the stock redhat for testing. $ Configure httpd: c...
UsnoDifxTFTP
TFTP Setup for Diskless Boot Enable TFTP Services on server. $ Create new tftp directory in /opt/services tree: mkdir p /opt/services/tftpboot $ edit /e...
UsnoDifxNTP
NTP Configure Time Servers and Peers This is one of the differences between the test cluster at the NRAO/AOC and the production cluster at USNO. The test cluste...
UsnoDifxDNS
DNS (bind) Install DNS Retrieve bind from http://www.isc.org/software/bind/ Use the latest 9.7 release. We split bind into the following directory structure to...
UsnoDifxSSH
SSH Because of security settings by the USNO, one cannot ssh in as root. Using passwords with ssh is not allowed, only phasphrase keys can be used. Nodes (Both ...
UsnoDifxCert
Web Certificates The default web cert (/etc/pki/tls/certs/localhost.crt) expires 1 year after it is created which is when the machine is installed. There is a c...
UsnoDifxInstallationPrerequisites
Prerequisites for DIFX installation Intel Performance Primitives Library (IPP) 64bit Install $ For 32bit: export VERSION=l_ipp_7.0.6.293_ia32 $ For 64bit...
Jul2315
Main.SandraCastro 2015 07 21 Casa HPC/Parallelization meeting agenda/minutes Thursday 23/07/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
Jul0915
Main.SandraCastro 2015 07 07 Casa HPC/Parallelization meeting agenda/minutes Thursday 09 July 2015 , ESO Centaurus, C.2.01 , 15:00 UTC How to connect ...
Jun2515
Main.SandraCastro 2015 06 26 CASA HPC Face2Face Meeting in Socorro Attendees ESO: Julian, Justo and Sandra NRAO: CASA team NAOJ: Kana, Takeshi STFC: Stewart Ag...
Apr2315
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 23/04/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
Apr1615
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 16/04/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
SystemRequirements
CASA HPC/Parallelization Requirements Introduction Requirements applicable to the CASA HPC Parallelization effort are described below. An iterative and increment...
May2815
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 28/05/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
May2115
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 21/05/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
May1415
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 14/05/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
May0715
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 07/05/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
Apr3015
Main.SandraCastro 2015 04 15 Casa HPC/Parallelization meeting agenda/minutes Thursday 30/04/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
CasaParallelMinutes
Casa HPC/Parallelization meeting agenda/minutes Thursday ##/##/2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect * Dial in: 49 89 6834 * Vid...
Apr0915
Main.SandraCastro 2015 04 08 Casa HPC/Parallelization meeting agenda/minutes Thursday 09 April /2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect...
3EBSSeparatedALMAPipeline
Main.SandraCastro 2015 04 08 Data set X291 with 3 EBs. Weblog is OFF for all tests. casa test 4.4.123, pipeline rev 32881, CV cluster 1 Each EB runs on a sep...
3EBSALMAPipeline
Main.SandraCastro 2015 03 31 1. ALMA MS A001_X122_X291 with 3 EBs uid___A002_X856bb8_X169d, uid___A002_X86fcfa_X66b, uid___A002_X8719c8_X27f Script is: h_init()...
Apr0215
Main.SandraCastro 2015 04 01 Casa HPC/Parallelization meeting agenda/minutes Thursday 2 April 2015 , ESO Centaurus, C.2.01 , 15:00 UT How to connect ...
BleedingTests
Main.SandraCastro 2014 11 11 1 Tests using a cycle 2 data reduction script with Multi MS. The script runs the following tasks: 1 Tests using a cycle 2 data ...
Mar1915
Main.SandraCastro 2015 03 18 Casa HPC/Parallelization meeting agenda/minutes Thursday 19/03/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Mar1215
Main.SandraCastro 2015 03 11 Casa HPC/Parallelization meeting agenda/minutes Thursday 12/03/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
RunCASAWithMPI
Main.SandraCastro 2015 03 09 1. Running the trunk of CASA with MPI * If your desktop does not have the MPI libraries installed (NRAO computers should have the...
Mar0515
Main.SandraCastro 2015 03 04 Casa HPC/Parallelization meeting agenda/minutes Thursday 05/03/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Feb2615
Main.SandraCastro 2015 02 25 Casa HPC/Parallelization meeting agenda/minutes Thursday 26/02/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Feb1915
Main.SandraCastro 2015 02 18 Casa HPC/Parallelization meeting agenda/minutes Thursday 19/02/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Feb1215
Main.SandraCastro 2015 02 10 Casa HPC/Parallelization meeting agenda/minutes Thursday 12/2/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Feb0515
Main.SandraCastro 2015 02 03 Casa HPC/Parallelization meeting agenda/minutes Thursday 05/02/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
PipelineBalanced
Main.SandraCastro 2015 01 28 ALMA pipeline script and "balanced" mode in partition 1. (6 Feb) Balanced mode with 4 subMSs, about 14Gb each. Restarted the whole ...
Jan2915
Main.SandraCastro 2015 01 27 Casa HPC/Parallelization meeting agenda/minutes Thursday 29/01/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Jan2215
Main.SandraCastro 2015 01 21 Casa HPC/Parallelization meeting agenda/minutes Thursday 22/01/2015 , ESO Centaurus, C.2.01 , 9:00 AM MST How to connect ...
Jan1515
Main.SandraCastro 2015 01 13 Casa Parallelization meeting minutes Thursday 15 January, 2015 , ESO Centaurus C.2.01 , 9:00 MST * Dial in number: 49 89 30...
Cycle2MaxNumberSubMS
Tests using the maximum possible number of subMSs (all existing SPW/scan combinations) Since CASA data reduction scripts rely very commonly on SPW/scan selection ...
IssueChart
Current Issues Status Task Priority Assignee Ticket Number Note IO Shape and Size Number of Open Files 1 JJ Temp Lat...
Dec0414
Main.SandraCastro 2014 11 21 Casa Parallelization meeting minutes Face2Face Meeting in Socorro Monday 01 05 December 2014 , DSOC 248 , TIME Attendees: ...
TestMPICluster
Main.SandraCastro 2014 12 01 Running CASA scripts using the MPI framework in the Socorro cluster This procedure will build CASA from scratch and install all the ...
Cycle2LazyMMS
Main.SandraCastro 2014 12 01 Run a cycle 2 script using lazy filler and MMS * Run partition to create 10 subMSs, which seemed to be more optimal for applycal....
Cycle2MMS
Main.SandraCastro 2014 11 13 1. Tests using MMS We are running several tests on MMSs and will use this area to post some findings. None of the problems here are ...
PipelineMMSTests
Main.SandraCastro 2014 11 13 1. Test the pipeline using CASA's trunk build on MMSs. Seg faults on importasdm. It may have inconsistencies in the code. Need to use...
Nov0614
CASA Parallelization Meeting Minutes Thursday November 6th, DSOC 317, 8:00AM MT * 192.33.117.12##8108 * 434 817 6523 Attendees: * Socorro: Rob, James,...
Oct1614
CASA Parallelization Meeting Minutes Thursday October 16th, DSOC 280, 8:00AM MT * Polycom Video: 192.33.117.12##8110 * Voice: 434 817 6524 Attendees: ...
Sept2514
Mini TODO list *) Kumar to fix a bug in virtual model column not cleared at times *) Sanjay (with help of James R) will get a parallel run with boosted limit on f...
Sept1114
CASA Parallelization Meeting Minutes Thursday September 11th, DSOC 317, 8:00AM MT * Polycom Video: 192.33.117.12##8108 * Voice: 434 817 6523 Attendees: ...
DecisionLog
CASA Parallelization Decision Log A summary of recorded significant decisions at meetings for easy searching. Topic Decision Reference SimpleCluster I...
UsnoDifxBenchmarkingLustre
Tasks * Test power load with parrallel correlation and network tests Procedures Walter's notes are in /lustre/usno/benchmark/difx/difxspeed/Howto on correlato...
UsnoDifxBenchmarking
Benchmarking * UsnoDifxBenchmarkingLustre difxspeed: a new benchmarking tool A new tool, difxspeed (attached to this wiki page) has been developed that facilita...
MPIImplementation
Preferred MPI Implementation Background A preferred MPI implementation needs to be identified and incorporated into the CASA build system and development environ...
Aug2114
Casa Parallelization Meeting Minutes Thursday August 21st, DSOC 317, 8:00AM MT * Polycom Video: 192.33.117.12##8108 * Voice: 434 817 6523 Attendees: *...
ImplementationPlan
CASA Parallelization Implementation Plan Introduction The project will be approached with an iterative/incremental development model, deploying the parallelizat...
SystemArchitecture
CASA Parallelization Architecture General Approach Our general approach will to be to attack the "embarrassingly parallel" portions of data reduction. That is to...
ProjectScope
CASA Parallelization Project Scope With the expansion of the VLA and the construction of ALMA, data sets are increasing in size and data processing time is increa...
Aug1414
Casa Parallelization Meeting Minutes Thursday August 14th, DSOC 317, 8:00AM MT * Polycom Video: 192.33.117.12##8108 * Voice: 434 817 6523 Attendees: *...
UsnoDifxOSSOSInstall
Overview Lustre OSSes were purchased from Aeon computing and come pre installed with Centos 5.9 and Lustre 1.8.9. The following are modifications to the received...
Aug0714
Casa Parallelization Meeting Minutes Thursday August 07th, DSOC 317, 8:00AM MT * Polycom Video: 192.33.117.12##8108 * Voice: 434 817 6523 Attendees: *...
Aug1114
Casa Parallelization meeting minutes Thursday August 07th, DSOC 317, 8:00AM MT * Polycom Video: 192.33.117.12##8108 * Voice: 434 817 6523 Attendees: *...
UsnoDifxMDSOSInstall
Installing RedHat Enterprise 6 Workstation on the USNO Lustre MDS Pre Installation $ Enable Virtualization: This is necessary for 64bit versions of VMware. ...
UsnoDifxDisklessBoot
Diskless Booting of the Compute Nodes This topic discusses the configuration of the diskless network boot system proposed to be used with the USNO DifX software c...
UsnoDifxLustreInstall
July Lustre Installation steps Prior to Tuesday July 22nd * USNO Tasks * Identify Lustre MDS server: separately ordered Dell with 3 Hard Drives otherwis...
ClusterScheduling
Cluster Scheduling Overview The NRAO has a computer cluster for running CASA. A resource manager, Torque, and a scheduling program, Maui, are required to allow ...
Jul2913
Casa Parallelization meeting minutes: Monday 29 July 2013 Attendees: Jeff, Jim, Kumar, James, Sanjay Status Review * Temp Lattice * Hooks are in place,...
USNOPower
Powering Off and On the Cluster Without Admin Access Power Down 1 Ensure that correlation is not running. 1 Power off node 001 through node 033 by holdin...
NaascUvaXsede
Project page to track the proof of concept to transfer data and compute jobs from the NAASC to the UVA campus grid (XSEDE), specifically to the CS and Astronomy d...
Jun1713
Casa Parallelization meeting minutes: Monday 3 June 2013 Attendees: Jeff, Kumar, James, Jim, Brian Review of Priorities: * Removal of Scratch Columns: ...
Jun0313
Casa Parallelization meeting minutes: Monday 3 June 2013 Attendees: Jeff Review of Priorities: * Benchmarking the pipeline * Two tasks: * Ins...
Apr2913
Casa Parallelization meeting minutes: Monday 29 April 2013 Attendees: Jeff, James, Kumar, Sanjay Review of Priorities: * Benchmarking the pipeline * Tw...
Apr0113
Casa Parallelization meeting minutes: Monday 1 April 2013 Attendees: Jeff, James, Jim, Brian, Kumar, Sanjay Review of Priorities: * Benchmarking the pipeline...
Mar1813
Casa Parallelization meeting minutes Monday March 18th Room 317, 3:30pm MDT Attendees: Targets/task * Remaining partition non compliant tasks * Statu...
CasaParallelMinutes20130211
Casa Parallelization meeting minutes Monday February 11th Room 317, 3:30pm MDT Attendees: Targets/task * Large channel count cube imaging * Status pe...
UsnoMeeting09062012
Very brief informal meeting held to confirm shipment of the correlator and finalize visit plans. Main.JamesRobnett 2012 09 06
CasaParallelMinutes20121217
Casa Parallelization meeting minutes Monday December 17th Room 317, 3:30pm MDT Attendees: Targets/task * Large channel count cube imaging * Brief dis...
CasaParallelMinutes20120827
Casa Parallelization meeting minutes Monday August 27th Room 317, 3:30pm MDT Attendees: Targets/tasks * Benchmarks against various hardware James * U...
UsnoMeeting08032012
August 3rd 11am MDT/1pm EDT USNO Attendees: David, Nicole, Ken, Chris, Dave Hall NRAO Attendees: James, Kscott, Walter, Jeff Agenda * Budget and Production cl...
UsnoMeeting11302012
Agenda * status of Difx processing * 0.5 ns bug in DiFX * USNO network transition update * Any outstanding USNO needs * Initial Phase II discussions...
LustreFilesystemCreation
Lustre Filesystem Creation Documentation for creating MDS and OSS filesystems. Ensure the following steps have been done before proceeding * Operating systems...
PerformanceTests
Filesystem tests * For bonnie tests run something like _bonnie { u 101} f s(2*Mem)g d {path} * Where u 101 switches to a different user if root, di...
UsnoDifxGanglia
Ganglia We install ganglia in /opt/services instead of the normal location. This seperates it from the OS install and allows us to re install and/or upgrade the...
UsnoDifx-Networking-Description
USNO Difx Correlator Networks The Difx Correlator connects to 3 discrete Ethernet networks. * public network for remote access from NRAO/NM for maintenance and...
CasaParallelMinutes20120813
Casa Parallelization meeting minutes Monday August 13th Room 317, 3:30pm MDT Attendees: Targets/tasks * Benchmarks against various hardware James * U...
UsnoDifxTasks
Task Person Status remove mark5fx names from DNS remove /home/usno export to mark5fx units Ensure up to date software is checked out WFB ...
CasaParallelMinutes20120806
Casa Parallelization meeting minutes Monday August 6th Room 317, 3:30pm MDT Attendees: James, Jeff, Kumar, Bryan, Brian, Sanjay, Jim Targets/tasks * Benchma...
WideAreaNetworking
This page or subpages are intended to track Wide Area Network (WAN) performance within the NRAO, primarily for improving performance instrument data mirroring and...
CasaParallelMinutes20120730
Casa Parallelization meeting minutes Monday July 30th Room 317, 3:30pm MDT Attendees: Jeff, James, Kumar Targets/tasks * Benchmarks against various hardware...
CasaParallelMinutes20120723
Casa Parallelization meeting minutes Monday July 23rd Room 317, 3:30pm MDT Attendees: Targets/tasks * Benchmarks against various hardware James * Sta...
LustreMonitoringSystems
Install Monitoring Systems We install ganglia in /opt/services instead of the normal location. This seperates it from the OS install and allows us to re install ...
LustreTuning
MDS Tunables OSS Tunables Read Cache filesize: Consider reducing the maximum filesize for read cache. Since Lustre is mostly supplying raw CASA data there will ...
CasaParallelMinutes20120716
Casa Parallelization meeting minutes Monday July 16th Room 317, 3:30pm MDT Attendees: James, Brian, Kumar Targets/tasks * Benchmarks against various hardwar...
Lustre10G
Installing 10Gb for Lustre Configuring 10G on systems The card we use is the Solarflare SFC9020. Note that these instructions assume eth2. Assign IP address wi...
3WareInstall
3ware Install and Configure Some of these steps may be specific to the NRAO. Setup System * Add a fixed address for aoc oss X in the 10.64.1.XXX range. Use n...
CasaParallelMinutes20120702
Casa Parallelization meeting minutes Monday July 2nd, Room 317, 3:30pm MDT Attendees: Bryan, Jeff, James, Kumar, Jim Targets/tasks * Complete or nearly comp...
UsnoDifxHardware
USNO Difx Correlator Hardware Hardware list Test system * 2 Dell 620 2.9 Ghz dual processor 1U processing nodes http://www.dell.com/us/enterprise/p/poweredge...
UsnoMeeting07122012
July 12th 11am MDT/1pm EDT USNO Attendees: Nicole, Alan, Ken, Dave Boboltz, Dave Hall, John, Chris NRAO Attendees: Kscott, Jeff, James, Walter, John Agenda * ...
UsnoSchedule
USNO Correlator schedule Monthly schedules with bulleted list at bottom of page. More target dates will be added as project progresses. Bulleted list * 2 Apr...
LustreHardware
Lustre Server Hardware OSS server The OSS consists of the following hardware, an example spec can be found here:OSS specs.pdf * Superlogics 4U chassis, CSE...
CasaParallelMinutes20120625
Casa Parallelization meeting minutes Monday June 25th Room 317, 3:30pm MDT Attendees: Jeff, Bryan, Kumar, James Targets/tasks * Complete installation of tes...
CasaParallelMinutes20120618
Casa Parallelization meeting minutes Monday June 18th Room 317, 3:30pm MDT Attendees: Targets/tasks for June 18th 25th * Complete installation of test ha...
CasaParallelMinutes20120611
Targets/tasks for May 11th 18th * For next monday some description of memory consumption Discussion/Agenda * Memory requirements in imaging * Total...
UsnoMeeting06142012
June 14th 11am MDT/1pm EDT USNO Attendees: David, Nicole, John Spitzak, Chris, Dave Hall NRAO Attendees: John, Kscott, Walter, James Agenda * Budget and Produ...
CasaParallelMinutes20120507
Casa Parallelization meeting minutes Monday May 7th Room 317, 3:30pm MDT Attendees: Targets/tasks for May 7th 14th Discussion/Agenda * Memory require...
Web100NdtLinuxInstall
Installing web100 / ndt I chose to base my install off a standard RHEL6.2 x64 kickstart. After patching the box was running the 2.6.32 220.13.1.el6.x86_64 kernel....
DiFX
DiFX Detailed information about DiFX can be found on The CIRA DiFX wiki . Main.WalterBrisken 2012 05 15
UsnoMeeting05102012
Main.JamesRobnett 2012 05 08 May 10th 11am MDT/1pm EDT USNO Attendees: NRAO Attendees: Steve, John, Kscott, James, Walter Agenda * Budget * All test cl...
CasaParallelMinutes20120409
Casa Parallelization meeting minutes Monday April 9th Room 317, 3:30pm MDT Attendees: Targets/tasks for April 9th April 15th * Test model data column cha...
CasaParallelMinutes20120326
Casa Parallelization meeting minutes Monday March 26th Room 317, 3:30pm MDT Attendees: James, Jeff, Kumar, Sanjay, Targets/tasks for March 19th to March 25th ...
UsnoMeeting04052012
USNO Difx Correlator kick off meeting April 5th 1pm MDT/3pm EDT USNO Attendees: Ken, Kerry, Nancy, Dave, Alan, Nicole, Chris NRAO Attendees: Walter, Steve, James,...
CasaParallelMinutes20120319
Casa Parallelization meeting minutes Monday March 19th Room 317, 3:30pm MDT Attendees: Jim, Sanjay, Kumar, Bryan, Jeff, James Targets/tasks for March 19th to M...
CasaParallelMinutes20120312
Casa Parallelization meeting minutes Monday March 12th Room 317, 3:30pm MDT Attendees: Targets/tasks for January 27th March 4th * Test thread gridder per...
CasaParallelMinutes20120227
Casa Parallelization meeting minutes Monday February 27th Room 317, 3:30pm MDT Attendees: Targets/tasks for January 27th March 4th * Test thread gridder ...
CasaParallelMinutes20120206
Casa Parallelization meeting minutes Monday February 6th Room 317, 3:30pm MDT Attendees: Targets/tasks for January 6th February 13th Discussion/Agenda *...
CasaParallelMinutes20120130
Casa Parallelization meeting minutes Monday January 30th Room 317, 3:30pm MDT Attendees: Jim, James, Bryan, Kumar, Sanjay, Jeff Targets/tasks for January 30th ...
NFSRootComputeNodes
Main.DanielKlopp 2011 12 15 Comments on Content This information is provided as is in the hope that it will be helpful to some people. Be careful utilizing some...
CasaParallelMinutes20120109
Casa Parallelization meeting minutes Monday January 9th Room 317, 3:30pm MDT Attendees: James, Jeff, Brian, Kumar, Sanjay, Jim Targets/tasks for January 9th ...
LustreTraining
Lustre Training January 24 27th 2012 Denver Colorado Network * Check Lustre cabling, look for errors or inexplicable client evictions * Ensure IB cards are...
CasaParallelMinutes20111114
Casa Parallelization meeting minutes Monday November 14th Room 317, 3:30pm MDT Attendees: Brian, Kumar, Sanjay, Jeff, Jim, James Targets/tasks for November 14t...
CasaParallelMinutes20111017
Casa Parallelization meeting minutes Monday October 17th Room 317, 3:30pm MDT Attendees: James, Jeff, Jim, Kumar, Bryan, Brian Targets/tasks for October 17th ...
CasaParallelMinutes20111003
Casa Parallelization meeting minutes Monday October 3rd Room 317, 3:30pm MDT Attendees: Targets/tasks for October 3rd 10th * Discussion/Agenda * Lus...
CasaParallelMinutes20110912
Casa Parallelization meeting minutes Monday September 12th Room 317, 3:30pm MDT Attendees: Sanjay, Brian, Bryan, Jim, Jeff, James, Kumar Targets/tasks for Sept...
CasaParallelMinutes20110808
Casa Parallelization meeting minutes Monday August 8th Room 317, 3:30pm MDT Attendees: Brian, Jeff, Kumar, James Targets/tasks for August 8th 14th * Conti...
CasaParallelMinutes20110725
Casa Parallelization meeting minutes Monday July 25th Room 317, 3:30pm MDT Attendees: Jim, Jeff, James, Justo, Kumar, Brian Targets/tasks for July 25th July ...
LustreOverview
Lustre Overview Lustre is a parallel distributed filesystem used in most large scale computing facilities. It allows NRAO/NM desktops, public machines and clus...
CasaParallelMinutes20110718
Casa Parallelization meeting minutes Monday July 18th Room 317, 3:30pm MDT Attendees: Kumar, Jim, Jeff, James, Justo Targets/tasks for June 18th July 24th ...
CasaParallelMinutes20110711
Casa Parallelization meeting minutes Monday July 11thth Room 317, 3:30pm MDT Attendees: James, Jeff, Sanjay, Kumar, Bryan, Simon Radcliffe Targets/tasks for Ju...
LustreClientInstall
How to make RHEL5.x x86_64 Lustre client RPMs. Download and Compile Working space and variables tmpdir="/tmp/$$" extraversion=`uname r cut d" " f2` ...
JaoOss1Xdd
Xdd Results for JAO OSS 1 * /dev/sdb T Q Bytes Ops Time Rate IOPS Latency %CPU TARGET PASS0001 0 ...
JaoOss2Xdd
Xdd Results for JAO OSS 2 * /dev/sdb T Q Bytes Ops Time Rate IOPS Latency %CPU TARGET PASS0001 0 ...
LustreServerInstall
Lustre Build and Install notes Lustre build notes for building and installing Lustre servers and clients against Redhat (RHEL5.5) kernel. Get Quilt patch mana...
CasaParallelMinutes20110627
Casa Parallelization meeting minutes Monday June 27th Room 317, 3:30pm MDT Attendees: Kumar, James, Jeff, James, Jim, Sanjay Targets/tasks for June 27th July...
CasaParallelMinutes20110620
Casa Parallelization meeting minutes Monday June 20th Room 317, 3:30pm MDT Attendees: Bryan, Brian, Sanjay, James, Jim, Jeff, Kumar Targets/tasks for June 20th...
CasaParallelMinutes20110613
Casa Parallelization meeting minutes Monday June 13th Room 317, 3:30pm MDT Attendees: Jim, James, Kumar, Jeff Targets/tasks for June 13th June 19th Discussi...
CasaParallelMinutes20110606
Casa Parallelization meeting minutes Monday June 6th Room 317, 3;30pm MDT Attendees: Bryan, Brian, Kumar, Jeff, James, Sanjay Targets/tasks for June 6th June...
CasaParallelMinutes20110523
Casa Parallelization meeting minutes Monday May 23rd Room 317, 3;30pm MDT Attendees: Bryan, Sanjay, Kumar, Jim, James Targets/tasks for May 23rd May 29th ...
CasaParallelMinutes20110517
Casa Parallelization meeting minutes Monday May 16th Room 317, 3;30pm MDT Attendees: Targets/tasks for May 16th May 23rd * Examine async thread failure p...
CasaParallelMinutes20110510
Casa Parallelization meeting minutes Tuesday May 10th Room 317, 11:00am MDT Attendees: Jim, Jeff, James, Brian, Sanjay, Kumar and visitors from LOFAR Targets/...
CasaParallelMinutes20110425
Casa Parallelization meeting minutes Monday April 25th Room 317, 3:30pm MDT Attendees: Jim, Jeff, James, Kumar, Bryan, Brian Targets/tasks for April 25th May...
CasaParallelMinutes20110418
Casa Parallelization meeting minutes Monday April 18th Room 317, 3:30pm MDT Attendees: Bryan, James, Jeff, Kumar, Sanjay, Jim Targets/tasks for April 18th A...
CasaParallelMinutes20110404
Casa Parallelization meeting minutes Monday April 4th Room 317, 3:30pm MDT Attendees: Bryan, Brian, Kumar, Sanjay, James, Jim Targets/tasks for April 4th Apr...
CasaParallelMinutes20110328
Casa Parallelization meeting minutes Monday March 28th Room 317, 3:30pm MDT Attendees: Brian, Kumar, Jeff, Jim, Sanjay, James, Dan Targets/tasks for March 28th...
CasaParallelMinutes20110321
Casa Parallelization meeting minutes Monday March 21st Room 317, 3:30pm MDT Attendees: Bryan, Brian, Jim, James, Sanjay, Dan Klopp Targets/tasks for March 21st...
CasaParallelMinutes20110315
Casa Parallelization meeting minutes Tuesday March 15th Room 317, 3:00pm MDT Attendees: Jim, Jeff, Brian, James, Sanjay, Dan Targets/tasks for March 14th Mar...
CasaParallelMinutes20110307
Casa Parallelization meeting minutes Monday March 7th Room 317, 3:30pm MDT Attendees: Brian, Jeff, Jim, Sanjay, James Targets/tasks for March 7th March 13th ...
CasaParallelMinutes20110228
Casa Parallelization meeting minutes Monday February 28th Room 317, 3:30pm MDT Attendees: James, Bryan, Jim, Sanjay, Jeff Targets/tasks for February 28th Mar...
CasaParallelMinutes20110214
Casa Parallelization meeting minutes Monday February 14th Room 317, 3:30pm MDT Attendees: Bryan, Brian, Jim, James, Jeff, Kumar, Sanjay Targets/tasks for Febru...
CasaParallelClearCal
Main.JamesRobnett 2011 02 23
CasaParallelMinutes20110207
Casa Parallelization meeting minutes Monday February 7th Room 317, 3:30pm MDT Attendees: Greg, Jim, Sanjay, Kumar, James, Jeff Targets/tasks for February 7th ...
CasaParallelMinutes20110131
Casa Parallelization meeting minutes Monday January 31st Room 317, 3:30pm MDT Attendees: Bryan, Brian, Jeff, Jim, Kumar, James Targets/tasks for January 31th ...
CasaParallelMinutes20110124
Casa Parallelization meeting minutes Monday January 24th Room 317, 3:30pm MDT Attendees: Jim, James, Kumar, Bryan, Sanjay Targets/tasks for January 24th Janu...
CasaParallelMinutes20110117
Casa Parallelization meeting minutes Monday January 17th Room 317, 3:30pm MDT Attendees: Jeff, Sanjay, James, Rob, Brian, Kumar, Jim, Urvashi Targets/tasks for...
CasaParallelMinutes20110103
Casa Parallelization meeting minutes Monday January 3rd Room 317, 3:30pm MDT Attendees: Urvashi, Jim, James, Bryan, Brian, Jeff, Kumar, Sanjay Targets/tasks fo...
CasaParallelMinutes20101129
Casa Parallelization meeting minutes Monday November 29nd Room 317, 3:30pm MDT Attendees: Kumar, James, Jim, Greg, Jeff, Bryan, Brian Targets/tasks for Novembe...
CasaParallelMinutes20101122
Casa Parallelization meeting minutes Monday November 22nd Room 317, 3:30pm MDT Attendees: Brian, Jim, Kumar, Sanjay, Jeff, James Targets/tasks for November 22 ...
CasaParallelMinutes20101115
Casa Parallelization meeting minutes Monday November 15th Room 317, 3:30pm MDT Attendees: Kumar, Jim, Brian, Jeff, Greg, James Targets/tasks for November 15 ...
CasaParallelMinutes20101108
Casa Parallelization meeting minutes Monday November 8th Room 317, 3:30pm MDT Attendees: Kumar, Jim, James, Bryan, Brian, Greg, Jeff Targets/tasks for November...
CasaParallelBenchmarks
Procedures IN PROGRESS awaiting test scripts In the interest of obtaining consistent results all tests should be run on the designated CASA dev node(s). * E...
CasaParallelMinutes20101101
Monday November 1st Room 317 Attendees: Greg, Kumar, Sanjay, Jim, James Targets/tasks for November 1 November 7 * Async I/O development plan Jeff/Jim * ...
CasaParallelMinutes20101025
Casa Parallelization meeting minutes Monday October 25th Room 317 Attendees: Ger, James, Kumar, Jeff, Jim, Sanjay Targets/tasks for October 25 November 31 D...
CasaParallelMinutes20101019
Casa Parallelization meeting minutes Tuesday October 19th Room 317 Attendees: Kumar, James, Jim, Greg, Sanjay, Bryan Targets/tasks for October 18 October 24 ...
CasaParallelMinutes20101011
Monday October 11th Room 317 Attendees: Kumar, Sanjay, James, Jim, Jeff, Bryan Targets/tasks for October 11 October 18 * Revise CasaParallelTaskList Jeff ...
CasaParallelMinutes20100917
Casa Parallelization meeting minutes Friday September 17 Attendees: James Robnett, Bryan Butler, Kumar Golap, Sanjay Bhatnagar Targets/tasks for September 17 2...
CasaParallelMinutes20100903
Friday September 3 Attendees: Targets/tasks for September 3 10 * Time domain partitioning in continuum imaging Kumar * Enable multiple MSes per imaging p...
CasaParallelMinutes20100820
Casa Parallelization meeting minutes Friday August 20 Attendees: Targets/tasks for August 20 27 * Time domain partitioning in continuum imaging Kumar * E...
CasaParallelMinutes20100813
Casa Parallelization meeting minutes Friday August 13 Attendees: Kumar Golap, Sanjay Bhatnagar, Brian Glendenning, James Robnett Targets/tasks for August 13 20...
CasaParallelMinutes20100806
Casa Parallelization meeting minutes Friday August 6 Attendees: Kumar Golap, Sanjay Bhatnagar, Bryan Butler, James Robnett Targets/tasks for August 6 13 * F...
CasaParallelMinutes20100730
Casa Parallelization meeting minutes Friday July 30 Attendees: Kumar Golap, Sanjay Bhatnagar, Bryan Butler, James Robnett Discussion * Cluster and Lustre...
CasaParallelSpectralImaging
Main.JamesRobnett 2010 07 30
AstroGPU07
AstroGPU 2007 About AstroGPU 2007 Workshop on General Purpose Computation on Graphics Processing Units in Astronomy and Astrophysics Institute for Advanced Study...
r2 - 2009-10-19 - 10:54 by CarolynWhite
ClusterComputingCategory
Main.WalterBrisken 05 Sep 2007 Cluster Computing Software Correlator
r3 - 2009-10-19 - 10:54 by CarolynWhite
TeraGrid2009
Notes from TeraGrid 2009 Main.AmyShelton 2009 07 14 What is TeraGrid? From their website: TeraGrid is an open scientific discovery infrastructure combining lea...
r3 - 2009-10-19 - 10:54 by CarolynWhite
r3 - 2009-10-19 - 10:54 by CarolynWhite
r4 - 2009-10-19 - 10:54 by CarolynWhite
WebPreferences
HPC Web Preferences The following settings are web preferences of the HPC web. These preferences overwrite the site level preferences in . and , and can b...
r13 - 2009-10-19 - 10:54 by CarolynWhite
r3 - 2009-10-19 - 10:54 by CarolynWhite
r3 - 2009-10-19 - 10:54 by CarolynWhite
NotesSc08DuPlain
Here are some very quick notes on SC08. General Impressions: * big push for "green computing" ... looking at FLOPS per watt * Green500 extension of Top50...
WebLeftBar
" warn="off"}% * * * * * * * *
r3 - 2008-03-28 - 03:16 by EdwardNorton
AstroGPU07NotesShelton
AstroGPU 2007 Notes (A. Shelton) General Information * Program Schedule (HTML, PDF) * Slides for talks * Group photo Day One General Purpose Comput...
SC07NotesShelton
Super Computing 2007 (A. Shelton's Notes) Tutorial: Introduction to Scientific Workflow Management and the Kepler System * One of the presenters mentioned t...
WebAtom
NRAO Public Wiki's HPC web
WebNotify
* Main.TWikiGuest example #64;your.company __ .WebChangesAlert, ., .TWikiRegistration
WebRss
NRAO Public Wiki's HPC web /HPC
Number of topics: 412

See also: rss-small RSS feed, recent changes with 50, 100, 200, 500, 1000 topics, all changes
Topic revision: r3 - 2009-10-19, CarolynWhite
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback