Project page to track the proof of concept to transfer data and compute jobs from the NAASC to the UVA campus grid (XSEDE), specifically to the CS and Astronomy department clusters.

Documentation pointers

Details

  • NRAO client: cartman 192.33.115.59 TCP port 18443
  • Account UID/GID TBD
    • Grid account is "nrao", password is shared between James, Mike, K. Scott and Dan.
  • Installation directory (path to executables on cartman)
    • /opt/services/GenesisII

Container installation

Installation of the container was fairly basic. The container is meant to be installed as the user that will run it. For our test I used the root account (this will save meta data in ~/.genesisII-2.0/). For the future please create a local account, whether a system account or a user account to run the application. Download the container and run it likeso:

bash genesis2_container_linux64_v2_7_15.bin

It will bring up a graphical installation guide that looks like it was written in Java. From whence, select the installation directory of "/opt/services/GenesisII". The port number 18443 was used as well as the publically facing interface "bulk2.cv.nrao.edu". When asked for the "container owner" this is not the effective UID the program will be run under, but rather, your XSEDE account. Next select to download the appropriate certificates and move on.

After that the installation should finish. However, it will not work until you attach it to your namespace. I'll cover that after you set up your environment below.

Configuring Your Environment

Download rlwrap ( http://freecode.com/projects/rlwrap ) and build it. Place the executable (rlwrap) in /opt/services/bin.

Next, whichever user account runs the container, please add the following to their ~/.bashrc file for ease of use:

PATH=/opt/services/GenesisII:/opt/services/bin:$PATH
export PATH
alias grid='rlwrap grid'

You should log out and back in on that account for the profile changes to take effect.

Attaching GenesisII to the Namespace

I'm only presenting the basic commands to ensure the Container is properly running. For more details on these commands and general usage, please see the section below.

Check if it is running:

XCGContainer status

If not, start it.

XCGContainer start

Attach to the grid.

grid login

It will ask for your XSEDE username and password. If you do not provide them, many commands will not work. Next, attach yourself to the namespace:

grid ln --service-url=https://192.33.115.159:18443/axis/services/VCGRContainerPortType /home/nrao/nrao-container

The given URL "https://192.33.115.159:18443/axis/services/VCGRContainerPortType" is obtained from the port number and IP address (TODO, use CNAME next time) you gave during the installation. The trailing "/axis/services/VCGRContainerPortType" is not as arbitrary as it first appears. If you look at your container on the grid:

[root@cartman GenesisII]# grid ls rns:/home/nrao/nrao-container/Services/
Current version is 2.7.15 Build 5758.
Checking for updates.
Services:
EnhancedNotificationBrokerFactoryPortType
FSProxyPortType
ExportedFilePortType
GeniiResolverPortType
JNDIAuthnPortType
PipePortType
EnhancedNotificationBrokerPortType
ApplicationDescriptionPortType
GeniiPullPointPortType
BESActivityPortType
X509AuthnPortType
EnhancedRNSPortType
RExportResolverFactoryPortType
RandomByteIOPortType
RExportDirPortType
LightWeightExportPortType
GeniiWSNBrokerPortType
GeniiPublisherRegistrationPortType
ExportedDirPortType
QueuePortType
ApplicationDeployerPortType
ExportedRootPortType
GeniiBESPortType
RExportResolverPortType
StreamableByteIOPortType
TTYPortType
WSIteratorPortType
CertGeneratorPortType
GeniiSubscriptionPortType
RExportFilePortType
KerbAuthnPortType
VCGRContainerPortType

[root@cartman GenesisII]#

You can, in fact, find it there. I am not certain how the "axis" is translated a this time.

The rest of the command "/home/nrao/nrao-container" is provided by XSEDE upon account creation. Please contact the appropriate admin or grad student to create this for you.

Exporting a Directory to the Grid

To export a directory local to your environment to the grid, you can do so with the "grid export" command.

grid export --create /home/nrao/nrao-container/Services/LightWeightExportPortType local:/lustre/naasc/nraogrid /home/nrao/nrao-export

"local:/lustre/naasc/nraogrid" is the local filesystem you are exporting to the grid. The last "/home/nrao/nrao-export" is where on the grid it is exported to (the mount point). The "--create /home/nrao/nrao-container/Services/LightWeightExportPortType" is an option I think is the type of export, but I need to research more to say for certain.

Execution/Commands

  • Put useful commands here, viewing container, logging in etc

TODO

  • Install genesis2 container DONE
    • Need to attach to namespace DONE
  • Decide on account name, UID/GID details DONE
  • Work with Vana to show that they can make a connection DONE
  • Email Vana asking for a dummy test job James
  • Add ssh keys to cartman for Kscott/James DONE

-- JamesRobnett - 2013-07-16
Topic revision: r6 - 2013-07-19, DanielKlopp
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback