Wiki page to track August 26/27 CHTC site visit to NRAO

Date: August 26-27 2019

Locations: SO-Auditorium, CV-Auditorium(Monday) and ER-245 (Tuesday)

Connection Info: To support internal and external connections the NM and CV video systems need to connect to the new polycom interface which supports web access from Windows and OSX laptops:

10.5.0.5##228109

Laptops should connect to:

https://video-meetme.nrao.edu/228109

This appears to work but if it doesn't we'll rever to standard hub connections

Phone: No phone connections supported with the above mechanism

Zoom ?: No zoom connections supported with the above mechanism.

Start MDT	End MDT	Topic	Presenter	Group
Monday	August 26	Socorro Auditorium and CV-Auditiroum
8:30	9:00	HTC-CHTC-welcome.pptx	James Robnett	SCG
9:00	9:30	2019OSG_ResearcherCampusServices.pptx	Lauren Michael	CHTC
9:30	10:15	CHTCVisit_Intro_Radio_Interferometry_UR.pdf	Urvashi Rau Venkatta	CASA
10:15	10:30	Break
10:30	11:00	2019-08-CHTC-SRDP.pptx	Jeff Kern	SRDP
11:00	11:30	CNGI_overview_for_CHTC.pptx	Ryan Raba	CASA
11:30	11:45	ngVLA Overview.pptx	Rafael Hiriat	ngVLA
noon	13:00	Lunch, pizza catered in NM	Chartwells	NMT
13:00	13:45	NRAO-Condor-Philosophy.pptx	Greg Thain	CHTC
13:45	14:30	Workspace and Workflow Architecture.pptx	Stephan Witz	SSA
14:30	15:00	CASA Pipeline architecture and PPR structure	Kanako Sugimoto	CASA Pipeline
15:00	15:15	Break
15:15	15:45	2019HTCondorWeek_AutomatedWorkflowsDAGMan_LMichael.pptx	Lauren Michael	CHTC
15:45	16:00	VLASS-Cube-workflow.pptx	James Robnett	SCG
16:00	16:30	NRAO-Classads.pptx	Greg Thain	CHTC
16:30	17:00	NRAO Archive Design	Daniel Lyons	SSA
18:00		Dinner in Socorro @El Sombrero	Brian Glendenning's Dime	All
Tuesday	August 27	Socorro Auditorium and ER-245
8:30	9:00	Archive_Design.pptx	Daniel Lyons	SSA
9:00	9:45	Current CASA Tools, Tasks and Data Structures	Kumar Golap	CASA
9:45	10:30	CHTC_ARDG_Bhatnagar.pdf	Sanjay Bhatnagar	ARDG
10:30		Break
10:45	11:15	CHTC-NRAO-krowe.ppt	KScott Rowe	SCG
11:15	Noon	Conclusions, next steps discussion	All	All
Noon		non-catered lunch, TBD
13:30	17:00	CHTC VLA site visit and tour	Brian Glendenning

https://docs.google.com/document/d/1xx8gIjxHUt5ujb_o5O8N50aolPI87uPq-eET2giOdbw/edit?usp=sharing

If the planned connections don't work we'll use

IMPORTANT:Videoconf Info
System: Polycom HDX 8000
Video Name: SO-Aud
VideoIP: 146.88.6.9
VideoHub Name: SO-Aud-hub
VideoHubIP: 192.33.117.12##8109
AudioHub: 434-817-6519

Presentations

• Power Point Template: CHTC-NRAO.potx

-- JamesRobnett - 2019-08-19

• Intro. to compute intensive algorithmic units: CHTC_ARDG_Bhatnagar.pdf

• CHTC-visit-KG.pdf: CHTC-visit-KG.pdf

• Class Ads: NRAO-Classads.pptx

Questions

Federating HTCondor

There are many ways one can use HTCondor to run jobs on other clusters, whether those clusters are HTCondor or other systems like PBS or SLURM.

• Flocking is HTCondor’s way of allowing jobs that cannot immediately run within the pool of machines where the job was submitted to instead run on a different HTCondor pool. It is a relationship from a submit host (schedd) to a different Central Manager. Startd Flocking (aka reverse flocking) is a relationship from an Execute Host (startd) to more than one Central Manager (collector).

• Glidein is the technique that allows jobs submitted to HTCondor to be executed on grid machines in various locations worldwide. As the details of grid computing evolve, so does HTCondor’s ability, starting with Globus-controlled resources.

• condor_annex adds cloud resources to the pool. (“The pool” is determined in the usual manner for HTCondor daemons and tools.) This version supports only Amazon Web Services (‘AWS’).
  • https://htcondor.readthedocs.io/en/v8_8_4/man-pages/condor_annex.html?highlight=condor_annex
  • https://htcondor.readthedocs.io/en/v8_8_4/cloud-computing/using-annex-first-time.html?highlight=condor_annex

• HTCondor-C Grid Type, allows jobs in one machine’s job queue to be moved to another machine’s job queue.

• batch Grid Type (for PBS) It allows an HTCondor job to be submitted to a local Torque/Moab cluster.

• Job Router The Job Router can transform the jobs such as vanilla universe jobs into grid universe jobs that use any of the grid types supported by HTCondor.

• HTCondor-ce is a "door" to non-condor remote pools. It combines HTCondor-C with Job Router.

• HTCondor-G is the name given to HTCondor when grid universe jobs are sent to grid resources utilizing Globus software for job execution. This looks like older technology from the days when Globus provided computing resources instead of just being a data mover.