Casa HPC/Parallelization meeting agenda/minutes

Thursday [10/12/2015], [ESO Centaurus, C.2.01], [16:00 UT]

How to connect

• Dial in: +49 89 307 6832
• Video connection: Use this one (46102@134.171.42.27).

Attendees:

Agenda and Minutes

1. 4.6 and 4.7 development items list (list is below)
2. New HPC-related pipeline requirements (ALMA, EVLA)
3. New HPC-related imaging requirements (see Justo's tickets: CAS-8158, CAS-8159)

List of development items for cycles 4.6 and 4.7

• SC: move version-2 tasks to main tasks (split, hanningsmooth, cvel) (CAS-7886)
  • verify regression tests with the above changes at the same time
  • apply fixes related to above
  • JT: verify status of cvel2 differences
• JT: optimize the concatenation of the output MMS in ms.createmultims → concatTable(). It gets slower with increasing number of Sub-MSs
• New baseline partition axis (CAS-7890)
• SC: make all sub-tables links in all Sub-MSs (CAS-7896)
• JG: cleanup the mpi4casa log messages that go to INFO
• JG: Introduce run-time OMP re-configuration capabilities in mpi4casa.
  • TBD with imaging team and pipeline
• JG: Introduce run-time memory limit re-specification capabilities in mpi4casa.
• SC: Replace calls to ms methods by msmd ones inside listpartition and partition (CAS-7784)
• Settle final design for Tier-2 parallelization and support Pipeline and Single Dish teams to introduce it.
  • To be re-discussed in another cycle if really needed. Tier-0 full implementation should be done first in the pipelines.
• Support pipelines
  • What are the requests from the EVLA pipeline, if any?
    • TBV with Brian.
  • What is the status of improvement in applying Tier-0? → needs changes in pipeline infrastructure
• Fully parallelize uvcontsub
  • Not for now.
• JT: Deprecate simple_cluster - CAS-8226
• JG: Agreement for the future of gcwrapers: Merge pg/cli wrappers or keep them separated?
• GM: Problems running OTF calibration on selected MSs (affecting MMS case) - see CAS-8051.
  
• Performance tests
  • define them here: lustre, sagan5, sagan4 (binaries)
  • pipeline testing, alma-m100-hpc, cycle2

Minutes

1. Item

2. Item

3. Item

Action Item List

Useful Links

• Major blockers
• Current status
• CASA parallelization task list
• Long-term issue chart
• Bleeding tests area
• Documentation (see Reference Materials topic)-- SandraCastro - 2015-12-04