Casa Parallelization meeting minutes

Friday August 6

Attendees:

Targets/tasks for August 6-13

• Further Lustre testing James
• Create description for calibration from one MS to another Bryan
• Time domain partitioning in continuum imaging Kumar
• Minor debugging of current frequency based continuum imaging Kumar
• Examine Multiscale-clean performance issue Sanjay
• Check on multi-ms viewer Sanjay stalled till Ger gets back
• Create CASA parallelization priority list James/Bryan
• I/O manager draft James

Discussion

• Further Lustre testing James
  • 2.1GB/s reads reached with 3 clients, 2.4GB/s writes. More testing needed
• Setup HPC wiki James DONE
  • Acceptable
• Python modification to correct interactive masking DROP Sanjay
• Check on multi-ms viewer Sanjay
  • Ger on vacation, no response as yet (not back till end of August)
• Calibration from one MS to another Bryan
  • Jonas potentially available to tackle
  • Need description to provide to Jonas/Nick from Bryan or Kumar, may be in CASA tickets
  • Need soon after having MS split by time to take full advantage of MS split
• Time domain partitioning in continuum imaging Kumar
  • start next week
• Start parallel filler discussion *?
  • Michele has an initial version of parallel filler split by time
  • Testing postponed to some later date, probably around 2 months
• Enumerate CASA tasks that need parallelization everyone
• I/O manager discussion everyone
  • Try to get internal draft by next friday James
  • Kumar suggests trying to implement in the table system
• Debugging of Imaging errors discussion
  • Converted exception to warning if all data to one process is flagged
  • Various lock issues corrected
  • Currently disparity in spectral window splitting which causes some processes to take longer if they span spectral windows
  • Major cycle has to wait for last minor cycle
• Multiscale clean (deconvolution)
  • Substantially slower than expected
  • Sanjay to look into