Casa Parallelization meeting minutes

Monday March 12th Room 317, 3:30pm MDT

Attendees:

Targets/tasks for January 27th - March 4th

• Test thread gridder performance James
• Test model data column changes James

Discussion/Agenda

• Threaded gridder benchmark update James
• Update on Partitioning status (null selections, non-conforming tasks) Jeff
  • No update
• Update on asdm2ms_xl schedule for stable inclusion
  • Still serial, eventually multi-threaded across spw, multi-process across scans
• Model data tests
  • James to get with Kumar on Tuesday 28th to start testing
• Pcube and pclean conversion to task status Kumar
• Revisit async iterator for writing Jim/Justo
  • Refactoring seems to be working in active
  • Justo is testing flagging appears to be an improvement
  • Attempt to make async I/O in flagging make it to release
• Memory resident subtables Jim
  • Test performance James
  • Check that it affects number of FDs as well
• Spectral imaging Kumar
  • Understand channel chunk choice effect on memory James
• Need 400+GB continuum case with complex field
  • Stalled for partitioning

CASA HPC Initiatives for the 3.4 Cycle

• Memory Footprint Issues
  • Deployment of Multi-Field MS-MFS (Urvashi) Deferred
  • Deployment of Parallel Gridder and splitting of the Grid (Jim)
  • Design of MS-MFS Minor Cycle Parallelization (Jim et. al.) using Friday meetings Deferred
• Initial Deployment of ASP Clean (Sanjay)
• Performance Issues:
  • Virtual Model Data Column (Kumar) Done
    • Removes model data column
    • removes need for Setjy
  • Memory Resident Subtables Deployment In progress needs testing
  • VisBuffer Processing Framework
    • Add Write capability (Jim) Need to revisit but seems to work in not imaging
    • Deployment in tasks (Jeff to Assign)
  • Parallel Filler (and partitioning) (Tak) In progress
• User Interface:
  • Parallel Imager in Task (Kumar)
  • Parallelization of other Tasks (assigned to Europe)

Deferred Topics

ARDG Targets

• What is negative side effect of CVel in filler, non-reversible
• What needs to be done to acceptably implement Auto-boxing with large number of channels