Casa Parallelization meeting minutes

Tuesday October 19th Room 317

Attendees: Kumar, James, Jim, Greg, Sanjay, Bryan

Targets/tasks for October 18 - October 24

• Revise CasaParallelTaskList Jeff
• Ponder task interface specification All
• Specify final 4 data sets Bryan
• Generate baseline timings for test data sets Greg
• Time domain partitioning with multiple MSes per imaging process Kumar
• Async I/O and I/O manager email to Ger Kumar/James
• Cluster scheduler scripting with CV James
• Visbuffer examination and preparation for design discussion Jim
• Cluster resource definitions Jim

Discussion/Agenda

• Revise CasaParallelTaskList Jeff
  • Draft plan in progress waiting
• Ponder task interface specification All
  • Need to differentiate whether this is just for the parallel case
  • Try to ensure the approach is consistent
  • Simplest approach is to extend existing task specifications
• Obtain 120GB data set Jeff/James
  • I believe these exist. We need to get them consolidated
  • Of the proposed data sets we need to reduce it to 4 specific ones
  • Bryan will pick 4.
• Generate baseline timings for test data sets Greg
  • Some progress on IRC+10216 TDEM001???? spectral data set, need to add clean
  • Should also do auto-boxing or save manual mask ... decision to save manual mask
• Time domain partitioning with multiple MSes per imaging process Kumar
  • In progressed, hindered by release schedule
  • Exposed issue with gather step, appears to be new problem
• Async I/O and I/O manager email to Ger Kumar/James
  • Should be send today
• Cluster scheduler scripting with CV James
  • Nothing
• Visbuffer examination and preparation for design discussion Jim
  • Difficult to thread at bottom of chain
  • Consider advancing look ahead iterator to prefetch next tiles
  • Question of does logic exist to calculate next data chunk, answer appears to be yes if not at the tile level.
• Cluster resource definitions Jim