Casa Parallelization meeting minutes

Monday October 17th Room 317, 3:30pm MDT

Attendees: James, Jeff, Jim, Kumar, Bryan, Brian

Targets/tasks for October 17th - 23rd

Discussion/Agenda

  • Lustre file I/O failure Jim/James
    • Being logged but no hits reported
    • Retry implemented also no hits reported
  • Revisit async iterator for writing Jim/Justo
    • In progress, may affect the RO iterator
    • Need
  • Move subtables to in-memory storage manager Jim
    • Recent tests with storage manager inconclusive, seems to be no but no affect
    • flagging infrastructure most likely next target (Justo might do)
    • Partition worth looking at
  • Continuum imaging
    • Partition generates empty selection in certain circumstances
  • Spectral imaging Kumar
    • Test channel chunk choice effect on memory
  • Complete parallel user interface frame work Jeff/Honglin
    • Status
  • Refine and distribute cluster scheduler interface James
    • In progress, Kscott working on implementation and user documentation
  • Need 400+GB continuum case with complex field Sanjay
    • Formalized reduction status
    • Scripted reduction status
  • Version 3 Filler status

CASA HPC Initiatives for the 3.4 Cycle

  • Memory Footprint Issues
    • Deployment of Multi-Field MS-MFS (Urvashi)
    • Deployment of Parallel Gridder and splitting of the Grid (Jim)
    • Design of MS-MFS Minor Cycle Parallelization (Jim et. al.) using Friday meetings
  • Initial Deployment of ASP Clean (Sanjay)
  • Performance Issues:
    • Virtual Model Data Column (Kumar)
      • Removes model data column
      • removes need for Setjy
    • Memory Resident Subtables Deployment (Identify list of tasks)
    • VisBuffer Processing Framework
      • Add Write capability (Jim)
      • Deployment in tasks (Jeff to Assign)
    • Parallel Filler (and partitioning) (Tak)
  • User Interface:
    • Parallel Imager in Task (Kumar)
    • Parallelization of other Tasks (Kumar and Jeff)

Deferred Topics

  • Test version of auto-flagging deferred

ARDG Targets

  • What is negative side effect of CVel in filler, non-reversible
  • What needs to be done to acceptably implement Auto-boxing with large number of channels

-- JamesRobnett - 2011-11-14
Topic revision: r1 - 2011-11-14, JamesRobnett
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback