Casa Parallelization meeting minutes

Monday February 7th Room 317, 3:30pm MDT

Attendees: Greg, Jim, Sanjay, Kumar, James, Jeff

Targets/tasks for February 7th - February 13th

Discussion/Agenda

• Check on summer student availability Kumar/Jeff
  • List of candidates, examining
• Uniform MS size discussion Drop
  • Outcome of discussion
• Memmap vs cache in casarc
  • Timing tests to see behavior
• Split status, correct visiter call in test ?
  • Appears to be in test
• Version tagging, difficult to differentiate versions of casatest/active
  • Rely on version of test
• Continue code development of async I/O Jim
  • Merge into active, waiting on permissions
• Integrate async I/O with large continuum test case Kumar
  • Awaiting async I/O in active
• Parallel imaging for large continuum case Kumar
  • Filler doesn't fill the feed table by default, importevla to be changed
  • modify script with #node and #core selection
  • add full beam code later
• Parallel split test case Jeff
  • Plan to recreate as a task
  • Multi-ms definition now exists
    • Is in ok shape for split, applycal that can be done on an MS basis
    • listobs, plotms are less clear or won't work
  • Only time domain for now
• Make listobs multi-ms compatable Sanjay
• Filling I/O issues
  • Michel is optimistic of having a streamed I/O approach and use sub-ms infrastructure to test by friday 2/4/11
    • When is less clear now
  • Waiting on Francois to change data access methods
• Plot-ms suffers similar problem to split but needs lower level solution Ger
• Complete remaining timing scripts Gregg
  • Small spectral status (needed further cleaning)
    • does not include continuum subtraction as a separate timed step using uvconsub2.
  • Large continuum essentially done
  • Large spectral
• Generate procedures and first timings for test cases James
  • Tile size substantially affects performance, need to characterize behavior
  • Still need other data sets
• Time domain partitioning with multiple MSes per imaging process Kumar
  • Cube case regression status
  • Trying to identify 10% small reads, possibly metadata column (either main or sub table)
• Cluster scheduler scripting with CV James on hold for scripts
  • Discuss with Jim semantics for cluster/CASA interaction
• Cluster resource definitions James/Jim on hold