Casa Parallelization meeting minutes: Monday 3 June 2013

Attendees: Jeff

Review of Priorities:

• Benchmarking the pipeline
  • Two tasks:
    • Install pipeline for James use
    • Instrument pipeline for metrics
• Removal of Scratch Columns:
  • CalLibrary: 4.2 cycle Progressing

Completed Targets

• Kumar: MMS and Model Column CAS-3584
• Justo / Sandra: msTransform (including retiling)

Progress on Current Development Targets

• Kumar: Tile Size for Temp Lattice
  • Code is changed in active (default is at least 1 MB)
  • Should we change this, to something bigger? Not yet in the toolkit.
    • Kumar will change to allow this to be specified
• Kumar: Grid Threading and load balancing: break up into many smaller pieces then can thread across all available cores.
  • Still looking at processing improvement, why is this not improving linearly... to investigate.
  • Needs to be scheduled for work.
  • Jeff to open a Jira to track this
• Jim: Time averaging and BL dependent averaging
  • Design in process
• Compressed storage manager, needs to be tested.
  • Starting with filler

Benchmarking / Profiling

Results

Requests

• IO Profile of ALMA pipeline
  • Blocked waiting on larger data set
• Tile size performance measurements
  • Waiting for Kumar to expose parameters
• Testing of compressed storage manager

AOB

• UVA: