CASA 4.5 Planning

  • Feature Freeze Aug 1
This is a user facing summary of the 4.5 planning, bugs and very specific features are not listed here, nor are the infrastructure and behind the scenes work that needs to be done.

Overview

  • Support for ALMA (VLA secondary) pipeline imaging initial release and parallel execution
  • Continued support for the delivery of end-to-end parallel processing, including imaging with multi-threading and self-cal.
  • Delivery of the refactored Clean (tClean) task to users
  • Completion of scratchless operations including initial deployment of the CalLibrary covering all calibration types.
  • Delivery of high performance computing and other performance issues
  • Continued adoption of the VI/VB2 and transforming Visibility Iterator unified IO system
  • Preparation and infrastructure improvements for a focused robustness, documentation, and testing effort in the post 4.5 cycle.
  • Single dish development

Details

Support for ALMA (VLA secondary) pipeline imaging initial release and parallel execution

  • Addition of partition mode to importasdm task
  • Import SDM issues affecting Pipeline
  • New summary mode in Flag Data to improve performance of pipeline statistics
  • Migration of visstat to VI/VB2 and new statistics framework
  • Development of Imaging Heuristics for Pipeline
  • Imaging Capabilities Needed by Pipeline
    • Ensure that MFS works in predict even on channels that were not in initial solution
    • Ensure that empty channels are not processed in major cycle
    • Implement a resource estimation of some sort
    • Continuum Imaging
      • Syntax bug in channel selection
      • Testing / commissioning of parallel imaging using pipeline
    • Cube Imaging
      • Verify numerical correctness of spectral coords, data to image mapping, connection to user params
      • Selection and job organization for serial and parallel imaging
      • Sensitivity calculation for cubes
      • Virtual concatination of sub cubes
      • Integration of minimal data selection with task
  • Read Only Access for plotMS parallel execution
  • MSMD additions affecting pipeline
  • Integrated Virtual Frame buffer support for plotMS
  • Scan Intent selection for virtual model column
  • Development and integration of Automasking capabilities

Continued support for the delivery of end-to-end parallel processing, including imaging

  • Support for self calibration in parallel tClean
  • multi-threaded gridder in all FT machines
  • Parallel calculation of convolution functions
  • Extensive testing

Delivery of the refactored Clean (tClean) task to users

  • Completion and documentation of task Interface
  • Incorporation of prolate spheroidal term in AW-Projection kernel
  • Test programs
  • Heuristics for “Internal” Parameters of tClean
  • Validation of Deconvolution Algorithms
  • Correct parallel imaging weights
  • Ephemeris Object Imaging

Completion of scratchless operations including initial deployment of the CalLibrary covering all calibration types

  • Virtual Corrected Column in ms iterator
  • Cal Library completion
    • C++ Implementation of Cal Library Parser
    • Implementation of a-priory and parametric Cal Tables
  • Ability to create new MS using virtual corrected model column
  • Improvements to the calibrating visibility iterator
  • Use of CalLibrary in calibration solve context

High Performance Computing and other Performance Issues

  • Integration of OpenMPI framework into regular package production
  • Implementation of Tier-2 Parallelization framework
  • Investigation into tiling performance and optimization
  • Fix of open-mp implementation of sort in casacore

Continued adoption of the VI/VB2 and transforming Visibility Iterator unified IO system

  • Migration of UV Continuum Subtraction to new framework and improved capabilities
  • Improvement / normalization of StatWt task based on VI/VB2 framework
  • Performance Optimization of VI/VB2 and Transforming VI
  • Time/Frequency Averaging in Flagging

Single Dish Development

  • Migration to MS based process (in progress, not for delivery in current cycle)
  • SD Imaging improvements
    • Support intent selection
    • Support for data column selection

Other Development Targets

  • Begin UVFITS import/export cleanup, unlikely to address all issues this cycle
  • Improved FITSIDI import support
  • Development of Linear Mosaic task
  • SetJy Improvement
    • Remove unnecessary per-spectral window loop in setting models
    • Connect to refactored Imager capabilities

System / Testing Issues

  • Incorporation of accepted tests in automation framework
  • Boost Normalization (and preparation for removal)
  • Casacore Github use automation (including possible other external repositories)
  • Implementation of new Data Repository update script

-- JeffKern - 2015-06-10
Topic revision: r2 - 2015-06-11, JeffKern
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback