Monday Morning Meeting 02/12/18

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro:
  • CV:
  • Garching:
  • SCO:

News / Meetings / Visitors

Development

Pipeline

  • Development
    • Replaced global pipeline task dictionary with a task registration scheme. Task registration and a brief description is now registered in the task classes themselves
    • Work on spw mapping for imaging multiple Ms(s) resumed
  • Ongoing ALMA Pipeline / Archive discussions via email
    • A document describing the current pipeline manifest needs to be produced. Longer term the old pipeline results schema should be reviewed
  • VLASS / VLA
    • VLASS requirements review took last week
    • Some pipeline requirements need better definition, e.g. how to automate spectral index fitting.
    • Some requirements need more data flow analysis, e.g. how does input data flow from a previous pipeline recipe to the next, etc
  • Technological issues
    • Excessive memory usage in hifv_importdata. Probably pipeline issue but the code seems to be swapping which is puzzling.
    • Slow memory leak in repeated hif_editimlist calls. Workaround is to generate standard lists internally in one call. Needs investigation.
  • Lifecycle issues
    • Concern expressed on the issue of pipeline release patches for different pipeline at CCC meeting. Pipeline does not see this as a major issue as telescope specific code is maintained in different pipeline "packages". Patches are to be expected from eiter CASA or Pipeline or both.
    • Pipeline is concerned about the CASA release schedule and bottlenecks there given the current manpower situation.

HPC

  • Development
    • CAS-10697: "uvcontsub does not work in parallel mode with 'combine=spw'" - ready for validation
  • Performance tests
    • Pipeline tests with 5.2.0-9, varying number of cores for selected "big" datasets ongoing, somewhat delayed as the cluster machines had to be rebooted

Users

Build, Release

  • All of the Mac packaging is now done with XCode 9. There is no rush for the developers to upgrade.
  • 10.13.3 didn't fix the OS header issue so gcc5 still requires OS headers to be manually fixed. See https://gcc.gnu.org/bugzilla/show_bug.cgi?id=83531 for details.

Verification Testing

Validation Testing

  • Current validation tally
    • 130 Under Validation, 88 Ready to Validate.
  • Current Testing Efforts for 5.3 deliverables

Architecture

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
    • Ongoing ALMA Pipeline / Archive interface discussions
    • Participated in VLASs single epoch imaging requirements review
    • Test new task registration capability
  • Bjorn Emonts
  • Pam Ford
    • CAS-11058: plotting CalTables (done) and associated features in plotms: locate (done), selection (in progress), summary (not started)
  • Enrique Garcia
  • Bob Garwood
  • Kumar Golap
  • David Mehringer
  • George Moellenbrock
    • Continued work on CalLibrary, mainly exclusivity logic that discerns absent-but-expected from merely absent calibration (per obs/fld/intent/spw) for purposes of jointly supporting per-caltable agnosticism (merely absent) and applymode='*strict' (expected). Almost done!
    • Some polarization science that had been perpetually languishing...
  • Dirk Petry
  • Martin Pokorny
  • Federico M Pouzols
    • CAS-10584 "mstransform regridding in fftshift interpolation creates all zeros" fixed in cvel2/mstransform.
    • CAS-10340 "mstransform + tclean drops a channel in cube", CAS-10446 "Velocity not transformed to LSRK" - looking into them.
    • Definitely closed issues:
      • CAS-10662 "pipeline.infrastructure.launcher produces exceptions sending command requests - MPI_ERR_BUFFER: invalid buffer pointer".
      • CAS-10794 "Slowdown of pipeline tasks in parallel mode".
  • Urvashi Rao
    • CAS-10946 : Resolved : Redid restoring beam fixes from the 5.2 branch onto the 5.3 master. Verification test added. Merged to master (as requested by JM).
    • CAS-2961 : Ready to Validate : Enable Pseudo-I stokes imaging as a special case via tclean(stokes = "pseudoI"). Verification tests added. Work needed to complete other use cases added to CASR-275 (by JO).
    • Sent Klara S. some casa images and a script to make images of different dimensions/shapes to get her started with exploring the viewer. Sent Tak T. a description of one way to implement N-sigma thresholds. RH7 issues related to CASA install/build/use all seem to be resolved now (or will soon be once buiild/test turn on RH7 build packaging).
  • Darrell Schiebel
  • Ville Suoranta
  • Takahiro Tsutsumi
Friday NAOJ Meeting
  • Kanako Sugimoto
  • Wataru Kawasaki
  • Takeshi Nakazato
  • Renaud Miel
Topic revision: r11 - 2018-02-12, VilleSuoranta
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback