Monday Morning Meeting 12/18/17

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro:
  • CV:
  • Garching:
  • SCO:

News / Meetings / Visitors

  • ICT Leads meeting held in CV 12/12 - 12/15
  • Still waiting on final confirmation of 2/26/18 for CASA F2F
  • Final Build/Test Process Review meeting to be scheduled with Pipeline developers
  • Orphaned/Target-less CASA Feature Ticket migration to CASR Jira Project underway
    • CASA 5.4 planning will select from CASR requirements tickets, develop/update Plone task specifications, and obtain stakeholder signoff prior to beginning development work
    • CAS development tickets opened once agreement is reached in Plone on what to do, initially anyway
    • Plone task definition still understood to be an iterative and evolving back and forth as development progresses

Development

Pipeline

HPC

  • Round of test ALMA pipeline runs with prerelease-5.2.0-5 - https://open-confluence.nrao.edu/pages/viewpage.action?pageId=7048259
    • Many (20+) runs available for validation (of restoringbeam='common' and anything else). A few examples given in: CAS-10849. No (obvious) issues seen so far in any test.
    • These are at the same time tests for performance issues (CAS-10794.
  • Current status:
    • Now parallel mode is always faster (or marginally faster ~= same)
    • Only one exception, T034 19% increase (less now). For further investigation why tclean is slower, mosaic mode. Maybe a couple of more exceptions ~expected in test runs not yet done.
  • Run times:

Users

Build, Release

  • Avoid cherry-picking between development branches. This is not wrong per se but makes tracking the history and merges confusing.
  • Try to sequence the pull requests if you already know that two branches impact same set of files. That way the PR build actually tests the current state.
  • Branched casacore for 5.2.0. Keep the Casacore branches in mind when planning your development.
  • Bamboo upgrade today.
  • feature/bugfix prefix still required for the branches that go through packaging and validation.

Verification Testing

Validation Testing

  • Current validation tally
    • 128 Under Validation, 80 Ready to Validate.
    • Dec 8 - 14: 13 tickets assigned for validation. 7 tickets resolved.
  • JDM: ALMA commissioning project should be finished this week
  • Current Testing Efforts for 5.2 deliverables
  • Current Testing Efforts for 5.3 deliverables
    • imaging issues/autoboxing refinements
    • statwt2 (CAS-10530)
    • systematic tests of mstransform
    • plone/CASAdocs: updated confluence page with task list and "categories"
    • further parallelization testing (non-ALMA pipeline specific)
    • polarization calibration
    • testing snapshot -- please see https://safe.nrao.edu/wiki/bin/view/Software/CASAUserTesting for the up-to-date list of tickets and testing status
      • testing ongoing:
        • plotms/plotbandpass capability (Pam, CAS-9053)
        • statwt2 (Dave, CAS-10530 and others)
        • imhistory tickets (Dave, several)
        • phase center shift in plotms (CAS-8431)
        • averaging in flagdata (CAS-6215)
        • frequency interpolation of 'linearflag' for BP tables with good solutions (George, CAS-10772)
        • simulations (Remy, several; this should be finished -- or handed off -- by early January)
        • Implement ACCOR equivalent (George, Walter, CAS-10941)
        • immath 'poli' and 'pola' implementation (Dave, CAS-9123, CAS-9124)
        • specflux(function='mean') (Dave, CAS-10791), ready to resolve

Architecture

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
  • Bjorn Emonts
  • Pam Ford
    • Debug pipeline failures (CAS-10774), bus errors probably due to multiple writes to ~vlapipe/.fontconfig font cache
  • Enrique Garcia
    • Finished CAS-10458: found a number of other VI/VB2 issues while at that.
  • Bob Garwood
  • Kumar Golap
  • David Mehringer
  • George Moellenbrock
  • Dirk Petry
  • Martin Pokorny
  • Federico M Pouzols
    • CAS-10959 in CASA prerelease-5.2.0-5 which fixes 'imageparams_base and friends' performance issue in the ALMA pipeline in parallel. CAS-11025 sibling for CASA 5.3.
    • Test runs for CASA prerelease-5.2.0, running status: https://open-confluence.nrao.edu/pages/viewpage.action?pageId=7048259. Run files and stats being produced in /lustre/naasc/sciops/comm/scastro/pipeline/root_5.2/prerelease-5.2.0-5/
    • CAS-10768: newer extended tests of memory use of tclean for sizes up to 10kx10k, all 2 spec modes, 4 gridders, 4 deconvolvers. Added VmHWM and adding predictor interface code.
  • Urvashi Rao
  • Darrell Schiebel
  • Ville Suoranta
  • Takahiro Tsutsumi
Friday NAOJ Meeting
  • Kanako Sugimoto
    • sideband separation algorithm ( CAS-8091)
      • a new task, sdsidebandsplit is almost ready
      • I created the initial version of test case table for functional tests of the task
      • remaining things TODO: implement functionalt tests, brush up error handlings based on test cases, write Plone task document (separate ticket?) and English version of algorithm document
    • Enrique reported an issue in C++ unit test, LineFindingUtils _GTest ( CAS-11016)
      it was a trivial typo which caused setting an array with wrong number of elements and it failed at assertion of array length intermittently. The bug was fixed but we are puzzled why it does not always fail. Enrique asked for the comments of Ville (, Andy and Akeem).
  • Wataru Kawasaki
  • Takeshi Nakazato
    • management
    • created CAS-11023 to discuss how to fix tclean crash when data selection results in empty MS
  • Renaud Miel
    • CAS-8087 PlotMS Pointings: verified test data pointings table
    • Reported browsetable bug
    • Dared support

-- TakeshiNakazato - 2017-12-13

This topic: Software/CASA > Software > WebHome > CASAMeetingPage > Dec1817
Topic revision: 2017-12-18, JenDonovanMeyer
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback