Thursday Morning Meeting 21 September 2017

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro:
  • CV:
  • Garching:
  • SCO:

News / Meetings / Visitors

Build, Release

  • Are we ready to branch 5.2? If so, which pipeline branch should be used?
  • Bamboo test suite updates applied early next week (or as soon as 5.1 is out).
  • CASA group does not seem to receive timely casacore merges

Verification Testing

  • Akeem may be returning - possibly as soon as next week (as long as the stars align)
  • CAS-10730: runUnitTest.py -m option shows an AttributeError error
    • I'll try to look in to this in the next few days

Validation Testing

Architecture

HPC

  • A serial run that took 24 days showed SEVERE messages in hif _makeimages as reported in CAS-10388 . The issue was fixed on the ticket but it seems to happen again in a different stage. Dirk is looking into this
  • Federico created scripts for the news tests, which will run eppr and copy the fluclx and antennapos files. We are waiting for the release to start testing.
  • Not yet confirmed, but it seems that the aU.picklePipeRuns function does not support concatenated images. Will report more details later.

Development

  • HPC testing : Last week's meeting's result was that we will repeat our previous serial/parallel tests with only one minor addition, plus run some new datasets. We will address operational bugs (as before) and outputs will be presented to the PLWG for detailed scientific validation. The actual parallelization of the ALMA pipeline scripts is outside the scope of the CASA team.
  • MeasurementSet V.3 discussions ( send more input to Kumar and Martin )
    • features we have encountered that MS v.2 doesn't support ( Kumar - update on what you have so far ? )
    • 'asis' tables from the asdm to the MS, and their usage within CASA - should we start monitoring this more closely ?
  • Qn from Bob about CAS-10738 : What all in CASA is affected by changes to values in the ephemeris tables?
    • Note: we don't believe the ALMA-related changes (tabular) affect science results, it's not clear if the polynomial bug (VLA) affects any real use case
    • What I'm looking for are tests I can do to check that as I clean up the ephemeris code I haven't broken anything.

Pipeline

  • CASA 5.1.0-73 / Pipeline-CASA51-P2-B.40825 prerelease is available
    • End to end sanity check test using --pipeline switch passed
    • imaging data selection issue CAS-10388 which was closed as fixed may have resurfaced in a different context, patch ?
  • Pipeline framework development planning tickets are in jira with tags C5.4P1 / C5.4P2
    • Session support framework mostly done ~ 3 months ago, needs to be updated, merged to trunk, and tested
    • CASA / pipeline callib integration work started see below
    • Plotcal replacement requires user input
  • Pipeline news letter completed
  • CASA callib / pipeline callib integration
    • using standard ALMA pipeline applycal calls, the CASA applycaltocallib utility fucntion, and the plotms and applycal tasks
    • problems parsing the auto-generated CASA callib file, temporary fixes from Pam, stiil seems to be a data selection issue, George to investigate

AOB

Developer Reports

Thursday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
    • Started investigation into CASA / Pipeline callibrary integration issues
    • Completed entry of Cycle 6 pipeline framework tickets into jira
    • Much email exchanged on hif[]_restoredata issues with ALMA DSO / PWG
    • Completed CASA newsletter article
  • Bjorn Emonts
  • Pam Ford
    • CAS-10598 - new plotants: added another parameter, most subtasks validated
    • CAS-10736 - found cal library parser bug: fix ready, but OTF calibration in plotms still fails in calibration code
    • CAS-10727 - fixed plotms seg fault when Add Plot then Close, but does not draw axes on replot -- in progress
  • Enrique Garcia
  • Bob Garwood
    • asdm2MS ephemeris code review. CAS-10738, CAS-10621, CAS-7861
    • ASDM documentation fixes (quick fix, needing > 1 day to figure out how the auto-generated latex worked)
    • Investigating unexpected slow importasdm speed (CAS-10732). Appears to not be repeatable. No good explanation for that very slow fill. Even the "faster" fill is still a good example of a slow fill case (38 hrs vs 17 hrs).
    • It would be nice if there were regular filler benchmarks on ASDMs of various sizes/complexities that could be used to tell if a software change impacted performance. So that when a user says "The filler seems a lot slower now" I can answer either "there's been no change to the filler code that should have caused that" or "yeah, I'm seeing that in the benchmarks and looking into it" with some confidence. Do we regularly or periodically run benchmarks on other parts of CASA? Does the pipeline do that?
  • Kumar Golap
  • David Mehringer
  • George Moellenbrock
    • CAS-10719: gencal now agnostic about presence of EVLA solar Tcals in CALDEVICE. This was merged to CASA 5.1.0 via CAS-10729.
    • MSv3 notes that I will forward to Kumar and Martin soon...
    • Some followup on VI2 newsletter article
    • Some work on cross-hand phase organization (CAS-9108,CAS-9112)
    • Worked on CASA dev build on loaner laptop...
  • Dirk Petry
  • Martin Pokorny
  • Federico M Pouzols
  • Urvashi Rao
    • Some discussions about autoboxing and iteration control with the PLWG
    • Began adding 5.3 planning content to : https://open-confluence.nrao.edu/display/CASA/Release+Planning
    • Numerous conversations/emails about getting 5.1 out and about how to handle targets for 5.3 that require algorithm dev.
    • CAS-10719/CAS-10721 : log message for 5.1, fix to go in for 5.3.
  • Darrell Schiebel
  • Ville Suoranta
  • Takahiro Tsutsumi
    • Finished checking in all necessary updates for Perley-Butler 2017 for setjy + functionality check the valid freq. ranges for the model
    • automask discussion
Friday NAOJ Meeting
  • Kanako Sugimoto
    • DONE Review discussion of casa 5.1 development cycle
    • casa 5.3 planning
  • Wataru Kawasaki
  • Masaya Kuniyoshi
  • Takeshi Nakazato
  • Renaud Miel
    • DARED production 4 test + install
    • NAOJ CASA development host: ongoing, CASA dev packages installed
-- MorganGriffith - 2017-09-13
Topic revision: r15 - 2017-09-21, RenaudMiel
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback