Monday Morning Meeting 22 August 2016

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro: Susan, Lindsey, Pam, Jeff, Kumar, Martin, Juergen, Tak
  • CV: Ville, Anand, Akeem, David, Andy
  • Garching: Julian, Dirk
  • SCO:

News / Meetings / Visitors

  • Newsletter: Should be coming soon.
  • CUC Meeting: 9/26 - 9/27. Jeff will send a list of who should make presentations.

Build, Release

  • Remaining Issues for release
    • ChanChunks Testing
    • SetJy in VLA pipeline

Verification Testing

  • Akeem and Andy are in Chile the weeks September 5 and September 12
    • Focusing on ALMA Integration and Release Management tasks
  • Working on getting all accepted tests passing, in light of the upcoming release

Validation Testing

  • Working on getting testing tickets resolved before the upcoming release (pinged several VLA PL tickets that look ready to close)
  • Devised a testing plan with Bryan and Crystal for CAS-7863 (updated asteroid models in setjy) -- user tester in Socorro or in CV?

Architecture

  • Warnings Summary
  • Support for casacore as its own namespace is in the home stretch. About 90 files require a final merging with current source files which changed during the modification work. CasaCore mod to allow cmake enable/disable of the feature is in a pull-request. In a day or two it ought to go into the trunk.

HPC

Development

Pipeline

  • C4R21 release branching preparations, branch scheduled for Aug 29
  • ALMA interferometry pipeline
    • memory resource handling biggest issue, too many open files issue resurfaced
    • what to do about really big cubes, skip, representative spw only, coarse resolution, subsample
    • excessive online flagging problem under investigation
  • EVLA interferometry pipeline
    • setjy model frequency interpolation behavior differences for single spw vs multiple spw exections
    • statwt performance
  • ALMA single dish pipeline
    • transition to MS issues

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
    • worked on QA scores for imaging with Dirk and Stewart
    • investigated cube creation parameter issues LSRK start, width, nchan settings with Dirk, Vincent
    • investigated aggregate bandwidth computation issues with Dirk, Todd
    • investigated C4 testing results, flagging statistics, excessive flagging
    • participated in VLASS survey PDR preparation meeting
  • Pam Ford
    • CAS-8895 RTT - message about plotting weight when weight spectrum available
    • CAS-8892 RTT - support for plotting SD cal tables in plotms
    • CAS-8380 UT - responded to tester's minor issues with plotcal axes
    • CAS-2656 Resolved - plot cal table SNR column
    • CAS-8810 - not a bug? Discussion about including flagged scans in time-averaging w.r.t. scan and time labels
    • Eclipse IDE tutorials - PEP goal
  • Kumar Golap
  • Justo Gonz├ílez Villalba
  • Jim Jacobs
  • Jeff Kern
  • Susan Loveland
    • Large amount of time recovering from bad Ubuntu upgrade (Jim helped)
    • CARTA: Work integrating regions in profile.
  • David Mehringer
    • Four days vacation.
    • (CAS-8871) imfit does not like ellipse region specifing corr=[I]: Not a bug. Appears to have been resolved since 4.6 release.
    • (CAS-8855) implement multithreading in ClassicalStatistics::_doMaxMin(): Resolved.
    • (CAS-8837) implement multithreading in ClassicalStatistics::_createDataArrays(). UT. Responded to query that this and other related tickets could be tested together as long as quantile-like values are part of the test plan.
  • George Moellenbrock
    • Completed migration to OSX 10.11 on my laptop, then wrestled with the CASA build. Only a few quirks to contend with relative to the wiki instructions, mostly related to the fact that I was updating an existing installation of 3rd party stuff rather than installing them from scratch. Provided some feedback to Ville.
    • Advised on CAS-8895 (chan-ave'd weights don't look right), which was mostly pilot error in selecting axis options in plotms. Pam added a warning that 'wt' refers explicitly to the unchan'd WEIGHT column, and will plot it (even vs. freq-dep axes) even if there is a non-trivial WEIGHT_SPECTRUM. Next cycle we will move toward serving the weight info with the same shape as data and flags always, to simplify this interface, and deeper application interfaces as well (JIRA ticket pending).
    • CAS-8893 ('nearest' freq interp wrong) RTT: This turned out to be a re-do of a fix CAS-6995) I did in May 2015 on the v4.4 release branch that never made it back to casacore trunk on the git repo (we were in the midst of migrating to the git repo, and this revision was lost in the shuffle). Asked Jim to expedite a pull request for this, so it can be fixed in v4.7.
    • CAS-8904 (single-precision time in interpolation defeats ~msec sampling observations). Turns out time (minus a large offset) has been explicitly cast to Float in calibration interpolation because the Interpolate1D class can't handle a Double abscissa when interpolating an Array<Float> ordinate. I think this is mainly because mixed-type operator* (and similar) is not supported in the public interface (or at least the well-used interface) of ArrayMath. I wonder if it is a good idea to support mixed types there or not. For v4.7, we'll finesse the time offset to minimize the problem, and address the deeper ArrayMath fix for v5.0.
    • Several non-CASA meetings (local sci staff, OSTC), misc. correspondence.
  • Dirk Petry
  • Martin Pokorny
    • CASA IO testing
    • visstat2 unit tests on time averaging
    • [VLA]
  • Urvashi Rao
  • Darrell Schiebel
  • Ville Suoranta
    • Carta OSX packaged from development branch
    • Still working on Carta build issues on Ubuntu
    • Plan creation from Jira works, but the plan creation won't cascade. Hence the build plan needs to create a new testing plan at the final stage (no point in creating/running test plan before the initial build is done). The initial test of this seemed to work alright.
    • Started consolidating Bamboo plans, but based on current workflow and the trigger limitations in Bamboo, those will probably need to be split up again.
  • Julian Taylor
  • Takahiro Tsutsumi
    • Checked in new asteroid models and updated code for setjy
    • Automask doc - responding some of Amanda's questions
    • Investigating CAS-8900 the pipeline shows the difference in the flux scaling in setjy (evla) running multiple spws all at once versus running individually.
Friday NAOJ Meeting
  • Kanako Sugimoto
  • Wataru Kawasaki
  • Masaya Kuniyoshi
  • Takeshi Nakazato
    • discussion on how to test CAS-8419 with Kana and Patricio
    • bug report on CTTimeInterp1 (conversion time value to single precision)
  • Renaud Miel
    • CAS-7339: double-checked Eiji's verification result. Quasar not visible on imaging result
    • CAS-8082: no progress

-- KanaSugimoto - 2016-08-16
Topic attachments
I Attachment Action Size Date Who Comment
CASA_Build_And_Test_Workflow_Proposal.pdfpdf CASA_Build_And_Test_Workflow_Proposal.pdf manage 309 K 2016-08-22 - 09:45 JaredCrossley CASA Build and Test Workflow Proposal
Topic revision: r20 - 2016-08-22, JaredCrossley
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback