Monday Morning Meeting 20 November 2017

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro:
  • CV:
  • Garching:
  • SCO:

News / Meetings / Visitors

  • Face to Face meeting planning - Feb 5th
  • Build/Test Process Reviews
  • Thursday and Friday (Nov 23-24) - Thanksgiving holiday in US

Development

  • 5.2
    • CAS-10857 : Numerical differences between serial/parallel. Difference understood (CAS-7210). Manifests as a 'different weighting scheme'.
    • CAS-10849 : Restoring beam : One round of fixes made (via casacore), waiting for next round. ( Dave - any more info on the latest PR ? )

Pipeline

  • 5.1 ?
    • Progress on VLASS issues, restoring beam computation slowdown (Pipeline), image statistics crash (CASA)
  • 5.2 Issues
    • Waiting on CASA issues, see development section
    • Reminder that uvcontfit uses old vi/vb1 framework, uvcontsub cannot be parallelized
  • 5.3
    • Waiting on callibrary feedback from George
    • Sessions branch testing, some issues with per MS execution order, naming and numbering of sub-stages
    • ALMA Pipeline / Archive / AQUA roles and responsibilities meeting, some progress
    • Problem interpreting flux density values returned by CASA fluxscale in low SNR cases * Calibration seems OK (?), concern over possible gaintype='T', calmode='a', weighting issue

HPC

Users

  • Flyer (poster) for winter AAS; see attachment below. Proposed highlights that are important for users: CASA Docs, tclean, pipeline, parallelization - work in progress. Please provide feedback.
  • Helpdesk tickets on visualization growing - helpdesk starts referring users to CARTA. Need to discuss if this is desirable (probably not!) and what to do.
  • Documentation updates ongoing: CASA webpages, ALMA CASA Guides (Rachel Friesen), CASA Docs.

Build, Release

Verification Testing

  • Issue with CAS-10857 believed to be duplicate of CAS-7210
    • This is currently unscheduled for a fix date
  • Merged unit and regression test scripts
    • Being tested right now
    • Need to implement -all option before it is merged
  • Added a single dish test (tsdimaging test) to accepted test list
  • Moved Test 4532 Sdimaging (Was in quarantine) from critical to accepted
  • Move Tests From Accepted to Critical: 3171 Statwt2 4305 Predictcomp 4713 Plotprofilemap 4720 Plotweather 5101 Asdmsummary

Validation Testing

  • Current validation tally
    • 122 Under Validation, 83 Ready to Validate.
    • Nov 10 - 16: 3 tickets assigned for validation. 2 tickets resolved.
  • JDM working most of the time on an ALMA commissioning project through Nov; will be out next week (11/27-11/30) at ALMA meeting in Korea
  • Current Testing Efforts for 5.2 deliverables
  • Current Testing Efforts for 5.3 deliverables
    • imaging issues/autoboxing refinements
    • statwt2 (CAS-10530)
    • systematic tests of mstransform
      • initial testing plan circulated to SWST, will send something around soon
    • plone/CASAdocs:
    • further parallelization testing (non-ALMA pipeline specific)
    • polarization calibration
    • testing snapshot -- please see https://safe.nrao.edu/wiki/bin/view/Software/CASAUserTesting for the up-to-date list of tickets and testing status
      • testing ongoing:
        • plotants tickets (Pam, few more)
        • plotms/plotbandpass capability (Pam, CAS-9053)
        • statwt2 (Dave, CAS-10530 and others)
        • imhistory tickets (Dave, several)
        • phase center shift in plotms (CAS-8431)
        • averaging in flagdata (CAS-6215)
        • frequency interpolation of 'linearflag' for BP tables with good solutions (George, CAS-10772)
        • ms tool selectinit (Pam, Sandra, CAS-10818)
        • simulations (Remy, several)
        • Implement ACCOR equivalent (George, Walter, CAS-10366) -- does this need a new testing ticket?
        • immath 'poli' and 'pola' implementation (Dave, CAS-9123, CAS-9124)
        • plotcal functionality in plotms (Pam, CAS-8270)
        • ms tool getdata returns wrong number of rows for capitalized item (Kana, Pam, CAS-10848)

Architecture

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
    • Investigating the origin of the "ghost" WVR spws that exist in the ASDM. Importasdm imports these spws to the SPW sub-table, but they do not exist in the main table, because there is no binary data. It seems that this was a request from the TelCal system, and eventually these spws got included in the ASDMs and forgotten to be removed (To-be-confirmed). The fact is that mstransform does not include them in the output MS, which seems to be the right thing to do. This behaviour is inconsistent with importasdm, which in principle should not include them in the MS, but it currently does. I will confirm all the above suspicion soon.
  • Lindsey Davis
    • Participated in ALMA Archive / Pipeline / AQUA roles and responsibilities meeting
    • Sessions branc testing
    • Implemented pipeline import data as imaging data at user level
  • Bjorn Emonts
  • Pam Ford
    • CAS-8270 (plot cal tables in plotms): additional bug fixes for axes labels, legend
  • Enrique Garcia
  • Bob Garwood
    • CAS-10644 Filler needs to detect duplicate (sets of) rows and retain only one copy. The POINTING fix has been checked and appear to be working. The DATA column duplicate detection is taking much longer than anticipated due to the complexity of that section of the asdm2MS code. Decisions based on the number of expected new MS rows are made well before many details are known about what's going in to those rows. And I still am uncertain how this will affect the lazy filler mode.
    • CAS-10386 Add new shared ALMA code to support 2 new ASDM tables in asdm2MS. Started this while still working on the above. This is essentially mindless copying of existing code from ALMA to CASA and verifying that the existing unit tests still work. I'm trying to hunt down existing test ASDMs with the new tables (TelCal from ALMA and Pulsar from VLA).
    • GBT work. A software release is planned for next month and I'm hoping to finally get my parallel gbt sdfits filler into the release branch. Running some reliability tests.
  • Kumar Golap
  • David Mehringer
  • George Moellenbrock
  • Dirk Petry
  • Martin Pokorny
  • Federico M Pouzols
  • Urvashi Rao
  • Darrell Schiebel
    • CASAtools
      • finished adding support for Python 3.4
      • succeeded in building on OSX 10.12 (configuration refactoring needed)
  • Ville Suoranta
  • Takahiro Tsutsumi
Friday NAOJ Meeting
  • Kanako Sugimoto
  • Wataru Kawasaki
  • Takeshi Nakazato
    • almost completed CAS-10683 migration of sdimaging task to new imager framework
    • created an Epic CAS-10889 to collect requests to imager framework from the viewpoint of single dish imaging
      • some discussion ongoing (with Urvashi)
      • started one ticket to improve the performance: CAS-10895
    • started working on CAS-9956 investigation of performance degrade of sdcal for SQLD (Solar) data
      • edge detection is slow and memory intensive
    • bug report: CAS-10905 sdcal fails if input is MMS
  • Renaud Miel
    • CAS-8087 PlotMS pointings / VIVB2 checking

-- TakeshiNakazato - 2017-11-16
Topic revision: r18 - 2017-11-20, JenDonovanMeyer
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback