Thursday Morning Meeting - 5 October 2017

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro:
  • CV:
  • Garching:
  • SCO:

News / Meetings / Visitors

  • Recruiting
  • Meetings

Build, Release

  • Samba maintenance 12:00PM EDT will impact Jira trigger: Moving ticket to "Ready to Verify" won't create a Bamboo branch while Samba is down.
  • Moving Mac build machines: A couple of build and test machines will be down around 2:00PM - 4:00PM EDT.
  • 5.2 release branched

Verification Testing

  • Andy has started looking at the weblogs for the 5.2 pipeline/HPC runs
    • Unfortunate that we can't keep the data on disk (due to space constraints)
    • Nothing out of the ordinary (some of the flagging diverges between the two, but no quantifiable difference in results, as far as I can tell)
    • I still have to look at more results

Validation Testing

Architecture

  • Warning summary has moved: Warnings Summary
    • alma warnings now at 0.
    • New warnings in atnf & atmosphere

HPC

  • HPC Testing of the ALMA pipeline using CASA 5.1 release
    • READY FOR VALIDATION
      • 16 "E2E5" datasets ready for validation. Weblogs + pickles and comparePipeRuns() output copied to https://safe.nrao.edu/alma/PipelineTestResults/ParallelImaging/CASA_5.2. Needs checking differences in imstats (comarePipeRuns()) and weblogs.
      • From the 23 new "E2E5" datasets (22 effective as 1 is duplicated):
        • 16 finished. All the runs went functionally well (or as well as their serial counterparts).
        • 5 are running at the moment and should be available soon
        • 1 "fails mitigation"
      • Lustre space issues: we're removing the 'working' directories, but we might still need ~15 TB for all 5.2 tests.
      • Asked Remy to fix analysisUtilities, which does not support parallel image files. We are currently using a local version with these changes!
      • You can see detailed information of our parallel tests in https://open-confluence.nrao.edu/display/CASA/Tests+for+CASA+5.2
    • NEW tickets

Pipeline

Development

  • CASA 5.2 : Right now, awaiting new issues to arise via HPC tests. Do we know how the parallel pipeline development efforts (outside of CASA) are going ?
    • CAS-10428 : image analysis tasks are slower on reference concatenated images
    • flagging differences serial vs parallel : if they get significant we should do something, otherwise leave as is.
  • CASA 5.3 :
    • Report from Bjorn on his tests of parallelization usability : problems with model writing, setjy slowness, uvcontsub
    • Update on support for ephemeris objects - CAS-9004 , CAS-6620, CAS-10808 ? ( CAS-10808 for later )
    • Statwt new feature requests - need to develop detailed requirements.
    • First step of a resource predictor for imager : CAS-10768
    • Anything else ?

AOB

  • Timing of a possible CASA F2F

Developer Reports

Thursday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
  • Bjorn Emonts
  • Pam Ford
    • 2 pull requests merged: ms tool deprecation warnings, plotms seg fault when add+close plot
    • CAS-10774: investigated plotms failures in VLASS pipeline; worked with Kumar, Darrell, and K.Scott. Discovered xvfb-run failures on cluster nodes.
  • Enrique Garcia
  • Bob Garwood
    • CAS-10738 : Review the existing Ephemeris handling code in asdm2MS and fix found bugs. Code changes have been made. One existing test fails:: test_importevla, because of the improved accuracy of PI now being used the reported FIELD center is slightly different than that expected in this test. I'll be adding additional tests to test_importasdm. Looking for additional cases that might be good tests. These changes likely impact existing pipeline tests in similar ways.
  • Kumar Golap
  • David Mehringer
  • George Moellenbrock
  • Dirk Petry
  • Martin Pokorny
  • Federico M Pouzols
    • Running and checking new E2E5 tests and re-running new versions.
    • Compiling info for CAS-10794: Eng. task with sub-tasks for "Slowdown of pipeline tasks in parallel mode".
    • Timing of pipeline tasks in serial versus parallel test runs.
  • Urvashi Rao
    • Some code work for CAS-10768 + numerous emails/discussions.
  • Darrell Schiebel
  • Ville Suoranta
  • Takahiro Tsutsumi
    • Continued working on timing/profiling of key functions used in automask
    • Looking into cube tclean bugs
      • CAS-10769: Failure in ‘optical’ velocity mode with an error, “wcs linset error: PCi_ja matrix is singular”. Got the relevant data and reproduced the error. Need to dig into deeper.
      • CAS-10773: “tclean can’t reproduced requested velocity start for cube if very precise rest frequency is used” - A bug in QuantitytoString (), as std::to_string used in the function returns in a fixed decimal places (6 digits)
Friday NAOJ Meeting
  • Kanako Sugimoto
    • Definition of CASA 5.3 single dish targets
      • Defined development targets, schedule, and assignment of single dish team.
      • Finished briefing to the team. The plan approaved.
      • JIRA filter of CASA-SD targets (need to log in first): this filter always points to the targets of the next release we are working on.
      • Adding single dish section to the confluence page of CASA 5.3 Planning
  • Wataru Kawasaki
  • Masaya Kuniyoshi
  • Takeshi Nakazato
    • attended MSv3 meeting
    • worked on CAS-10683: trying to define unit test
    • report on missing fixspwbackport
    • DARED: confirmed that dared is bundled with latest casa 5.1.0-74
  • Renaud Miel
    • NAOJ CASA development host setup: almost done
      • CASA build: 18 minutes
      • TS3 regression suite: 38 minutes
-- MorganGriffith - 2017-10-03-- MorganGriffith - 2017-10-03
Topic revision: r20 - 2017-10-05, TakeshiNakazato
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback