Monday Morning Meeting Sept. 19 2016

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Minutes in blue.

Attendance

  • Socorro: Jeff, Susan, Lindsey, Pam, Juergen, George, Sanjay, Urvashi, Jim, Tak, Martin
  • CV: Anand, Darrell, Ville, Akeem, David, Andy
  • Garching: Justo, Julien
  • SCO:

News / Meetings / Visitors

  • VLASS PDR Results
    • Delta-PDR required before end of year
    • Open question about whether or not full-Muller imaging is required.
  • JIRA migration from bugs.nrao.edu to open-jira.nrao.edu scheduled for Wednesday @ 5pm ET / 3pm MT. Both servers will be unavailable for several hours. Everything except filters should move over.
  • Documentation update (plone) meeting moved to Mondays @ 3pm ET / 1pm MT. Plone problems can be reported in JIRA under the "DOCUMENTATION" component; please assign tickets to Anand.
  • CASA Users Committee meeting next week, Monday and Tuesday.
  • NRAO CASA Internal Stakeholders meeting next week, Thursday.
  • NM Luster system change will happen this coming weekend.

Build, Release

Verification Testing

Validation Testing

  • Jen is currently at the A5Y meeting, headed to the airport to help shuttle participants to the hotel (p.s. yes, we are all wearing ALMA trucker hats)
    • testing support is going to be very light this week, as most of the NAASC staff, including the data analysts, are in Palm Springs
  • blockers to the 4.7 release (according to Crystal): mosaic handling of chanchunks, the BDF flags ticket, memory issues on CAS-8984, Urvashi's divergence ticket
    • BDF flags ticket testing is underway (apologies to Justo, as I did that last week instead of uvcontsub testing), progress is being made on the other three tickets as well
  • as soon as blockers are knocked down, we'll also start on a tclean CASAguide

Architecture

  • Warnings Summary
  • Conversion to casacore namespace hit a road bump. With any luck it'll go in this week. Forgot about gcwrap and ASAP; the latter increases the number of "moving parts" a bit.
  • The final details of the CrashReporter need to be dealt with for the release (packaging, symbol capture, release notes, opt-in vs. opt-out, data captured, etc.).

HPC

  • Mostly running performance tests on the parallelised tasks, pipeline and tclean for the presentation to CUC.
  • The ALMA pipeline in parallel is failling with an error coming from applycal. The message is: Exception Reported: Table::lock cannot sync table /lustre/naasc/users/scastro/work/pipeline/X291_par/par8/uid___A002_X86fcfa_X66b.ms/SUBMSS/uid___A002_X86fcfa_X66b.ms.0000.ms; another process changed the number of columns. I haven't had any problems running the applycal stage in the pipeline for a long time, so it's either some changes in applycal or the use of a tool in the pipeline. To be investigated.

Development

Pipeline

  • Major activity responding to issues raised by pipeline acceptance testing
    • See CASA validation testing issues, pipeline has workaround for CAS-8984
    • Calibration vs imaging ms workflow issues have been resolved
    • No unaddressed pipeline blockers

AOB

  • CASA Newsletter (Anand)
    • Anand needs articles from Jeff and Sanjay ASAP.
    • Will submit materials to communications office no later than Wednesday.
    • Newsletter release October 1st.

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
    • I will not be able to attend the meeting today.
    • Preparing the CUC presentation. Have added more text in the Parallelization documentation in Plone.
  • Lindsey Davis
    • Clarified and provided workaround for ALMA interferometry imaging workflow issues
    • Cleaned up check source quality assessment heuristics
    • Implemented ALMA calibration survey pipeline recipe per PWG requirements
    • Consulted with Jitan on ALMA pipeline infrastructure issues
    • Submitted CASA news letter article
  • Pam Ford
    • Bug fix in antenna averaging with zero weights reported by VLA data analyst
    • Plone docs
      • Finished plotms and the other "Data Examination and Editing" tasks (copied from cookbook)
      • Discussion with Anand and Ville about git workflow docs, adding git commands to the Revision Control Process page (in progress)
  • Kumar Golap
  • Justo Gonz├ílez Villalba
    • Linux debugging course in Santiago
    • Also attended ALMA SW testing meetings in Santiago
    • Benchmark tests for CUC
    • Non-CASA work (Moving ESO's Common Pipeline Lib from c to c++ using c++11 features like auto/lambdas etc)
  • Jim Jacobs
    • See above.
  • Jeff Kern
  • Susan Loveland
    • Bug fixing and region work.
  • David Mehringer
    • (CAS-8963) investigate imstat performance issues: RTT. Ticket to investigate possible cases in which performance has degraded after parrallelization of stats code.
    • (CAS-9003) ImageCollapser can exhaust memory on large images: WIP. Have reimplemented a couple of possible memory draining calls thus far.
    • (CAS-9007) Reimplement putAt() calls in LatticeStatistics::_doStatsLoop(): WIP
    • (CAS-8984) Pipeline run on Cycle 3 Config 8 project (Eris) segfaults in hif_makeimages after finishing tclean of first target's first spw (11664x11664 pixels), during cleanbox.analyse_clean_result: WIP. segfault in tables code called by stats code. Created another ticket for those familiar with tables code to investigate memcopy() segfault. I've modified the higher level code to avoid the call that produces the segfault. That introduced other issues, so I've modified relevant Lattice stats code for that and submitted PR.
    • (CAS-5740) CASA needs equivalent to BLSUM/ISPEC for integrated line flux density: WIP. Fixed bug re: multiple beams.
    • (CAS-8989) imhead should show at least 2 significant digits in the beam size in the logger: RTT. Beam info now reported to four decimal places.
    • (CAS-8949) ia.statistics cannot handle concatenated cubes: WIP. Responded to Ger's email, although really this ball is in Kumar's court.
  • George Moellenbrock
  • Dirk Petry
  • Martin Pokorny
    • test for IO effect of memory resident sub-tables
    • testing IO vs Sorted Table
    • [VLA: realfast preparation and meeting]
  • Urvashi Rao
  • Darrell Schiebel
    • pieces for incremental update of structure101 DB ready for integration
    • worked on moving redhat build scripts to /opt/casa/bt
  • Ville Suoranta
    • Started working on extracting pull request descriptions for docs.
    • Generated docs for 4.7
    • investigated and fixed broken doc builds
    • Investigated and rolled back Casacore namespace changes
    • Clarified some of the Git documentation
    • Worked on Git tagging and package naming
  • Julian Taylor
  • Takahiro Tsutsumi
    • Worked on documentation: revised automask doc (for Amanda) and plone docs
    • Attended the part of the VLASS meeting
Friday NAOJ Meeting
-- JeffKern - 2016-09-15
Topic revision: r21 - 2016-09-19, JaredCrossley
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback