Monday Morning Meeting -- 02 May 2016

  • DIAL-IN NUMBERS & PASSCODES:
  • IP: 192.33.117.12##8110
  • Phone: (434) 817-6524

Attendance

  • Socorro: Jeff, Martin, Juergen, Lindsey, George, Pam, Tak, Kumar, Jim
  • CV: Ville, Jen, Darrell, Dave, Anand
  • Garching: Julian, Dirk,
  • SCO:

News / Meetings / Visitors

  • Anand Crossley joining team

Build, Release

  • Licenses for Structure 101, Jeff follow up with Josh & Pat on Atlasssian Suite (Bamboo then Jira)
  • RH-7 waiting for NFS permissions

Verification Testing

  • When MPI tests are run in the framework, issues with the viewer and recent MPI updates are causing the tests to timeout (though they pass)
    • This is severely slowing down test turnaround
    • Julian and Darrell have been working with Akeem on this
    • It appears the problem is that the deamonizing of the viewer is causing problems shutting down the viewer
  • Test inventory spreadsheet
    • Just need a few last inputs: Masaya (Andy will ping him this week), Remy (no reply from email, and Andy can't seem to catch him in his office), Sanjay (on vacation), and Jim
  • Pipeline is not working as expected on OSX 10.11
    • casa --pipeline is not working, but casa --testpipe does
    • The working theory is that the pipeline is not installed internally with that build, but --testpipe option is installed in .casa/prelude and .casa/init.py, so that works
    • Akeem is working with Brian Kent on this
  • Imaging tests started running slow as of the 23rd, what checkin caused this.

Validation Testing

Architecture

  • Technical Forums:

HPC

Development

  • VI/VB2 in tCLEAN it's working.

Pipeline

  • New standard ALMA imaging recipe, including new uv continuum subtraction heuristics and new threshold / niter estimation heuristics
  • pipeline C4R1 release regression testing, debugging, release notes preparation
  • Issues
    • plotms averaged (time, scan, antenna) amplitude vs frequency plots, differences between CASA 4.5.3 pipeline C3R4 / CASA 4.6 pipeline C4R1
    • pipeline / CASA 4.6 meta data handling efficiency issues with VLASS data

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
  • Sandra Castro
  • Lindsey Davis
    • Implemented new standard ALMA imaging recipe
    • C4R1 release preparations
  • Pam Ford
    • CAS-8374 in progress (port casaqt to Qwt 6) - Lots of testing, fixed bugs in colorized plots, gridlines, external legends. Only remaining issue is latency between loading cache and drawing plot.
    • Investigating CAS-7817 (Bug while iterating over SPW) - plots differ when plotted as iteraxis (e.g. spw 19 plot when spw='17,19') vs. individually (e.g. spw='19'); looks like bug is in plotms antenna-averaging code
  • Kumar Golap
    • Making it possible for ComponentList to do simulation. Need to open Jira ticket.
  • Justo González Villalba
  • Jim Jacobs
  • Jeff Kern
    • ObsMode Meeting
  • Susan Loveland
    • Viewer
      • CAS-8458: Viewer Spectral profile tool line display should include line temperature
      • CAS-8512: Viewer misaligns optical and radio velocity
    • CARTA: Profile work, fix of some memory leaks, unsuccessful efforts at getting scripted client tests to pass.
  • David Mehringer
    • CAS-8497,,exportuvfits possibly incorrectly writing antenna coordinates: Pinged Jeff about this since this code remains unreviewed after two weeks.
    • (CAS-8569) improve performance of reading columns in Main table in MSMetaData: Resolved. Decreased listobs run time on Steve Myers' 0.5 TB data set by 15%. Since I began work on optimizing MSMetaData 's listobs specific methods, I've decreased the listobs run time from 11 minutes to 48 seconds on this data set on my eight core linux box. Thanks to Julian for all the code reviews.
    • (CAS-6906) avgchan in exportuvfits not changing number of channels in output: WIP. Considering using MSTransformer for preprocessing these types of transformations prior to writing uvfits since the uvfits specific code to this reportedly is buggy and is certainly convoluted.
    • (CAS-8565) integration interval fluke in listobs: Resolved. Not a bug. Suggested reporter query whomever is responsible for applications upstream of listobs as to why the MS intervals for this data set are peculiar.
    • (CAS-8570) ia.moments doesn't close output image correctly. RTT. Fixed. Similar issue for ia.imagecalc() also resolved.
    • Attended CIS security briefing. Asked Pat afterwards details on secure ways to destroy hard drives that can no longer be attached to computer so cannot be wiped with software. Learned that one of the methods used in GB is to use them as target practice.
    • (CAS-8525) robust statistics "fit-half" not working: RTT. Fixed.
    • (CAS-8529) Modify MSMetaData::_getExposureTimes() to improve performance. Resolved. Implemented.
    • (CAS-8500) imhead will crash on fully masked images. RTT. Fixed.
    • (CAS-8441) MSMetaData::getSubScanProps() is returning exposure times for mean intervals. Resolved. Fixed.
    • Attended Joanna Corby's thesis talk. Began thinking of design for implementing her automated spectral line identification and fitting tool in CASA. Will set up meeting with her and Remijan when she returns to CV.
    • (CAS-7202) boxit crashes when imagename ends with '/' and error isn't very obvious. RTT. Implemented more general solution to escaping special characters in the LEL. mask expression.
    • (CAS-8528) improve listobs performance by adding wantreturn param to ms.summary(): Resolved. Implemented.
  • George Moellenbrock
    • Kick-started cal solving w/ VI2/VB2 efforts
    • Organized JIRA tickets for JIVE/NRAO VLBI collaboration
    • Polarization Cal intents discussions w/ Chris
  • Dirk Petry
  • Martin Pokorny
    • IO profiling of CASA on Ulster
  • Urvashi Rao
  • Darrell Schiebel
    • CASA RPMs building on RHEL7 (waiting on NFS permission issue)
    • Worked on Bitbucket, Bamboo, workflow
    • Revisited pipeline runsetup script
    • Worked on virtualized OSX
  • Ville Suoranta
    • OSX packaging for Carta: Initial instructions on how to build and create application package here: https://safe.nrao.edu/wiki/bin/view/Software/CASA/CartaBuildInstructionsForOsx. Still need to resolve broken Qt5 package and create proper launcher (AppleScript).
    • Got Carta to compile on RH6, but the runtime doesn't work right: Won't render the image and segfaults at exit.
    • Tested Bitbucket Subgit plugin with Asap, which seemed to work alright. Tested syncing SVN BranchGit master, seemed to get only a partial history. Need to test again.
  • Julian Taylor
    • fixed watchdog process hanging around for 2 minutes after casa end
    • fixed namespace pollution of plotms/casaqt headers causing conflicts with Qt::QVector and casa::QVector, please don't use 'using namespace' in headers
  • Takahiro Tsutsumi
    • tclean outframe modification: not to put the LSRK conversion layer in the output images
    • Dealt with gencal unit test failure
Friday NAOJ Meeting
  • Kanako Sugimoto
  • Wataru Kawasaki
  • Masaya Kuniyoshi
  • Takeshi Nakazato
  • Renaud Miel

-- PamFord - 2016-04-29
Topic revision: r13 - 2016-05-02, JeffKern
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback