CASA User Testing Meeting Minutes - 2014-04-15, 09:00 Socorro / 11:00 Charlottesville

NOTE: The meeting for this date has been canceled.

NOTE: THIS PAGE INTERIM ONLY. SEE THE MINUTES OF 2014-04-30 FOR A MORE COMPLETE SUMMARY.

Agenda

Participants

Present: N/A

Apologies: N/A

Locations

https://staff.nrao.edu/cal/RoomListing.htm

  • Socorro: AOC-317; IP: 146.88.6.8
  • Charlottesville: Room 331; IP: 192.33.117.19


Minutes (Main Points Only)

Status

  • Second 4.3 Linux test package is still the current one. New one currently being put together.
  • 4.2.1 is the current release version for Linux. Note: 4.2.1 has not been publicly released yet - it is still only available within NRAO.
    • If you are on a Red Hat 5 machine, you can access older versions via the '-r' option, e.g. 'casapy -r4.1.0'
    • If you are on Red Hat 6 and need CASA 4.1, run it from here: /home/casa/packages/RHEL5/release/casapy-41.0.24668-001-64b/casapy
  • Mac OS X 10.7 and 10.8 CASA 4.2.1 pre-release package being tested. Most functional and regression tests pass. User testing feedback generally positive (PlotMS looks good, for example). However, significant work still needed on the viewer. This is being addressed.

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets, but excluding Pipeline) prior to meeting: 102.

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets) following meeting: ??.

Main Points Raised and Any Other Business

  • imrebin discussion has taken place; specifications have been provided to the developer.
  • imfit meeting took place; Brian and Jeff had produced documents.
  • OS X 4.2.1 package testing to be done: .dmg currently undergoing automated testing.
    • Plotms tests (versus time, freq, etc.). No exhaustive testing. Make a box, try to zoom, try to locate.
    • Juergen has done some 10.7.5 testing (see above). He now also has access to a 10.8 Mac. DAs also available for OS X testing.
    • Test imview, save png file.
    • Logger
    • Make sure that casaviewer from command line works same as within CASA.
    • Test a reduction script on TDM?
    • Interactive clean
  • Version numbering discussion: requirements being collated; will be circulated to the CSSC.
  • See also other items with red notes below.
  • Mark Lacy had identified a problem using mstransform to align the velocities in the ACA data. A similar problem was previously found and fixed for 12m data, so it may only be ACA data that is affected by this bug.
  • Mark R. concerned about: CAS-5111 and CAS-5379. Do we need to specifically recruit a couple of expert user testers for these items?
  • The next meeting is currently scheduled to take place on TBA.

New Action Items Arising

N/A

PART 1: Items To Be Covered During Meetings

Ready to Close Items

TBA

Items Overdue for Status Updates (i.e. the "Nag List")

  • CAS-5335(Jul): CASA Region Text File pixel sizes not handled properly. Critical item. Currently listed as "Open". The two blocker aspects (CAS-5589, perceived issue with region sizes) have now been addressed by the developers, subject to positive testing feedback, so the parent ticket status has been lowered to 'Critical'.
    Tester: Paul, with support from Mark L.
  • CAS-2252 (May): calculate the rotation measure. VLA item. Currently ARTT Will be released for 4.2 "as is". Testing done Preshanth. Report pending. Tester: Preshanth
  • CAS-6073 Feb 2014): 4.3 item. Improve line overlay behavior (in viewer). Currently ARTT (r28486). Tester: Crystal.
  • CAS-6038 (Feb 2014): 4,2/4.3 item. toolkit inline help now producing unreadable output. RTT. Tester: Mark R. (who really needs to do something about this and the next one...)
    • CAS-5418 (Dec): XML markup in inline tools documentation is not always parsed correctly. (A)RTT for 4.2/4.3. r28452. Tester: Mark R. Ongoing.

Single Dish (to be skipped during the meeting)
  • CAS-5338 (Jul/Nov): Update single dish flagging task interface (sdflag2). Currently ARTT again in the pre-release. Tester: Eric Villard. Long overdue for tester feedback - ticket pinged again. Eric has said that he will try to test this during the next week.
  • CAS-5139 (Sep): Proper handling of flag information in sideband separation algorithm. Low priority item. Subtask of CAS-1756. Currently ARTT; 4.2 item. Tester: Bunyo

Items Currently Undergoing Testing

  • CAS-5123 (May): Support for On the Fly Mosaics. Currently ARTT. JAO (ALMA) and Socorro (VLA) to test. Awaiting suitable data from ALMA. Steve has done some work on this for VLA. Still waiting on data; unlikely to be fully tested before release. Ticket is with Steve now. Have recently been in the process of doing tests on the VLA with some data scanning across bright sources. Kunal to test this when ready to invoke the imaging. Eric Villard is also looking at this now for ALMA (see CSV-553). Kumar attempted some imaging (on the associated CSV ticket) in mid-March, but this looks to have gone quiet.

Input Required

  • CAS-5764 (Oct): 4.3(?) item. casafeather: add scaling to LowXHigh, weighted. Works as intended, but ticket set to Input Required to get confirmation from Science that the current behavior is what is actually desired. Tester: Brian (was Juergen).
  • CAS-3532 (Sep): Incorporation of Alma Primary Beam in Mosaic. Was ARTT, now Input Required from Crystal. Tester was Scott S., but ticket passed to Crystal for input. Some test imaging done.
  • CAS-5758 (Nov): 4.3(?) item. casafeather: the low convolved, and weighted needs to include the 'scaled' label. Input Required from Science. Juergen has asked for comment from Brian and Kumar in the ticket. Tester: Juergen.
  • CAS-5720 (Oct): 4.2 item. change tooltip for new histogram functionality tool. ARTT. Tester: Paul (eventually). Switched to "Input Required" and passed to Crystal, so that she and Adam can comment on preferred behavior.
  • CAS-5844(Dec 2013): 4.3 imsmooth specification and testing targets. See also its subtasks. See list of Action Items above. Currently "Open" and assigned to developer. Work in progress.
    • CAS-5848 (Dec 2013): 4.3. enhancements for imsmooth. Input Required from Science (via Mark R.). Subtask of CAS-5844. Currently assigned to Jeff. Juergen will discuss preferred behaviour with Dave.
    • CAS-962 (Nov): there should be a facility (task and/or tool) to convolve/cross-correlate two images along one axis (e.g. channel). Input Required. Ties specsmooth and imsmooth together. Jeff to write up his discussions with Steve. Ticket assigned to Jeff. Ticket pinged at the end of March.
  • CAS-5379 - Subtle inconsistencies with other programs in Galactic Coordinates (Adam and Harvey). In a nutshell, shifts of ~0.2" are seen when taking data into other packages (e.g. DS9, IDL which both seem to agree with each other). It is unclear yet if this is an incorrect implementation in one or more packages, or possibly just a precision error. This is a subtle issue, and has been pushed back to 4.3. Ticket stalled. Needs to be looked at by someone with lots of time. To be left as-is for now. We really need to identify someone who can seriously focus on this issue.
  • CAS-5780 (Nov): Regridding a VLA image onto a GBT image fails to generate the expected warning message. Input Required from Adam.
  • CAS-5162 (Sep 2013): Improvements in flagging documentation and examples. Input Required from Science (via Jeff).

Other Blockers

  • CAS-3666 split on spws gives errors for different correlation shapes. Blocker. Got stuck On Hold, but is causing problems for the VLA pipeline now, so needs to be fixed as soon as possible. Currently assigned to Jeff, who will continue testing. Developer notes that we are waiting on the availability of split2 for a fix for this. mstransform has supported these MSs since October.
  • CAS-5806 Mathematical prediction of post-gridding single dish beam. Blocker. Developer has done some modelling, but... ? This is a "blocker of a different kind..." High priority, but not a blocker for the 4.2 release (but blocking further development). Ticket was pinged on March 28th, but no response yet.
  • CAS-4946 Crash on Mac OS X when virtual model requested. Blocker. Re-checked by Nathan, and it now sounds as if this still affects Mac OS X 10.6, but not 10.7 or 10.8. Debugging code pops up for all, though. This will be left as-is until CASA 4.2 for OS X becomes available. Passed to Jeff, so that it doesn't get forgotten about.
  • CAS-6020 (Jan 2014): 4.2 item. viewer - cross talk between animators. ARTT. Fix was r27981. Tester was to be Sarah, but it has already been found to work on Linux, so passed to Juergen to be included in the OS X (10.7 and 10.8) check-out.
  • Also, Mac OS X 10.7 Qt stuff: CAS-4602. Need to wait to assess the OS X CASA 4.2 package.


Mark has down to here.

PART 2: Items Listed for Informational Purposes (note that these will not normally be specifically discussed during the meeting unless someone raises them)

"ARTT" Items Pending Tester Assignment

(TBA)

Unable to Test Items

  • CAS-4636 (Oct 2012): Elevation dependent opacity application w/ Tsys. Still awaiting input from Science (since February). had been "On Hold" since August, awaiting data. Switched to Input Required and passed to Crystal for comment. Bumped back to 4.3. Placed "On Hold" until further notice.

  • CAS-4754 MSTransform (with subtasks): Lots of testing done. MSTransform marked as "experimental" in the 4.2 release. Speed sometimes not faster than split, but not horribly slow. Just keep an eye on performance for now - no corrective action needed. Keepflags option still missing - to be part of 4.3. No subtasks currently needing science user testing. This ticket cannot be resolved as done yet. It has two subtasks still on hold, and another (CAS-4864) that requires developer testing. No dedicated science user tester needed at present, though.
  • CAS-5111 (May): Implement autoboxing capability. Currently On Hold. This one had previously been ARTT, and Crystal had looked at this and provided a problem case. A fix had been put in and tested by Steve. He has provided feedback: seems to sort of work, but still fiddly right now. Ticket is currently set to "Ready To Test" and assigned to Tony, so that he can try it with both the M100 and Orion datasets. Lots of comments provided by John Lightfoot. A meeting has taken place on this, and it is an ongoing development topic. Ongoing development will be target of 4.3 Cycle. Crystal says that this will need significant effort and someone assigned to work with the developers for a while. Developer to work on the C++ and clean libraries. Requires significant science tester input.
  • CAS-4469 (Jun+ 2013): Split with channel averaging is creating spurious spectral features and weight is wrong when there has been channel flagging. Subtask of CAS-5245. On Hold. Tester: Crystal. Currently "On hold" for user testing purposes, as it cannot be tested until weight spectrum is fixed.
  • CAS-5084 (May): Testing multi-term support in pclean. Lots of feedback supplied by Kristina and Claire. On Hold (since August 2013) and assigned to Kumar pending class refactoring. Timeline for getting this off hold again requested.
  • CAS-5431 (Dec): slicing in frequency selection throws exception. Set to Input Required and passed back to dev. Tester: Kumar. Jeff: Jim was to update the docs. Ticket pinged - can it be closed?
  • CAS-5879 (Dec): 4.3 item. include pixel rms in imfit fitting. Not really in a state to be tested yet, so set back to Open for now. Committed to trunk as r27674. Tester: Claire. See also update for CAS-3476.

Upcoming Ready to (Re)Test Items

Not Yet Assigned To Testers

  • CAS-6342 (Mar): Viewer: Log Scale on Color Axis. RTT (r28981). Ticket with Mark R. for now. Tester: TBD.
  • CAS-6220 (Mar): Enable importasdm to read flags from the binary ASDM data. RTT (r28609). Ticket with Dirk for now. To be tested down in Chile by someone to be identified by Denis.
  • CAS-5191 (Mar): Add gain threshold parameter to fluxscale. RTT (r28480). Ticket parked with Mark R. for now. Tester: TBD.
  • CAS-6279 (Mar): imfit model and residual image should have same extent in direction plane as input image. Subtask of CAS-6124. RTT (r28847) pending new test package. Ticket parked with Mark R. for now. Tester: TBD (maybe Brian?)
  • CAS-6015 (Jan): The residual image produced by imfit loses its brightness unit. RTT (r8792), pending new test package. Ticket parked with Mark R. for now. Tester: TBD (maybe Brian?)
  • CAS-5844(Dec 2013): 4.3 imsmooth specification and testing targets. See also its subtasks. See list of Action Items above. Currently "Open" and assigned to developer. Work in progress.
    • CAS-5849 (Feb): implement spectral smoothing functions at task level. Subtask of CAS-5844. *RTT", pending a new testing package. Parked with Mark R. for now. Tester: TBD (probably Adam or Mark R.)

Single Dish

See below "assigned" SD list.

Already Assigned To Testers

  • CAS-5725 (Oct): 4.2 item. Testing of bug fix for non-J2000 coordinates and centered rectangles. RTT again. Some testing done, and it appears to work for everythin g but ellipses. New fix committed as r29226. Tester: Paul, with support from Mark R. as needed.
  • CAS-5334 (Feb): Ellipse regions have wrong width (RA). Second fix committed. RTT again (r29096). Tester: Paul

  • CAS-5852 mstransform needs to have the keepflags=True/False capability of split. RTT (r28959), pending a new test package. Tester: Steve
  • CAS-6185 (Feb): viewer doesn't work when not in own directory. RTT (r28572), pending a new test package. Ticket parked with Mark R. for now. Tester: Sarah
  • CAS-6255 (Feb): plotms crashes CASA. RTT (r28704); pending a user-testable package. Ticket parked with Mark R. for now. Tester: Tester
  • CAS-5946 (Feb): immath fails without a useful error message when the outfile already exists. Subtask of CAS-6124. RTT (r28792) pending new test package. Ticket parked with Mark R. for now. Tester: Nathan
  • CAS-5343 (Mar): IMFIT should provide # of pixels in logfile. RTT (r28804), pending a new test package. Tester: Kristina
  • CAS-6170 (Feb 2014): 4.3 item. testing ticket for ia.decimate(). Should be a subtask of CAS-5849, but Jira does not permit sub-subtasks. RTT again, pending a new test package. Tester: Nathan, consulting Adam if need be. Some testing done, mostly works, with a few remaining quirks associated with error reporting. A separate ticket has been spawned (CAS-6286) regarding handling of Boolean types.
  • CAS-6200 (Feb): Viewer: Issues with the pixel range box. Tester: Arielle. RTT again now (due to bugfix r28962), pending a new user-testable package.
  • CAS-3476 Reporting of uncertainties in IMFIT. Blocker. Currently RTT (for r29003), pending a testable package. Related to CAS-5879 (see above). Tester: Brian (with others)
  • CAS-6233 (Feb): casafeather weight function is zero. RTT, pending a new testable package. Most recent commit to trunk was r28682. Tester: Juergen.
  • CAS-6232 (Mar): writing version numbers in GUIs. RTT, pending a new testable package. Most recent commit to trunk was r28952. Tester: Juergen.
  • CAS-5836 (Nov): 4.3 item. Create new task imrebin. RTT. Commit to trunk as r29786. Probably a fairly high priority for testing, as there will almost certainly be a need to iterate on this. Tester: Adam, but Mark R. may do this.
  • CAS-6179 (Feb): Make a wrapper of hanningsmooth to use the MSTransform framework. RTT (r28604), pending a new testing package. Currently "RTT". Tester: Nathan.
  • CAS-6022 (Feb): imview fails if the range key of the raster dictionary is specified as float64 rather than float. RTT (r28583), pending a new testing package. Tester: Todd
  • CAS-5974 (Dec): impv: impv: support for supplying a center world coordinate and position angle. RTT again, following some testing and follow-up work (r28701). 4.3 item. Probably close to done. Tester: Juergen
  • CAS-5743 (Oct): 4.2 item. spectral viewer - once right mouse button was used, left mouse won't work anymore. RTT again (r28657), pending a new cassapy-test. Testing done. Actually fixed as written. However, a few other issues have cropped up (and spawned tickets accordingly), and an "RTT" fix has been committed for some of these that needs to be tested. Tester: Sarah
  • CAS-5844(Dec 2013): 4.3 imsmooth specification and testing targets. See also its subtasks. See list of Action Items above. Currently "Open" and assigned to developer. Work in progress.
    • CAS-5972 (Dec): testing ticket for imsmooth::commonbeam RTT - most recent commit was r28721. 4.3 item. See imsmooth discussion above. Subtask of CAS-5844. Tester: Juergen.
  • CAS-5731 (Oct): Loading DS9 region files into the viewer produces a warning and does not load. Open; 4.3 item. Ticket back with developer. Tester: Jen.
  • CAS-3116 (Jun): Comprehensive computation of spectral index from image(s). Laura Perez is testing this for the VLA. ALMA will hold off on testing this for now, pending the VLA testing. Some testing done, problems still found. Currently Open; bumped to 4.3. Tester: Kristina (in discussion with Laura). Jeff had agreed look at this with Kristina to get a better handle on how to go forward with this, which may result in more related tickets being spawned.
  • CAS-5701 (Nov): msmd needs a method to get the integration time. Currently Open. Tester: Todd. Works as advertised, but needs further improvement (better handling of pol ID). Raised to "Critical" status. Flagged to Jeff for possible reprioritization.
  • CAS-5125 (Jul): Make frequency an axis display option (in the viewer). Previously ARTT, currently Open. Tester: Adam. Tested. Needs more work and so ticket back to dev. Bumped back to 4.3.
  • CAS-3517 (Aug): Improve remapping interface (Cal libraries). Input Required from developer. Tester: Steve. Some testing done, recommendations made, ticket back with developer. Discussion ongoing. Further callibrary work to be pushed out to 4.3 in Jira. Ticket pinged a couple of times now.
  • CAS-5738 (Nov): slice cut is not visible. RTT again (r28904). Tester: Juergen.
  • CAS-4663 (Oct 2012): specfit components/prompt/inf. *Open" again, following input from Juergen.
  • CAS-5975 (Dec): impv: Support specifying input slice width as a world (angular) measure. RTT, pending a new test package - most recent commit was r28720. 4.3 item. Subtask of CAS-5835. Tester: Juergen.
  • CAS-5127 (May): Document ia toolkit methods. Status In Progress. Mark is working on this. Most of Juergen's prioritized list of 26 items has been done. Dates to be added his future documentation updates. Prioritized by Mark. Ongoing. ia.regrid docs will require more work. Still needs code commits. Mark waiting on OS X 10.7 build. Will effectively now have to be bumped until after 4.2 release, due to OS X-based build issues.
  • CAS-21 Support for complex images in image tool. Status: Open, but with multiple "RTT" subtasks, all assigned to Preshanth
    • CAS-6090 (Jan 2014): Complex valued images testing ticket 1. Currently RTT. Tester: Preshanth
    • CAS-6103 (Jan 2014): Complex valued images testing ticket 2. Currently RTT. Tester: Preshanth
    • CAS-6117 (Jan 2014): Complex valued images testing ticket 3. Currently RTT. Tester: Preshanth
    • CAS-6123 (Jan 2014): Complex valued images testing ticket 4. Currently RTT. Tester: Preshanth
    • CAS-6128 (Jan 2014): Complex valued images testing ticket 5. Currently RTT. Tester: Preshanth
    • CAS-6146 (Jan 2014): Complex valued images testing ticket 6. Currently RTT. Tester: Preshanth
    • CAS-6155 (Jan 2014): Complex valued images testing ticket 7. Currently RTT. Tester: Preshanth

Single Dish

SD ticket list still to be reviewed by Mark R.

  • CAS-6303 (Mar): Segfault in reading recent GBT SDFITS files. RTT (asap r2907), pending a new test package. Bob Garwood to test.
  • CAS-4735 (Nov): imsmooth needs additional option for single dish use. ARTT. Tester: Shinya. Critical item. Code committed to trunk. 4.3 item. Testing ongoing.
  • CAS-6121 (Jan): sdgrid: 4.3 item. Latitude value in resulting scantable is reversed. ARTT. Tester: Shinya. Testing ongoing.
  • CAS-5842 (Jan): 4.3 item. Make sd.splitant available in sdsave. ARTT. Tester: Shinya. Seems to work as intended, but some tweaks to defaults and documentation might be needed. before resolving as done.
  • CAS-5858 (Nov/Dec): field section parameter in SD tasks should accept multiple fields selection by field IDs and names. ARTT. Passed to Bunyo for testing. 4.3 item.
  • CAS-5841 (Dec): Make the scan numbers between scantable, asdm, and MS consistent. Currently ARTT. 4.3 item. Tester TBD. Ticket with Bunyo.
  • CAS-6181: SD processing needs to incorporate data weights. Currently Open. Previously identified as an important ticket to track. More discussion to come.
  • CAS-6168: enable plotter2 to change viewport size. Currently RTT (ASAP r2895), pending the next casapy-test. Ticket with Takeshi.
  • List of many other new 4.3 SD items all currently set to RTT in Jira, all assigned to EA (Bunyo) for testing/testing reassignment; subtasks of CAS-5526: Re-design single dish task interfaces:
Topic revision: r3 - 2014-04-21, MarkRawlings
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback