CASA User Testing Meeting Minutes - 2013-10-22, 09:00 Socorro / 11:00 Charlottesville

THIS MEETING WAS RESCHEDULED FOR OCTOBER 29TH, 2013.

Agenda

Participants

Present: N/A

Apologies: N/A

Locations

  • Socorro: AOC-317; IP: 146.88.6.8
  • Charlottesville: Room 331; IP: 193.33.117.19


Minutes (Main Points Only)

Status

  • A new stable package is on the way.
  • Most recent casapy-test published: casapy-test r26919. Linux only; Mac OS X package to follow.
    • Changes since last casapy-test:
      • asap: svn.atnf.csiro.au/asap/trunk up to r2861
      • casacore: svn.cv.nrao.edu/svn/casa/trunk/casacore up to r26910
      • code: svn.cv.nrao.edu/svn/casa/trunk/code up to r26906
      • gcwrap: svn.cv.nrao.edu/svn/casa/trunk/gcwrap up to r26907
  • Known Issue: If both rpms and a tar casapy-stable are installed on the same RHEL 5.x system, and their versions do not match, you will see the failure described in CAS-5445 when starting CASA from the tar. You will not see this issue when starting casa from the rpms.

  • CAS-5379 - Subtle inconsistencies with other programs in Galactic Coordinates (Adam and Harvey). In a nutshell, shifts of ~0.2" are seen when taking data into other packages (e.g. DS9, IDL which both seem to agree with each other). It is unclear yet if this is an incorrect implementation in one or more packages, or possibly just a precision error. ACTION ITEM: Amy will look at the program, and also run a comparison with AIPS numbers. The best solution would be to get the correct matrices and make sure that they are implemented correctly in the CASA code.

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets) prior to meeting: 73.

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets) following meeting: 67 (as of Oct. 24th).

PART 1: Items To Be Covered During Meetings

Ready to Close Items

Items Descoped from CASA-4.2

  • CAS-5111 (May): Implement autoboxing capability. Currently RTT. This one had previously been ARTT, and Crystal had looked at this and provided a problem case. A fix had been put in and tested by Steve. He has provided feedback: seems to sort of work, but still fiddly right now. Ticket is currently set to "Ready To Test" and assigned to Tony, so that he can try it with both the M100 and Orion datasets. Lots of comments provided by John Lightfoot. A meeting has taken place on this, and it is an ongoing development topic. Ongoing development will be target of 4.3 Cycle.
  • CAS-5125 (Jul): Make frequency an axis display option (in the viewer). Previously ARTT, currently Open. Tester: Adam. Tested. Needs more work and so ticket back to dev. Pinged Oct. 22nd: possibly deprecated? Will probably not now make it into the 4.2 release.

Items Overdue for Status Updates (i.e. the "Nag List")

  • CAS-5127 (May): Document ia toolkit methods. Status In Progress. Mark is working on this. Currently half-way through Juergen's prioritized list of 26 items. But there are 99 tool methods in total. PRIORITIZED BY MARK.
  • CAS-5206 (Jun): Test regridding of GBT Data on 4.2 as well. ARTT. Adam to test.
  • CAS-5335 (Jul): CASA Region Text File pixel sizes not handled properly. BLOCKER.Currently listed as "Open". At least some of the blocker aspects have hopefully now been addressed by the developer - see below:
    • CAS-5572 (Sep): Test fix for circles and ellipses when image has non-square pixels. Subtask of CAS-5335. ARTT in casapy-test (r26662+). Tester: Amy.
    • CAS-5589 (Sep): Test cos(dec) fix to ensure region sizes are invariant upon shifts in dec. Subtask of CAS-5335. ARTT in casapy-test (r26662+). Tester: Amy.
  • CAS-2252 (May): calculate the rotation measure. VLA item. Currently ARTT Steve to do something.
  • CAS-4141 (May): SD: Sideband separation algorithm for DSB receivers. Shinya had been testing. Latest fix was r2835 to ASAP; included in casapy-test 25953+. ARTT. Tester: Shinya. Ticket pinged (again) on October 23rd. Testing resumed, error reported, developer investigating.
  • CAS-4959 (Jul): imregrid: Status ARTT. Tester: Adam.
  • CAS-4961 (Aug): imregrid: axis ordering of data cubes appears to be inconsistent. Currently ARTT with August stable package+. Tester: Adam.
  • CAS-5567 (Aug/Sep): testing for AnnCenterBox fix. Subtask of CAS-5541. Commit: r26367. Currently ARTT in casapy-test r26662+. Tester: Amy Mioduszewski.
  • CAS-5110 (May): big pixels in ia.regrid. Remy's been providing examples of problem cases, and possible approaches to solutions (with Adam). Input Required. Remy still to provide some recommendations text for tool documentation purposes. Work done by Remy, but some still awaiting some text from him. Some additional work done by developer. Ticket pinged for direction of this: may need to be switched over to "ARTT"?
  • CAS-3517 (Aug): Improve remapping interface (Cal libraries). Currently ARTT in casapy-test r26325+. Tester: Steve. Some testing done, recommendations made. More regressions to be done. Ongoing.
  • CAS-5134 (Apr/Jun): viewer crashes after certain interactive steps. Lots of work done and comments on this in the past. Testing being done by Josh and Kristina. Bugfix committed (r26431); ARTT in casapytest (r26662+). Tester: Kristina
  • CAS-3968 (Sep): Imregrid has trouble with degenerate axes. New item. Currently ARTT(?) in casapy-test r26662. Tester: Adam.
  • CAS-5179 (Sep): Viewer OTF Spectral Smoothing. New item. Currently ARTT in cassapy-test r26662+. Tester: Tony (previously Adam). Some testing and comments already present from Adam.
  • CAS-5610 (Sep): msmd needs a method to get the square law detector spws. (See also below items). Code commit: r26623. Currently ARTT in casapy-test r26662+. Tester: Todd.
  • CAS-5266 (Sep): msmd needs a method to return the field direction. New item. (See also below items). Code commit: r26512. Currently ARTT, in cassapy-test r26662+. Tester: Todd.
  • CAS-5450 (Sep): msmd needs a method to retrieve the total bandwidth of an spw. Can probably be tested with CAS-5266 (above). Code commit: r26542. Currently ARTT, in cassapy-test r26662+. Tester: Todd.
  • CAS-5477 (Sep): msmd needs a method to return non-wvr spws. New item. Can probably be tested with CAS-5266 and CAS-5450 (above). Code commit: r26549. Currently ARTT, in cassapy-test r26662+. Tester: Todd.
  • CAS-4754 - MSTransform subtasks:
    • CAS-5172 (Jun): Add capability for fftshift to regridding portion of MSTransform. To be tested as part of CAS-4754. Juergen's done some testing of this, but Adam could help if necessary. Some follow-up work done by the developers (r26435). ARTT in cassapy-test r26662+. Tester: Juergen
  • CAS-5545 (Aug): MS to scantable filler should apply FLAGROW of scantable to FLAG of MS. Currently ARTT in casapy-test (r26325+) package. Ticket passed to Bunyo for reassignment. Tester: Shinya. Ticket pinged for progress update on Oct. 24th.
  • CAS-5499 (Aug/Sep): sdimaging: support input of multiple MSes. Currently ARTT in casapy-test (r26662+). Tester: Shinya. Ticket pinged for an update Oct. 24th.
  • CAS-4777 (Mar): Define caltable for Tsys calibration. Currently ARTT in casapy-test (r26662+). Tester: Daniel. Ticket pinged for an update Oct. 24th.
  • CAS-4776 (Mar): Define caltable for sky calibration. Currently ARTT in casapy-test (r26662+). Tester: Daniel. Ticket pinged for an update Oct. 24th.
  • CAS-4774 (Mar): Implement an applycal task for single dish calibration. Currently ARTT in casapy-test (r26662+). Tester: Daniel. Ticket pinged for an update Oct. 24th.
  • CAS-4772 (Mar): Implement Tsys calibration task. Currently ARTT in casapy-test (r26662+). Tester: Shinya. Ticket pinged for an update Oct. 24th.

Items Currently Undergoing Testing

  • CAS-5598 (Oct): Differences in averaged data between TVI (mstransform) and split. Currently ARTT(?) - in current casapy-test (26919+). Subtask of CAS-4901. Tester: Scott Schnee. Could perhaps be tested together with the above two tickets?
  • CAS-5496 (Sep): sdflag2: enable data selection by time range. Currently ARTT in casapy-test. Tester: Daniel Espada(?)
  • CAS-5680 (Sep): regions statistics in casaviewer-test. Currently ARTT in casapy-test r26872+. Tester: Amy Mioduszewski.
  • CAS-5600 (Oct): msmd needs a method to map spectral window ID into data description ID. Tester: Todd. ARTT in casapy-test r26919+.
  • CAS-5708 (Oct): gaincal selectdata parameter is not set to True by default. Tester: Scott S. ARTT in casapy-test r26919+.
  • CAS-5695 (Oct): msmd "forintent" methods should allow wildcards in intent names. ARTT in casapy-test r26919+. Commit was r26907. Todd to test.
  • CAS-4081 (Aug): Create tool / view that allows management of open images and changing the image stack. ARTT again now in casapy-test r26662+. Tester: Mark Lacy. Tested by Mark and it now at least runs. However, ds9 pre-rotated images remain problematic (this would be for some future release, though - not now).
  • CAS-4637 (Sep): Multi-SPW Bulk Delay Fitting. Latest commit (r26888) is currently ARTT in casapy-test r26919+. Steve's done some testing of this. Juergen: the Cookbook entry for this needs updating - see the ticket.
  • CAS-3116 (Jun): Comprehensive computation of spectral index from image(s). Laura Perez is testing this for the VLA. ALMA will hold off on testing this for now, pending the VLA testing. Latest fix was (r26751). Currently ARTT in casapy-test (r6919+). Laura has been doing some testing. Urvashi has reported issues, Dave has put in a fix.
  • CAS-2722 (Jul): Viewer profile tool and ascii have weird order for multiple cubes. ARTT in casapy-test again (latest commit: r26666). Tester: Crystal. Should be pretty much done now (assuming use of the CWD). Passed to Juergen for Cookbook follow-up work.
  • CAS-5213 (Jul): feathering GUI (casafeather) upgrade. Upgraded to BLOCKER. Brian Mason and Juergen did some testing of this, and are working on documentation. Bugs have been reported to the dev recently and the ticket passed back accordingly. ARTT in casapy-test (r26919+) package. Latest commit was r26738.
  • CAS-4960 (Aug/Sep): imregrid: When regridding, the regridding should by default be done in accordance only with whichever axes are common to both the template and the image (and are sensible). Most recent commit: r26439. Currently ARTT in casapy-test r26662+). To be considered as part of "imregrid checkout". Tester: Adam.
  • CAS-5547 (Aug): Testing ticket for AnnRectBox fix. Fix committed. Subtask of CAS-5541. Currently ARTT, in casapy-test (r26325) package. Tester: Amy Mioduszewski. Some testing started. Dependent on CAS-5276 (which is now getting close to being resolved).
  • CAS-5248 (Aug/Sep): propagate gridding and beam changes to simanalyze. ARTT in casapy-test r26662+ (but previously partly tested in private build). Tester: Jen. Lots of back and forth, still being tested.
  • CAS-4754 - MSTransform subtasks:
    • CAS-5013 (Jul): "cvel handling of different sensitivity spw". ARTT in July stable+. Subtask of CAS-4754. Ticket passed to Anita in Europe as part of the general MSTransform testing effort there. Testing is ongoing, with lots of harmonious-sounding back-and-forth. Left open in light of availability of time averaging in new split. See also new parent ticket for combined MSTransform testing (CAS-5581).
    • CAS-5581 - Test of MSTransform capabilities in combination. ARTT. Most recent commit was r26622 - now in latest casapy-test. Currently being tested by Anita Richards. Time average in new split now available (r26919). Ongoing.


PART 2: Items Listed for Informational Purposes (note that these will not be specifically discussed during the meeting unless someone raises them)

"ARTT" Items Pending Tester Assignment

  • CAS-4754 - MSTransform
    • CAS-4849 (Oct): Enhanced Split Capabilities: Time Averaging. Currently ARTT - in current casapy-test (26919+). Tester TBD.
    • CAS-4850 (Oct): Enhanced Split Capabilities: Baseline Dependent Time Averaging. Currently ARTT - in current casapy-test (26919+). Tester TBD.
  • CAS-3532 (Sep): Incorporation of Alma Primary Beam in Mosaic. Currently ARTT. Needs tester assigning. Also, Mark to check documentation.
  • CAS-5376 (Oct): moment 9 map stores values in 'Hz' although its unit is 'km/s'. Latest commit is currently ARTT in casapy-test r26919+. Passed to Juergen for user tester assignment. Tester: TBD.
  • CAS-5117 (May): Association of Syspower Cal entries with scan / field in table or during apply. Currently ARTT in casapy-stable (May 2013; r24824+). Information posted to ticket by developer. VLA item. Steve will figure out how to proceed with this one. He may end up testing this himself. Tester: Still TBD. Ticket pinged for an update Oct. 24th.
  • CAS-5487 (Aug): sdimaging: image header stores a wrong unit. Workaround fix provided. Currently ARTT with August stable package. Brian Mason added as a watcher for North America. Ticket passed to Bunyo for reassignment. Tester: TBD. Ticket pinged for a progress update Oct. 24th.
  • CAS-5535 (Aug): Remove freq_tolsr parameter from sd.splitant(). Currently ARTT in casapy-test package. Tester: TBD. Ticket passed to Bunyo for reassignment. Tester: TBD. Ticket pinged for an update Oct. 24th.
  • CAS-5497 (Aug/Sep): sdimaging: sdflag2: improve description of selection parameters in inline help. Currently ARTT in casapy-test (r26662+). Ticket passed to Bunyo for tester identification. Tester: TBD. Ticket pinged for a progress update on Oct 24th.
  • CAS-5139 (Sep): Proper handling of flag information in sideband separation algorithm. Subtask of CAS-1756. Currently ARTT in casapy-test. Checking with Jeff regarding need for science user testing.

Unable to Test Items

  • CAS-4636 (Oct 2012): Elevation dependent opacity application w/ Tsys. Still awaiting input from Science (since February). On Hold. Awaiting data.
  • CAS-5084 (May): Testing multi-term support in pclean. Lots of feedback supplied by Kristina and Claire. Currently On Hold and assigned to Kumar pending class refactoring.

Upcoming Ready to (Re)Test Items

Not Yet Assigned To Testers
  • CAS-4938 (Sep/Oct): CLONE - mstransform on spws gives errors for different correlation shapes. RTT pending availability in a test package (most recent commit was r26929). Tester: TBD.
  • CAS-5214 (Sep/Oct): plotms hangs when plotting amp vs channel in IRAS16293 CASAguide. RTT pending availability in a test package (most recent commit was r26923). Tester: TBD. Data Analyst?
  • CAS-5710 (Sep/Oct): plotms does not indicate when the measurement set is not found. RTT pending availability in a test package (most recent commit was r26923). Tester: TBD. Data Analyst?

Already Assigned To Testers
  • CAS-5466 (Oct): typos in the help for immath. Fix put in; RTT, pending testable version. Mark to check this.
  • CAS-5123 (May): Support for On the Fly Mosaics. Currently ARTT. JAO (ALMA) and Socorro (VLA) to test. Awaiting suitable data from ALMA. Steve has done some work on this for VLA. Still waiting on data; unlikely to be fully tested before release. Ticket's with Steve now. Have recently been in the process of doing tests on the VLA with some data scanning across bright sources. Kunal to test this when ready to invoke the imaging.
  • CAS-5706 (Oct): msmd.spwsforfield returns the wrong answer (Blank) if the specified field name has two IDs. Todd to test this. Currently RTT, pending a newer test package. Commit was r26931.
  • CAS-5138 (Aug): Make default image area of sdimaging cover the pointings in MS. Shinya has been testing this. Set back to Open and passed back to developer, following identified issues.
  • CAS-5431 slicing in frequency selection throws exception. Set back to Open and passed back to dev. Tester: Kumar.
  • CAS-5502 (Aug): Velocity regridding in viewer sometimes not available. Previously ARTT, currently Open. Tester: Adam. Earlier fix tested. Needs more work and so passed back to dev. Ticket pinged Sep. 24th, Oct. 22nd.
  • CAS-5276 (Jul): Loading region file with box, ellipse and poly shapes produces warning and does not load. Tester: Anand. Set back to Open again. Windows behavior now appears fine. Extraneous logger warning messages have been downgraded to "info" messages. Close to done.

Other Blockers

  • CAS-4946 Crash on Mac OS X when virtual model requested. BLOCKER. Recently re-checked by Nathan, and it now sounds as if this still affects Mac OS X 10.6, but not 10.7 or 10.8. Debugging code pops up for all, though.
  • Also, Mac OS X 10.7 Qt stuff: CAS-4310, 4602.

-- MarkRawlings - 2013-10-20
Topic revision: r11 - 2013-10-25, MarkRawlings
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback