CASA User Testing Meeting Minutes - 2014-09-16, 09:00 Socorro / 11:00 Charlottesville

Agenda

Participants

Present: Mark R., Steve, Anand, Mark L.

Apologies: Adam, Juergen

Locations

https://staff.nrao.edu/cal/RoomListing.htm

  • Socorro: AOC-317; IP: 146.88.6.8
  • Charlottesville: Room 331; IP: 192.33.117.19


Minutes (Main Points Only)

Status

  • 4.3 Linux and OS X (10.8) test packages have been updated recently. Feature freeze date for 4.3 was yesterday, meaning that all remaining 4.3 work should be bugfixes only (modulo a few pre-agreed bits of finishing work).
  • 4.2.2 is the current public release version for both Linux and OS X. many thanks to all who helped with getting this done.
    • If you are on a Red Hat 5 machine, you can access older versions via the '-r' option, e.g. 'casapy -r4.1.0'
    • If you are on Red Hat 6 and need CASA 4.1, run it from here: /home/casa/packages/RHEL5/release/casapy-41.0.24668-001-64b/casapy.

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets, but excluding Pipeline) prior to meeting: 97 (was 104).

Number of CASA Jira tickets with "Ready To Test" status (including EA, EU, JAO, Software-only tickets) following meeting: 97.

Agenda

  • Weights
  • Viewer and PlotMS testing - DAs
    • CAS-6604 - Viewer parent, Some subtasks remain Open.
    • CAS-6605 - Testing mostly to be done by Pipeline group. Some subtasks resolved.
  • Current status of imfit work? CAS-6124 and its subtasks. Brian had reported on this last time. His general sense was that it mostly looked fine at this point, with two lesser issues noted that have spawned tickets. Also, a minor adjustment was requested for the default value of NOISEFWHM. See also CAS-3476 - some discussion of preferred behavior. (A)RTT again. Code appears to work as advertised. Test or close?
  • General reminder to keep an eye PlotMS reliability and report any reproducible issues...
  • The "nag list", "input required" items
  • Other testing items specifically raised?
    • Steve noted a reference frames(?) keyword-related issue with MSs in 4.3 that limits the usefulness of the current 4.3 build for him. Mark R. will ping Jeff for more details, and will discuss it with Darrell if necessary.

New Testing Assignments (see relevant section below)

  • Assignment of any other "To Be Assigned" Items.
  • The next meeting will take place on October 7th.
  • Any Other Business:
    • Jeff: Which 4.2.2 release branch tickets (if any) can be resolved as obsolete?

New Action Items Arising

TBA

PART 1: Items To Be Possibly Covered During Meetings

Propose to Close Items

  • CAS-3476 Reporting of uncertainties in IMFIT. Former 4.2.2 blocker. ARTT in 4.3 (latest commit was r29487). Related to CAS-5879. Tester: Brian (with others). Brian thinks that the code behaves correctly now. Test and/or resolve?
  • CAS-5785 (May 2014): drastic split speed discrepancies depending on whether spw is set or not. Open. Ticket with dev. Known behavior for MSSelection. Some discussion of this item and related topics: split with spw (see also CAS-3666 below). It would be good to be able to select by spw on a large dataset. Will MSTransform have the same problem? Do MMSs help here? Also, Justo's note on this implies that this is a known issue with MSSelection (and not a split problem), but doesn't actually indicate if this is a known issue to be addressed or a known issue that we have to document and just live with. (Steve would also like to be able to do spw selection in asdm2ms - there may well be a separate ticket for this).

Items Overdue for Status Updates (i.e. the "Nag List")

  • CAS-5836 (Nov): 4.3 item. Create new task imrebin. ARTT in casapy-test r29326+. Commit to trunk was r29786. Testable since April... Tester: Adam.
  • CAS-5720 (Oct): 4.2 item. change tooltip for new histogram functionality tool. (A)RTT. Tester: Paul
  • CAS-5191 (Mar): Add gain threshold parameter to fluxscale. ARTT (r28480) in the latest 4.3 casapy-test. Tester: Crystal
  • CAS-6663 (Jun): imfit failure if major or minor axes are set as fixed in the estimates file. ARTT in 4.3. Commit was r30010. Tester: DA (TBD)
  • CAS-5848( 2014): 4.3. enhancements for imsmooth. Subtask of CAS-5844. ARTT (r30554) in 4.3. Tester: Juergen.
  • CAS-5893 (May): 4.3 item. add the ability to write a spectral profile to an ASCII file in the ia tool. ARTT in 4.3. Commit was r29681. Tester: Assigned to Juergen for testing and a possible CSSC discussion. CSSC-directed items noted to Steve, mainly just for reference.
  • CAS-3116 (Jun): Comprehensive computation of spectral index from image(s). Laura Perez had been testing this for the VLA. ALMA will hold off on testing this for now, pending the VLA testing. Some testing done, problems still found. Had been bumped to 4.3. Latest commits are ARTT in 4.3. Tester: Kristina (in discussion with Laura). Jeff had agreed look at this with Kristina to get a better handle on how to go forward with this, which may result in more related tickets being spawned.
  • CAS-3666: split on spws gives errors for different correlation shapes. 4.3 Blocker. Had been stuck On Hold, but is causing problems for the VLA pipeline now, so needs to be fixed as soon as possible. The awaited mstransform and split2 functionality has now been committed. 4.3 item. ARTT in 4.3. Tester: Passed to Steve for reassignment someone in Socorro instead. New split roll-out deferred to 4.3 (see split2 tickets elsewhere on this page). See also above meeting notes on CAS-5785.
  • CAS-6164 Running setjy several times on different source / spw selections sometimes clears previous model data 4.3 Blocker. ARTT in casapytest now. Had previously been resolved, but reopened as it affects EVLA data too. 4.3 item. Tester: Mark Lacy Mark will try to get to this as time permits, but has pipeline release-related issues to address first.
  • CAS-6179 (Jul): 4.3 item. Make a wrapper of hanningsmooth to use the MSTransform framework. ARTT in 4.3. Commit was r30273. Tester: Paul

Items Currently Undergoing Testing

  • CAS-3580 (Aug): 4.3 item. Prediction of expected image based noise based on Tsys. ARTT in 4.3. Tester: Eric V. (to be tested at the JAO).
  • CAS-6220 (Mar): Enable importasdm to read flags from the binary ASDM data. ARTT in 4.3. Commit was r28609. Ticket with Dirk for now. To be tested down in Chile by someone to be identified by Denis. Todd had incidentally tested this while working on something else. Runs to completion (and sometimes generates a lot of INFO messages). Close to done?
  • CAS-6870 (Aug): Plotms: Summary not available prior to plotting. ARTT in 4.3 (r30873+). Tester: Lindsey
  • CAS-6820 (Aug): plotcal crashes when file = gain calibration table and axis = delay. ARTT in 4.3 (r30845+). Tester: Anand
  • CAS-6848 (Aug): imsmooth not reporting output beam correctly. ARTT in 4.3 test package (r30808+). Tester: Nathan
  • CAS-4623 (Aug): SetJy: Method to set Pol Fraction and Angle as Function of Frequency. ARTT in 4.3 test package. Tester: Steve (or perhaps Bryan?)
  • CAS-6733 (Jul/Aug): mstransform on mixed VLA XY/LR data produces an unreadable MS. ARTT in 4.3 (r30738+) in the latest casapy-test package. Subtask of CAS-5245. Tester: Juergen
  • CAS-6073 Feb 2014): 4.3 item. Improve line overlay behavior (in viewer). ARTT in casapy-test 4.3. Tester: Crystal. Previously tested in casapy-test r29326 and already mostly worked. A few additional tweaks still to be checked. Dependent on CAS-6809 (which should itself now be "ARTT" in the same test package).
  • CAS-6459 (May): msmd needs a method to get spw names. 4.3 item. Commit r29685. ARTT again in 4.3 test package. Tester: Nathan.
  • CAS-6693: importfits should warn the user about existence of more than one HDU. Jsut set back to Open again, after initial testing in 4.3 casapy-test. Tester: Todd. Testing ongoing.
  • CAS-6844: plotms huge and fuzzy plot on large plotindex. (A)RTT in latest casapy-test package. Tester: Juergen
  • CAS-6912: makemask copy always replaces image. ARTT in latest casapy-test package. Tester: Juergen
  • CAS-6746 (Aug): 4.3 item. different data flagged based on order of flagdata commands. ARTT in 4.3. Some discussion on this ticket, workaround provided. Tester: Nathan.
  • CAS-6529: MS processed with mstransform not handled correctly by uvcontsub, clean, etc... ARTT in latest casapy-test package. Tester: Kristina

"ARTT" Items Pending Tester Assignment

  • CAS-5359 (May): total integration time calculated incorrectly. Commit r30645. ARTT in 4.3. Tester: DA (TBD) - ticket to go to Anand.
  • CAS-6809 Viewer spectral profile is getting frequency wrong. ARTT in 4.3 in the latest casapy-test package. Tester: DA (TBD) - ticket to go to Anand.
  • CAS-6807 spectrum doesn't do K correctly or even consistently. ARTT in 4.3 in the latest casapy-test package. Ticket parked with Mark R. for now. Tester: DA (TBD) - ticket to go to Anand.
  • CAS-6817 (Aug): Add a name() method to msmd tool. Commit r30732. ARTT in the latest 4.3 casapy-test package. Ticket parked with Mark R. for now. Tester: Nathan
  • CAS-6840 plotms exprange does not work. ARTT in 4.3, pending a new casapy-test package. Ticket parked with developer for now. Tester: TBD. Maybe we just need to say what it does. make sure that r30847 makes it into the 4.2.2 Pipeline Release build. Mark R. to ping Lindsey and/or Brian to check if it works acceptably for them.
  • CAS-6178 (Sep): Make a wrapper of split to use the MSTransform framework. ARTT in casapy-test 4.3. Tester: TBD. (Scientist needed. Big item?) To be tested by data reducers as available (needs manual reduction datasets, or a modified pipeline). Mark R. may also try pinging Anita to see if she has any spare cycles. Following the meeting, Mark L. has assigned Drew Brisbin a dataset to reduce that can probably be used for this purpose, so this ticket will provisionally go to him.
  • CAS-6706 (Sep): mstransform problems with SOURCE sub-table when creating an MMS. ARTT in 4.3. Tester: TBD. Not sure who'd be a suitable specialist for this. Mark R. will sound out Crystal in case she has any ideas.
  • CAS-6707 (Sep): mstransform problems with CALDEVICE and SYSPOWER sub-tables when creating an MMS. ARTT in 4.3. Tester: TBD. Not sure who'd be a suitable specialist for this. Mark R. will sound out Crystal in case she has any ideas.
  • CAS-6729 (Sep): Update ATM library in CASA 4.3. ARTT in 4.3. Tester: Todd(?). Maybe Todd can comment on this (he's done ATM plotting, etc.). Failing that, then there is an action Item on Mark R. to ping the ticket for advice on how to test, and proceed from there.

Single Dish (to be skipped during the meeting)

  • CAS-5139 (Sep): Proper handling of flag information in sideband separation algorithm. Low priority item. Subtask of CAS-1756. Currently ARTT; 4.2.2+ item. Tester: Bunyo. Testing ongoing.
  • CAS-6121 (Jan): sdgrid: 4.3 item. Latitude value in resulting scantable is reversed. ARTT. Tester: was Shinya, passed to Bunyo. Testing ongoing.

Input Required

  • CAS-4735 (Nov): imsmooth needs additional option for single dish use. Subtask of CAS-5844 (above). Open again. Tester: Tsuyoshi. Critical item. Code committed to trunk. 4.3 item. Some testing done, mostly works as intended. Input Required from Crystal for some remaining changes.
  • CAS-3335 (May 2014): parallelized gaincal fails when trying to create scratch columns. Input Required from Claire (since May).
  • CAS-5162 (Sep 2013): Improvements in flagging documentation and examples. Input Required from Science (via Jeff). This ticket has been left untouched since May 2013...
  • CAS-5942: toggle warning messages in ia tool . Input Required. Ticket passed to Remy to work with the developer on this. Ticket pinged in early August. Now pushed back to being a 4.4 item.
  • CAS-4049: Fold SpectralFitter into ImageProfileFitter. Input Required (was "On Hold"). Passed to Andy Hale for input. Ticket pinged. Pushed back to 4.4.
  • CAS-6124: imfit subtasks:
    • CAS-4538: migrate imfit input estimates from file to input parameters. Input Required (was "On Hold"). Subtask of CAS-6124. Ticket passed to Juergen, pending a CSSC discussion of what needs to be done and a scheduling of the work. Pushed back to 4.4.
    • CAS-6234: imfit estimates should allow sky coordinates in addition to pixel values. Input Required (was "On Hold"). Subtask of CAS-6124. Ticket with Juergen, pending a CSSC discussion of what needs to be done and a scheduling of the work. Pushed back to 4.4.
  • CAS-5996: immath unit- (and if relevant beam-) awareness. Input Required. Ticket with Juergen, pending a CSSC discussion of what needs to be done. Pushed back to 4.4.
  • CAS-5597: CRTF doco improvements. Input Required. Ticket with Juergen.
  • CAS-6925: Color Postscript isn't. Input Required. Ticket with Remy. Seems to happen for unsupported Linuxes. Unclear yet for tarball installations of RHEL6. Question: if it's OK on that, can we just flag it as a known issue?
  • CAS-5488: include beam size in header of SD image. Input Required. Ticket with Cat. EOC will provide input.
  • CAS-6826: wvrgcal should have an option to automatically interpolate over antennas with high discrepancy values. *Input Required." Ticket with Dirk. Dependent on CAS-5897

Other Blockers

  • CAS-5806 Mathematical prediction of post-gridding single dish beam. 4.3+ Blocker. Developer has done some modelling, but... ? This is a "blocker of a different kind..." High priority (blocking further development). Currently Open. Crystal and Kumar had been in discussion, but this ticket has been quiet for several months now.


PART 2: Items Listed for Informational Purposes (note that these will not normally be specifically discussed during the meeting unless someone raises them)

Unable to Test Items

  • CAS-5844(Dec 2013): 4.3 imsmooth specification and testing targets. Container ticket only - see its subtasks (including CAS-4735 which is "ARTT"). Currently "Open" and assigned to developer. Will be resolved when all subtasks are done.
  • CAS-6433 (Apr): Implement a function to derive Jy/K factor from amplitude calibrator observation. Open. Currently with developer. Targeted for Nov Pipeline release.
  • CAS-5379 - Subtle inconsistencies with other programs in Galactic Coordinates (Adam and Harvey). In a nutshell, shifts of ~0.2" are seen when taking data into other packages (e.g. DS9, IDL which both seem to agree with each other). It is unclear yet if this is an incorrect implementation in one or more packages, or possibly just a precision error. This is a subtle issue, and was pushed back to 4.3. Ticket stalled. Needs to be looked at by someone with lots of time. To be left as-is for now. This needs significant work, including new science papers on how to actually define the Galactic coordinate system? Needs casacore discussion; this can be part of that. Passed to Jeff for now. Pushed back to 4.4 (at the earliest).
  • CAS-4636 (Oct 2012): Elevation dependent opacity application w/ Tsys. Still awaiting input from Science (since February). Had been "On Hold" since August, awaiting data. Switched to Input Required and passed to Crystal for comment. Bumped back to 4.3. Placed "On Hold" (in February) until further notice.
  • CAS-4469 (Jun+ 2013): Split with channel averaging is creating spurious spectral features and weight is wrong when there has been channel flagging. Subtask of CAS-5245. Had been "On Hold", with Crystal as the tester. This should be addressable as soon as the weights spectrum handling comes online as part of 4.3. Currently set to Open again, and parked with Mark R. for now. It cannot be user tested until weight spectrum is fixed (a CASA 4.3 item). Are we getting close to having to think about this one again, yet?
  • CAS-5879 include pixel rms in imfit fitting. Open. Subtask of CAS-6124. Currently with Claire, but testing has paused, as it has additional dependencies (e.g. CAS-3476). 4.3 item.
  • CAS-5084 (May): Testing multi-term support in pclean. Lots of feedback supplied by Kristina and Claire. On Hold (since August 2013) and assigned to Kumar pending class refactoring. To be left on hold, pending the refactor.
  • CAS-2988 (May): Make importasdm and MeasTable work with the JPL Horizon ephemerides for solar system objects via the "COMET" mechanism of Measures. Currently flagged as RTT in 4.3, but awaiting ASDMs with ephemeris tables and diameter information in the Source table. Discussion ongoing. Tester: Dirk.

Upcoming Ready to (Re)Test Items

Not Yet Assigned To Testers

  • CAS-6921 (Sep): plotms(coloraxis='chan') does not work, but it does not issue an error either. RTT (r31028+) in casapy-test, pending a new package. Tester: TBD (DA?)
  • CAS-6837 (Sep): makemask doesn't work with regions, and cookbook is wrong. RTT (r31038+) in casapy-test, pending a new package. Tester: TBD (DA?)
  • CAS-6835 (Sep): Make a wrapper of cvel to use the MSTransform framework RTT (r31057+) in casapy-test, pending a new package. Tester: TBD (Scientist?)
  • CAS-6919 (Sep): A timesforintent method would be useful in msmd. RTT (r31083+) in casapy-test, pending a new package. Tester: TBD

Single Dish

See below "assigned" SD list.

Already Assigned To Testers

  • CAS-6751 (Jul): 4.2.2 item. Next iteration button causes plotms to crash. RTT in casapy-test again, pending a new package. Tester: Tester: Nathan
  • CAS-6753: Plotms wrapper gets stuck. Subtask of CAS-6605. RTT (r31048+) in casapy-test, pending a new casapy-test package. Tester: Dirk Muders
  • CAS-6346: sdimaging creates a blank image if one of the correlations is flagged. RTT in casapy-test. Tester: Crystal
  • CAS-5689 (Aug): spectral fitting results seem off Open again in 4.3, and back with developer. Tester: Dirk
  • CAS-6232 (Mar): writing version numbers in GUIs. Open in 4.3. Most recent commit to trunk was r29373. Tester: Juergen. Ticket pinged for an update.
  • CAS-6802 (May): typo in the help for plotms (averagedata) "Open" again in 4.3, pending a newer test package. Tester: Mark R.
  • CAS-4592: plotms on 10.7 issues. Half fixed due to Qt updates. Was "ARTT" in 4.2.1 and 4.2.2 pre-release. On Hold now, pending availability of a 10.8 Mac for the developer. Tester: Nathan
  • CAS-3532 (Sep): Incorporation of Alma Primary Beam in Mosaic. Was ARTT. Tester was Scott S., but ticket passed to Crystal for input. Some test imaging done. Switched from "Input Required" to Open and passed over to Kumar for more work from him. Ticket pinged.
  • CAS-5334 (Feb): Ellipse regions have wrong width (RA). Second fix committed. Was ARTT in previous casapy-test (r29326), set back to Open for input from developer. Tester: Paul.
  • CAS-5731 (Oct): Loading DS9 region files into the viewer produces a warning and does not load. Open; 4.3 item. Ticket back with developer. Tester: Jen.
  • CAS-3517 (Aug): Improve remapping interface (Cal libraries). Input Required from developer. Tester: Steve. Some testing done, recommendations made, ticket back with developer. Discussion ongoing. Further callibrary work to be pushed out to 4.4 in Jira. Ticket pinged a few times now, on the period of about once/month...
  • CAS-4663 (Oct 2012): specfit components/prompt/inf. On hold (following input from Juergen). Slated for work, but expensive in terms of effort, so not a priority right now.
  • CAS-5127 (May): Document ia toolkit methods. Status In Progress. Mark is working on this. Most of Juergen's prioritized list of 26 items has been done. Dates to be added his future documentation updates. Prioritized by Mark. Ongoing. ia.regrid docs will require more work. Still needs code commits. Mark waiting on OS X 10.7 build. Bumped to 4.3 release, due to OS X-based build issues. Mark should be able to work on this under Linux instead soon.

Single Dish

  • CAS-6346 (Sep): sdimaging creates a blank image if one of the correlations is flagged. 4.3 item. RTT in 4.3, pending s new casapy-test package. Commit was r31039. Ticket passed to Bunyo. Tester: TBD

  • CAS-6243: sdimaging does not accept type numpy.string_ for fieldid. 4.3 item. ARTT in 4.3. Commit was r29988. Discussion ongoing. Tester: Todd.
  • CAS-6585 (Jul): proper flagging information handling in sdcal2. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD. Testing to to be combined with that of CAS-6571
  • CAS-6571 (Jul): Take flag into account in single dish Tsys calibration table. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD. Testing to to be combined with that of CAS-6585
  • CAS-6109 (Jul): sdlist: time range shift in scantable summary when scanavarege=True. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6591 (Jul): proper flagging information handling in sdimaging. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6599 (Jul): proper flagging information handling in sdstat. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6592 (Jul): proper flagging information handling in sdimprocess. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6597 (Jul): proper flagging information handling in sdsave. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6594 (Jul): proper flagging information handling in sdmath. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6593 (Jul): proper flagging information handling in sdlist. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6583 (Jul): proper flagging information handling in sdbaseline. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6586 (Jun): proper flagging information handling in sdcoadd. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6589 (Jun): proper flagging information handling in sdflagmanager. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6588 (Jun): proper flagging information handling in sdflag. Subtask of CAS-1756. Currently ARTT; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6598 (Jun): proper flagging information handling in sdscale. Subtask of CAS-1756. Marked as ARTT by developer; 4.3 item. Ticket passed to Bunyo. Tester: TBD
  • CAS-6564 (Jul): sdplot: improper tick interval in plottype='azel'. ARTT in 4.3 casapy-test package. Passed to Bunyo for testing assignment.
  • CAS-6859 (Aug): Use new sdimaging task in simanalyze and simalma. ARTT in 4.3 casapy-test package. Passed to Bunyo for testing assignment.
  • CAS-6467 (Aug): sdimaging uses the observatory position in AZEL-to-RADEC conversion. ARTT in 4.3 test package. Passed to Bunyo for testing assignment (probably Tsuyoshi?).
  • CAS-6348: sdmath needs non-nullstring for output file name. ARTT in 4.3 casapy-test package. Ticket with Bunyo.
  • CAS-6795: spw by list does not work in sdimaging. RTT in 4.3, pending a new test package. Ticket with Bunyo.
  • CAS-6702: Provide a way to select data by scan row in raster mapping. ARTT in latest 4.3 casapy-test package. Tester: Tsuyoshi.
  • CAS-6572: (Aug): A new baseline task that handles baseline table. ARTT in latest 4.3 casapy-test package. Mostly done. Ticket with Wataru/Kana.
  • CAS-6168: enable plotter2 to change viewport size. ARTT (ASAP r2895) in casapy-test (r29326). Ticket with Takeshi. To be tested after 4.2.2 release.
  • CAS-6582 (Jun): proper flagging information handling in sdaverage. Subtask of CAS-1756. Currently ARTT (r30796+) in latest casapy-test package; 4.3 item. Ticket passed to Bunyo. Tester: TBD

-- MarkRawlings - 2014-09-11
Topic revision: r8 - 2014-10-01, MarkRawlings
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback