Monday Morning Meeting July 28th, 2014

  • DIAL-IN NUMBERS & PASSCODES:
  • USA Toll Free Number: 866-901-8266
  • USA Toll Number: +1-203-566-3863
  • PARTICIPANT PASSCODE: 725760

Attendance

  • Socorro: Jeff, Rob, Tak, Lindsey, Susan, Kumar, Sanjay, Urvashi, Jim
  • CV: Darrell, David, Andy,
  • Garching: Justo, Sandra, Dirk,
  • SCO:

News / Meetings / Visitors

  • NAOJ Developers arriving today
    • Should we change repository

Build, Release, Testing

  • 4.2.2 Status
    • Sometimes the plotMS gets stuck
      • Issues about how plotMS and globals interact
    • Plot Bandpass can go into an infinite loop
    • Visstat is fundamentally flawed, tries to hold full set in memory.
    • SetJy Issues
  • OSX Primary build will be 10.8
  • Linux Testbuild: Darrell to kick it off

Architecture

  • Technical Forums:

Development

  • ALMA FPS MRB

Pipeline

AOB

Developer Reports

Monday Meeting
  • Sanjay Bhatnagar
    • Fixing issues in AW-Project FT Mac
    • Moving Imager to VI/VB2 Framework
    • Jira ticket which is not a bugg
  • Sandra Castro
    • Lengthy debugging of supposedly flagdata problem in MS with inconsistent FLAG_ROW=True and FLAG_cube=True. Justo and I have both tested different parts of flagdata and VI/VB2 and it seems that the problem is of data corruption. In two reported problems, the problem can be resolved if the spw selection is removed from the call to flagdata(vis,spw='1~22',autocorr=True) in the a priori flagging steps. The spw selection is redundant in this case because autocorr=True will automatically exclude any non-CORRELATION data from the flagging. On the other hand, in one report, the problem is also solved if mstransform is used instead of split, right before the last batch of flag calls. See Justo's report for the latest findings.
    • Another lengthy debugging of a seg. fault in visstat. After struggling to copy the MS to ESO (running out of disk space), the problem seems to be lack of resources. The task accumulates the whole data cube in order to calculate the median and runs out of memory when resizing a Vector. There is no quick solution for this problem and in my opinion, visstat needs to be re-factored to use the VI/VB2 (to make use of the rowBlocking). There is also the need of full requirements from the pipeline. Do they need the median of the entire data column to be calculated?
  • Lindsey Davis
    • Vacation
    • Follow up on pipeline release bugs and issues
    • Fixes to pipeline task CASA interface, BDF flags handling, output image names
    • Pipeline patch released
    • CTF presentation
    • Infrastructure, OODT discussions
  • Kumar Golap
    • Fixed virtual model vis to handle the case when SOURCE_ID=-1 in the FIELD table
    • worked to make a brnch for vi2/vb2 conversion of imaging code
    • consensus that we should do it for refactored imager only as amount of work to convert existing imager is huge ; thus branching is unnecessary
    • made a TransformMachine2 directory to have the vi2/vb2 ftmachine and related classes
  • Justo Gonz├ílez Villalba
    • CAS-6746 (FLAG_ROW/FLAG cube inconsistencies):
      • Verified that the problem is not related with FlagData heuristics, MSSelection issues, or slicer usage in VI/VB.
      • Detected some unexpected sorting order in the MSs affected (data is not time-sorted within sub-scans:
        • Reported to Michel Calliac the unexpected sorting order produced by asdm2MS (in other ALMA regressions which are not affected by this bug we see the usual time sorting order within sub-scans).
        • Apart from potential relation with data corruption problem, the non-time sorted pattern that asdm2MS is producing for the affected MS typically leads to non-contiguous data access and has a big impact of data processing speed.
      • Found evidence data corruption in the SORTED_TABLE of the affected MSs:
        • SORTED_TABLE does not have the some number of rows as the original in the affected MSs
        • Currently in the process of finding out why SORTED_TABLE gets corrupted
  • Jim Jacobs
    • Fixed performance issue in VI/VB2
  • Jeff Kern
    • OODT Deployment Design
    • Pipeline Imaging Meeting
    • Governance Document / Meet with PMD
  • Susan Loveland
    • Worked on viewer and plotms bugs.
    • Worked on CARTA
  • David Mehringer
    • Fixed ia.fitprofile()/specfit issue in which fit results were not reproducable from one run to another in some cases, CAS-6742.
    • Continued work on image statistic filters design, consulted with Rob re: requirements.
    • Implemented convolve-using-image in imsmooth, CAS-5844.
    • Implemented msmd.pointingdirection(), CAS-5878.
    • Completed implementation for imhead support for NCP projection, CAS-6568.
    • Provided input for the requirements of the new build and test system, CAS-6788.
    • Attended CTF.
    • Fixed imregrid bug in which image rotation was being performed incorrectly in the opposite direction when converting between direction reference frames and the longitudinal pixel increment was positive, CAS-6533.
  • George Moellenbrock
  • Dirk Petry
    • FITS File Processing
  • Urvashi Rao
    • VI/VB2 Porting in Imaging
  • Darrell Schiebel
    • new 4.2.2 release candidate for linux
    • checked out osx application structure
    • wrote script to collect dependencies from binaries and python modules (for creating OSX app)
    • corrected one errant dependency (but still others remain)
  • Rob Selina
    • Trying to close on open items related to robust noise estimating algorithms in imstat.
    • 4.3 status chart update for the CSSC (will be used to give them a status before they comment on 4.4 priorities).
    • More existing H/W infrastructure research, with a focus on OSX development machines. Will have a catalog of all our shared hardware on the web soon.
  • Takahiro Tsutsumi
    • Switched the calls in BuildCoordinateSystem () from SubMS::calcChanFreq (and combineSpws) to the corresponding methods in MSTransform
    • Mask handling in the refactored Imager. Moving some of the existing C++ and Python code related mask generation to the refactored Imager code
    • Added some descriptions of the 'setpol' parameters in in-line help for setjy
    • Looked at a new setjy selection issue reported on CAS-5941
Friday NAOJ Meeting
  • Kanako Sugimoto
  • Wataru Kawasaki
  • Takeshi Nakazato
  • Shinnosuke Kawakami
-- TakTsutsumi - 2014-07-25
Topic revision: r12 - 2014-07-28, JeffKern
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback