Procedure for Pipeline Testing

This wiki is outdated.

This page documents the procedure for testing pipeline data that is not being delivered to a PI. For the pipeline test procedure relevant to data that may be delivered, see Cycle1DataReductionWorkflow (Cycle 1).

Cycle 0 Data

A list of cycle 0 data sets that will be used for pipeline testing are maintained by Todd Hunter. See, PipelineTestingSep2013, PipelineTestingMay2013.

Pipeline Procedure

  1. Extract data using pipelineMakeRequest.
  2. Comment out all ASDMs except the one request in Todd's wiki table.
  3. If the data contain null coordinates for a solar system flux calibrator:
    1. Modify PPR to perform only hif_importdata.
    2. Execute the pipeline.
    3. Start casapy and run fixplanets, specifying the field and setting fixuvw=T .
    4. Revert the PPR procedure to its original state.
  4. Edit the PPR to make the refant agree with the manual reducer's refant:
    <ProcessingCommand>
        <Command>hif_refant</Command>
        <ParameterSet>
            <Parameter>
                <Keyword>hm_refant</Keyword>
                <Value>manual</Value>
            </Parameter>
            <Parameter>
                <Keyword>refant</Keyword>
                <Value>DV05</Value>
            </Parameter>
        </ParameterSet>
    </ProcessingCommand> 
    
  5. Edit the PPR to import tables required for Todd's sideband ratio plot: (NOT YET TESTED)
    <ProcessingCommand>
        <Command>hif_importdata</Command>
        <ParameterSet>
            <Parameter>
                <Keyword>asis</Keyword>
                <Value>Station Receiver CalAtmosphere CalData</Value>
            </Parameter>
        </ParameterSet>
    </ProcessingCommand>
    
  6. Execute the pipeline.
  7. Copy the total run time from the pipeline weblog front page to the status column of Todd's wiki table. Calculate the total runtime without imaging. The imaging time can be obtained from the web log, on the hif_makecleanlist and hif_cleanlist pages. Runtimes can also be calculated directly from the casapy log. (The total runtime for the same dataset using the May2013 pipeline release needs to be added to the May wiki table.)
  8. Run analyzemscal with the appropriate manualcaldir and with webarea = True, webpagedir = 'Sep2013_heuristics', plotlevel = 2 .
  9. When AMC is finished, verify the output and add the AMC version to Todd's wiki table.

This topic: ALMA/NAASC > NAASCDataAnalysts > PipelineTestProcedure
Topic revision: 2015-09-01, JaredCrossley
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback