Testing of May 2013 heuristics

*Note: If the link to the analyzemscal result is broken, this project has not been run through the new pipeline yet.*

# Project ARC SCOPS Obs. Date Band Type (spw BW in MHz) #Antennas
(low gain)
Flux cal
(antennas)
OUS ASDM=EID (linked to analyzemscal results) Status,
version
Pipeline reducer Manual reducer, refantSorted ascending Notes Suspect pointing Flagging
25
2011.0.00319.S
EU
266
17-Jun-2012
6 (mosaic)
FDM (1875)
19
Mars,
ra,dec=0,0
uid://A001/X74/X23c
sharps2_limit=0.1: uid___A002_X435875_X204
sharps2_limit=0.3: uid___A002_X435875_X204
done, v1.297
Todd
 
DV15 has birdies
 
WVR: DV15
26
9999.4.00013.CSV
JAO
118 flux track
27-Jan-2012
3
TDM
17
Mars,
ra,dec=0,0
uid://A002/X327408/X1c0
done, v1.317
Todd
 
 
 
WVR: DV15
27
2011.0.00053.CSV
JAO
130 flux track
06-Jun-2012
7
TDM
18
Neptune,
ra,dec=0,0
uid://A002/X3ff4ae/X7c
pipeline failed on gaincal intint BANDPASS: ParseException: Expected W:(0123...) (at char 0), (line:1, col:1)
Todd
 
J1924 has wrong coordinates; tried to use J1700-261 as next brightest
 
 
28
2012.1.00912.S
NA
336
24-Jan-2013
3
TDM
32
 
uid://A002/X5a9a13/X528
done, v1.343
Todd
 
tsysspwmap fails with tsysChanTol=1
 
WVR: DV23
11
2011.0.00476
NA
203
28-Jul-2012
3
FDM (1875)
25 (1)
Titan, 152.6" from Saturn,
pipeline/manual=1.042
uid://A002/X391d0b/X183

pipeline done, v1.251 (NameError: global name 'msmdtool' is not defined)

pipeline runtime=2:12:32

Dongchan
Adam, DV04
file permission error on manual reduction directory.
 
WVR: none
19
2011.0.00978 = 00399
NA
246
20-Nov-2012
7
FDM (58)
25 (2)
Ceres
pipeline/manual=1.119
uid://A002/X327408/X34f
done, v1.260 duration=3:02:59
Paul
Adam, DV04
 
none
WVR: none
10
2011.0.00476
NA
203
09-May-2012
3
FDM (1875)
16 (0)
Titan, 194 arcsec from Saturn,
pipeline/manual=1.046
uid://A002/X391d0b/X183
uid___A002_X3fdb4f_X78c, Todd's version with Tsys spike flagging: uid___A002_X3fdb4f_X78c

pipeline done, v1.259 (file permission error)

pipeline runtime=1:32:29 (Tsys spike flagging), 1:38:54

Dongchan
Adam, DV12
file permission error on manual reduction directory.
none
WVR: DV15
18
2011.0.00978 = 00399
NA
246
20-May-2012
7
FDM (58)
16 (0)
Titan,
71.8 arcsec from Saturn
pipeline/manual=1.449
uid://A002/X327408/X34f
done. v1.257 runtime = 1:33:46
Paul
Adam, DV12
 
none
WVR: none
24
2011.0.00206.S
NA
198
27-Mar-2012
6
TDM
15 (4)
Titan,
77 arcsec from Saturn
uid://A002/X391d0b/X1e
done, v1.252
Nuria
Amy
 
 
WVR: DV15
2
2011.0.00142
NA
167
16-Jun-2012
6
TDM
22
Neptune (11/22) ra,dec=(0,0), pipeline/manual=0.938
uid://A002/X327408/X313
done, v1.268
Andy
Brenda, DV04
 
none
WVR: none
9
2011.0.00397
NA
49
28-Aug-2012
7
TDM
27 (2)
Titan (unresolved), 164 arcsec from Saturn, pipeline/manual=1.000
uid://A001/X74/X231
done, v1.244
Paul
Carol, DV04
 
none
WVR: none
6
2011.0.00348
NA
238
18-Dec-2012
3
FDM (1875)
28 (1)
Ceres (unresolved)
uid://A002/X391d0b/X280
done, v1.297
Crystal
Crystal, DV04
 
DV01, DV23, DV24
WVR = none
7
2011.0.00348
NA
238
16-Dec-2012
3
FDM (1875)
25 (0)
Ceres (unresolved), pipeline/manual=1.114
uid://A002/X391d0b/X280
done, v1.255 (plotbandpass issue)
Crystal
Crystal, DV04
spw15 Tsys derivative
DV23, DV24
WVR: none
12
2011.0.00526
NA
5
16-Dec-2012
7
FDM (1875)
21
Titan (unresolved)
115.6" from Saturn,
pipeline/manual=1.047
uid://A001/X74/X186
Failed: brackets in field names
Crystal
Crystal, DV04
 
DV01, DV23, DV24
 
8
2011.0.00348
NA
238
05-May-2012
3
FDM (1875)
16 (0)
J085448+200647, pipeline=manual=0.115
uid://A002/X391d0b/X280
done, v1.297
Crystal
Crystal, DV12
 
PM02
WVR: DV15
1
2011.0.00010
NA
129
24-Jan-2012
6
FDM (1875)
17 (0)
Titan (unresolved), 107 arcsec from Saturn, pipeline/manual=0.998
uid://A002/X327408/X217
done, v1.243; runtime = 1:02:41
Anand
Ed, DV05
 
none
WVR: none
14
2011.0.00652
NA
189
09-May-2012
3
2 TDM
16 (0)
Mars (0/16)
ra,dec=(0,0)
pipeline/manual=1.025
uid://A002/X3216af/Xa
done, v1.297
Todd
Jim Braatz, DV12
 
none
WVR: DV15
13
2011.0.00539
NA
114
13-Jul-2012
7
TDM
18
Callisto (10/18),
450 arcsec from Jupiter,
pipeline/manual=0.845
uid://A002/X391d0b/X16d
done, v1.267 runtime = 0:39:36
Paul
John Hibbard, DV04
 
none
WVR: none
5
2011.0.00243
NA
243
16-Jun-2012
6
TDM
21
Uranus (8/21) radec=(0,0), pipeline/manual=0.995
uid://A002/X3ff4ae/X38

done, v1.262 (Exception Reported: CasaPyInterpreter: From Python)

Pipeline runtime=0:36:46

Dongchan
Mark Lacy, DV04
 
none
WVR: none
23
2011.0.00511
NA
112
18-Jun-2012
7
FDM (937)
19
Callisto,
314 arcsec from Jupiter
uid://A002/X391d0b/X101

done, v1.271 (some plots are missing)

pipeline runtime=1:13:29

Dongchan
Nuria (Dongchan re-reduced), DV04
archive broken (execblock_status=broken)
 
WVR: none
20
2011.0.00511
NA
112
27-Jul-2012
7
FDM (937)
23
Callisto,
315 arcsec from Jupiter
pipeline/manual=0.867
uid://A002/X391d0b/X101
done, v1.267, some plots from manual redu missing
Nuria
Nuria, DV04
 
DV02, PM02
WVR: none
21
2011.0.00150
NA
119
16-Nov-2012
7
FDM (1875)
28 (2)
Callisto,
599 arcsec from Jupiter
pipeline/manual=0.856
uid://A002/X327408/X37
done, v1.262
Nuria
Nuria, DV19
Tsys bandpass shape issue (CSV-1807), manual reduction used the phase cal as bandpass. Pipeline results flagging affected tsys: uid___A002_X54d35d_X664
none
WVR: none
4
2011.0.00175
NA
166
09-May-2012
7
TDM
16 (2)
Titan (13/16), 195 arcsec from Saturn, pipeline/manual=0.994
uid://A002/X327408/X276

done, v1.241 (Exception Reported: CasaPyInterpreter: From Python)

Pipeline runtime=0:46:03

Dongchan
Schnee/Wootten,DV12
 
none
WVR: DV15
22
2011.0.00150
NA
119
17-Nov-2012
6
FDM (1875)
27
Callisto,
477 arcsec from Jupiter, pipeline/manual=0.984
uid://A002/X327408/X3b
done, v1.297
Todd
Scott, DV19
 
none
WVR: none
15
2011.0.00747
NA
83
28-Aug-2012
9
TDM
27
Neptune
ra,dec=(0,0)
pipeline/manual=38.85
uid://A001/X74/X130
uid___A002_X4b58a4_X31, Todd's run with tsysflagchans metric=median: uid___A002_X4b58a4_X31
done, v1.268 pipeline run time=1h 19m (run time2=52m)
Andy
Todd, DV04
 
none
WVR: none
16
2011.0.00958
NA
51
14-Aug-2012
7
TDM
22 (1)
Neptune
ra,dec=(0,0)
pipeline/manual=0.943
uid://A002/X314ea1/X231
done, v1.255; runtime = 0:27:39
Anand
Todd, DV04
 
none
WVR: none
17
2011.0.00958
NA
51
13-Aug-2012
7
TDM
25 (2)
Neptune
radec=(0,0)
uid://A002/X314ea1/X233
done, v1.263
Todd
Todd, DV04
 
 
WVR: none
3
2011.0.00150
NA
119
16-Nov-2012
7
FDM (1875)
28 (3)
Callisto (16/28), 596 arcsec from Jupiter, pipeline/manual=0.857, intent=AMPLI
uid://A002/X327408/X3d
done, v1.297
Todd
Todd, DV19
wvrflags DV13, not warranted
none
WVR: DV13

If any antennas were flagged by hif_wvrgcalflag, please include them in the Notes column.

After analyzemscal runs successfully, please include the version number in the Status column.

# Project ARC SCOPS Obs. Date Band Type (narrowest spw) #Antennas
(low gain)
Flux cal OUS ASDM=EID (linked to analyzsemscal results) Status Pipeline reducer Manual reducer Notes Suspect pointing Flagging
1
2012.1.00185.S
NA
356
15-Mar-2013
3
2TDM,2FDM (1875)
34 (2)
Titan, 153 arcsec from Saturn, intent=AMPLI
uid://A002/X5a9a13/X726
success, v1.297
Hunter
n/a
 
 
WVR: DV18, DV15
2
2012.1.00989.S
NA
364
25-Jan-2013
6
4TDM
29
J0334-401, intent=AMPLI
uid://A002/X5a9a13/X141
success, v1.310
Hunter
n/a
 
 
WVR: none
3
2012.1.00096.CSV
JAO
31-Jan-2013
3
1TDM,3FDM (234)
30 (1)
J1107-448, intent=AMPLI
uid://A002/X5a9a13/X6ca
success, v1.297
Hunter
Hunter
2/3 of antennas are flagged for Tsys on phase cal. Good test of tmf1=0.666
 
WVR: none
4
2012.1.00118.CSV
JAO
13-Apr-2013
3
1TDM,3FDM (234)
25 (2)
Titan, 65 arcsec from Saturn, intent=AMPLI,FLUX
uid://A002/X5d9e5c/X3cb
success, v1.297
Hunter
Hunter
See CSV-2757, lots of examples of low amplitude at beginning of scans
 
WVR: none
5
2012.1.00762.S
EA
348
28-Jan-2013
3 (ACA)
FDM (1000)
9 (1)
J1107-448, intent=AMPLI
uid://A002/X5a9a13/X68b
success, v1.308
Hunter
n/a
 
 
WVR: no WVRs
6
2011.0.00054.CSV
JAO
 
16-apr-2013
3
TDM
24
Titan, 156 arcsec from Saturn, intent=AMPLI,AMPLI
uid://A002/X576a5e/X1e
 
 
Nuria
Calsurvey run manual results
 
 
7
2011.0.00054.CSV
JAO
 
16-apr-2013
7
TDM
24
Titan, 156 arcsec from Saturn, intent=AMPLI,AMPLI
uid://A002/X576a5e/X1e
 
 
Nuria, DA51
Calsurvey run manual results. Previous pipeline results (v 1.197) using DV01 as reference.
 
 
8
0000.0.00099.CSV
JAO
 
22-Apr-2013
3 (ACA)
FDM (125)
9
Titan,
91.5 arcsec from Saturn
pipeline/manual=1.449, intent=AMPLI,FLUX
uid://A002/X5d9e5c/X1f4
success, v1.310
Hunter
Scott, CM02
7m array
none
WVR: no WVRs
9
0000.0.00099.CSV
JAO
 
16-Apr-2013
3
3FDM,1TDM (117)
25
Titan,
163 arcsec from Saturn, intent=AMPLI,FLUX
uid://A002/X5d9e5c/X1ed
Success, v1.297
Scott, then Todd
Scott
250ps delay issues! Needs tsysChanTol=1
 
WVR: DV19, DV18, DA49, DV11, DA47, DV01
10
2011.0.00054.CSV
JAO
 
16-apr-2013
7 (ACA)
TDM
10
Titan,
165 arcsec from Saturn, intent=AMPLI,AMPLI
uid://A002/X5d9e5c/Xa1
 
 
Nuria
Calsurvey run manual results
 
WVR: no WVRs
11
0000.0.00083.CSV
JAO
 
11-May-2013
3 (ACA)
FDM (1992)
8 (mosaic)
none!
uid://A002/X5d9e5c/X64
Done, v1.308. But need to re-run with intentgroups=['*ATMOSPHERE*']. Final hif_tsysflag bombs with: IndexError: tuple index out of range
Scott
 
Tsys spike, good one to test new heuristics on
 
WVR: no WVRs
12
2012.1.00124.CSV
JAO
 
17-May-2013
6
FDM (117)
34
Titan
uid://A002/X639a2a/X66

Done, v1.268 (ERROR: An unexpected error occurred while tokenizing input)

pipeline runtime=1:56:31

Dongchan
 
 
 
WVR: DV15
13
2012.1.00229.S
NA
 
03-June-2013
7 (pointing with 6)
1FDM,3TDM (468)
35 (13)
J2232+117
uid://A002/X628157/Xd1
success, v1.247
Scott
 
WVR on DV23 (antenna 31) has high scatter
 
WVR: DV23
14
0000.0.00089.CSV
JAO
 
26-Mar-2013
3
3FDM,1TDM (117)
23
3c279
uid://A002/X5d9e5c/Xdd
success, v1.297
Todd
 
spike in Tsys
 
WVR: DV18, DA47, DV23, DV15, DV01
15
0000.0.00125.CSV
DDT
 
08-Jun-2013
3
4TDM
32
Neptune
uid://A002/X6610eb/X21
success, v1.297
Todd
Al, DV05
not all high Tsys values flagged, Neptune has 2 field IDs
 
WVR: DV15, DV23
16
0000.0.00125.CSV
DDT
 
08-Jun-2013
3
4TDM
32
Neptune
uid://A002/X6610eb/X21
success, v1.297
Todd
Al, DV05
DA44 spw13 Tsys has ripples on one edge, but not flagged
 
WVR: none
17
2012.1.00139.S
EA
 
01-Jun-2013
7
4TDM
30
3, Titan plus 2 quasars
uid://A002/X5a9a13/Xf1
success, v1.297
Todd
 
Titan flagged on 19/30 antennas for Tsys, 96% overall
 
WVR: none
18
2012.1.00139.S
EA
 
01-Jun-2013
7
4TDM
30
3, Titan plus 2 quasars
uid://A002/X5a9a13/Xf5
success, v1.297
Todd
 
Titan flagged on 19/30 antenans for Tsys
 
WVR: DV15, DV23
19
phase V test dataset
NA
 
12-Mar-2013
3
3TDM,1FDM (117)
34
Titan
uid://A002/X5a9a13/X12c
 
 
 
 
 
WVR: DV18, DA48, DV15, DV25, DV01
20
2012.1.00635.S
NA
 
18-Jun-2013
6,7
1FDM,3TDM in band 6
1FDM (1875),3TDM in band 7 (1875)
27
J1733-130
uid://A002/X5d7935/X2fb
uid___A002_X67f61e_X687
listobs
listobs_full_res_spws_only
 
Todd
 
pipeline fails at wvrgcalflag with gaincal::Calibrater::setapply(type, applypar) Cube::resize() - attempt to form n on-Cube Check inputs and try again.
 
 
21
2012.1.00127.CSV
JAO
 
05-Jun-2013
3
TDM, some with 32 and 64 channels
42
none
uid://A002/X638463/X2e
uid___A002_X65c1ab_X1ae
 
 
 
 
 
 
22
phase V test dataset
NA
 
01-Jun-2013
7
4FDM (937)
30
J2232+117
uid://A002/X639a2a/X2a
done, v1.297
Tony
 
platforming on DV16
 
DV23, DV25 (good test for CAS-5291)
23
2012.1.00423.S
 
 
27-Jan-2013
3
4FDM (1875)
30
J0132-169
uid://A002/X5a9a13/X114
v1.297
Todd
 
platforming
 
WVR: DV21

-- ToddHunter - 2013-03-25

Topic attachments
I Attachment Action Size Date Who Comment
X687.full_res.listobslistobs X687.full_res.listobs manage 36 K 2013-08-13 - 11:30 ToddHunter listobs for uid___A002_X67f61e_X687 (June 18, 2013), FULL_RES spws only
X687.listobslistobs X687.listobs manage 40 K 2013-08-13 - 11:17 ToddHunter listobs for uid___A002_X67f61e_X687 (June 18, 2013)
aqua-qa0-report-2013-05-14T19_00_47.pdfpdf aqua-qa0-report-2013-05-14T19_00_47.pdf manage 88 K 2013-05-17 - 10:36 ToddHunter  
Topic revision: r99 - 2015-07-01, ToddHunter
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback