You are here: NRAO Public Wiki>Software/CASA Web>CASAAutomatedSoftwareTesting>ContinuousIntegrationTestDiscussionForBamboo (2016-10-04, AndyHale) Edit wiki text Edit Attach Print version

Test Suite Discussion in the Bamboo CI Setup

Test Suites

Test Suite 0 (TS0) Current smoke tests: 008 Cleanhelper Test (00:05), 012 Equinox Vis (00:10), 017 Imagepoltest (00:12), 100 Boxit (00:04)
Est total run time 31s = 00m31s
Test Suite 1 (TS1) Accum Test (00:07), Async-Segfault (00:05), 008 Cleanhelper Test (00:05), Coordsystest (00:09), EquinoxVis (00:10), Imagepoltest (00:12), Irc Cs Task (00:11), Listcal (00:18), Ori Hc3N (00:04), Ori Sio (00:04), Pylabmem (00:19), Sim Ppdisk (00:21), Time Then Chan Avg (0:05), Bandpass (00:04), Boxit (00:04), Calanalysis (00:02), Caltabconvert (0:02), Componentlist (00:02), Conjugatevis (00:02), Coordsys (00:02), Cvelfreqs (00:04), Fixplanets (00:14), Flagmanager (00:10), Gaincal (00:03), Gencal (00:04), Getchunk (00:03), Ia tests (210, 213, 215, 220, 225) (00:10), Ia tests (236, 240, 245, 250, 255) (00:10), Imhistory (00:02), Impbcor (00:04), Importfitsidi (00:08), Imtrans (00:04), Listhistory (00:02), Listobs (00:05), Msmd (00:06), Plotants (00:05), Plotuv (00:03), Po tests (500, 505, 510, 515, 520) (00:10), Report (00:02), Rg frombcs (00:02), Rg selectedchannels (00:02), Sdbaseline2 (00:03), Sdcal (00:14), Sdcoadd (00:08), Sdfit (00:09), Sdflagmanager (00:06), Sdimprocess (00:06), Sdlist (00:03), Sdscale (00:07), Sdstat (00:08), Smoothcal (00:07), Specflux (00:03), Splattotable (00:04), Spxfit (00:09), Uvcontsub (00:11), Uvcontsub3 (00:06), Visstat (00:34), Vpmanager (00:08), Asdm-Imexport+Analysis (1:15), Calstat (00:26), Fits-Import-Export (00:43), Fls3A Hi (0:52), Imagetest (00:10), Ngc5921Redux (00:26), Testcube2 (00:24), 120 Cleanhelper (00:15), Fixvis (00:30), Fluxscale (00:09), ia tests (230, 235, 259, 260-355 (1:38), Imval (00:04), Initwieghts (00:18), Listpartition (00:21), Po tests 525-575 (00:23), Sdcal2 (00:18), Slsearch (00:13), Statwt (00:11), Tsdsmooth (00:19), 115 Clean (3:15), 395 Importasdm (4:12), Flagcmd (00:48), Concat (00:57), Makemask (00:59), 725 Split (00:49), 185 Flagdata (5:24), 125 Clearstat (00:03), Imstat, 755 Vishead (00:04), 460 Measures (00:02)
Est total run time 1904s = 31m44s
Test Suite 2 PipelineTest (1:00:04), Alma M100 Sd regression (16:17), Hanningsmooth (3:31), 3C129 (5:09), Cleanchan (2:47), Cvel (10:31), H121 (1:13), L02D (2:22), Listvis (2:20), Orionmos4Sim (2:18), Orionmosaic (4:22), Polcal 20080224 Cband (1:20), Sim M51C (1:08), Sim M51 Tp (1:08), Sim Testcomp (1:04), Third4826 (2:59), Wideband (1:19), Agentflagger (00:56), Csvclean (00:59), Cvel (2:43), Exportasdm (00:49), Hanningsmooth (00:59), Hanningsmooth2 (00:57), Imcontsub (1:30), Imfit (00:25), Imhead (00:28), Immoments (1:49), Imregrid (00:27), Imsmooth (00:23), Mstransform mms (3:42), 493 Plotms (11:50), Rg fromtextfile (00:17), Sdaverage (00:28), Sdbaseline (00:26), Sdflag (00:36), Sdgrid (00:11), Sdmath (00:26), Sdreduce (00:33), Sdsave (00:46), Setjy (1:43), Simobserve (4:08), Tsdfit (00:27), Virtualconcat (00:27), Visstat2 (00:40), 3C219D test (1:17), ALMA Titan ephemeris (9:42), 3C391polim (1:41),
Est total run time 10,197s = 2h49m57s
Test Suite 3 Casaguides, Refimager (2:55), Ngc2403 (5:51), Pointing Test (5:28), Ic2233 (5:08), Wproject Regression (32:34), Importevla (2:03), Partition (4:03), Sdimaging (3:10), Specfit (1:19), Tsdbaseline (1:44), Tsdcal (1:46), Wvrgcal (4:53), Importasdm mms (25:53), 475 Mstransform (8:46), 577 Refimager (56:11), 800 Alma M100 Analysis Regression (1:58:34), 890 Alma M100 Analysis Hpc Regression (1:36:38), 891 Alma M100 Analysis Hpc Regression Tclean (1:43:46), 895 Applycal (2:06), 900 Cvel2 (4:56), 907 Importasdm (10:46), 908 Importasdm Mms (17:49), 910 Mpi4Casa (15:32), 915 Mstransform Mms (17:11), 920 Partition (12:20), 925 Split (5:21)
Est total run time 34,003s = 9h26m43s (does not include casaguide runtime)

  • Note: this is based on the numbers for RH 6 CASA 4.7.134 (r 38011)
  • RH 6 time tend to be slower, compared to RH 7 (possibly due to platform, or due to hardware) therefore, the numbers should improve with updated hardware (or testing on RH7)
  • TS0 tests will be included in TS 1 (smoke test results do not get included in the reports)

Plone Page With Test and Test Suite Definitions

Notes On This Topic

  • Based on whiteboard discussion between Jeff, Akeem, Anand, and Andy on 2016-07-01
  • Whiteboard Image by Jeff outlining build and test in Bamboo for CASA:
    WhiteboardBambooCISketch.JPG
  • Black straight line: Master Repo or Trunk
    • Feature Branches need to initiate pull request and after review of code, pull request is either accepted or denied
    • Angled green line (with CASA-4.7 label) represents an official CASA release
    • Incoming green line to Master Repo: Pull Request from another Feature Branch
      • Any approved pull requests added to the Main Repo would be updated to all Feature Branches
  • Curved black line: Feature Branch (created based on JIRA for bug fix or new feature development, fork from Master Repo)
    • Commits come in from developer clone (no pull request needed)
    • Red "X" represents tar and dmg packages created (based on the feature branch) to support user validation testing
  • Straight red line: Developer fork (personal copy of the Master Repo)
  • Curved red line: clone of developer fork
    • Developer commits come from here
    • red "Xs" represent developer code changes/improvements

-- AndyHale - 2016-07-06
Edit  | Attach | Print version | History: r19 < r18 < r17 < r16 | Backlinks | View wiki text | Edit wiki text | More topic actions
Topic revision: r19 - 2016-10-04, AndyHale
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback