CASA Software Engineering Project: Move the Public CASA Package Repository

Move the current CASA Public Package Repositories from

To an appropriate location on the CASA User Web to improve separation between tested and released CASA packages, and untested or not released CASA packages, and to support cleaner mirroring to other sites.

Status: See CAS-5880.

Team

Customers
  • JuergenOtt
  • Kana Sugimoto
  • Koji Nakamura
  • All CASA users outside of NRAO

Collaborators

Plan

  1. Set a package retention policy.
    • Needed to estimate disk space required on casa.nrao.edu
  2. Measure space used by current CASA packages that should be moved to the new site.
    • Assumption: this repository will only contain Linux tars and OS X dmgs to start with.
    • Issue: we are working on increasing the number of supported Linux distributions. Because we have not settled on package formats, disk space requirements will be uncertain.
    • Issue: we are considering changes to the way we distribute CASA. This may significantly change our disk space requirements.
  3. Set a space budget for packages on casa.nrao.edu.
  4. Agree with Stephan and Pat on how to manage this space.
  5. Request this space on casa.nrao.edu from Stephan and Pat.
  6. Use new scripts to publish existing packages to new repository.
  7. Test and debug.
  8. Update http://casa.nrao.edu/casa_obtaining.shtml to refer to new repository.

Deliverables

  1. Concise requirements/design/impementation notes (on this page).
  2. Concise mirroring instructions (one short wiki page).
  3. Concise instructions for CASA package publishers (one short wiki page).
    • Instructions for naming fixes for broken packages.
    • Scripts for automating package publishing.
    • Scripts for deleting old (TBD) packages.
  4. Updates to http://casa.nrao.edu/installlinux.shtml

Requirements

The package repository on casa.nrao.edu

  1. must contain,
    • the last three CASA release packages for all supported OSs,
    • all CASA stable packages for the current development cycle (typically up to 6) for all supported OSs,
    • all CASA prerelease packages leading up to the current release (assuming 6 for now) - to be removed once that release is complete.
  2. may only contain tested packages.
    • This is to prevent users from installing untested software.
  3. may only contain complete packages.
    • This is to simplify mirroring. In the past, package publishing in progress has corrupted mirrors.
  4. must fit within limited disk space.
    • NRAO web servers have limited disk space. We can ask for disk space we require, but we can't expect this to grow without bounds.

Additional requirements

Design

  1. The package repository on casa.nrao.edu will be managed by the user "casaadm".
    • This is a shared user account accessible by signed ssh key. Assigning tasks to shared user accounts allows us to move work around within the project easily and prevents work from being blocked when a critical person is unavailable.
  2. After a package has been tested, the casaadm user will run a script to copy the tested package from https://svn.cv.nrao.edu/casa/* to a private buffer on casa.nrao.edu on the same file system as the public repository. After the package has been completely copied, the script will move the package within the file system to the public repository.
    • See requirements 2, 3.
    • Implementation suggested by Koji Nakamura. cp can take a long time. mv within a file system is as close to instantaneous as we are likely to get.
  3. A cron job will run periodically to delete packages from the public repository that are no longer required.
    • See requirements 1, 4.

Implementation

(Note: replace this note with a one paragraph summary of the implementation for this project, a short bullet list of implementation details, or link(s) other pages documenting the implementation for this project. Often, this will be a bullet list including the location for any source code in change control and any user accounts or computers required by this project.)

Tasks

Project tasks are tracked with Jira sub-tasks under this project's master task. See CAS-5880.

-- ScottRankin - 2013-12-02
Topic revision: r7 - 2014-02-25, ScottRankin
This site is powered by FoswikiCopyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki? Send feedback