You are here:
NRAO Public Wiki
>
HPC Web
>
CasaParallelization
>
CasaParallelMinutes20120319
(2012-03-26,
JamesRobnett
)
Edit
w
iki text
Edit
Attach
P
rint version
Casa Parallelization meeting minutes
Monday March 19th Room 317, 3:30pm MDT
Attendees: Jim, Sanjay, Kumar, Bryan, Jeff, James
Targets/tasks for March 19th to March 25th
Test model data column changes
James
Discussion/Agenda
Cluster object specification and its effect on tasks. How do tasks make use of the cluster object (node, memory and core counts).
Should enumerate max cores and memory per node
Memory requirements as a function of imaging algorithm and image size
MS-MFS memory handling (how does it handle over mem situations)
test memory and temp image use
Threaded gridder benchmark update
James
Jeff to ask Scott to build active
Suggestion for quadrant selection
Update on Partitioning status (null selections, non-conforming tasks)
Jeff
No update
Update on asdm2ms_xl schedule for stable inclusion
Still serial, eventually multi-threaded across spw, multi-process across scans
now multi-process across spw with shrdmem (single node only)
Model data tests
James to get with Kumar
Pcube and pclean conversion to task status
Kumar
Revisit async iterator for writing
Jim/Justo
Refactoring seems to be working in active
Justo is testing flagging appears to be an improvement
Attempt to make async I/O in flagging make it to release
Memory resident subtables
Jim
Test performance
James
Check that it affects number of FDs as well
Spectral imaging
Kumar
Understand channel chunk choice effect on memory
James
Obtaining data set from Drew to test
Need 400+GB continuum case with complex field
Stalled for partitioning
CASA HPC Initiatives for the 3.4 Cycle
Memory Footprint Issues
Deployment of Multi-Field MS-MFS (Urvashi)
Deferred
Deployment of Parallel Gridder and splitting of the Grid (Jim)
Design of MS-MFS Minor Cycle Parallelization (Jim et. al.) using Friday meetings
Deferred
Initial Deployment of ASP Clean (Sanjay)
Performance Issues:
Virtual Model Data Column (Kumar)
Done
Removes model data column
removes need for Setjy
Memory Resident Subtables Deployment
In progress needs testing
VisBuffer
Processing Framework
Add Write capability (Jim)
Need to revisit but seems to work in not imaging
Deployment in tasks (Jeff to Assign)
Parallel Filler (and partitioning) (Tak)
In progress
User Interface:
Parallel Imager in Task (Kumar)
Parallelization of other Tasks (assigned to Europe)
Deferred Topics
ARDG Targets
What is negative side effect of CVel in filler, non-reversible
What needs to be done to acceptably implement Auto-boxing with large number of channels
--
JamesRobnett
- 2012-03-26
E
dit
|
A
ttach
|
P
rint version
|
H
istory
: r1
|
B
acklinks
|
V
iew wiki text
|
Edit
w
iki text
|
M
ore topic actions
Topic revision: r1 - 2012-03-26,
JamesRobnett
HPC
Log In
Register
HPC Web
Create New Topic
Index
Search
Changes
Notifications
Statistics
Preferences
Webs
ALMA
NAASC
SCIIPT
CDL
CICADA
Ccs
Littlethings
Cville
DSAA
EVLA
FASR
GB
Computing
Data
Dynamic
Electronics
Gbtpipeline
Knowledge
Mechanical
Observing
WbandVLBACal
Obsreports
Operate
PTCS
OOF
ServoImprovementsHome
ServoSiteAcceptTestProcs
Pennarray
Projects
Recreation
Scicenter
Skynet
Software
CLEO
StaffEvents
TACTool
HPC
JVLA
KPAF
Library
Main
Metrics
NGVLA
NM
Computing
Electronics
OSAA
OSX
SRDP
Software
Algorithms
CASA
Splat
System
VLBA
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding NRAO Public Wiki?
Send feedback