acm_table_markII
Updated: Sep17, 2019

This routine provides a fast method of summarizing the properties of acm images. It surveys the contents of a PAS(acm) directory specified by (BaseDir,Date) files and contructs a table file (basename = ACMDAT). As images are added to the directory, new calls to acm_table_markII process only the new images, and add their results to the ACMDAT table.

Unlike the original acm_table, this code only uses information from the FITS headers, and the images are read and processed by a single OTW routine (survey_headers.sh).


% acm_table_markII --help    
Usage: acm_table_markII N 
arg1 - run in verbose/debug mode (Y/N) 

Typical input files: 
% cat BaseDir
/media/sco/DataDisk1/sco/AD/HET_work/acm_nights
% cat Date
20190724

Output files: 
ACMDAT.table       = the ASCII file containing data values for each image 
ACMDAT.images      = list of the corresponding input images 
ACMDAT.parlab      = list of the parameter names and expanded explanations 
                    for each column stored in ACMDAT.table
acm_mcs_paths.out  = the corresponding original image address on mcs for each 
                     input image.
list.BIAS          = list of images identified as bias frames 
list.NONE          = list of images with no recognized image type 
list.OPEN          = list of image exposed with PFIP shutter open
list.IMAGES        = a complete list of images currently in the location specified 
                     by the (BaseDir,Date) files 
list.IMAGES_OLD    = a copy of list.IMAGES that is used in the next run of acm_table_markII 
                    to recognize newly acquired images. 
list.IMAGES_NEW    = a list of the new images that were added. If this file does not exist, 
                     then no new images were created since the last run of acm_table_markII

newacm.table ===========> See below 
 
On a newer machine (sco2019) we can process 500 images in about 6 seconds. On an old system (mcs) this could take about 25 seconds.

An important point should be noted here. The file "list.IMAGES_NEW" can be used to indicate whetehr new images were added to the image directory. If none were added, then there will be no "list.IMAGES_NEW". If the file exists, then the images listed there will already have been added to the ACMDAT table file. In addition, a table file for just these new images, with the basename "newacm", has also been created. The format of this newacm tbale is just like ACMDAT. We may want to process only these new files in some way. For instance, a common practice (if bias frame data are present) is to use the paga routine to bias correct the acm images (as well a some other things) and deposit the processed images in the ./local_red/FIXXUP directory. The newacm table is useful for this.

Below I show a (slightly editted) sample run. Note that the short processing time (1 second) is beacuse this was a secondary call. Not all 519 images were processed at once. Instead, only those images identified as new arrivals were processed and added to the ACMDAT table.


% cat Date 
20190724
% cat BaseDir 
/media/sco/DataDisk1/sco/AD/HET_work/acm_nights

% acm_table_markII N  
Time for this run              = 1.000000   (seconds) 
  10   0   455   54   (Nbias,Ndark,Nopen,Nnone)  

acm_table_markII processing time for 519 acm images = 1.000000 (seconds)

Done. Recall that a good way to review the images is: 
   point_selector ACMDAT uthrs im N  


Sometimes it is useful to summarize a table of acm data with just a few numbers (the number of bias images, the number of shutter open images, etc...). The acm_table_qc is handy for this. It also allows you to construct useful images lists for different types of images if you like.




Back to SCO CODES page