Tools for DSF Procedure
Last updated: Oct24,2019

Routines I have developed to aid in collecting DSF data sets are discussed.

  1. Gettig a list of images.
  2. Looking at specific units.
  3. Gather DSF data.



Gettig a list of images. .

We need a way to find the ldls_long images.



VIRUS image:    1064 x 1032        bias starst in colunmn 1028 
Note:  a better bias area is [140:105,50:950] 
       bias zones vary quite a lot among the various detectors. 

Usage: virims 6000 1 081 RU ldls_long N 
arg1 = obs number  (9901, can be "any")  
arg2 = exposure number (1, can be "any")  
arg3 = ifuslot     (081, can be "ny")  
arg4 = amp name (LL,LU,RL,RU,  can be "ny")   
arg5 = object card value (can be "ny")   
arg6 - run in debug mode (Y/N)

Usage: virstats.sh list.in 1 1020 1 1032 99.5 N
arg1 - list of FITS images 
arg2 - min i of image sub-region 
arg3 - max i of image sub-region 
arg4 - min j of image sub-region 
arg5 - max j of image sub-region 
arg6 - desired max fraction of total pixels (99.5)
arg7 - Run in debug/verbose mode (Y/N) 


To make a file listing of ldls_long images  (BaseDir,Date must be present) 
% virims 1 1 any any ldls_long N                  # 236 image,  =  59 units x 4 amps) 

To compute the pixel stats for virus flt images: 
virstats.sh virims.out1 1 1020 1 1032 99.5 N

My results for these 236 images:

# output from virstats.sh:
Col01 = mean bias value
Col02 = mean pixel signal (inclduing bias)
Col03 = mean error of mean 
Col04 = standard deviation 
Col05 = min pixel value 
Col06 = max pixel value 
Col07 = Signal where Npix exceeds  99.50 percent of total
Col08 = number of pixel in image statsec 
Col09 = basename of image 
  1081.632   3242.555      1.462   1499.565   1017.000  13375.000   6306.000    1052640   20191023T000616.4_013LL_flt
  1276.409   2997.546      1.274   1307.285   1031.000  18641.000   5771.000    1052640   20191023T000616.4_013LU_flt
  1297.883   3141.247      1.414   1450.370   1039.000  13230.000   6175.000    1052640   20191023T000616.4_013RL_flt
  1090.158   3343.567      1.534   1573.479   1026.000  13758.000   6654.000    1052640   20191023T000616.4_013RU_flt
  1113.911   3582.677      1.676   1719.434   1049.000   7917.000   7051.000    1052640   20191023T000616.4_014LL_flt
  1334.652   3213.887      1.474   1512.302   1053.000   7293.000   6419.000    1052640   20191023T000616.4_014LU_flt
  1327.201   3775.013      1.812   1858.953   1018.000  18750.000   7735.000    1052640   20191023T000616.4_014RL_flt
  1094.539   4179.991      1.998   2049.664   1021.000  10677.000   8645.000    1052640   20191023T000616.4_014RU_flt
  1073.993   3342.824      1.488   1527.160   1013.000  17735.000   6614.000    1052640   20191023T000616.4_015LL_flt
  1256.981   3163.073      1.347   1382.068   1026.000  16054.000   6322.000    1052640   20191023T000616.4_015LU_flt
  1320.002   3662.906      1.632   1674.412   1022.000   8289.000   7330.000    1052640   20191023T000616.4_015RL_flt
  1077.266   4036.447      1.890   1938.837   1011.000   9197.000   8250.000    1052640   20191023T000616.4_015RU_flt
  1080.490   3531.027      1.640   1682.868   1019.000   7962.000   6914.000    1052640   20191023T000616.4_016LL_flt
  1294.604   3170.512      1.424   1460.635   1047.000   8037.000   6292.000    1052640   20191023T000616.4_016LU_flt
  1343.409   3796.890      1.790   1836.874   1033.000  12589.000   7342.000    1052640   20191023T000616.4_016RL_flt
  1111.204   4070.124      1.968   2019.190   1036.000  10796.000   7973.000    1052640   20191023T000616.4_016RU_flt
  2259.652   3804.403      1.148   1177.614   2215.000  20350.000   6379.000    1052640   20191023T000616.4_021LL_flt
  2328.954   3654.225      1.088   1116.127   2186.000  17427.000   6177.000    1052640   20191023T000616.4_021LU_flt
  2308.283   3861.602      1.247   1279.400   2107.000  20251.000   6621.000    1052640   20191023T000616.4_021RL_flt
  2123.816   3915.532      1.295   1328.900   2078.000   8280.000   6762.000    1052640   20191023T000616.4_021RU_flt
  2136.247   4500.490      1.729   1773.521   2049.000   8980.000   8254.000    1052640   20191023T000616.4_022LL_flt
  2296.619   4224.687      1.554   1594.486   2048.000   9611.000   7792.000    1052640   20191023T000616.4_022LU_flt
  2405.562   4968.330      2.067   2120.814   2075.000  11042.000   9746.000    1052640   20191023T000616.4_022RL_flt
  2115.991   5086.992      2.126   2181.037   2069.000  11319.000   9882.000    1052640   20191023T000616.4_022RU_flt
  1942.127   6020.893      3.119   3199.731   1846.000  13928.000  12429.000    1052640   20191023T000616.4_023LL_flt
  2990.009   6179.218      2.794   2866.547   2516.000  14199.000  12524.000    1052640   20191023T000616.4_023LU_flt
  2810.198   6803.069      3.490   3581.072   2175.000  16763.000  14159.000    1052640   20191023T000616.4_023RL_flt
  2308.082   6702.543      3.329   3415.394   2208.000  23155.000  13873.000    1052640   20191023T000616.4_023RU_flt
  2218.100   7382.604      3.776   3873.866   2111.000  16404.000  15022.000    1052640   20191023T000616.4_024LL_flt
  2645.843   6635.292      3.400   3488.711   2084.000  15346.000  13981.000    1052640   20191023T000616.4_024LU_flt
  2932.800   7875.608      4.289   4400.811   2210.000  18845.000  16817.000    1052640   20191023T000616.4_024RL_flt
  2353.214   8203.494      4.463   4578.550   2220.000  26216.000  17313.000    1052640   20191023T000616.4_024RU_flt
  2140.688   7044.321      3.514   3605.016   2022.000  15484.000  13961.000    1052640   20191023T000616.4_025LL_flt
  2562.724   6509.422      3.245   3329.789   2066.000  31489.000  13455.000    1052640   20191023T000616.4_025LU_flt
  2638.125   8160.227      4.495   4612.053   1915.000  25636.000  17899.000    1052640   20191023T000616.4_025RL_flt
  2201.460   8942.590      4.832   4957.404   2059.000  28744.000  19245.000    1052640   20191023T000616.4_025RU_flt
  2092.786   6841.921      3.399   3487.826   1981.000  22206.000  13653.000    1052640   20191023T000616.4_026LL_flt
  2606.986   6536.130      3.095   3175.058   2113.000  65535.000  13208.000    1052640   20191023T000616.4_026LU_flt
  2961.269   8478.446      4.183   4291.961   2173.000  19233.000  17328.000    1052640   20191023T000616.4_026RL_flt
  2338.398   8677.177      4.350   4462.862   2194.000  19346.000  17838.000    1052640   20191023T000616.4_026RU_flt
  2250.637   6591.605      3.033   3111.432   2143.000  14347.000  12952.000    1052640   20191023T000616.4_027LL_flt
  2663.537   6084.762      2.689   2758.868   2154.000  15640.000  12047.000    1052640   20191023T000616.4_027LU_flt
  2546.918   6415.755      2.790   2862.757   2059.000  16479.000  12820.000    1052640   20191023T000616.4_027RL_flt
  2163.786   6738.116      3.115   3195.750   2029.000  19230.000  13572.000    1052640   20191023T000616.4_027RU_flt
  1122.558   3551.625      1.641   1683.895   1042.000  10194.000   7233.000    1052640   20191023T000616.4_028LL_flt
  1281.000   3279.604      1.477   1515.221   1062.000  10276.000   6677.000    1052640   20191023T000616.4_028LU_flt
  1402.826   4112.596      2.106   2160.757   1032.000  10183.000   8759.000    1052640   20191023T000616.4_028RL_flt
  1117.821   4623.824      2.385   2447.439   1043.000  15301.000   9838.000    1052640   20191023T000616.4_028RU_flt
  1232.568   3674.399      1.690   1733.664   1174.000   9313.000   7544.000    1052640   20191023T000616.4_031LL_flt
  1472.843   3482.801      1.559   1599.452   1214.000  19084.000   7171.000    1052640   20191023T000616.4_031LU_flt
  1606.840   4405.990      2.210   2267.518   1189.000  10816.000   9554.000    1052640   20191023T000616.4_031RL_flt
  1271.145   4334.968      2.126   2180.944   1212.000  11456.000   9592.000    1052640   20191023T000616.4_031RU_flt
  2200.824   7219.971      3.777   3874.966   2084.000  17238.000  15418.000    1052640   20191023T000616.4_032LL_flt
  2626.021   6619.293      3.415   3504.054   2076.000  17052.000  14479.000    1052640   20191023T000616.4_032LU_flt
  2840.963   7273.472      3.445   3534.430   2212.000  20553.000  14914.000    1052640   20191023T000616.4_032RL_flt
  2218.323   7212.783      3.480   3570.789   2095.000  16880.000  15024.000    1052640   20191023T000616.4_032RU_flt
  2248.545  10148.414      5.545   5689.414   2096.000  24274.000  22136.000    1052640   20191023T000616.4_033LL_flt
  2950.811   9290.444      5.200   5335.551   2085.000  23966.000  20908.000    1052640   20191023T000616.4_033LU_flt
  2893.858   9395.333      5.275   5412.119   2001.000  24448.000  21128.000    1052640   20191023T000616.4_033RL_flt
  2276.549  10229.350      5.420   5560.449   2127.000  25522.000  22511.000    1052640   20191023T000616.4_033RU_flt
  2320.148  11279.096      7.592   7789.623   1068.000  29761.000  26762.000    1052640   20191023T000616.4_034LL_flt
  1249.083  10247.774      6.868   7046.376   1082.000  28271.000  25073.000    1052640   20191023T000616.4_034LU_flt
  1271.161  10645.810      6.957   7137.850   1063.000  28395.000  24991.000    1052640   20191023T000616.4_034RL_flt
  2364.443  10728.658      7.156   7341.928   1111.000  28817.000  25886.000    1052640   20191023T000616.4_034RU_flt
  2131.911  10432.956      6.354   6519.463   1052.000  25843.000  23437.000    1052640   20191023T000616.4_035LL_flt
  1242.943  10181.909      6.255   6417.347   1007.000  26584.000  23568.000    1052640   20191023T000616.4_035LU_flt
  1316.987   9778.873      5.760   5909.540   1138.000  23462.000  21717.000    1052640   20191023T000616.4_035RL_flt
  2117.526   9988.361      5.957   6112.195   1057.000  23733.000  22337.000    1052640   20191023T000616.4_035RU_flt
  2358.488  11690.433      6.904   7083.116   2209.000  30528.000  25419.000    1052640   20191023T000616.4_036LL_flt
  3433.375  10553.367      6.267   6429.786   2170.000  26866.000  23924.000    1052640   20191023T000616.4_036LU_flt
  3366.890  11987.654      7.467   7661.120   2229.000  31337.000  28227.000    1052640   20191023T000616.4_036RL_flt
  2294.083  12409.329      7.754   7955.740   2128.000  32187.000  29067.000    1052640   20191023T000616.4_036RU_flt
  2290.722   9996.684      5.591   5736.279   2134.000  24473.000  22039.000    1052640   20191023T000616.4_037LL_flt
  3054.486   9389.179      5.362   5501.237   2216.000  25913.000  21413.000    1052640   20191023T000616.4_037LU_flt
  3134.272  10194.015      5.842   5994.127   2077.000  25147.000  22650.000    1052640   20191023T000616.4_037RL_flt
  2316.845  10967.546      6.266   6428.505   2104.000  65535.000  24131.000    1052640   20191023T000616.4_037RU_flt
  1176.977   5602.733      2.984   3062.003   1067.000  13813.000  12224.000    1052640   20191023T000616.4_038LL_flt
  1540.235   5459.497      2.962   3039.460   1035.000  13631.000  12088.000    1052640   20191023T000616.4_038LU_flt
  1625.801   6115.078      3.433   3522.011   1043.000  15799.000  13752.000    1052640   20191023T000616.4_038RL_flt
  1170.966   6406.114      3.584   3677.323   1063.000  16249.000  14528.000    1052640   20191023T000616.4_038RU_flt
  1494.301   4580.081      2.565   2631.156   1026.000  11445.000  10330.000    1052640   20191023T000616.4_041LL_flt
  1063.827   4418.629      2.413   2475.674   1017.000  16187.000  10033.000    1052640   20191023T000616.4_041LU_flt
  1090.099   4982.070      2.679   2749.007    995.000  15865.000  11267.000    1052640   20191023T000616.4_041RL_flt
  1408.665   4335.218      2.262   2320.510    998.000  11208.000   9813.000    1052640   20191023T000616.4_041RU_flt
  2158.584   9542.120      5.561   5705.994   2010.000  24039.000  21557.000    1052640   20191023T000616.4_042LL_flt
  3066.832   9308.562      5.378   5517.814   2053.000  23656.000  20760.000    1052640   20191023T000616.4_042LU_flt
  2952.017   9474.126      5.280   5417.212   2085.000  23635.000  20996.000    1052640   20191023T000616.4_042RL_flt
  2247.209   9149.459      5.082   5213.619   2070.000  23356.000  20371.000    1052640   20191023T000616.4_042RU_flt
  2319.314  14309.945      8.481   8701.296   2085.000  37220.000  33077.000    1052640   20191023T000616.4_043LL_flt
  3516.336  13248.420      8.030   8238.616   2082.000  48917.000  31656.000    1052640   20191023T000616.4_043LU_flt
  3686.610  13582.529      9.037   9271.432   1976.000  36644.000  32529.000    1052640   20191023T000616.4_043RL_flt
  2241.751  14170.240      9.336   9578.298   2030.000  38014.000  33843.000    1052640   20191023T000616.4_043RU_flt
  2341.938  15099.223      9.779  10032.576   2134.000  38290.000  35097.000    1052640   20191023T000616.4_044LL_flt
  3803.810  14213.919      9.291   9532.392   2163.000  37856.000  33836.000    1052640   20191023T000616.4_044LU_flt
  4096.716  17681.566     12.042  12355.188   2090.000  48760.000  43927.000    1052640   20191023T000616.4_044RL_flt
  2280.274  18100.236     12.748  13079.114   2105.000  51541.000  46228.000    1052640   20191023T000616.4_044RU_flt
  2228.545  16502.014     10.371  10640.914   1974.000  42128.000  38033.000    1052640   20191023T000616.4_045LL_flt
  3791.734  16518.883     10.478  10749.836   1959.000  44123.000  39289.000    1052640   20191023T000616.4_045LU_flt
  4089.826  17405.471     11.346  11641.272   1901.000  44769.000  40202.000    1052640   20191023T000616.4_045RL_flt
  2461.890  15906.299      9.963  10221.746   2171.000  39461.000  36124.000    1052640   20191023T000616.4_045RU_flt
  2326.879  15159.178      9.411   9655.343   2055.000  44790.000  33886.000    1052640   20191023T000616.4_046LL_flt
  3625.803  13848.902      8.625   8849.112   2094.000  36914.000  32042.000    1052640   20191023T000616.4_046LU_flt
  3870.006  14522.495      9.259   9499.320   2092.000  37930.000  32550.000    1052640   20191023T000616.4_046RL_flt
  2349.024  14329.307      9.022   9256.309   2108.000  35056.000  31775.000    1052640   20191023T000616.4_046RU_flt
  2326.278  14509.308      8.764   8992.000   2177.000  36854.000  32711.000    1052640   20191023T000616.4_047LL_flt
  3685.188  14109.825      8.620   8843.985   2171.000  65535.000  32580.000    1052640   20191023T000616.4_047LU_flt
  3272.191  12273.159      7.238   7425.781   2056.000  30854.000  27356.000    1052640   20191023T000616.4_047RL_flt
  2342.918  12351.234      7.245   7433.412   2127.000  31017.000  27261.000    1052640   20191023T000616.4_047RU_flt
  2271.196   9421.235      5.193   5328.076   2095.000  24020.000  21002.000    1052640   20191023T000616.4_052LL_flt
  2914.488   8937.832      4.698   4819.805   2101.000  22976.000  20361.000    1052640   20191023T000616.4_052LU_flt
  3240.085  11231.316      6.737   6912.149   2065.000  29246.000  25745.000    1052640   20191023T000616.4_052RL_flt
  2284.378  10854.450      6.294   6457.382   2053.000  28068.000  24732.000    1052640   20191023T000616.4_052RU_flt
  2255.368  13342.709      8.351   8568.244   2060.000  35513.000  31537.000    1052640   20191023T000616.4_053LL_flt
  3377.345  13802.420      8.976   9209.680   2055.000  38959.000  33802.000    1052640   20191023T000616.4_053LU_flt
  4079.731  16442.719     10.279  10545.735   2104.000  65535.000  38202.000    1052640   20191023T000616.4_053RL_flt
  2275.141  14755.651      9.084   9320.125   2089.000  36944.000  33668.000    1052640   20191023T000616.4_053RU_flt
  2294.084   9240.398      4.953   5081.503   2116.000  22824.000  19988.000    1052640   20191023T000616.4_062LL_flt
  3170.938   9006.806      4.780   4904.056   2288.000  21499.000  18847.000    1052640   20191023T000616.4_062LU_flt
  3645.675  11272.441      6.548   6718.028   2462.000  32222.000  25363.000    1052640   20191023T000616.4_062RL_flt
  2515.020  10855.141      6.356   6520.863   2352.000  27838.000  24629.000    1052640   20191023T000616.4_062RU_flt
  2342.346  12825.383      8.391   8609.006   1098.000  33674.000  30856.000    1052640   20191023T000616.4_063LL_flt
  1291.285  12462.608      8.146   8357.394   1224.000  34819.000  30755.000    1052640   20191023T000616.4_063LU_flt
  1134.694  14634.448      9.608   9857.829   1036.000  40946.000  35270.000    1052640   20191023T000616.4_063RL_flt
  2687.313  13750.051      9.003   9236.556   1071.000  47024.000  33679.000    1052640   20191023T000616.4_063RU_flt
  3249.156  14831.147      9.483   9729.507   1440.000  40877.000  35253.000    1052640   20191023T000616.4_067LL_flt
     0.000     49.955      0.485    497.676      0.000  18286.000  65000.000    1052640   20191023T000616.4_067LU_flt
  1252.258  13171.397      8.437   8655.891   1000.000  35020.000  30859.000    1052640   20191023T000616.4_067RL_flt
  2604.753  12092.149      7.457   7650.699   1150.000  33992.000  28642.000    1052640   20191023T000616.4_067RU_flt
  1155.410   6323.917      3.625   3719.402   1062.000  17139.000  14727.000    1052640   20191023T000616.4_071LL_flt
  1771.518   6333.980      3.595   3688.651   1046.000  21620.000  14695.000    1052640   20191023T000616.4_071LU_flt
  1552.025   5241.145      2.944   3020.216   1041.000  14033.000  12258.000    1052640   20191023T000616.4_071RL_flt
  1137.891   5321.121      2.906   2981.811   1048.000  14050.000  12286.000    1052640   20191023T000616.4_071RU_flt
  1252.583  10434.991      6.271   6434.023   1077.000  28619.000  24953.000    1052640   20191023T000616.4_072LL_flt
  2057.395   9408.211      5.487   5629.738   1073.000  26244.000  22209.000    1052640   20191023T000616.4_072LU_flt
  2074.521   9775.213      5.974   6128.876   1077.000  26938.000  23485.000    1052640   20191023T000616.4_072RL_flt
  1248.762   9624.517      5.872   6024.710   1048.000  27500.000  23521.000    1052640   20191023T000616.4_072RU_flt
  1334.443  14389.274      8.679   8904.006   1145.000  37453.000  33642.000    1052640   20191023T000616.4_073LL_flt
  2588.910  13628.749      8.324   8540.201   1146.000  37948.000  32377.000    1052640   20191023T000616.4_073LU_flt
  3327.326  16369.992     10.942  11226.505   1077.000  44885.000  40069.000    1052640   20191023T000616.4_073RL_flt
  1289.378  15859.977     10.284  10550.797   1141.000  42999.000  38332.000    1052640   20191023T000616.4_073RU_flt
  1368.163  16242.754     10.310  10578.067   1071.000  42345.000  37472.000    1052640   20191023T000616.4_074LL_flt
  2875.081  15053.247      9.749  10002.372   1129.000  39965.000  35848.000    1052640   20191023T000616.4_074LU_flt
  2815.911  15667.550     10.025  10285.920   1109.000  56443.000  37249.000    1052640   20191023T000616.4_074RL_flt
  1338.420  15378.679      9.891  10148.258   1117.000  42074.000  37255.000    1052640   20191023T000616.4_074RU_flt
  2375.637  18829.160     12.174  12490.704   2157.000  47829.000  43080.000    1052640   20191023T000616.4_075LL_flt
  4436.172  18946.053     12.628  12956.482   2154.000  49593.000  44410.000    1052640   20191023T000616.4_075LU_flt
  3600.713  17675.939     11.750  12055.408   2019.000  47890.000  43643.000    1052640   20191023T000616.4_075RL_flt
  2396.816  17306.594     11.496  11794.705   2098.000  64270.000  44327.000    1052640   20191023T000616.4_075RU_flt
  2391.907  17358.457      9.941  10199.158   2030.000  43884.000  40070.000    1052640   20191023T000616.4_076LL_flt
  3877.916  17027.785     10.708  10985.892   1966.000  44951.000  40624.000    1052640   20191023T000616.4_076LU_flt
  4197.420  17177.580     11.133  11422.058   2064.000  42855.000  39427.000    1052640   20191023T000616.4_076RL_flt
  2313.092  16027.360     10.124  10386.899   2065.000  40871.000  36851.000    1052640   20191023T000616.4_076RU_flt
  1299.870  15100.647      9.609   9858.159   1031.000  40104.000  35367.000    1052640   20191023T000616.4_077LL_flt
  2748.142  13316.804      8.294   8509.528   1086.000  34354.000  30338.000    1052640   20191023T000616.4_077LU_flt
  2742.527  13866.540      8.849   9078.895   1026.000  36389.000  32419.000    1052640   20191023T000616.4_077RL_flt
  1286.057  12739.433      7.673   7872.054   1098.000  33863.000  29708.000    1052640   20191023T000616.4_077RU_flt
  1126.496   4358.010      2.498   2562.956   1060.000  20426.000  10285.000    1052640   20191023T000616.4_081LL_flt
  1550.214   4414.313      2.572   2639.005   1058.000  12332.000  10363.000    1052640   20191023T000616.4_081LU_flt
  1585.773   4683.019      2.673   2742.483   1089.000  13196.000  10597.000    1052640   20191023T000616.4_081RL_flt
  1121.924   4430.829      2.387   2449.496   1047.000  11583.000   9921.000    1052640   20191023T000616.4_081RU_flt
  2232.186   8935.412      4.842   4967.420   2068.000  27192.000  19482.000    1052640   20191023T000616.4_082LL_flt
  2833.444   8868.291      4.948   5076.397   1981.000  21956.000  19616.000    1052640   20191023T000616.4_082LU_flt
  2813.972   7975.252      4.235   4345.344   2106.000  20945.000  16950.000    1052640   20191023T000616.4_082RL_flt
  2091.194   7595.196      4.016   4120.690   1974.000  26824.000  16446.000    1052640   20191023T000616.4_082RU_flt
  2206.452  11712.438      7.157   7342.641   2069.000  30282.000  26790.000    1052640   20191023T000616.4_083LL_flt
  3195.208  12011.134      7.557   7753.153   1975.000  39061.000  27712.000    1052640   20191023T000616.4_083LU_flt
  3396.602  12363.569      7.665   7864.016   2021.000  34705.000  28170.000    1052640   20191023T000616.4_083RL_flt
  2167.286  10776.723      6.193   6353.981   1984.000  29676.000  25701.000    1052640   20191023T000616.4_083RU_flt
  2334.569  13872.063      8.702   8927.794   2124.000  35828.000  31978.000    1052640   20191023T000616.4_084LL_flt
  3615.845  14055.061      9.033   9267.426   2093.000  36225.000  32696.000    1052640   20191023T000616.4_084LU_flt
  3603.966  14528.193      9.210   9448.897   2072.000  38486.000  33231.000    1052640   20191023T000616.4_084RL_flt
  2361.648  13503.014      8.231   8444.368   2116.000  35186.000  31528.000    1052640   20191023T000616.4_084RU_flt
  3030.383  14709.889      8.715   8941.635   1057.000  65535.000  32637.000    1052640   20191023T000616.4_085LL_flt
  1254.956  15373.440      9.169   9407.597   1051.000  38335.000  34867.000    1052640   20191023T000616.4_085LU_flt
  1271.309  13367.887      9.213   9452.188   1019.000  34842.000  32229.000    1052640   20191023T000616.4_085RL_flt
  2502.282  12510.567      8.760   8987.347   1052.000  34917.000  31279.000    1052640   20191023T000616.4_085RU_flt
  2299.578  14112.998      8.609   8832.719   2042.000  37063.000  32235.000    1052640   20191023T000616.4_086LL_flt
  3845.323  14433.530      8.896   9126.815   2060.000  36592.000  33139.000    1052640   20191023T000616.4_086LU_flt
  3559.113  13439.478      8.161   8372.565   2055.000  34085.000  30349.000    1052640   20191023T000616.4_086RL_flt
  2260.468  12470.178      7.348   7538.757   2125.000  33804.000  29357.000    1052640   20191023T000616.4_086RU_flt
  2213.274  11709.956      6.671   6843.863   2008.000  29982.000  26257.000    1052640   20191023T000616.4_087LL_flt
  3275.167  11844.497      6.774   6949.688   2143.000  30056.000  26272.000    1052640   20191023T000616.4_087LU_flt
  3212.443  11493.384      6.743   6918.183   2013.000  39054.000  25506.000    1052640   20191023T000616.4_087RL_flt
  2237.079  10508.753      5.826   5977.233   2025.000  36148.000  23138.000    1052640   20191023T000616.4_087RU_flt
  2238.042   8083.740      4.293   4404.633   2084.000  29334.000  17628.000    1052640   20191023T000616.4_088LL_flt
  2845.609   8060.571      4.403   4517.004   2038.000  20777.000  17860.000    1052640   20191023T000616.4_088LU_flt
  2965.036   8319.966      4.209   4318.471   2113.000  20112.000  17750.000    1052640   20191023T000616.4_088RL_flt
  2133.284   7182.946      3.542   3634.350   2034.000  17672.000  15419.000    1052640   20191023T000616.4_088RU_flt
  1240.958   3576.065      1.631   1673.607   1193.000   8456.000   7354.000    1052640   20191023T000616.4_091LL_flt
  1183.102   2928.554      1.414   1450.422    907.000   8655.000   6409.000    1052640   20191023T000616.4_091LU_flt
  1556.396   3430.417      1.450   1487.244   1327.000   8171.000   6900.000    1052640   20191023T000616.4_091RL_flt
   815.547   2459.678      1.034   1060.854    785.000   8947.000   5135.000    1052640   20191023T000616.4_091RU_flt
  1106.410   5719.017      3.323   3409.651   1010.000  14936.000  13055.000    1052640   20191023T000616.4_092LL_flt
  1635.158   5885.175      3.492   3582.760   1006.000  15523.000  13601.000    1052640   20191023T000616.4_092LU_flt
  1643.589   5611.836      3.336   3422.213   1035.000  15654.000  12868.000    1052640   20191023T000616.4_092RL_flt
  1095.069   5289.064      3.073   3152.813   1028.000  13938.000  12150.000    1052640   20191023T000616.4_092RU_flt
  2102.841   6778.686      3.801   3899.548   1352.000  17782.000  15500.000    1052640   20191023T000616.4_093LL_flt
  1125.228   6910.231      4.118   4225.471    982.000  18381.000  16141.000    1052640   20191023T000616.4_093LU_flt
  1019.362   6899.194      4.571   4689.896    927.000  18114.000  16516.000    1052640   20191023T000616.4_093RL_flt
  2069.917   6493.117      4.052   4156.822   1185.000  23884.000  15803.000    1052640   20191023T000616.4_093RU_flt
  1956.173   8373.265      5.078   5209.812   1116.000  23126.000  20240.000    1052640   20191023T000616.4_094LL_flt
  1232.429   8414.536      5.062   5193.315   1087.000  21940.000  19644.000    1052640   20191023T000616.4_094LU_flt
  1260.183   8584.778      5.421   5561.450   1104.000  23036.000  20714.000    1052640   20191023T000616.4_094RL_flt
  1980.011   8169.250      5.306   5443.531      0.000  65535.000  20831.000    1052640   20191023T000616.4_094RU_flt
  1892.021   7794.063      4.851   4977.488   1046.000  26043.000  18697.000    1052640   20191023T000616.4_095LL_flt
  1144.435   7385.664      4.563   4681.888   1048.000  20761.000  18489.000    1052640   20191023T000616.4_095LU_flt
  1058.741  10004.068      6.645   6818.111    921.000  29739.000  24660.000    1052640   20191023T000616.4_095RL_flt
  1963.363   8869.703      6.102   6260.885    986.000  26330.000  23513.000    1052640   20191023T000616.4_095RU_flt
  1197.577   8447.082      4.817   4942.654   1047.000  34890.000  19103.000    1052640   20191023T000616.4_096LL_flt
  2203.033   9140.727      5.679   5827.022   1153.000  23245.000  20790.000    1052640   20191023T000616.4_096LU_flt
  1832.716   6899.793      4.181   4290.119   1044.000  17918.000  15578.000    1052640   20191023T000616.4_096RL_flt
  1132.786   5911.591      3.392   3479.762   1054.000  19376.000  13698.000    1052640   20191023T000616.4_096RU_flt
  1966.888   6721.329      4.040   4144.966   1230.000  18886.000  16275.000    1052640   20191023T000616.4_097LL_flt
  1117.864   6934.609      4.316   4427.886   1032.000  19329.000  17016.000    1052640   20191023T000616.4_097LU_flt
  1623.457   6899.474      3.697   3793.104   1497.000  18674.000  14741.000    1052640   20191023T000616.4_097RL_flt
  1446.249   5428.451      3.184   3267.085    899.000  21267.000  12796.000    1052640   20191023T000616.4_097RU_flt
  1412.710   4580.575      2.447   2511.079   1030.000  11920.000  10291.000    1052640   20191023T000616.4_098LL_flt
  1114.317   4560.690      2.427   2489.871   1026.000  12290.000  10346.000    1052640   20191023T000616.4_098LU_flt
  1086.676   4944.578      2.852   2926.113   1001.000  12714.000  11478.000    1052640   20191023T000616.4_098RL_flt
  1537.232   4683.524      2.703   2772.800   1008.000  12972.000  11238.000    1052640   20191023T000616.4_098RU_flt
  1816.767   4635.246      2.214   2271.730   1391.000  22852.000   9569.000    1052640   20191023T000616.4_103LL_flt
  1866.193   4599.130      1.954   2005.081   1761.000  13352.000   8953.000    1052640   20191023T000616.4_103LU_flt
  1363.138   4763.742      2.404   2466.684   1297.000  11242.000  10052.000    1052640   20191023T000616.4_103RL_flt
  1267.441   4013.353      2.154   2210.081    901.000  10540.000   9074.000    1052640   20191023T000616.4_103RU_flt
  1618.508   5080.546      2.891   2966.450   1094.000  13284.000  11676.000    1052640   20191023T000616.4_104LL_flt
  1408.257   5830.044      3.212   3294.964   1326.000  14147.000  12772.000    1052640   20191023T000616.4_104LU_flt
   974.258   4362.818      2.392   2453.872    885.000  13746.000   9359.000    1052640   20191023T000616.4_104RL_flt
  1549.733   4198.831      2.072   2125.969   1143.000  11213.000   9005.000    1052640   20191023T000616.4_104RU_flt
  1404.569   5614.690      2.991   3068.919   1309.000  14713.000  12622.000    1052640   20191023T000616.4_105LL_flt
  1882.743   5794.834      3.053   3132.805   1334.000  19105.000  12761.000    1052640   20191023T000616.4_105LU_flt
  1434.145   4610.251      2.603   2670.684    958.000  12651.000  10330.000    1052640   20191023T000616.4_105RL_flt
  1305.161   4779.111      2.540   2605.791   1234.000  11844.000  10567.000    1052640   20191023T000616.4_105RU_flt
  1560.789   5001.529      2.792   2864.106   1043.000  12261.000  10932.000    1052640   20191023T000616.4_106LL_flt
  1111.209   5353.560      3.066   3145.212   1023.000  12804.000  11576.000    1052640   20191023T000616.4_106LU_flt
  1124.610   5052.754      2.873   2947.584   1042.000  14987.000  11036.000    1052640   20191023T000616.4_106RL_flt
  1514.054   4663.188      2.643   2711.904   1027.000  11967.000  10646.000    1052640   20191023T000616.4_106RU_flt
 
This is just a start.

Return to top.



Looking at specific units.

Here is what I might do for the dsf data of 20191024. Initial example uses my Ops data from 20191023.

[sco@mcs ~/tmp3]$ cat BaseDir 
/hetdata/data
[sco@mcs ~/tmp3]$ cat Date 
20191023
[sco@mcs ~/tmp3]$ virims any 1 081 any ldls_long N  
  172  8   (number of lines virims.out0 virims.out1)  
[sco@mcs ~/tmp3]$ cat virims.out1 
/hetdata/data/20191023/virus/virus0000001/exp01/virus/20191023T000616.4_081LL_flt.fits
/hetdata/data/20191023/virus/virus0000001/exp01/virus/20191023T000616.4_081LU_flt.fits
/hetdata/data/20191023/virus/virus0000001/exp01/virus/20191023T000616.4_081RL_flt.fits
/hetdata/data/20191023/virus/virus0000001/exp01/virus/20191023T000616.4_081RU_flt.fits
/hetdata/data/20191023/virus/virus0009901/exp01/virus/20191023T215124.1_081LL_flt.fits
/hetdata/data/20191023/virus/virus0009901/exp01/virus/20191023T215124.1_081LU_flt.fits
/hetdata/data/20191023/virus/virus0009901/exp01/virus/20191023T215124.1_081RL_flt.fits
/hetdata/data/20191023/virus/virus0009901/exp01/virus/20191023T215124.1_081RU_flt.fits

virstats.sh virims.out1 1 1020 1 1032 99.9 N
     1052640 - 1000  = 1051640   
    fper = 1051640/1052640 * 100  = 99.90 

[sco@mcs ~/tmp3]$ virstats.sh virims.out1 1 1020 1 1032 99.99 N            # takes about 3 sec on mcs

[sco@mcs ~/tmp3]$ cat virstats.* 
# output from virstats.sh:
Col01 = mean bias value
Col02 = mean pixel signal (inclduing bias)
Col03 = mean error of mean 
Col04 = standard deviation 
Col05 = min pixel value 
Col06 = max pixel value 
Col07 = Signal where Npix exceeds  99.99 percent of total
Col08 = number of pixel in image statsec 
Col09 = basename of image 
  1126.496   4358.010      2.498   2562.956   1060.000  20426.000  11366.000    1052640   20191023T000616.4_081LL_flt
  1550.214   4414.313      2.572   2639.005   1058.000  12332.000  11523.000    1052640   20191023T000616.4_081LU_flt
  1585.773   4683.019      2.673   2742.483   1089.000  13196.000  11316.000    1052640   20191023T000616.4_081RL_flt
  1121.924   4430.829      2.387   2449.496   1047.000  11583.000  10899.000    1052640   20191023T000616.4_081RU_flt
  1110.931   4122.521      2.332   2392.561   1047.000  11192.000  10691.000    1052640   20191023T215124.1_081LL_flt
  1508.854   4172.901      2.399   2461.469   1048.000  11600.000  10832.000    1052640   20191023T215124.1_081LU_flt
  1544.046   4434.915      2.508   2573.518   1076.000  16414.000  10681.000    1052640   20191023T215124.1_081RL_flt
  1107.279   4199.034      2.247   2304.977   1037.000  20877.000  10250.000    1052640   20191023T215124.1_081RU_flt
 
This is just a start.

Return to top.



Gather DSF data.

On 20191024 we need DSF data for:


   V414 S038 
   V413 S028 
   V330 S092   

[sco@mcs ~/tmp3]$ cat BaseDir 
/hetdata/data
[sco@mcs ~/tmp3]$ cat Date 
20191023

For each ifu:
[sco@mcs ~/tmp3]$ virims 6000 1 038 any ldls_long N  
[sco@mcs ~/tmp3]$ virstats.sh virims.out1 1 1020 1 1032 99.99 N  
 
For my sample data on sco2019:
% virims 1 1 038 any ldls_long N 
  4  4   (number of lines virims.out0 virims.out1)  
% virstats.sh virims.out1 1 1020 1 1032 99.99 N 

% gethead /media/sco/DataDisk1/sco/AD/VIRDATA/20191023/virus/virus0000001/exp01/virus/20191023T000616.4_038RU_flt.fits EXPTIME
23.000033536

% cat virstats.*
# output from virstats.sh:
Col01 = mean bias value
Col02 = mean pixel signal (inclduing bias)
Col03 = mean error of mean 
Col04 = standard deviation 
Col05 = min pixel value 
Col06 = max pixel value 
Col07 = Signal where Npix exceeds  99.99 percent of total
Col08 = number of pixel in image statsec 
Col09 = basename of image 
  1064.288   5602.733      2.984   3062.003   1067.000  13813.000  13184.000    1052640   20191023T000616.4_038LL_flt
  1037.867   5459.497      2.962   3039.460   1035.000  13631.000  13095.000    1052640   20191023T000616.4_038LU_flt
  1043.139   6115.078      3.433   3522.011   1043.000  15799.000  14919.000    1052640   20191023T000616.4_038RL_flt
  1059.766   6406.114      3.584   3677.323   1063.000  16249.000  15586.000    1052640   20191023T000616.4_038RU_flt

Hence, I need to run exposure_cal with: 
exposure_cal 45000.0 1064 13184 24.0 Y 
Estimated exptime for desired peak level =      87.001980
 
The first use of these tools occurred on 20191024 UT.


Units of interest today:      
   Names                                Final subdirectory 
   V414 S038; V413 S028: V330 S092      /hetdata/data/20191024/virus/virus0007000   

* lights off in dome                                     # 16:20 UT
* ipvg off ; apcCmd off V309_IONPump                     # 16:23
                                                                      
Proper syntax today is: 
[astronomer@mcs ~]$ cal virus -l ldls_long -L 1 -o 6000 -bexp 1.3       # 16:25 UT  (7min)  

Best exposure times: 
   IFUSLOT   EXPTIME 
   038        1.5 sec       
   028        2.2 sec
   092        1.6 sec
Hence, 1.5 is my minmun allowed exp time. To compenste I scale nexp=30 to 
    nexp = 30 (2.2/1.5) = 44 exposure,    I use n=45 

[astronomer@mcs ~]$ cal virus -l ldls_long -L 45 -o 7000 -bexp 1.5       # 16:50 UT   end: 17:

*** Confirmed that 7000 series 038RU is near peak of 45000adu 

* ipvg on ; apcCmd on V309_IONPump                     # 17:55  
* lights or in dome                                    # 17:56 

Valuable info for RAs:      For 45 images I measured rate = 1.428 min/image     
(We are eeadtime dominated, so this is a fairly general number) 

# ----------------------------------------------------------------
Do not send SCO notes  
# ----------------------------------------------------------------
This work in:  /home/mcs/astronomer/sco/RA_logs/20191024_dsf  
Following instructions in:
https://hettrac.as.utexas.edu:8001/trac/WFUCommissioning/wiki/HetProcedures/VDF

dsftimes runs in:    /home/mcs/sco/tmp4

6000 038 test with virusview     bias=1050   peak=37000      RU
 
# SCO NOTES
dsftimes 6000 038 1.3 N
    im,bias,Fmax,Texp,TexpNEW:  4 1065.697 37891.000 1.3 1.550961   RU      checks with virusview

dsftimes 6000 028 1.3 N
    im,bias,Fmax,Texp,TexpNEW:  4 1047.283 26500.000 1.3 2.244889   RU       checks with virusview

dsftimes 6000 092 1.3 N
im,bias,Fmax,Texp,TexpNEW:  2 1031.800 35677.000 1.3 1.649829a      LU       checks with virusview

Best exposure times: 
   IFUSLOT   EXPTIME 
   038        1.5 sec       
   028        2.2 sec
   092        1.6 sec
Hence, 1.5 is my minmun allowed exp time. To compenste I scale nexp=30 to 
    nexp = 30 (2.2/1.5) = 44 exposure,    I use n=45 
 
The emphasis on explanatory notes is discouraged, so everything below "SCO notes" line is excluded from the reporting emails.

Return to top.



Back to SCO code page