eSASS Q&A meeting / SASS developers Zoom meeting
Start of meeting: 2020-09-01 13:30 (1:30pm)
Zoom link: https://zoom.us/j/7909307159?pwd=ZEdGeTJQUzdsRGpkd2Q5aUZXQmZZdz09
eSASS Q&A
- eSASS developers meeting
- Open actions
- Act20200818/1_IS: make catprep write FITS units and comment strings - ongoing
- writes units / not clear about comments (column comments)
- Act20200811/1_GL: investigate whether ersensmap output maps are correct - ongoing
- Act20200825/1_IS+GL: investigate how catprep determines the DetUID - done
- new parameter to specifiy prefix (onfirmed by Miriam and Georg)
- Act20200818/1_IS: make catprep write FITS units and comment strings - ongoing
- NRTA
- 946 / 947 (re-)processing
c946 TEL chain + EXP/DET chains (RASS:2), SOU chain about to restart
- Disk space:
- LOCK mechanism to block write access to directories while they are copied to a different disk
- Pipeline failures before LOCK mechanism was in place
- Compressing all srctool products (c946)
This week: /ero_archive6 & /ero_archive7 (ca. 190 TB each)
- LOCK mechanism to block write access to directories while they are copied to a different disk
- 945 / 946 comparison
- RXJ 1856 (eDay 44838) / c946 normalization issues
- ca. 20 affected eROdays in eRASS:1
CalPV 945/946 comparison? -> Thursday meeting
- RXJ 1856 (eDay 44838) / c946 normalization issues
- Held cameras
- 08/25 anomaly? should be reprocessed!
- Open actions
reset |
TM |
timeoff |
badcamt |
report |
eDays released |
07/08 |
TM5 |
no |
yes |
- |
yes |
07/14 |
TM3 |
no |
no |
yes |
|
07/15 |
TM4 |
yes |
yes |
yes |
|
07/16 |
TM3 |
no |
yes |
yes |
|
07/20 |
TM1 |
no |
yes |
yes |
|
07/20 |
TM4 |
yes |
yes |
yes |
|
07/21 |
TM5 |
no |
no |
yes |
|
07/27 |
TM6 |
no |
no |
yes |
|
08/02 |
TM2 |
no |
yes |
yes |
|
08/08 |
TM4 |
no |
yes |
yes |
|
08/27 |
TM4 |
no |
yes |
yes |
|
08/30 |
TM3 |
no |
yes |
- |
yes |
eSASS tasks (ongoing/planned) eSASSdevel page
expmap (PE015)
- 'table interpolation error' (fixed for detcorr in expmap, not corratt)
- make expmap more robust, fix root cause in evtool
- compare evatt/expmap coordinate conversion codes
- 'table interpolation error' (fixed for detcorr in expmap, not corratt)
- evprep: MIP counter in SciHK / new task parameter - update pipeline script (HB)
- evprep updates of 08/31
- evtool: don't copy most extensions (only GTI) if image=yes, events=no
flaregti (PE022): GTI issues
- quick fix in flaregti
- ersensmap: have a look at output maps, are they correct?
- crashes when there are null values in exposure map (in corner)
- currently only works with survey PSF
- Georg will update code to work with pointing PSF and review/improve algorithm
- Better documentation?
- apetool testing - Antonis will update docmentation
- eSASS task descriptions Web pages - developers should have a look and update them
- eSASSdevel nightly builds (script directories / file versions?)
- Recent task uploads
- DAtool
- PROCstat
- DEC range seems to flipped
- eRASS:1 / eRASS:2
- Longterm activities
- Light leak mitigation
- Wait for outcome of threshold test
- expmap: time dependent bad pixels
- Time dependent RMFs/ARFs (srctool?)
- Background analysis: projecting closed data onto the sky (XMM SAS) - dedicated meeting?
- Build infastructure (git) - meeting next week
- Public data release / public software release - discuss with Andrea (dedicated meeting)
- Light leak mitigation
- User requests
- Orbit file access (Axel Schwope) - use caldb download script
Previous meeting:
- Open actions:
- Act20200804/1_GL: test whether new lapack version (v3.9, ubuntu: 3.5.0) gives same result - closed
- only used by shapelib (matrix inversion) / autoconf build errors
- Act20200818/1_IS: make catprep write FITS units and comment strings - ongoing
- Act20200811/1_GL: investigate whether ersensmap output maps are correct - ongoing
- Act20200825/1_IS+GL: investigate how catprep determines the DetUID
- Act20200804/1_GL: test whether new lapack version (v3.9, ubuntu: 3.5.0) gives same result - closed
- NRTA
- 946 / 947 (re-)processing
- pipeline on hold: /ero_archive3/4/5 is full
- current short term solution: Harald is copying some directories to a new disk
- soon (next week): bring new archive disks online (350 TB)
- needs to be operatinal by end of next week (Harald's vacation)
- eropipe upgrades:
- allow mix of compressed/uncompressed products in files
- create LOCK mechanism to block directories while they are copied to a different disk
- 945 / 946 comparison (new plot by Miriam)
- Miriam will make some in depth spot checks
- pipeline on hold: /ero_archive3/4/5 is full
- Held cameras
reset |
TM |
timeoff |
badcamt |
report |
eDays released |
07/08 |
TM5 |
no |
yes |
- |
yes |
07/14 |
TM3 |
no |
no |
yes |
|
07/15 |
TM4 |
yes |
yes |
yes |
|
07/16 |
TM3 |
no |
yes |
yes |
|
07/20 |
TM1 |
no |
yes |
yes |
|
07/20 |
TM4 |
yes |
yes |
yes |
|
07/21 |
TM5 |
no |
no |
yes |
|
07/27 |
TM6 |
no |
no |
yes |
|
08/02 |
TM2 |
no |
yes |
yes |
|
08/08 |
TM4 |
no |
yes |
yes |
eSASS tasks (ongoing/planned) eSASSdevel page
- expmap:
- 'table interpolation error' (fixed for detcorr in expmap, not corratt)
- make expmap more robust, fix root cause in evtool
- compare evatt/expmap coordinate conversion codes
- 'table interpolation error' (fixed for detcorr in expmap, not corratt)
- evprep: MIP counter in SciHK - done
- new task parameter! pipeline script needs to be updated.
- evtool: don't copy most extensions (only GTI) if image=yes, events=no
- catprep: unique IDs
- apetool testing (demo script)
- some s/w updates, test script in test directory
- cookbook entry for apetool
- eSASS task descriptions Web pages - developers should have a look and update them
- ersensmap: have a look at output maps, are they correct?
- crashes when there are null values in exposure map (in corner)
- currently only works with survey PSF
- Georg will update code to work with pointing PSF and review/improve algorithm
- flaregti: TSTART=TSTOP?
- ermldet: vignetting and RAWX/Y column not filled: only pointing - should be documented (already in source list description)
- make sure columns are filled for pointings (GL)
- recent uploads:
- caldb
- bright TM3 columns? - very soft, probably not need
- expmap:
- DAtool
- Background analysis: projecting closed data onto the sky (XMM ESAS) - dedicated meeting?
- Longterm activities
- Light leak mitigation
- Wait for outcome of threshold test
- expmap: time dependent bad pixels
- Time dependent RMFs/ARFs (srctool?)
- Build infastructure (git)
- Public data release - discuss with Andrea (dedicated meeting)
- Public software release
- Light leak mitigation
- User requests
- Orbit file access (Axel Schwope) - use caldb download script