Weekly eSASS developers meeting
Start of meeting: 2021-07-13 13:30
Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09
Participants: Ian Stewart, Hermann Brunner, Miriam Ramos, Alain Gueguen, Konrad Dennerl, Sabine Osterhage, Susanne Friedrich, Chandeyee Maitra, Michael Freyberg, Jeremy Sanders, Andrea Merloni, Felix Schmidt, Teng Liu, Mara Salvato
- eROSITA anniversary: 4386 eROdays
- Preprocessing / NRTA
- EDR
- Forum
- Subforums not visible for most people (Harald investigates)
- License for public eSASS
- Response by Achim
- eSASS:
- Older HEASOFT versions not supported (put in documentation - Alain)
- Create new alias to helpdesk list (e.g. EDR-helpdesk) - ask Harald
- Forum
- eFEDS referee report
- forced photometry update (ermldet-1.47), reordering columns
- DATool
- srctool products for cat+products region requests
- fixed in Alain's dev version, will be brought online after more testing
- fix will go online, further bug fixing regarding region filtering in evtool ongoing (requires erolib update)
- fixed in Alain's dev version, will be brought online after more testing
- Emails to DATool user / helpdesk
- cc responses to users to helpdesk
- Further upgrades, etc.?
- srctool products for cat+products region requests
- 980 test pipeline
- Susanne will use F003 in raw/proc
- HB will create list of potential eropipe improvements
- Backups of eSASS, caldb, /ero_archive
https://wiki.mpe.mpg.de/eRosita/EroCat/eSASSdevel/eROArchiveBkp
Disk backups (storing important data on multiple disks+SciServer)
- /ero_archive6/Backup (ca. 9 TB)
- raw, sw, IKIdata
- /ero_archive6/Backup (ca. 9 TB)
eSASS tasks eSASSdevel page / Error tracking page
- From previous meeting
- PSF normalization
- repeat test with new ermldet version (to be uploaded) Teng+Georg
- detection vs sensitivity map
Frank <-> Georg (both are/will go on vacation soon)
- may be due to chopper issues in CalPV
- no further tests before Georg's vacation
- srctool option to use multipe envent files
- if lightcurve time bin spans two event files rates will be wrong (documentation issue)
- should be placed in known issues for CalPV - done
- Check whether there are still keyword issues in recent survey data (TSTART/TSTOP, RA_CEN/DEC_CEN, OWNER)
- check in 947 test data
- TSTART/TSTOP still open (?)
- FRAMETIM:
- fix in eroio for now (email by Michael?)
- fixed in eroio-2.59?
- fix in eroio for now (email by Michael?)
- expmap
- add a warning: potential inconsitency between withdetmap command line parameter and selection events on out of fov bit (is on Ian's todo list)
- PSF normalization
- ftfindhotpix-1.18 issues (missing bad pixels?)
- needs bug fix (rerun 947 100 eROday list?)
- Recent task updates:
- eroio-2.59
- ermldet-1.47
- erolib-2.59
- evprep-3.34
- From previous meeting
- Pipeline / ongoing processing
processing wiki page Pipeline / ongoing
- bti, badpix, held cameras
- time shift for TM3
- TM4/5/7 still held
- TM5/7 additiona bad pixels (set pad on-board/on-ground as needed)
- 946 / eRASS4
- 947 / eRASS1/2/3
- validation
- 946/947 errors?
- telgti need updte when Georg is back (three failed TEL chain run)
- TEL chains started multiple times? (Miriam's email)
- now worked (we don't know why)
- srv.fits files left in TEL directories
- HiPS maps
- 947 / missing tiles
- srv.fits files left in TEL directories
- HiPS maps
- 947 / missing tiles?
- so far only eRASS1
- 947 / missing tiles?
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[7] EV_WEIGHT: event based vignetting correction
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?
- add option to provide larger sky areas (Jeremy's script)
Previous meeting:
eSASS Q&A
- Preprocessing / NRTA
- EDR
- data downloads, etc.
- docker eSASS, cone search?
- forum, subforums?
- Internal task descriptions: should link to current user release
- License for public eSASS
-> GPL2 or later
- where to add the license text?
- should be in download folder and each tar ball (and in docker)
- in the future each developer should put the license file in the tar ball (put in make file)
- are there any MPG considerations (ask Achim Bohner)
- should be in download folder and each tar ball (and in docker)
- eFEDS referee report
- ask Antonis about hi availability
- Andrea/Mara are available till Aug 7.
- Figure on scanning pattern?
- DATool
- srctool products for cat+products region requests
- fixed in Alain's dev version, will be brought online after more testing
- srctool products for cat+products region requests
- 980 test pipeline for caldb
- Susanne will use F003 in raw/proc
- Pipeline / ongoing processing
processing wiki page Pipeline / ongoing
- bti, badpix, held cameras
- 946 / eRASS4
- 947 / eRASS1/2
- checking results?
- processing speed
- 946/947 errors?
- TEL chain: 47102..05 TM4?
- HiPS maps
- 947 / missing tiles
eSASS tasks eSASSdevel page / Error tracking page
- From previous meeting
- PSF normalization
- repeat test with new ermldet version (to be uploaded) Teng+Georg
- Georg will upload ermldet update today (for 947)
- repeat test with new ermldet version (to be uploaded) Teng+Georg
- detection vs sensitivity map
Frank <-> Georg (both are/will go on vacation soon)
- may be due to chopper issues in CalPV
- no further tests before Georg's vacation
- srctool option to use multipe envent files
- if lightcurve time bin spans two event files rates will be wrong (documentation issue)
- should be placed in known issues for CalPV - done
- Check whether there are still keyword issues in recent survey data (TSTART/TSTOP, RA_CEN/DEC_CEN, OWNER)
- check in 947 test dasta
- TSTART/TSTOP still open
- FRAMETIM: hardcoded (eroio?), caldb?
- fix in eroio for now (email by Michael?)
- expmap
- add a warning, potential inconsitency between withdetmap command line parameter and selection events on out of fov bit (is on Ian's todo list)
- PSF normalization
- ftfindhotpix (further testing?)
- v1.18 should also go in 946
- Ian will still do in depth tests (compare history of changes for TM4)
- Recent task updates
- erolib-2.58.1 / 2.58.2
- evprep-3.33
- ftfindhotpix-1.17 / 1.18
- expmerge-1.25
- tel-1.26
- some crashes du to multiple concurrent runs of same dataset
- flaregti-1.24
- future updates for evtool (947) and expmap
- HB: update telatt (v1.6) in 946
- From previous meeting
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[7] EV_WEIGHT: event based vignetting correction
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?