Weekly eSASS developers meeting
Start of meeting: 2021-03-16 13:30
Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09
Participants: Ian Stewart, Hermann Brunner, Miriam Ramos, Alain Gueguen, Konrad Dennerl, Mara Salvato, Sabine Osterhage, Susanne Friedrich, Chandeyee Maitra, Andrea Merloni, Michael Freyberg
- Open actions from previous developers meetings
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- updates by Jeremy and Ian (evtool, expmap, catprep)
still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)
- Act20201006/1_SF clean event file description, update source list description
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- Preprocessing / NRTA
- eFEDS catalog paper
eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page
- telselect (Ian's modifications)
- evtool (Martin's email)
- ftfindhotpix (v1.10 in 946 pipeline)
- task parameters in pipeline (document)
- fftw-3.3.8/9 single/double precision
- shapelib + ermldet changed to double precision: everything consistent now
- ds53 to be upgraded to bionic after April
apache v2.2 -> v2.4.7 (changed htaccess syntax), php -> v5.5.9
- Pipeline tasks (shadow developer/pipeline operator)
- eropipe, proc, prexec - Alain
- telstage, dalist, rmvers - Miriam, ?
- Recent task updates:
- general-1.9
- erolib-2.47
- evprep-3.22
- Pipeline / ongoing processing
- 946 processing restarted / reruns
- HiPS maps / hot pixels
- TM4: BTI starting from 46346 is in place, artefact is earlier (extend bti?)
- held cameras (TM2/4/5), caldb updates
- Zip patterns - operations/pipeline/caldb
- Updating bad pixel definition
- Cosmetic bad pixels?
- Flagging data of uncertain quality?
- rerunning 947 test dataset
- RXJ 1605 in 947 pipeline?
All-sky data access / SciServer
- eRASS3 in eRASSuser (cronjob)
- direct archive access
- EDR
- Web forum update
- Web pages - password access
- Documentation, etc.
DAtool / ProcStat
- access restrictions for data request logs + project descriptions (discussion ongoing - details tbd)
- large requests / limits (Zhu Liu's request)
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python - ongoing
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?
- Open actions from previous developers meetings
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- updates by Jeremy and Ian (evtool, expmap, catprep)
still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)
- Act20201006/1_SF clean event file description, update source list description
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- Preprocessing / NRTA
- eFEDS catalog paper
- Technical appendix
- Main paper layout
eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page
- energy-3.1
- new HK3 column (evprep)
- erolib/telselect/evtool/eSASSuser/946 compatibility issues?
- telselect needs updates (prepared by Ian in December) to work with new event files
- expmerge may also require update
- (no) time ordering in event files / time back jumps
- energy now works independent of event sorting (uses TSTART, TSTOP, evprep could add min/val keywords)
- erolib/telselect/evtool/eSASSuser/946 compatibility issues?
- new HK3 column (evprep)
- fftw-3.3.8/9 single/double precision; srctool needs single precision because of memory usage
- how to provide both version in build?
- ds53 to be upgraded to bionic: Hips/Java, Python version, eSASSdevel builds (build needs to be adjusted) eROSE/eROpub, php
- upgrade after EDR/947 pipeline, can't be after April. Suggestion: after April 15. Write email to Harald with cc of
- some downtime needed before restarting eROSITA services
- Pipeline tasks (shadow developer/pipeline operator)
- eropipe, proc, prexec - Alain
- telstage, dalist, rmvers - Miriam, ?
- Recent task updates:
- eropipe2-1.20, proc-1.21
- evprep-3.11.4/3.11.5/3.20/3.21
- pattern-3.0, energy-3.1
- gtcal-1.13.1
- evtool-2.10.2/2.20
- erolib-2.44/2.45
- energy-3.1
- Pipeline / ongoing processing
- RXJ 1605: not yet fully dumped - probably processed tomorrow
- 946 pipeline
- SEXP/SDET chains stopped (today) till caldb is updated (sky artefacts/reprocessing needed)
- TM4 badpix (Michael's email) / time jumps
- temperature dependent energy calibration in 946 pipeline?
- 947 sky tile 087156+093156 processed
- starting full eRASS1/2?
- rerun 100 eROday test after some more updates by Ian (probybly next week)
All-sky data access / SciServer
- eRASS3 in eRASSuser (cronjob)
- EDR
- Web forum update
- Web pages, documentation
- Miriam proposes a Webpage meeting (Hermann, Sabine, Susanne, Alain, Miriam) during the first week of April.
- Validation of CalPV/c001 data: guidelines by eSASS team
- Chandreyee has corrected some header keywords. @Michael: what else needs to be corrected? when do we expect to have the latex templates?
DAtool / ProcStat
- access restrictions for data request logs + project descriptions (discussion ongoing - details tbd)
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python - ongoing
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?