Monthly eSASS Q&A / weekly eSASS developers meeting
Start of meeting: 2021-05-11 13:30
Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09
eSASS Q&A
- Old actions:
- EDR task descriptions etc. - deadline May 15
- Preprocessing / NRTA
eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page
- Task updates for 947 pipeline: ermldet/apetool,eprep, other?
- evprep
- thresholding (running 946+947 in parallel, Jan's summary) - use corralgo algorithm
- SPLT2NOI HK value: parameter for evprep to pass location of file to keep track last good value of threshold scaling - should be in 947
- ermldet: asymmetric errors - setup for 947
dedicated meeting? -> perhaps not needed/discuss on Thursdsy once more
- Provide asymmetric and symmetric errors, decide later how to compute summary band errors (simulations?)
- Renaming columns (estimate_...) to indicate the limitations of the summary band errors
- Positional errors - RA/DEC upper/lower/RADEC_ERR - change delta chi-sq. threshold?
- GL will upload new version
- update catprep to accommodate new columns
- write NULL value for failed error determinations in EDR user release? Leave as is and document in task description.
- Changed BADPIX format
- move ftfindhotpix-1.11 and srctool-1.65 to 946 pipeline, set expmap to read badpix extension
- apetool
- latest version not yet in task archive?
- Antonis' ermldet changes for compatibility with apetool
- Antonis/Georg/Ian meeting
- New pattern version for 947 (requires new cal file type)
- Pipeline testing (Alain...)
- Recent task updates:
- erolib-2.52
- evprep-3.24
- expmap-2.6.1
- ftfindhotpix-1.12
- Pipeline / ongoing processing
- 946
- held cameras / TM4 processing
- caldb: bright pixels/columns, Zip patterns
- set new validity start days when new pixel scheme is enabled
- processing errors, backlogs, etc.
- Hips map: 021 band count excess (will be fixed in 947 with new evprep version)
- Exposure map discontinuity: look at example sky tile where discuontinuity happend and investigate GTI, task versions, caldb, etc.
- disk copying
- 947
- test runs / time scale / code freeze
- EDR
- EDR Web pages (Miriam's todo list(s), Andrea's comments)
Page counters -> https://de.wikipedia.org/wiki/Matomo
- Data issues
- CalPV TSTART/TSTOP and times, header keywords, Puppis A
- Document the wrong time keywords either globally and/or in the TeX reports
- Investigate swhether the issue persists in current eSASS versions
- New November planning file
001 pipeline needs to be rerun (four ObsIDs) -> HB, Chandreyee needs to rerun header correction script
- meeting last Thursday
- TeX reports / Susanne's Python script
- Reprocessing?
- CalPV TSTART/TSTOP and times, header keywords, Puppis A
- EDR Web pages (Miriam's todo list(s), Andrea's comments)
DAtool / ProcStat
- access restrictions for data request logs + project descriptions
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python - ongoing
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[7] EV_WEIGHT: event based vignetting correction
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?
Previous meeting:
- Open actions from previous developers meetings
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- updates by Jeremy and Ian (evtool, expmap, catprep)
still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)
- Act20201006/1_SF clean event file description, update source list description
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- Preprocessing / NRTA
- eFEDS catalog paper
- Paul's comments
eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page
- GTI computation (Michael's email)
- Task updates for 947 pipeline: ermldet/apetool, other?
srctool products in subdirectories (Jeremy) -> group by each 100 sources (947 pipeline)
- Changed BADPIX caldb format / backward compatibility in 946
- move ftfindhotpix-1.11 and srctool-1.65 to 946 pipeline, set expmap to read badpix extension
- SPLT2NOI HK value (Ian/Konrad)
- new parameter for evprep to pass location of file to keep track last good value of threshold scaling
- evprep-3.23/caldb: THRMAP/SCTHRMAP
- might cause issues with running 946 and 947 in parallel
- evtool: polar images (Andy)
- bug in autoscaling? report in known issues of user eSASS, don't patch eSASSuser_201009
- Pipeline tasks (shadow developer/pipeline operator)
- eropipe, proc, prexec - Alain
- telstage, dalist, rmvers - Miriam, ?
- Recent task updates
- transprep-1.2
- expmap-2.6
- catprep-2.4.1
- srctool-1.66
- Pipeline / ongoing processing
- 946
- held cameras / TM4 processing
- processing errors, backlogs, etc.
- caldb: bright pixels/columns, Zip patterns
- Hips map: 021 band count excess / exposure map discontinuitiy
- disk copying
- 947
- test runs / time scale / code freeze
Discussion at data meeting 947 processing Wiki page
- EDR
- Web pages - access
- Documentation, etc.
eSASS known issues (ChangeLogs)
- CalPV START/STOP times (Frank)
DAtool / ProcStat
- access restrictions for data request logs + project descriptions
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python - ongoing
- Longterm activities
[?] Moving task archive to git
- evprep
[9] evprep: space invaders event flag
- evtool should update the gti according to this flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[7] EV_WEIGHT: event based vignetting correction
[6] Background analysis: projecting closed data onto the sky (XMM SAS)
[4] ersensmap: implement pointing PSF
[3] ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)?