Monthly eSASS Q&A / weekly eSASS developers meeting
Start of meeting: 2021-02-02 13:30 (1:30pm)
Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09
eSASS Q&A
- Open actions from previous developers meetings
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- updates by Jeremy and Ian (evtool, expmap, catprep)
- still missing: Hermann (radec2xy), Georg (detection + evatt)
- Act20201006/1_SF clean event file description, update source list description
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- Preprocessing / NRTA
- Noise/offset maps?
- TEL chain trigger files / HK file versions
eSASS tasks (ongoing/planned) / current processing errors - eSASSdevel page / Error tracking page
- eRASS1 code updates/code freeze (Ian's email)
expmap: parallel version? Jeremy <--> Ian
- still under investigation, patch for 947 may be needed
- catprep: making number of bands variable (1..5) - in progress
- detection task updates (ongoing, perhaps ready for 947)
- clobber option
- improved RADEC_ERR, upper/lower count rate errors
- Pipeline tasks (shadow developer/pipeline operator): eropipe, proc, prexec, telstage, dalist, rmvers
- Recent task updates:
- evprep-3.18, evprep-3.11.3, erolib-2.39, tel-1.24
- Pipeline / ongoing processing
- Processing artefacts page rearranged by Chandreyee
- Computing resources for eSASS pipeline/ground segment vs. heg general
- NFS server issues
- 947 test runs
- eRASS3 (946) exposure deficit
- caused (in part) by incomplete/not-current HK file versions?
- telgti issues at border of planning files (fixed in tel-1.24)
- 46008 and 46085 rerun in eRASS3 946 processing
- similar exposure deficits in eRASS1/2
- Missing soft sources (Frank)
- Chandreyee will investigate
- bad pixels in caldb (TM1/2/3/7)
- Temperature dependence in task energy (HK access)
- should go in 947 pipeline
- Konrad will prove list of eROday to Hermann
- Zip pattern analysis
- updating badpixel / bti in caldb
- Discrepancies in source list of demo script runs / ermldet uninitialized variables
- Still different results of same binaries on different machines
- Different from pervious problem, all sources are affected (parameter are sightly different) - high priority
- Confirm whether ermldet patch changes the eFEDS source list (Teng?)
- pipeline (eropipe2) machine utilization
- potential improvements
- MIP threshold increase (get threshold from HK)
- evprep-3.18/3-11.3
- evprep summary reports
- will be updated by Chandreyee to check TM5/7 against successive eROdays
- HiPS / ds53 issues / processing speed
- migrating to He4ero?
- s/c clock drift / clock resets
- EDR
- Web pages, documentation
- Validation of CalPV/c001 data: guidlines by eSASS team
- EDR
- Longterm activities
[?] Moving to git
- expmap
[10] Parallel version
- evprep
[9] evprep: space invaders event flag
- post-processing: frames with many counts?
- BTI/GTI:
- PDF for CalPV linked on wiki page (done?)
[7] one PDF per eRASS in wiki
- ermldet
[8] ca. 2% of sources have positional error 0, some also have count error 0
- can't be fixed quickly, may need replacement of algorithm
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- Time dependent RMFs/ARFs (srctool?)
[8] RMF
[7] ARF
[6] Background analysis: projecting closed data onto the sky (XMM SAS) -> 6
[4] ersensmap: implement pointing PSF
- ftfindhotpix: test and update algorithm
[1] Light leak in eSASS/pipeline?
[1] DAtool: filtering catalogs (separate from DAtool)? -> 1
- DAtool
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python / should everything be moved to Python? - ongoing
- DAtool / eROSE interface: requires change in frontend
Previous meeting:
- Open actions
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- updates by Jeremy and Ian (evtool, expmap, catprep)
- still missing: Hermann (radec2xy), Georg (detection + evatt)
- Act20201006/1_SF clean event file description, update source list description
- Act20200929/1_all make sure html task descriptions are current and consistent with user release
- Preprocessing / NRTA
eSASS tasks (ongoing/planned) / current processing errors - eSASSdevel page / Error tracking page
- eRASS1 code updates/code freeze (Ian's email)
expmap: parallel version? Jeremy <--> Ian
- catprep: making number of bands variable (1..5)?
- expmerge: 947 crashes
- detection task updates (ongoing, perhaps ready for 947)
- clobber option
- improved RADEC_ERR, upper/lower count rate errors
- Pipeline tasks (shadow developer/pipeline operator): eropipe, proc, prexec, telstage, dalist, rmvers
- Recent task updates:
- Pipeline / ongoing processing
processing wiki page (Miriam's changes)
- eRASS3 (946) exposure deficit (Chandreyee's analysis)
- Georg thinks this is a telgti problem - might also have h ed in pevious eRASSes - will investigate
- Missing soft sources (Frank)
- Artefacts in CalPV (c001) ObsID 710000 - Teng
- issue with subpixel calculation, due to unfortunate placement o sourc on pixel grid?
- bad pixels in caldb (TM2/TM3) - Susanne will put them in the caldb
- Temperature dependence in task energy (HK access) - could be part of 947 reprocessing if timescales align
- should go in 947 pipeline / timescale ca. 2 weeks
- KOnrad will pove list of eROday to Hermann
- Treating zip patterns as bad pixels?
- Data quality of events not on zip pattern?
- evprep summary reports - thresholds, incomplete eROdays, etc.
- threshold raised for TM5/7
- Discrepancies in source list of demo script runs / ermldet uninitialized variables
- Still different results of same binaries on different machines
- Different from pervious problem, all sources are affected (parameter are sightly different) - high priority
- Confirm whether ermldet patch changes the eFEDS source list (Teng?)
- Patch user release / update Docker version? Will be fixed for Georg's/Teng's CALPV papers
- Hanging pipeline jobs
- LOCK, ERROR, START files?
- MIP threshold increase (threshold from HK)
- should be patched in 946 pipeline eSASS
- EDR
- Web pages, documentation
- Validation of CalPV/c001 data: guidlines by eSASS team
- Longterm activities
- BTI/GTI: user access to bad data
- PDF for CalPV linked for wiki page?
one PSF per eRASS in wiki? -> 7
ersensmap: implement pointing PSF -> 4
- expmap
Parallel version -> 10
- ermldet
- ca. 2% of sources have positional error 0, some also have count error 0
can't be fixed quickly, may need replacement of algorithm -> 8
- Johan's proposal? Georg to discuss with Johan (long timescale project)
- ca. 2% of sources have positional error 0, some also have count error 0
- evprep: experimental event flags (space invaders)
post-processing: space invaders, frames with many counts, statistical event flagging -> 9
- ftfindhotpix: test and update algorithm
Light leak in eSASS/pipeline? -> 1
DAtool: filtering catalogs (separate from DAtool)? -> 1
Time dependent RMFs/ARFs (srctool?) -> 8 (RMF) 7 (ARF) +/-5
Background analysis: projecting closed data onto the sky (XMM SAS) -> 6
Moving to git -> ?
- BTI/GTI: user access to bad data
- DAtool
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python / should everything be moved to Python? - ongoing
- DAtool / eROSE interface: requires change in frontend
- Retrieving eRASS3/c946 data?
- Other issues
- eRASS1/946?
eRASS:n -> eRASSn