#acl EroCatGroup:read,write,revert All:read == Weekly eSASS developers meeting == '''Start of meeting: 2021-03-16 13:30''' Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09 Participants: Ian Stewart, Hermann Brunner, Miriam Ramos, Alain Gueguen, Konrad Dennerl, Mara Salvato, Sabine Osterhage, Susanne Friedrich, Chandeyee Maitra, Andrea Merloni, Michael Freyberg * Open actions from previous developers meetings * Act20200929/1_all make sure html task descriptions are current and consistent with user release * updates by Jeremy and Ian (evtool, expmap, catprep) * still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam) * Act20201006/1_SF clean event file description, update source list description * Preprocessing / NRTA * eFEDS catalog paper * eSASS tasks (ongoing/) / current processing errors - [[https://wiki.mpe.mpg.de/eRosita/EroCat/eSASSdevel|eSASSdevel page]] / [[https://wiki.mpe.mpg.de/eRosita/pipelineErrorTracking|Error tracking page]] * telselect (Ian's modifications) * evtool (Martin's email) * ftfindhotpix (v1.10 in 946 pipeline) * task parameters in pipeline (document) * fftw-3.3.8/9 single/double precision * shapelib + ermldet changed to double precision: everything consistent now * ds53 to be upgraded to bionic after April * apache v2.2 -> v2.4.7 (changed htaccess syntax), php -> v5.5.9 * Pipeline tasks (shadow developer/pipeline operator) * eropipe, proc, prexec - Alain * telstage, dalist, rmvers - Miriam, ? * Recent task updates: * general-1.9 * erolib-2.47 * evprep-3.22 * Pipeline / ongoing processing * [[https://wiki.mpe.mpg.de/eRosita/PipeProc|processing wiki page]] * 946 processing restarted / reruns * HiPS maps / hot pixels * TM4: BTI starting from 46346 is in place, artefact is earlier (extend bti?) * held cameras (TM2/4/5), caldb updates * Zip patterns - operations/pipeline/caldb * Updating bad pixel definition * Cosmetic bad pixels? * Flagging data of uncertain quality? * rerunning 947 test dataset * RXJ 1605 in 947 pipeline? * All-sky data access / SciServer * eRASS3 in eRASSuser (cronjob) * direct archive access * EDR * Web forum update * Web pages - password access * Documentation, etc. * DAtool / ProcStat * access restrictions for data request logs + project descriptions (discussion ongoing - details tbd) * large requests / limits (Zhu Liu's request) * providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine * move simple copying request to Python - ongoing * Longterm activities * '''[?]''' Moving task archive to git * evprep * '''[9]''' evprep: space invaders event flag * evtool should update the gti according to this flag * post-processing: frames with many counts? * BTI/GTI: * PDF for CalPV linked on wiki page (done?) * '''[7]''' one PDF per eRASS in wiki * ermldet * '''[8]''' ca. 2% of sources have positional error 0, some also have count error 0 * can't be fixed quickly, may need replacement of algorithm * Johan's proposal? Georg to discuss with Johan (long timescale project) * Time dependent RMFs/ARFs (srctool?) * '''[8]''' RMF * '''[7]''' ARF * '''[6]''' Background analysis: projecting closed data onto the sky (XMM SAS) * '''[4]''' ersensmap: implement pointing PSF * '''[3]''' ftfindhotpix: test and update algorithm * '''[1]''' Light leak in eSASS/pipeline? * '''[1]''' DAtool: filtering catalogs (separate from DAtool)? ---- * Open actions from previous developers meetings * Act20200929/1_all make sure html task descriptions are current and consistent with user release * updates by Jeremy and Ian (evtool, expmap, catprep) * still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam) * Act20201006/1_SF clean event file description, update source list description * Preprocessing / NRTA * eFEDS catalog paper * Technical appendix * Main paper layout * eSASS tasks (ongoing/) / current processing errors - [[https://wiki.mpe.mpg.de/eRosita/EroCat/eSASSdevel|eSASSdevel page]] / [[https://wiki.mpe.mpg.de/eRosita/pipelineErrorTracking|Error tracking page]] * energy-3.1 * new HK3 column (evprep) * erolib/telselect/evtool/eSASSuser/946 compatibility issues? * telselect needs updates (prepared by Ian in December) to work with new event files * expmerge may also require update * (no) time ordering in event files / time back jumps * energy now works independent of event sorting (uses TSTART, TSTOP, evprep could add min/val keywords) * fftw-3.3.8/9 single/double precision; srctool needs single precision because of memory usage * how to provide both version in build? * ds53 to be upgraded to bionic: Hips/Java, Python version, eSASSdevel builds (build needs to be adjusted) eROSE/eROpub, php * upgrade after EDR/947 pipeline, can't be after April. Suggestion: after April 15. Write email to Harald with cc of * some downtime needed before restarting eROSITA services * Pipeline tasks (shadow developer/pipeline operator) * eropipe, proc, prexec - Alain * telstage, dalist, rmvers - Miriam, ? * Recent task updates: * eropipe2-1.20, proc-1.21 * evprep-3.11.4/3.11.5/3.20/3.21 * pattern-3.0, energy-3.1 * gtcal-1.13.1 * evtool-2.10.2/2.20 * erolib-2.44/2.45 * Pipeline / ongoing processing * [[https://wiki.mpe.mpg.de/eRosita/PipeProc|processing wiki page]] * RXJ 1605: not yet fully dumped - probably processed tomorrow * 946 pipeline * SEXP/SDET chains stopped (today) till caldb is updated (sky artefacts/reprocessing needed) * TM4 badpix (Michael's email) / time jumps * temperature dependent energy calibration in 946 pipeline? * 947 sky tile 087156+093156 processed * starting full eRASS1/2? * rerun 100 eROday test after some more updates by Ian (probybly next week) * All-sky data access / SciServer * eRASS3 in eRASSuser (cronjob) * EDR * Web forum update * Web pages, documentation * Miriam proposes a Webpage meeting (Hermann, Sabine, Susanne, Alain, Miriam) during the first week of April. * Validation of CalPV/c001 data: guidelines by eSASS team * Chandreyee has corrected some header keywords. @Michael: what else needs to be corrected? when do we expect to have the latex templates? * DAtool / ProcStat * access restrictions for data request logs + project descriptions (discussion ongoing - details tbd) * providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine * move simple copying request to Python - ongoing * Longterm activities * '''[?]''' Moving task archive to git * evprep * '''[9]''' evprep: space invaders event flag * evtool should update the gti according to this flag * post-processing: frames with many counts? * BTI/GTI: * PDF for CalPV linked on wiki page (done?) * '''[7]''' one PDF per eRASS in wiki * ermldet * '''[8]''' ca. 2% of sources have positional error 0, some also have count error 0 * can't be fixed quickly, may need replacement of algorithm * Johan's proposal? Georg to discuss with Johan (long timescale project) * Time dependent RMFs/ARFs (srctool?) * '''[8]''' RMF * '''[7]''' ARF * '''[6]''' Background analysis: projecting closed data onto the sky (XMM SAS) * '''[4]''' ersensmap: implement pointing PSF * '''[3]''' ftfindhotpix: test and update algorithm * '''[1]''' Light leak in eSASS/pipeline? * '''[1]''' DAtool: filtering catalogs (separate from DAtool)?