eSASS developers Zoom meeting
Start of meeting: 2020-09-15 13:30 (1:30pm)
Zoom link: https://zoom.us/j/7909307159?pwd=ZEdGeTJQUzdsRGpkd2Q5aUZXQmZZdz09
Participants: Ian Stewart, Hermann Brunner, Miriam Ramos, Ingo Kreykenbohm, Georg Lamer, Chandreyee Maitra, Sabine Osterhage, Andrea Merloni, Alain Gueguen, Mara Salvato, Jeremy Sanders
- Open actions
- Act20200811/1_GL: investigate whether ersensmap output maps are correct - ongoing
- algorithm seems correct, but pointing PSF is not implemented (work already started)
- how well do the ersensmap maps agree with survey/field scan source catalogs?
- could be put in 947 survey pipeline immediately but pointing pipeline requires update
- Act20200811/1_GL: investigate whether ersensmap output maps are correct - ongoing
- New actions
- NRTA
- disk space (/ero_archive, /ero_archive4)
- 946 / 947 (re-)processing
- 946 eRASS:1 SEXP/SDET processing ongoing - SOU chains will run in eRASS:1 947 reprocessing and in eRASS:2 946/947 processing
- List of eRodays with evprep-3.5 issues was reprocessed
- Final eRASS:1 processing for followup needed soon (weeks?)
- Reprocessing of pointings/field scans in current 946 pipeline (A3391, eFEDS, RXJ 1856)
- Done except for eFEDS 3000010
- 946 eRASS:1 SEXP/SDET processing ongoing - SOU chains will run in eRASS:1 947 reprocessing and in eRASS:2 946/947 processing
- 945 / 946 / 946_old comparison
- A3391 - dip around bright star no visible anymore (confirmed by Jeremy)
- eRASS naming conventions
- White book: eRASS:n is cumulative survey / use eRASS_1 for individual survey in the future
- different from convention used in eSASS wiki pages in the last month
- should be discussed in Thursday meeting
- Held cameras
reset |
TM |
timeoff |
badcamt |
report |
eDays released |
08/02 |
TM2 |
no |
yes |
yes |
|
08/08 |
TM4 |
no |
yes |
yes |
|
08/25 |
TM3 |
no |
yes |
- (no) |
|
08/27 |
TM4 |
no |
yes |
yes |
|
08/30 |
TM3 |
no |
yes |
yes |
|
09/05 |
TM5 |
no |
yes |
yes |
|
09/07 |
TM7 |
no |
yes |
- |
yes |
09/08 |
TM1 |
yes |
? |
- |
no |
09/08 |
TM4 |
yes |
yes |
yes |
|
09/12 |
TM1 |
yes |
? |
- |
- |
09/13 |
TM2 |
no |
? |
|
no |
eSASS tasks (ongoing/planned) / current processing errors - eSASSdevel page / Error tracking page
- expmap
- PE015
- Bring coordinate transformations into line with evatt
- Look into pattern selection in expmap
- Time dependent bad pixels
- Not clear whether theses updates can be put int the new users release
- Discuss parallel version once more after user release?
- evtool: image autosizing / first discuss at Thursday Meeting
- telatt (PE025): DATE_OBS, DATE_END missing in input
- Decide how DAT_OBS/DATE_END and TSTART/TEND should be set (currently matching GTI)
- flaregti-1.19 (PE022) - eFEDS 300010 (fixed in flaregti-1.20)
- srctool: errorbars in lightcurves
- Options: remove errors altogether (Paul's suggestion), only remove them if counts are to low, compute asymmetric errors (TBD)
- Jeremy will think of solution for user release
- all tasks (also DATool): reviewing ownership flags,column, keywords, filenames (event lists, catalogs, srctool products)
- srctool: setting owner character in filenames / SASS_PARINT env. variable (pipeline/PIPELINE)
- should evtool perform owner filtering in the pipeline? Probably no?
- Recent task uploads
- 3.11.1 (pipeline patch)
- flaregti-1.19 / flaregti-1.20
erolib-2.28 / erolib-2.24.1 / erolib-2.28.1 / erolib-2.24.2 / erolib-2.28.2
- expmap
- eSASS optimization
- use -O2 in default make of eSASSdevel (default make is not used in autobuild)
- New eSASS users release
- New LAPACK is needed for user release
- Testing of user release?
- Date of code freeze (end of this week)
- Testing build on different architectures (Linux/Mac)
- Testing should include pointing/field scan/survey field (use early and late c946/c945 processing versions)
- Re-releasing demoscript
- caldb
- corrections in badcamt files (error correction - email by Susanne), should be reprocessed (Susanne will provide eROday list)
- creating badcamt intervals before ITC event - Chandreyee will identify times, caldb update by chandreyee and Susanne
- DAtool
- (Jul. 28 meeting)
- Region requests issues
- catalogs can't yet be filtered, whole catalog will be returned
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python
- soft links instead of copying
- DAtool / eROSE interface
- Help-desk question (Sept. 3) - download script does not work on windows
- alternative to script: lftp or wget - documentation?
- delivered catalogs - ermldet output (Sept. 11)
- Discuss after unser release is out
- (Jul. 28 meeting)
- Making attitude files public
- Longterm activities
- Light leak mitigation - wait for outcome of threshold test
- Time dependent RMFs/ARFs (srctool?)
- Background analysis: projecting closed data onto the sky (XMM SAS) - dedicated meeting?
- Build infastructure (git) - meeting this week? Wednesday 2pm (less than 1h) face-to-face preferred
- Public data release / public software release - discussion with Andrea with at least Jonas, Jeremy, Miriam, Hermann
- User requests
- Orbit file access (Axel Schwope) - use caldb download script
Previous meeting:
- Open actions
- Act20200818/1_IS: make catprep write FITS units and comment strings - closed
- writes units / not clear about comments (column comments)
- Act20200811/1_GL: investigate whether ersensmap output maps are correct - ongoing
- algorithm seems correct, but pointing PSF is not implemented (work already started)
- how well do the ersensmap maps agree with survey/field scan source catalogs?
- Act20200818/1_IS: make catprep write FITS units and comment strings - closed
- New actions
- NRTA
- Current processing errors (if any)
- only one TM1 erRoday of ObsID 3000016 /A3391/95)
- 946 / 947 (re-)processing
- 946 eRASS:2 SEXP/SDET processing ongoing, SOU chain not yet restarted
- New disks /ero_archive6 (198 TB) and /ero_archive7 (173 TB) available - moving data to new disks not yet started
- Improved lock mechanism for directories being moved to other disks:
- In directory survey/proprietary:
- XXX_LOCK blocks declination zone (XXX is last three digits of field number) - set manually or by script
- XXXXXX_LOCK blocks individual sky tile - set by script which copies directory with no ongoing processing, read by tasks telstage and eropipe
- srctool products are compressed by pipeline / use srctool switch for compressing
- script for deleting old versions/compressing existing srctool products, soft links to highest version are reset (requires testing / bug fixing)
- eRASS:1 946 reprocessing will restart in parallel with copying/compressing of exisiting data
- 945 / 946 comparison
- RXJ 1856 (eDay 44838) / c946 normalization issues
- ca. 20 affected eROdays in eRASS:1
CalPV 945/946 comparison? -> Thursday meeting last week
- 3.5 has issues, comparison of c946 (evprep-3.11) with 945 will be useful
- Miriam will provide list of eROdays with issues in evprep 3.5 / these should be reprocessed with patched evprep (3.11.1)
- RXJ 1856 (eDay 44838) / c946 normalization issues
- Held cameras
reset |
TM |
timeoff |
badcamt |
report |
eDays released |
07/08 |
TM5 |
no |
yes |
- |
yes |
07/14 |
TM3 |
no |
no |
yes |
|
07/15 |
TM4 |
yes |
yes |
yes |
|
07/16 |
TM3 |
no |
yes |
yes |
|
07/20 |
TM1 |
no |
yes |
yes |
|
07/20 |
TM4 |
yes |
yes |
yes |
|
07/21 |
TM5 |
no |
no |
yes |
|
07/27 |
TM6 |
no |
no |
yes |
|
08/02 |
TM2 |
no |
yes |
yes |
|
08/08 |
TM4 |
no |
yes |
yes |
|
08/25 |
TM3 |
no |
yes |
- (no) |
|
08/27 |
TM4 |
no |
yes |
yes |
|
08/30 |
TM3 |
no |
yes |
yes |
|
09/05 |
TM5 |
no |
? |
OAR-42 |
no |
09/07 |
TM7 |
? |
? |
- |
no |
eSASS tasks (ongoing/planned) eSASSdevel page
expmap (PE015)
- 'table interpolation error' (fixed for detcorr in expmap, not corratt) - make expmap more robust, fix root cause in evtool (ongoing)
- pipeline should be updated expmap-1.33.1
evprep (PE024)
- catprep - ownership column: write outfile1/2 in pipeline, use latest catprep version (v1.25.1, fixes owner flag in filtered catalog)
- all tasks (also DATool): reviewing ownership flags,column, keywords, filenames (event lists, catalogs, srctool products)
- check whether srctool sets the owner character in the filenames correctly
- should evtool perfomr owner filtering in the pipeline?
- eSASSdevel nightly builds - logs, etc.
- apetool (Teng/AG)
- Recent task uploads
- caldb
- creating badcamt intervals before ITC event
- DAtool
- (Jul. 28 meeting)
- Region requests issues
- catalogs can't yet be filtered, whole catalog will be returned
- providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
- move simple copying request to Python
- soft links instead of copying
- DAtool / eROSE interface
- Wiki description / dedicated meeting?
- Help-desk question (Sept. 3) - download script does not work on windows
- alternative to script: lftp or wget - documentation?
- (Jul. 28 meeting)
- Longterm activities
- Light leak mitigation - wait for outcome of threshold test
- expmap: time dependent bad pixels
- Time dependent RMFs/ARFs (srctool?)
- Background analysis: projecting closed data onto the sky (XMM SAS) - dedicated meeting?
- Build infastructure (git) - meeting this week?
- Public data release / public software release - discuss with Andrea (dedicated meeting ca. in Sept.)
- User requests
- Orbit file access (Axel Schwope) - use caldb download script