Differences between revisions 22 and 23
⇤ ← Revision 22 as of 2021-05-11 12:43:50 →
Size: 8238
Editor: HermannBrunner
Comment:
← Revision 23 as of 2021-05-11 13:32:24 → ⇥
Size: 8537
Editor: HermannBrunner
Comment:
Deletions are marked like this. Additions are marked like this.
Line 58: Line 58:
       * Page counters        * Page counters -> https://de.wikipedia.org/wiki/Matomo
Line 60: Line 60:
       * CalPV START/STOP times, header keywords, Puppis A
         * New November planning file
         * telgti/expmerge ?		        * CalPV TSTART/TSTOP and times, header keywords, Puppis A
         * Document the wrong time keywords either globally and/or in the TeX reports
         * Investigate swhether the issue persists in current eSASS versions
         * New November planning file
           * 001 pipeline needs to be rerun (four ObsIDs) -> HB, Chandreyee needs to rerun header correction script

Monthly eSASS Q&A / weekly eSASS developers meeting

Start of meeting: 2021-05-11 13:30

Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09

  • eSASS Q&A

  • Old actions:
    • EDR task descriptions etc. - deadline May 15
  • Preprocessing / NRTA

  • eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page

    • Task updates for 947 pipeline: ermldet/apetool,eprep, other?
    • evprep
      • thresholding (running 946+947 in parallel, Jan's summary) - use corralgo algorithm
      • SPLT2NOI HK value: parameter for evprep to pass location of file to keep track last good value of threshold scaling - should be in 947
    • ermldet: asymmetric errors - setup for 947

      • dedicated meeting? -> perhaps not needed/discuss on Thursdsy once more

      • Provide asymmetric and symmetric errors, decide later how to compute summary band errors (simulations?)
      • Renaming columns (estimate_...) to indicate the limitations of the summary band errors
      • Positional errors - RA/DEC upper/lower/RADEC_ERR - change delta chi-sq. threshold?
      • GL will upload new version
      • update catprep to accommodate new columns
      • write NULL value for failed error determinations in EDR user release? Leave as is and document in task description.
    • Changed BADPIX format
      • move ftfindhotpix-1.11 and srctool-1.65 to 946 pipeline, set expmap to read badpix extension
    • apetool
      • latest version not yet in task archive?
      • Antonis' ermldet changes for compatibility with apetool
        • Antonis/Georg/Ian meeting
    • New pattern version for 947 (requires new cal file type)
    • Pipeline testing (Alain...)
    • Recent task updates:
      • erolib-2.52
      • evprep-3.24
      • expmap-2.6.1
      • ftfindhotpix-1.12
  • Pipeline / ongoing processing

    • processing wiki page

    • 946
      • held cameras / TM4 processing
      • caldb: bright pixels/columns, Zip patterns
        • set new validity start days when new pixel scheme is enabled
      • processing errors, backlogs, etc.
      • Hips map: 021 band count excess (will be fixed in 947 with new evprep version)
      • Exposure map discontinuity: look at example sky tile where discuontinuity happend and investigate GTI, task versions, caldb, etc.
      • disk copying
    • 947
      • test runs / time scale / code freeze
  • EDR
    • EDR Web pages (Miriam's todo list(s), Andrea's comments)
    • Data issues
      • CalPV TSTART/TSTOP and times, header keywords, Puppis A
        • Document the wrong time keywords either globally and/or in the TeX reports
        • Investigate swhether the issue persists in current eSASS versions
        • New November planning file

          • 001 pipeline needs to be rerun (four ObsIDs) -> HB, Chandreyee needs to rerun header correction script

        • meeting last Thursday
      • TeX reports / Susanne's Python script
      • Reprocessing?

  • DAtool / ProcStat

    • access restrictions for data request logs + project descriptions
    • providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
    • move simple copying request to Python - ongoing
  • Longterm activities

    • [?] Moving task archive to git

    • evprep

      • [9] evprep: space invaders event flag

        • evtool should update the gti according to this flag
        • post-processing: frames with many counts?
      • BTI/GTI:
        • PDF for CalPV linked on wiki page (done?)

        • [7] one PDF per eRASS in wiki

    • ermldet

      • [8] ca. 2% of sources have positional error 0, some also have count error 0

        • can't be fixed quickly, may need replacement of algorithm
        • Johan's proposal? Georg to discuss with Johan (long timescale project)
    • Time dependent RMFs/ARFs (srctool?)

      • [8] RMF

      • [7] ARF

    • [7] EV_WEIGHT: event based vignetting correction

    • [6] Background analysis: projecting closed data onto the sky (XMM SAS)

    • [4] ersensmap: implement pointing PSF

    • [3] ftfindhotpix: test and update algorithm

    • [1] Light leak in eSASS/pipeline?

    • [1] DAtool: filtering catalogs (separate from DAtool)?

Previous meeting:

  • Open actions from previous developers meetings
    • Act20200929/1_all make sure html task descriptions are current and consistent with user release
      • updates by Jeremy and Ian (evtool, expmap, catprep)

      • still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)

    • Act20201006/1_SF clean event file description, update source list description
  • Preprocessing / NRTA
  • eFEDS catalog paper
    • Paul's comments

  • eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page

    • GTI computation (Michael's email)
    • Task updates for 947 pipeline: ermldet/apetool, other?

    • srctool products in subdirectories (Jeremy) -> group by each 100 sources (947 pipeline)

    • Changed BADPIX caldb format / backward compatibility in 946
      • move ftfindhotpix-1.11 and srctool-1.65 to 946 pipeline, set expmap to read badpix extension
    • SPLT2NOI HK value (Ian/Konrad)
      • new parameter for evprep to pass location of file to keep track last good value of threshold scaling
    • evprep-3.23/caldb: THRMAP/SCTHRMAP
      • might cause issues with running 946 and 947 in parallel
    • evtool: polar images (Andy)
      • bug in autoscaling? report in known issues of user eSASS, don't patch eSASSuser_201009
    • Pipeline tasks (shadow developer/pipeline operator)
      • eropipe, proc, prexec - Alain
      • telstage, dalist, rmvers - Miriam, ?
    • Recent task updates
      • transprep-1.2
      • expmap-2.6
      • catprep-2.4.1
      • srctool-1.66
  • Pipeline / ongoing processing

    • processing wiki page

    • 946
      • held cameras / TM4 processing
      • processing errors, backlogs, etc.
      • caldb: bright pixels/columns, Zip patterns
      • Hips map: 021 band count excess / exposure map discontinuitiy
      • disk copying
    • 947
  • EDR
    • Web pages - access
    • Documentation, etc.

    • eSASS known issues (ChangeLogs)

    • CalPV START/STOP times (Frank)

  • DAtool / ProcStat

    • access restrictions for data request logs + project descriptions
    • providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
    • move simple copying request to Python - ongoing
  • Longterm activities

    • [?] Moving task archive to git

    • evprep

      • [9] evprep: space invaders event flag

        • evtool should update the gti according to this flag
        • post-processing: frames with many counts?
      • BTI/GTI:
        • PDF for CalPV linked on wiki page (done?)

        • [7] one PDF per eRASS in wiki

    • ermldet

      • [8] ca. 2% of sources have positional error 0, some also have count error 0

        • can't be fixed quickly, may need replacement of algorithm
        • Johan's proposal? Georg to discuss with Johan (long timescale project)
    • Time dependent RMFs/ARFs (srctool?)

      • [8] RMF

      • [7] ARF

    • [7] EV_WEIGHT: event based vignetting correction

    • [6] Background analysis: projecting closed data onto the sky (XMM SAS)

    • [4] ersensmap: implement pointing PSF

    • [3] ftfindhotpix: test and update algorithm

    • [1] Light leak in eSASS/pipeline?

    • [1] DAtool: filtering catalogs (separate from DAtool)?

EROSITAwiki: eSASSdevel_210511 (last edited 2021-05-11 13:32:24 by HermannBrunner)