Differences between revisions 1 and 2
Revision 1 as of 2021-02-02 08:52:50
Size: 34
Comment:
Revision 2 as of 2021-02-02 08:55:14
Size: 4693
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
Describe eSASSdevel_210202 here. == Monthly eSASS Q&A / weekly eSASS developers meeting ==

'''Start of meeting: 2021-02-02 13:30 (1:30pm)'''

NEW Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09

'''''Previous meeting:'''''

   * Open actions
     * Act20200929/1_all make sure html task descriptions are current and consistent with user release
       * updates by Jeremy and Ian (evtool, expmap, catprep)
       * still missing: Hermann (radec2xy), Georg (detection + evatt)
     * Act20201006/1_SF clean event file description, update source list description

   * Preprocessing / NRTA

   * eSASS tasks (ongoing/planned) / current processing errors - [[https://wiki.mpe.mpg.de/eRosita/EroCat/eSASSdevel|eSASSdevel page]] / [[https://wiki.mpe.mpg.de/eRosita/pipelineErrorTracking|Error tracking page]]
     * eRASS1 code updates/code freeze (Ian's email)
     * expmap: parallel version? Jeremy <--> Ian
     * catprep: making number of bands variable (1..5)?
     * expmerge: 947 crashes
     * detection task updates (ongoing, perhaps ready for 947)
       * clobber option
       * improved RADEC_ERR, upper/lower count rate errors
     * Pipeline tasks (shadow developer/pipeline operator): eropipe, proc, prexec, telstage, dalist, rmvers
     * Recent task updates:
       * [[https://lists.mpe.mpg.de/cgi-bin/mailman/private/erosita-sass/2021-January/001127.html|expmap-2.1, erolib-2.38, evtool-2.37, apetool-1.10]]

   * Pipeline / ongoing processing
     * [[https://wiki.mpe.mpg.de/eRosita/PipeProc|processing wiki page]] (Miriam's changes)
     * eRASS3 (946) exposure deficit (Chandreyee's analysis)
       * Georg thinks this is a telgti problem - might also have h ed in pevious eRASSes - will investigate
     * Missing soft sources (Frank)
     * Artefacts in CalPV (c001) ObsID 710000 - Teng
       * issue with subpixel calculation, due to unfortunate placement o sourc on pixel grid?
     * bad pixels in caldb (TM2/TM3) - Susanne will put them in the caldb
     * Temperature dependence in task energy (HK access) - could be part of 947 reprocessing if timescales align
       * should go in 947 pipeline / timescale ca. 2 weeks
       * KOnrad will pove list of eROday to Hermann
     * Treating zip patterns as bad pixels?
       * Data quality of events not on zip pattern?
     * evprep summary reports - thresholds, incomplete eROdays, etc.
       * threshold raised for TM5/7
     * Discrepancies in source list of demo script runs / ermldet uninitialized variables
       * Still different results of same binaries on different machines
       * Different from pervious problem, all sources are affected (parameter are sightly different) - high priority
       * Confirm whether ermldet patch changes the eFEDS source list (Teng?)
       * Patch user release / update Docker version? Will be fixed for Georg's/Teng's CALPV papers
    * Hanging pipeline jobs
       * LOCK, ERROR, START files?
    * MIP threshold increase (threshold from HK)
       * should be patched in 946 pipeline eSASS

   * EDR
     * Web pages, documentation
     * Validation of CalPV/c001 data: guidlines by eSASS team
       * https://wiki.mpe.mpg.de/eRosita/guide_validationEDR

   * Longterm activities
     * BTI/GTI: user access to bad data
       * PDF for CalPV linked for wiki page?
       * one PSF per eRASS in wiki? -> 7
     * ersensmap: implement pointing PSF -> 4
     * expmap
       * Parallel version -> 10
     * ermldet
       * ca. 2% of sources have positional error 0, some also have count error 0
         * can't be fixed quickly, may need replacement of algorithm -> 8
       * Johan's proposal? Georg to discuss with Johan (long timescale project)
     * evprep: experimental event flags (space invaders)
       * post-processing: space invaders, frames with many counts, statistical event flagging -> 9
     * ftfindhotpix: test and update algorithm
     * Light leak in eSASS/pipeline? -> 1
     * DAtool: filtering catalogs (separate from DAtool)? -> 1
     * Time dependent RMFs/ARFs (srctool?) -> 8 (RMF) 7 (ARF) +/-5
     * Background analysis: projecting closed data onto the sky (XMM SAS) -> 6
     * Moving to git -> ?

  * DAtool
     * providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
     * move simple copying request to Python / should everything be moved to Python? - ongoing
     * DAtool / eROSE interface: requires change in frontend
     * Retrieving eRASS3/c946 data?
     * Other issues

  * ProcStat
    * eRASS1/946?
    * eRASS:n -> eRASSn

Monthly eSASS Q&A / weekly eSASS developers meeting

Start of meeting: 2021-02-02 13:30 (1:30pm)

NEW Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09

Previous meeting:

  • Open actions
    • Act20200929/1_all make sure html task descriptions are current and consistent with user release
      • updates by Jeremy and Ian (evtool, expmap, catprep)
      • still missing: Hermann (radec2xy), Georg (detection + evatt)
    • Act20201006/1_SF clean event file description, update source list description
  • Preprocessing / NRTA
  • eSASS tasks (ongoing/planned) / current processing errors - eSASSdevel page / Error tracking page

    • eRASS1 code updates/code freeze (Ian's email)
    • expmap: parallel version? Jeremy <--> Ian

    • catprep: making number of bands variable (1..5)?
    • expmerge: 947 crashes
    • detection task updates (ongoing, perhaps ready for 947)
      • clobber option
      • improved RADEC_ERR, upper/lower count rate errors
    • Pipeline tasks (shadow developer/pipeline operator): eropipe, proc, prexec, telstage, dalist, rmvers
    • Recent task updates:
  • Pipeline / ongoing processing
    • processing wiki page (Miriam's changes)

    • eRASS3 (946) exposure deficit (Chandreyee's analysis)
      • Georg thinks this is a telgti problem - might also have h ed in pevious eRASSes - will investigate
    • Missing soft sources (Frank)
    • Artefacts in CalPV (c001) ObsID 710000 - Teng
      • issue with subpixel calculation, due to unfortunate placement o sourc on pixel grid?
    • bad pixels in caldb (TM2/TM3) - Susanne will put them in the caldb
    • Temperature dependence in task energy (HK access) - could be part of 947 reprocessing if timescales align
      • should go in 947 pipeline / timescale ca. 2 weeks
      • KOnrad will pove list of eROday to Hermann
    • Treating zip patterns as bad pixels?
      • Data quality of events not on zip pattern?
    • evprep summary reports - thresholds, incomplete eROdays, etc.
      • threshold raised for TM5/7
    • Discrepancies in source list of demo script runs / ermldet uninitialized variables
      • Still different results of same binaries on different machines
      • Different from pervious problem, all sources are affected (parameter are sightly different) - high priority
      • Confirm whether ermldet patch changes the eFEDS source list (Teng?)
      • Patch user release / update Docker version? Will be fixed for Georg's/Teng's CALPV papers
    • Hanging pipeline jobs
      • LOCK, ERROR, START files?
    • MIP threshold increase (threshold from HK)
      • should be patched in 946 pipeline eSASS
  • EDR
  • Longterm activities
    • BTI/GTI: user access to bad data
      • PDF for CalPV linked for wiki page?
      • one PSF per eRASS in wiki? -> 7

    • ersensmap: implement pointing PSF -> 4

    • expmap
      • Parallel version -> 10

    • ermldet
      • ca. 2% of sources have positional error 0, some also have count error 0
        • can't be fixed quickly, may need replacement of algorithm -> 8

      • Johan's proposal? Georg to discuss with Johan (long timescale project)
    • evprep: experimental event flags (space invaders)
      • post-processing: space invaders, frames with many counts, statistical event flagging -> 9

    • ftfindhotpix: test and update algorithm
    • Light leak in eSASS/pipeline? -> 1

    • DAtool: filtering catalogs (separate from DAtool)? -> 1

    • Time dependent RMFs/ARFs (srctool?) -> 8 (RMF) 7 (ARF) +/-5

    • Background analysis: projecting closed data onto the sky (XMM SAS) -> 6

    • Moving to git -> ?

  • DAtool
    • providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
    • move simple copying request to Python / should everything be moved to Python? - ongoing
    • DAtool / eROSE interface: requires change in frontend
    • Retrieving eRASS3/c946 data?
    • Other issues
  • ProcStat

    • eRASS1/946?
    • eRASS:n -> eRASSn

EROSITAwiki: eSASSdevel_210202 (last edited 2021-03-02 08:45:47 by HermannBrunner)