EROSITAwiki: Diff for "eSASSdevel_210504"

Monthly eSASS Q&A / weekly eSASS developers meeting

Start of meeting: 2021-05-04 13:30

Zoom link: https://zoom.us/j/97439409844?pwd=YXVkK0hBMnpybm5tL2VyYTh2Qld2UT09

Participants: Ian Stewart, Hermann Brunner, Miriam Ramos, Alain Gueguen, Konrad Dennerl, Sabine Osterhage, Susanne Friedrich, Chandeyee Maitra, Michael Freyberg, Jeremy Sanders

• Open actions from previous developers meetings
  • Act20200929/1_all make sure html task descriptions are current and consistent with user release
    • updates by Jeremy and Ian (evtool, expmap, catprep)

    • still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)

  • Act20201006/1_SF clean event file description, update source list description
• Preprocessing / NRTA
• eFEDS catalog paper
  • Paul's comments

• eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page

  • GTI computation (Michael's email)
  • Task updates for 947 pipeline: ermldet/apetool, other?

  • srctool products in subdirectories (Jeremy) -> group by each 100 sources (947 pipeline)

  • Changed BADPIX caldb format / backward compatibility in 946
    • move ftfindhotpix-1.11 and srctool-1.65 to 946 pipeline, set expmap to read badpix extension
  • SPLT2NOI HK value (Ian/Konrad)
    • new parameter for evprep to pass location of file to keep track last good value of threshold scaling
  • evprep-3.23/caldb: THRMAP/SCTHRMAP
    • might cause issues with running 946 and 947 in parallel
  • evtool: polar images (Andy)
    • bug in autoscaling? report in known issues of user eSASS, don't patch eSASSuser_201009
  • Pipeline tasks (shadow developer/pipeline operator)
    • eropipe, proc, prexec - Alain
    • telstage, dalist, rmvers - Miriam, ?
  • Recent task updates
    • transprep-1.2
    • expmap-2.6
    • catprep-2.4.1
    • srctool-1.66
• Pipeline / ongoing processing

  • processing wiki page

  • 946
    • held cameras / TM4 processing
    • processing errors, backlogs, etc.
    • caldb: bright pixels/columns, Zip patterns
    • Hips map: 021 band count excess / exposure map discontinuitiy
    • disk copying
  • 947
    • test runs / time scale / code freeze

    • Discussion at data meeting 947 processing Wiki page

• EDR
  • Web pages - access
  • Documentation, etc.

  • eSASS known issues (ChangeLogs)

  • CalPV START/STOP times (Frank)

• DAtool / ProcStat

  • access restrictions for data request logs + project descriptions
  • providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
  • move simple copying request to Python - ongoing

• Longterm activities

  • [?] Moving task archive to git

  • evprep

    • [9] evprep: space invaders event flag

      • evtool should update the gti according to this flag
      • post-processing: frames with many counts?
    • BTI/GTI:
      • PDF for CalPV linked on wiki page (done?)

      • [7] one PDF per eRASS in wiki

  • ermldet

    • [8] ca. 2% of sources have positional error 0, some also have count error 0

      • can't be fixed quickly, may need replacement of algorithm
      • Johan's proposal? Georg to discuss with Johan (long timescale project)
  • Time dependent RMFs/ARFs (srctool?)

    • [8] RMF

    • [7] ARF

  • [7] EV_WEIGHT: event based vignetting correction

  • [6] Background analysis: projecting closed data onto the sky (XMM SAS)

  • [4] ersensmap: implement pointing PSF

  • [3] ftfindhotpix: test and update algorithm

  • [1] Light leak in eSASS/pipeline?

  • [1] DAtool: filtering catalogs (separate from DAtool)?

Previous meeting:

• Open actions from previous developers meetings
  • Act20200929/1_all make sure html task descriptions are current and consistent with user release
    • updates by Jeremy and Ian (evtool, expmap, catprep)

    • still missing: Hermann (radec2xy), Georg (detection + evatt) --> Deadline April 15th 2021 (Miriam)

  • Act20201006/1_SF clean event file description, update source list description
• Preprocessing / NRTA
• eFEDS catalog paper
  • Paul's comments

• eSASS tasks (ongoing/) / current processing errors - eSASSdevel page / Error tracking page

  • Pipeline tasks (shadow developer/pipeline operator)
  • GTI computation (Michael's email)
  • EV_WEIGHT
  • srctool products in subdirectories (Jeremy)?
  • Pipeline tasks (shadow developer/pipeline operator)
    • eropipe, proc, prexec - Alain
    • telstage, dalist, rmvers - Miriam, ?
  • Recent task updates
    • erolib-2.50.1/2.51
    • expmap-2.5.1
    • varichck-1.8
    • evtool-2.22
    • apetool / datool
• Pipeline / ongoing processing

  • processing wiki page

  • 946
    • held cameras / TM4 processing
    • processing errors, backlogs, etc.
    • Hips maps
    • copying (DIRmove3.csh)/ disk access
  • 947
    • test runs / time scale / code freeze
    • Discussion last/next data meeting
• EDR
  • Web pages - access
  • Documentation, etc.

  • eSASS known issues (ChangeLogs)

• DAtool / ProcStat

  • access restrictions for data request logs + project descriptions
  • providing large multi-sky tile images - Jeremy will share his Python script with Alain and Sabine
  • move simple copying request to Python - ongoing

• Longterm activities

  • [?] Moving task archive to git

  • evprep

    • [9] evprep: space invaders event flag

      • evtool should update the gti according to this flag
      • post-processing: frames with many counts?
    • BTI/GTI:
      • PDF for CalPV linked on wiki page (done?)

      • [7] one PDF per eRASS in wiki

  • ermldet

    • [8] ca. 2% of sources have positional error 0, some also have count error 0

      • can't be fixed quickly, may need replacement of algorithm
      • Johan's proposal? Georg to discuss with Johan (long timescale project)
  • Time dependent RMFs/ARFs (srctool?)

    • [8] RMF

    • [7] ARF

  • [6] Background analysis: projecting closed data onto the sky (XMM SAS)

  • [4] ersensmap: implement pointing PSF

  • [3] ftfindhotpix: test and update algorithm

  • [1] Light leak in eSASS/pipeline?

  • [1] DAtool: filtering catalogs (separate from DAtool)?