Differences between revisions 2 and 3
Revision 2 as of 2023-11-21 16:25:00
Size: 6080
Comment:
Revision 3 as of 2023-11-21 16:26:03
Size: 79
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:

-----

= eRASS:3 and eRASS:4 processed catalogues =

(Versioning starts in sync with the eRASS1 processed versioning)

=== Version 7 ===

 * [[attachment:all_s3_SourceCat1B_221007_poscorr_mpe_clean_processed_v007.fits|Processed v007: Final eRASS:3 single band catalogue 07/10/2022, positions corrected, overlaps cleaned (1B)]]

v007 uses: Martin's HealSparse Maps for eRASS3 (FLAG_SP_SCL=star cluster, FLAG_SP_LGA=local galaxy, FLAG_SP_BPS=bright point source, FLAG_SP_SNR=supernovae remnant), and v3 of Ang's cluster maps (FLAG_SP_GC) and the conservative galaxy cluster flagging (FLAG_SP_GC_CONS). The RADEC_ERR_CORR column is added, which is computed using Antonis' suggestion of RADEC_ERR_CORR=1.14*RADEC_ERR- a caveat is that this was generated using a previous catalogue version, so *use this column with caution*.

=== Version 6 ===

 * [[attachment:all_s3_SourceCat1B_220829_poscorr_mpe_photom_processed_v006.fits|Processed v006: Final eRASS:3 single band catalogue 29/08/2022, positions corrected, overlaps cleaned (1B)]]

v006 uses: Martin's HealSparse Maps for eRASS3 (FLAG_SP_SCL=star cluster, FLAG_SP_LGA=local galaxy, FLAG_SP_BPS=bright point source, FLAG_SP_SNR=supernovae remnant), and v3 of Ang's cluster maps (FLAG_SP_GC) and the conservative galaxy cluster flagging (FLAG_SP_GC_CONS). The RADEC_ERR_CORR column is added, which is computed using Antonis' suggestion of RADEC_ERR_CORR=1.14*RADEC_ERR- a caveat is that this was generated using a previous catalogue version, so *use this column with caution*.


=== Version 5 ===

 * [[attachment:all_s3_SourceCat1B_220413_poscorr_mpe_photom_processed_v005.fits|Processed v005: Final eRASS:3 single band catalogue 13/04/2022, positions corrected, overlaps cleaned (1B)]]

 * [[attachment:all_s4_SourceCat1B_220616_poscorr_mpe_photom_processed_v005.fits|Processed v005: Final eRASS:4 single band catalogue 16/06/2022, positions corrected, overlaps cleaned (1B)]]


v005 uses: Martin's HealSparse Maps for eRASS3 (FLAG_SP_SCL=star cluster, FLAG_SP_LGA=local galaxy, FLAG_SP_BPS=bright point source, FLAG_SP_SNR=supernovae remnant), and v3 of Ang's cluster maps (FLAG_SP_GC) and the conservative galaxy cluster flagging (FLAG_SP_GC_CONS). The RADEC_ERR_CORR column is added, which is computed using Antonis' suggestion of RADEC_ERR_CORR=1.14*RADEC_ERR.


=== HealSparse Masks ===

These masks have been created via the dedicated search for regions on the sky with abnormally many sources (source density > 3x local average && more than 20 excess sources). To achieve this, local smoothed maps of source density were created, with a smoothing scale of 0.12°. The extracted overdense regions were then classified according to their physical origin into SNRs, galaxy clusters, star clusters, local galaxies, and bright point sources.

 * [[attachment:OverdenseRegions_eRASS3_Classes_Sparse.fits|Masks based on eRASS:3 catalog (version 221031)]]
 
 * [[attachment:OverdenseRegions_eRASS4_Classes_Sparse.fits|Masks based on eRASS:4 catalog (version 221030)]]
 
 * [[attachment:OverdenseRegions_eRASS45_Classes_Sparse.fits|Masks based on eRASS:4/eRASS:5 catalog (version 230619)]]


=== Spurious source flagging with Random Forests ===
That's an extension and update of previous attempts to flag likely spurious sources based on sources detected in their vicinity using random forests (VictorDoroshenko).
The task is accomplished by training true/spurious classifier using the cross-match of the clean sample of stacked XMMDR11 catalog (xmmstack_v2.2_4xmmdr11s_stackrows.fits with STACK_FLAG<3) with eRosita catalogs in area overlapping both catalogs and likely locations of spurious sources (surroundings of MAXI sources + SNRs + HECATE + ROSAT galaxy clusters). Within this regions eRosita sources which have no XMM counterpart are labeled spurious and those with counterpart as real (matching via NWAY).
Features used by classifier include broadband fluxes and detection/extension likelihood for given source + same stuff for surrounding sources (currently averaging done using healpix with NSIDE=128), plus sum of differences of rates in several bands (P1,2,3,6) compared to average rates in given healpix pixel. The classifier is trained separately for eRASS1 (eRASS1_Main.v0.4.fits) and eRASS:5 (all_s4_s5_SourceCat1B_230619_poscorr_mpe_photom.fits) with typical accuracy of around ~86%, and then the output is further filtered by spatial density of likely spurious sources. The attached catalogs are row-by-row subset of eRosita catalogs (only DETUID/RA/DEC are included) plus column P_SP_RF given final probability of source being spurious (supposed to be calibrated consistently between eRASS1/5, but absolute calibration is tricky). For cutoff of 99% the spurious sample is estimated to contain <4% of true sources, the fraction of not identified spurious sources is harder to assess as sensitivities of XMM/Chandra are much better than eRosita, i.e. some adjustment is needed before calibration. The actual files are:

 * [[attachment:erass_s1_pspurious_all.fits.gz | RF probabilities for source being spurious for eRASS1_Main.v0.4.fits]]
 * [[attachment:erass_s5_pspurious_all.fits.gz | RF probabilities for source being spurious for all_s4_s5_SourceCat1B_230619_poscorr_mpe_photom.fits]]

= Combined eRASS:4 / eRASS:5 catalog =

[[attachment:all_s4_s5_SourceCat1B_230619_poscorr_mpe_photom.fits]]

This catalog contains all sources from the eRASS:4 catalogue (all_s4_SourceCat1B_230117_poscorr_mpe_photom.fits)
in sky tiles where no eRASS5 data are available. In the eRASS5 sky tiles the eRASS:5 catalogue (all_s5_SourceCat1B_230616_poscorr_mpe_photom.fits)
is added


== Flagged eRASS:4 / eRASS:5 catalog ==

[[attachment:all_s4_s5_SourceCat1B_230619_poscorr_mpe_processed_v001.fits]]

Processed version of the combined eRASS:4 / eRASS:5 catalogue with spurious flags
(without forced photometry columns).

See [[attachment:2023-10-11_config_erass45.json.tar]], [[attachment:2023-10-11_process_erass_catalogue.py]]

for details.
Describe ScienceRelatedStuff/PostDr1_catalogs/List of Post-DR1 catalogs here.

Describe ScienceRelatedStuff/PostDr1_catalogs/List of Post-DR1 catalogs here.

EROSITAwiki: ScienceRelatedStuff/PostDr1_catalogs/List of Post-DR1 catalogs (last edited 2023-11-21 16:26:03 by AndreaMerloni)