DESI Databases¶
DESI has developed a PostgreSQL database of catalog-level quantities available with Data Release 1 (DR1) as well as the Early Data Release (EDR). Access information for NERSC and NOIRLab’s Astro Data Lab is provided below.
Note
No matter how you access DESI data, please remember to use the official DESI acknowledgments.
Note
Currently, these databases do not grant access to the actual DESI spectra nor to the majority of the Value Added Catalogs (VACs) described in the DR1 paper.
NOIRLab’s Astro Data Lab¶
The Astro Data Lab hosts a copy of the DESI DR1 database tables, which is accessible either anonymously via a Web Query Interface or using authenticated services such as a JupyterLab platform. In addition, the DESI EDR database tables are available.
For more information please see the Astro Data Lab page describing DESI data access.
NERSC¶
A copy of the database is hosted at NERSC and is accessible to anyone
with a NERSC account. To get started, add the access credentials to your
~/.pgpass file in your NERSC $HOME directory:
cat /global/common/software/desi/desi_public.pgpass >> ~/.pgpass
chmod 600 ~/.pgpass
Once that is set up, connect with psql from the command line:
psql -U desi_public -h specprod-db.desi.lbl.gov -d desi
import psycopg2
conn = psycopg2.connect(host="specprod-db.desi.lbl.gov",
database="desi", user="desi_public")
This database uses the default PostgreSQL port, 5432, so it is not necessary to specify the port.
The DR1 database tables, described below,
are all contained in the iron schema. In the examples below,
note that table names are schema-qualified, i.e., iron.target rather than target.
The EDR data are contained in the fuji schema, which has minor differences
from iron which are noted in the “Changes” sections below.
Finally note that the guadalupe spectroscopic production is also available.
For more information, a Jupyter notebook tutorial about using the database is available at the DESI GitHub tutorial repository.
Warning
The NERSC copy of the database is only accessible inside the NERSC network. You must access this database via a NERSC node, e.g. a perlmutter login node.
If you do not have a NERSC account, we recommend using NOIRLab’s Astro Data Lab service described below.
Schema Names¶
As described above, several different schema are available. This table gives the schema name equivalents at NERSC and NOIRLab’s Astro Data Lab.
| NERSC Schema | NOIRLab Schema | Description |
|---|---|---|
fuji |
desi_edr |
Database schema for DESI EDR catalog data |
guadalupe |
Not available | Database schema for the first 20% of Year 1 catalog data (DR1 supplement) |
iron |
desi_dr1 |
Database schema for DESI DR1 catalog data |
Matching Redshift Tables to Targeting Data¶
Matching redshift results back to targeting is an important task for many DESI science projects. Below we briefly describe the fundamentals of this matching using the database.
Tile-based¶
The ztile table contains a foreign key pointing to the primary key of the
target table. This means that for any row of ztile, there is a
pre-matched entry in the target table, and it can be accessed
with a simple join, such as:
SELECT z.targetid, z.spgrp, z.spgrpval, z.tileid, z.z, z.zwarn, z.spectype,
t.desi_target, t.bgs_target, t.mws_target, t.scnd_target,
p.ra, p.dec
FROM iron.ztile AS z
JOIN iron.target AS t ON z.targetphotid = t.id
JOIN iron.photometry AS p ON z.targetid = p.targetid
LIMIT 50;
z.targetphotid = t.id. This query also demonstrates a JOIN with
the photometry table, where targetid is unique.
HEALPixel-based¶
The redshift results from HEALPixel-based coadds in the zpix table
may be made up of several tiles, so it is not as simple to match these with
targeting data. In the majority of cases, the targeting information is the
same for a targetid across multiple tiles, as long as the tiles are
part of the same survey (e.g. main). However it is not always the
case, so we have instead collected the best values of the targeting information
and placed those values directly in the zpix table. Here is the analogous
query to the query above:
SELECT z.targetid, z.survey, z.program, z.healpix, z.z, z.zwarn, z.spectype,
z.desi_target, z.bgs_target, z.mws_target, z.scnd_target,
p.ra, p.dec
FROM iron.zpix AS z
JOIN iron.photometry AS p ON z.targetid = p.targetid
LIMIT 50;
Full Description of Database Tables¶
The following catalog tables are available:
| Name | Description |
|---|---|
| exposure | Summary quantities for every DESI exposure. |
| fiberassign | Quantities obtained when a DESI target is assigned to a fiber. |
| frame | Summary quantities for each petal of the DESI instrument in a given exposure; in normal operation there are ten frames for every exposure. |
| photometry | Photometric quantities from Legacy Surveys DR9 for every TARGETID. |
| potential | For a given tile, this table lists all targets that could have received a fiber assignment. |
| target | The quantities obtained when photometric objects are analyzed in the target selection process. |
| tile | Summary quantities for every DESI tile (pointing on the sky). |
| zpix | Redshift and other quantities for spectra that have been grouped and coadded by HEALPixel. |
| ztile | Redshift and other quantities for spectra that have been grouped and coadded by tile. |
exposure¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| night | integer | Observing night | |
| expid | integer | DESI Exposure ID number | |
| tileid | integer | Unique DESI tile ID | |
| tilera | double | deg | RA of tile given in fiberassign file |
| tiledec | double | deg | DEC of tile given in fiberassign file |
| date_obs | timestamp | UTC observation date and start time | |
| mjd | double | days | Modified Julian Date when shutter was opened for this exposure |
| survey | varchar | Survey name | |
| program | varchar | DESI program type - BRIGHT, DARK, or BACKUP | |
| faprgrm | varchar | Fiberassign program name | |
| faflavor | varchar | Fiberassign flavor name | |
| exptime | double | seconds | Length of time shutter was open |
| efftime_spec | double | seconds | Effective exposure time for nominal conditions derived from the TSNR2 fits to the spectroscopy |
| goaltime | double | seconds | Goal for total effective exposure time for the tile |
| goaltype | varchar | The intended observing conditions for the tile | |
| mintfrac | double | Minimum fraction of GOALTIME acceptable for considering a tile complete | |
| airmass | real | Average airmass during this exposure | |
| ebv | double | mag | Galactic extinction E(B-V) reddening from SFD98 |
| seeing_etc | real | arcsec | Average FWHM atmospheric seeing during this exposure as measured by ETC |
| efftime_etc | real | seconds | Effective exposure time for nominal conditions inferred from ETC data |
| tsnr2_elg | real | ELG template (S/N)^2 summed over B, R, Z | |
| tsnr2_qso | real | QSO template (S/N)^2 summed over B, R, Z | |
| tsnr2_lrg | real | LRG template (S/N)^2 summed over B, R, Z | |
| tsnr2_lya | double | LYA template (S/N)^2 summed over B, R, Z | |
| tsnr2_bgs | real | BGS template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbdark | real | GPBDARK template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbright | real | GPBBRIGHT template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbackup | real | GPBBACKUP template (S/N)^2 summed over B, R, Z | |
| lrg_efftime_dark | real | seconds | Effective exposure time for nominal dark conditions inferred for LRG targets |
| elg_efftime_dark | real | seconds | Effective exposure time for nominal dark conditions inferred for ELG targets |
| bgs_efftime_bright | real | seconds | Effective exposure time for nominal bright conditions inferred for BGS targets |
| lya_efftime_dark | double | seconds | Effective exposure time for nominal dark conditions inferred for LYA targets |
| gpb_efftime_dark | real | seconds | Effective exposure time for nominal dark conditions inferred for GPB targets |
| gpb_efftime_bright | real | seconds | Effective exposure time for nominal bright conditions inferred for GPB targets |
| gpb_efftime_backup | real | seconds | Effective exposure time for nominal backup conditions inferred for GPB targets |
| transparency_gfa | double | Average airmass during this exposure as measured by GFA | |
| seeing_gfa | double | arcsec | Average FWHM atmospheric seeing during this exposure as measured by GFA |
| fiber_fracflux_gfa | double | Fraction of the flux entering the fiber relative to nominal 1.1 arcsec seeing using the PSF inferred from the GFAs | |
| fiber_fracflux_elg_gfa | double | Fraction of the flux entering the fiber relative to nominal 1.1 arcsec seeing using the PSF inferred from the GFAs for a source with an ELG profile (0.45 arcsec exponential galaxy profile) | |
| fiber_fracflux_bgs_gfa | double | Fraction of the flux entering the fiber relative to nominal 1.1 arcsec seeing using the PSF inferred from the GFAs for a source with a BGS profile (deV profile half light radius of 1.5 arcsec) | |
| fiberfac_gfa | double | Fraction of light entering a fiber relative to expectations for 1.1 arcsec seeing, transparency 1, for an object with a PSF profile, measured by comparing the flux integrated over a 107 micron diameter circle on the GFA images centered at the PlateMaker expectations for where stars should land | |
| fiberfac_elg_gfa | double | Same as FIBERFAC_GFA except for an ELG profile | |
| fiberfac_bgs_gfa | double | Same as FIBERFAC_GFA except for a BGS profile | |
| airmass_gfa | double | Average airmass during this exposure as measured by GFA | |
| sky_mag_ab_gfa | double | Sky background in the GFA passband, measured from the GFA backgrounds | |
| sky_mag_g_spec | double | AB mags | Sky background measured in the spectroscopy integrated over the DECam g passband, AB mags |
| sky_mag_r_spec | double | AB mags | Sky background measured in the spectroscopy integrated over the DECam r passband, AB mags |
| sky_mag_z_spec | double | AB mags | Sky background measured in the spectroscopy integrated over the DECam z passband, AB mags |
| efftime_gfa | double | seconds | Effective exposure time for nominal conditions derived from exposure GFA data |
| efftime_dark_gfa | double | seconds | Effective exposure time for nominal dark conditions inferred from GFA data |
| efftime_bright_gfa | double | seconds | Effective exposure time for nominal bright conditions inferred from GFA data |
| efftime_backup_gfa | double | seconds | Effective exposure time for nominal backup conditions inferred from GFA data |
Indexes¶
fiberassign¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| id | numeric | Arbitrary primary key composed from targetid, tileid, location | |
| tileid | integer | Unique DESI tile ID | |
| targetid | bigint | Unique DESI target ID | |
| petal_loc | smallint | Petal location [0-9] | |
| device_loc | integer | Device location on focal plane [0-523] | |
| location | integer | Location on the focal plane PETAL_LOC*1000 + DEVICE_LOC | |
| fiber | integer | Fiber ID on the CCDs [0-4999] | |
| fiberstatus | integer | Fiber status mask. 0=good | |
| target_ra | double | deg | Target right ascension |
| target_dec | double | deg | Target declination |
| pmra | real | mas yr^-1 | Proper motion in the +RA direction (already including cos(dec)) |
| pmdec | real | mas yr^-1 | Proper motion in the +Dec direction |
| ref_epoch | real | yr | Reference epoch for Gaia/Tycho astrometry. Typically 2015.5 for Gaia |
| lambda_ref | real | Angstrom | Wavelength at which targets should be centered on fibers |
| fa_target | bigint | Targeting bit internally used by fiberassign (linked with FA_TYPE) | |
| fa_type | smallint | Target type (science, standard, sky, safe, suppsky) | |
| fiberassign_x | real | mm | Expected CS5 X on focal plane |
| fiberassign_y | real | mm | Expected CS5 Y on focal plane |
| priority | integer | Target current priority | |
| subpriority | double | Random subpriority [0-1) to break assignment ties | |
| parallax | real | mas | Reference catalog parallax |
Indexes¶
locationid(primary key)tileid(foreign key on tile)targetid(foreign key on photometry)tileid,targetid,location(unique identifier)target_ra,target_dec(q3c index)
frame¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| frameid | integer | Arbitrary primary key composed from expid, camera | |
| night | integer | Observing night | |
| expid | integer | DESI Exposure ID number | |
| tileid | integer | Unique DESI tile ID | |
| mjd | double | days | Modified Julian Date when shutter was opened for this exposure |
| exptime | real | seconds | Length of time shutter was open |
| ebv | real | mag | Galactic extinction E(B-V) reddening from SFD98 |
| camera | varchar | Camera identifier. Passband and SPECGRPH ([brz][0-9]) | |
| tsnr2_gpbdark | real | GPBDARK template (S/N)^2 summed over B, R, Z | |
| tsnr2_elg | real | ELG template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbright | real | GPBBRIGHT template (S/N)^2 summed over B, R, Z | |
| tsnr2_lya | double | LYA template (S/N)^2 summed over B, R, Z | |
| tsnr2_bgs | real | BGS template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbackup | real | GPBBACKUP template (S/N)^2 summed over B, R, Z | |
| tsnr2_qso | real | QSO template (S/N)^2 summed over B, R, Z | |
| tsnr2_lrg | real | LRG template (S/N)^2 summed over B, R, Z |
Indexes¶
nightframeid(primary key)tileidexpid(foreign key on exposure)
Known Issues¶
- Although
expidis listed as indexed above, it is not actually indexed in EDR (fuji.frame) or DR1 (guadalupe.frame,iron.frame). This will be fixed in DR2.
photometry¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| ls_id | bigint | Unique Legacy Survey object ID | |
| release | smallint | Imaging Surveys release ID | |
| brickid | integer | Brick ID from Tractor input | |
| brickname | varchar | Brick name from Tractor input | |
| brick_objid | integer | Imaging Surveys OBJID on that brick | |
| morphtype | varchar | Imaging Surveys morphological type from Tractor | |
| ra | double | deg | Right ascension |
| ra_ivar | real | deg^-2 | Right ascension inverse variance |
| dec | double | deg | Declination |
| dec_ivar | real | deg^-2 | Declination inverse variance |
| dchisq_psf | real | Difference in chi-squared between PSF (stellar) Tractor model fits | |
| dchisq_rex | real | Difference in chi-squared between REX (round exponential galaxy) Tractor model fits | |
| dchisq_dev | real | Difference in chi-squared between DEV (deVauc) Tractor model fits | |
| dchisq_exp | real | Difference in chi-squared between EXP (exponential) Tractor model fits | |
| dchisq_ser | real | Difference in chi-squared between SER (Sersic) Tractor model fits | |
| ebv | real | mag | Galactic extinction E(B-V) reddening from SFD98 |
| flux_g | real | nanomaggy | Flux in the Legacy Survey g-band (AB) |
| flux_r | real | nanomaggy | Flux in the Legacy Survey r-band (AB) |
| flux_z | real | nanomaggy | Flux in the Legacy Survey z-band (AB) |
| flux_ivar_g | real | nanomaggy^-2 | Inverse variance of FLUX_G (AB) |
| flux_ivar_r | real | nanomaggy^-2 | Inverse variance of FLUX_R (AB) |
| flux_ivar_z | real | nanomaggy^-2 | Inverse variance of FLUX_Z (AB) |
| mw_transmission_g | real | Milky Way dust transmission in LS g-band | |
| mw_transmission_r | real | Milky Way dust transmission in LS r-band | |
| mw_transmission_z | real | Milky Way dust transmission in LS z-band | |
| fracflux_g | real | Profile-weighted fraction of the flux from other sources divided by the total flux in g (typically [0,1]) | |
| fracflux_r | real | Profile-weighted fraction of the flux from other sources divided by the total flux in r (typically [0,1]) | |
| fracflux_z | real | Profile-weighted fraction of the flux from other sources divided by the total flux in z (typically [0,1]) | |
| fracmasked_g | real | Profile-weighted fraction of pixels masked from all observations of this object in g, strictly between [0,1] | |
| fracmasked_r | real | Profile-weighted fraction of pixels masked from all observations of this object in r, strictly between [0,1] | |
| fracmasked_z | real | Profile-weighted fraction of pixels masked from all observations of this object in z, strictly between [0,1] | |
| fracin_g | real | Fraction of a sources flux within the blob in g, near unity for real sources | |
| fracin_r | real | Fraction of a sources flux within the blob in r, near unity for real sources | |
| fracin_z | real | Fraction of a sources flux within the blob in z, near unity for real sources | |
| nobs_g | smallint | Number of images for central pixel in g-band | |
| nobs_r | smallint | Number of images for central pixel in r-band | |
| nobs_z | smallint | Number of images for central pixel in z-band | |
| psfdepth_g | real | nanomaggy^-2 | PSF-based depth in g-band |
| psfdepth_r | real | nanomaggy^-2 | PSF-based depth in r-band |
| psfdepth_z | real | nanomaggy^-2 | PSF-based depth in z-band |
| galdepth_g | real | nanomaggy^-2 | Galaxy model-based depth in Legacy Survey g-band |
| galdepth_r | real | nanomaggy^-2 | Galaxy model-based depth in Legacy Survey r-band |
| galdepth_z | real | nanomaggy^-2 | Galaxy model-based depth in Legacy Survey z-band |
| flux_w1 | real | nanomaggy | WISE flux in W1 (AB) |
| flux_w2 | real | nanomaggy | WISE flux in W2 (AB) |
| flux_w3 | real | nanomaggy | WISE flux in W3 (AB) |
| flux_w4 | real | nanomaggy | WISE flux in W4 (AB) |
| flux_ivar_w1 | real | nanomaggy^-2 | Inverse variance of FLUX_W1 (AB) |
| flux_ivar_w2 | real | nanomaggy^-2 | Inverse variance of FLUX_W2 (AB) |
| flux_ivar_w3 | real | nanomaggy^-2 | Inverse variance of FLUX_W3 (AB) |
| flux_ivar_w4 | real | nanomaggy^-2 | Inverse variance of FLUX_W4 (AB) |
| mw_transmission_w1 | real | Milky Way dust transmission in WISE W1 | |
| mw_transmission_w2 | real | Milky Way dust transmission in WISE W2 | |
| mw_transmission_w3 | real | Milky Way dust transmission in WISE W3 | |
| mw_transmission_w4 | real | Milky Way dust transmission in WISE W4 | |
| allmask_g | smallint | Bitwise mask set if the central pixel from all images satisfy each condition in g as cataloged on the LS DR9 bitmasks page | |
| allmask_r | smallint | Bitwise mask set if the central pixel from all images satisfy each condition in r as cataloged on the LS DR9 bitmasks page | |
| allmask_z | smallint | Bitwise mask set if the central pixel from all images satisfy each condition in z as cataloged on the LS DR9 bitmasks page | |
| fiberflux_g | real | nanomaggy | Predicted g-band flux within a fiber of diameter 1.5 arcsec from this object in 1 arcsec Gaussian seeing |
| fiberflux_r | real | nanomaggy | Predicted r-band flux within a fiber of diameter 1.5 arcsec from this object in 1 arcsec Gaussian seeing |
| fiberflux_z | real | nanomaggy | Predicted z-band flux within a fiber of diameter 1.5 arcsec from this object in 1 arcsec Gaussian seeing |
| fibertotflux_g | real | nanomaggy | Predicted g-band flux within a fiber of diameter 1.5 arcsec from all sources at this location in 1 arcsec Gaussian seeing |
| fibertotflux_r | real | nanomaggy | Predicted r-band flux within a fiber of diameter 1.5 arcsec from all sources at this location in 1 arcsec Gaussian seeing |
| fibertotflux_z | real | nanomaggy | Predicted z-band flux within a fiber of diameter 1.5 arcsec from all sources at this location in 1 arcsec Gaussian seeing |
| ref_epoch | real | yr | Reference epoch for Gaia/Tycho astrometry. Typically 2015.5 for Gaia |
| wisemask_w1 | smallint | W1 bitmask as cataloged on the DR9 bitmasks page | |
| wisemask_w2 | smallint | W2 bitmask as cataloged on the DR9 bitmasks page | |
| maskbits | smallint | Bitwise mask from the imaging indicating potential issue or blending | |
| shape_r | real | arcsec | Half-light radius of galaxy model (>0) |
| shape_e1 | real | Ellipticity component 1 of galaxy model for galaxy type MORPHTYPE | |
| shape_e2 | real | Ellipticity component 2 of galaxy model for galaxy type MORPHTYPE | |
| shape_r_ivar | real | arcsec^-2 | Inverse variance of SHAPE_R |
| shape_e1_ivar | real | Inverse variance of SHAPE_E1 | |
| shape_e2_ivar | real | Inverse variance of SHAPE_E2 | |
| sersic | real | Power-law index for the Sersic profile model (MORPHTYPE=SER) | |
| sersic_ivar | real | Inverse variance of SERSIC | |
| ref_id | bigint | Tyc1*1000000+Tyc2*10+Tyc3 for Tycho-2; sourceid for Gaia DR2 |
|
| ref_cat | varchar | Reference catalog source for star: T2 for Tycho2, G2 for Gaia DR2, L2 for the SGA, empty otherwise | |
| gaia_phot_g_mean_mag | real | mag | Gaia G band magnitude |
| gaia_phot_g_mean_flux_over_error | real | Gaia G band signal-to-noise | |
| gaia_phot_bp_mean_mag | real | mag | Gaia BP band magnitude |
| gaia_phot_bp_mean_flux_over_error | real | Gaia BP band signal-to-noise | |
| gaia_phot_rp_mean_mag | real | mag | Gaia RP band magnitude |
| gaia_phot_rp_mean_flux_over_error | real | Gaia RP band signal-to-noise | |
| gaia_phot_bp_rp_excess_factor | real | Gaia BP/RP excess factor | |
| gaia_duplicated_source | boolean | Gaia duplicated source flag | |
| gaia_astrometric_sigma5d_max | real | mas | Gaia longest semi-major axis of the 5-d error ellipsoid |
| gaia_astrometric_params_solved | smallint | Which astrometric parameters were estimated for a Gaia source | |
| parallax | real | mas | Reference catalog parallax |
| parallax_ivar | real | mas^-2 | Inverse variance of PARALLAX |
| pmra | real | mas yr^-1 | Reference catalog proper motion in the RA direction |
| pmra_ivar | real | yr^2 mas^-2 | Inverse variance of PMRA |
| pmdec | real | mas yr^-1 | Reference catalog proper motion in the Dec direction |
| pmdec_ivar | real | yr^2 mas^-2 | Inverse variance of PMDEC |
| targetid | bigint | Unique DESI target ID |
Indexes¶
ls_idtargetid(primary key)ra,dec(q3c index)
potential¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| id | numeric | Arbitrary primary key composed from targetid, tileid, location | |
| tileid | integer | Unique DESI tile ID | |
| targetid | bigint | Unique DESI target ID | |
| fiber | integer | Fiber ID on the CCDs [0-4999] | |
| location | integer | Location on the focal plane PETAL_LOC*1000 + DEVICE_LOC |
Indexes¶
locationid(primary key)tileid(foreign key on tile)targetid(foreign key on photometry)tileid,targetid,location(unique identifier)
target¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| id | numeric | Arbitrary primary key composed from targetid, survey, tileid | |
| targetid | bigint | Unique DESI target ID | |
| photsys | character | N for the MzLS/BASS photometric system, S for DECaLS | |
| subpriority | double | Random subpriority [0-1] to break assignment ties | |
| obsconditions | bigint | Bit-coded of allowed observing conditions | |
| priority_init | bigint | Target initial priority from target selection bitmasks and OBSCONDITIONS | |
| numobs_init | bigint | Initial number of observations for target calculated across target selection bitmasks and OBSCONDITIONS | |
| hpxpixel | bigint | HEALPixel containing this location at NSIDE=64 in the NESTED scheme | |
| cmx_target | bigint | Target selection bitmask for commissioning | |
| desi_target | bigint | Dark survey + calibration targeting bits | |
| bgs_target | bigint | BGS (bright time program) target selection bitmask | |
| mws_target | bigint | Milky Way Survey targeting bits | |
| scnd_target | bigint | Target selection bitmask for secondary programs | |
| sv1_desi_target | bigint | DESI (dark time program) target selection bitmask for SV1 | |
| sv1_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV1 | |
| sv1_mws_target | bigint | MWS (bright time program) target selection bitmask for SV1 | |
| sv1_scnd_target | bigint | Secondary target selection bitmask for SV1 | |
| sv2_desi_target | bigint | DESI (dark time program) target selection bitmask for SV2 | |
| sv2_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV2 | |
| sv2_mws_target | bigint | MWS (bright time program) target selection bitmask for SV2 | |
| sv2_scnd_target | bigint | Secondary target selection bitmask for SV2 | |
| sv3_desi_target | bigint | DESI (dark time program) target selection bitmask for SV3 | |
| sv3_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV3 | |
| sv3_mws_target | bigint | MWS (bright time program) target selection bitmask for SV3 | |
| sv3_scnd_target | bigint | Secondary target selection bitmask for SV3 | |
| survey | varchar | Survey name | |
| program | varchar | DESI program type - BRIGHT, DARK, or BACKUP | |
| tileid | integer | Unique DESI tile ID |
Indexes¶
hpxpixelsurveyprogramid(primary key)targetid(foreign key on photometry)tileid(foreign key on tile)targetid,survey,tileid(unique identifier)
tile¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| tileid | integer | Unique DESI tile ID | |
| survey | varchar | Survey name | |
| program | varchar | DESI program type - BRIGHT, DARK, or BACKUP | |
| faprgrm | varchar | Fiberassign program name | |
| faflavor | varchar | Fiberassign flavor name | |
| nexp | bigint | Number of exposures used in EFFTIME estimates | |
| exptime | double | seconds | Length of time shutter was open |
| tilera | double | deg | RA of tile given in fiberassign file |
| tiledec | double | deg | DEC of tile given in fiberassign file |
| efftime_etc | double | seconds | Effective exposure time for nominal conditions inferred from ETC data |
| efftime_spec | double | seconds | Effective exposure time for nominal conditions derived from the TSNR2 fits to the spectroscopy |
| efftime_gfa | double | seconds | Effective exposure time for nominal conditions derived from exposure GFA data |
| goaltime | double | seconds | Goal for total effective exposure time for the tile |
| obsstatus | varchar | Observing conditions bitmask | |
| lrg_efftime_dark | double | seconds | Effective exposure time for nominal dark conditions inferred for LRG targets |
| elg_efftime_dark | double | seconds | Effective exposure time for nominal dark conditions inferred for ELG targets |
| bgs_efftime_bright | double | seconds | Effective exposure time for nominal bright conditions inferred for BGS targets |
| lya_efftime_dark | double | seconds | Effective exposure time for nominal dark conditions inferred for LYA targets |
| goaltype | varchar | The intended observing conditions for the tile | |
| mintfrac | double | Minimum fraction of GOALTIME acceptable for considering a tile complete | |
| lastnight | integer | KPNO Calendar Date when the last exposure was obtained for the tile |
Indexes¶
tileid(primary key)tilera,tiledec(q3c index)
zpix¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| id | numeric | Arbitrary primary key composed from targetid, survey, program | |
| targetid | bigint | Unique DESI target ID | |
| survey | varchar | Survey name | |
| program | varchar | DESI program type - BRIGHT, DARK, or BACKUP | |
| spgrp | varchar | Type of spectral grouping. For zpix table this is always = healpix | |
| spgrpval | integer | Value corresponding to the grouping type indicated in the spgrp column. For zpix table this is the same as the healpix column | |
| healpix | integer | HEALPixel containing this location at NSIDE=64 in the NESTED scheme | |
| z | double | Redshift measured by Redrock | |
| zerr | double | Redshift error from Redrock | |
| zwarn | bigint | Redshift warning bitmask measured by Redrock | |
| chi2 | double | Best fit chi squared | |
| coeff_0 | double | Redrock template coefficients | |
| coeff_1 | double | Redrock template coefficients | |
| coeff_2 | double | Redrock template coefficients | |
| coeff_3 | double | Redrock template coefficients | |
| coeff_4 | double | Redrock template coefficients | |
| coeff_5 | double | Redrock template coefficients | |
| coeff_6 | double | Redrock template coefficients | |
| coeff_7 | double | Redrock template coefficients | |
| coeff_8 | double | Redrock template coefficients | |
| coeff_9 | double | Redrock template coefficients | |
| npixels | bigint | Number of unmasked wavelengths that contributed to the redshift fit | |
| spectype | varchar | Spectype from Redrock file | |
| subtype | varchar | Spectral subtype | |
| ncoeff | bigint | Number of Redrock template coefficients | |
| deltachi2 | double | Delta-chi-squared for template fit from Redrock | |
| coadd_fiberstatus | integer | Bitwise AND of the FIBERSTATUS values of the spectra used in the coadd | |
| cmx_target | bigint | Target selection bitmask for commissioning | |
| desi_target | bigint | Dark survey + calibration targeting bits | |
| bgs_target | bigint | BGS (bright time program) target selection bitmask | |
| mws_target | bigint | Milky Way Survey targeting bits | |
| scnd_target | bigint | Target selection bitmask for secondary programs | |
| sv1_desi_target | bigint | DESI (dark time program) target selection bitmask for SV1 | |
| sv1_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV1 | |
| sv1_mws_target | bigint | MWS (bright time program) target selection bitmask for SV1 | |
| sv1_scnd_target | bigint | Secondary target selection bitmask for SV1 | |
| sv2_desi_target | bigint | DESI (dark time program) target selection bitmask for SV2 | |
| sv2_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV2 | |
| sv2_mws_target | bigint | MWS (bright time program) target selection bitmask for SV2 | |
| sv2_scnd_target | bigint | Secondary target selection bitmask for SV2 | |
| sv3_desi_target | bigint | DESI (dark time program) target selection bitmask for SV3 | |
| sv3_bgs_target | bigint | BGS (bright time program) target selection bitmask for SV3 | |
| sv3_mws_target | bigint | MWS (bright time program) target selection bitmask for SV3 | |
| sv3_scnd_target | bigint | Secondary target selection bitmask for SV3 | |
| coadd_numexp | smallint | Number of exposures included in the coadd for this target | |
| coadd_exptime | real | seconds | Sum of the exposure times contributing to the coadd for this target |
| coadd_numnight | smallint | Number of different nights included in the coadd for this target | |
| coadd_numtile | smallint | Number of different tiles included in the coadd for this target | |
| mean_delta_x | real | mm | Mean (over exposures) fiber difference between measured and requested CS5 X location on focal plane |
| rms_delta_x | real | mm | RMS (over exposures) of the fiber difference between measured and requested CS5 X location on focal plane |
| mean_delta_y | real | mm | Mean (over exposures) fiber difference between measured and requested CS5 Y location on focal plane |
| rms_delta_y | real | mm | RMS (over exposures) of the fiber difference between measured and requested CS5 Y location on focal plane |
| mean_fiber_ra | double | deg | Mean (over exposures) RA of actual fiber position |
| std_fiber_ra | real | deg | Standard deviation (over exposures) of RA of actual fiber position |
| mean_fiber_dec | double | deg | Mean (over exposures) DEC of actual fiber position |
| std_fiber_dec | real | deg | Standard deviation (over exposures) of DEC of actual fiber position |
| mean_psf_to_fiber_specflux | real | Mean of the PSF_TO_FIBER_SPECFLUX values of the spectra used in the coadd | |
| tsnr2_gpbdark_b | real | GPBDARK B template (S/N)^2 | |
| tsnr2_elg_b | real | ELG B template (S/N)^2 | |
| tsnr2_gpbbright_b | real | GPBBRIGHT B template (S/N)^2 | |
| tsnr2_lya_b | real | LYA B template (S/N)^2 | |
| tsnr2_bgs_b | real | BGS B template (S/N)^2 | |
| tsnr2_gpbbackup_b | real | GPBBACKUP B template (S/N)^2 | |
| tsnr2_qso_b | real | QSO B template (S/N)^2 | |
| tsnr2_lrg_b | real | LRG B template (S/N)^2 | |
| tsnr2_gpbdark_r | real | GPBDARK R template (S/N)^2 | |
| tsnr2_elg_r | real | ELG R template (S/N)^2 | |
| tsnr2_gpbbright_r | real | GPBBRIGHT R template (S/N)^2 | |
| tsnr2_lya_r | real | LYA R template (S/N)^2 | |
| tsnr2_bgs_r | real | BGS R template (S/N)^2 | |
| tsnr2_gpbbackup_r | real | GPBBACKUP R template (S/N)^2 | |
| tsnr2_qso_r | real | QSO R template (S/N)^2 | |
| tsnr2_lrg_r | real | LRG R template (S/N)^2 | |
| tsnr2_gpbdark_z | real | GPBDARK Z template (S/N)^2 | |
| tsnr2_elg_z | real | ELG Z template (S/N)^2 | |
| tsnr2_gpbbright_z | real | GPBBRIGHT Z template (S/N)^2 | |
| tsnr2_lya_z | real | LYA Z template (S/N)^2 | |
| tsnr2_bgs_z | real | BGS Z template (S/N)^2 | |
| tsnr2_gpbbackup_z | real | GPBBACKUP Z template (S/N)^2 | |
| tsnr2_qso_z | real | QSO Z template (S/N)^2 | |
| tsnr2_lrg_z | real | LRG Z template (S/N)^2 | |
| tsnr2_gpbdark | real | GPBDARK template (S/N)^2 summed over B, R, Z | |
| tsnr2_elg | real | ELG template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbright | real | GPBBRIGHT template (S/N)^2 summed over B, R, Z | |
| tsnr2_lya | real | LYA template (S/N)^2 summed over B, R, Z | |
| tsnr2_bgs | real | BGS template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbackup | real | GPBBACKUP template (S/N)^2 summed over B, R, Z | |
| tsnr2_qso | real | QSO template (S/N)^2 summed over B, R, Z | |
| tsnr2_lrg | real | LRG template (S/N)^2 summed over B, R, Z | |
| sv_nspec | smallint | Number of coadded spectra for this TARGETID in SV (SV1+2+3) | |
| sv_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in SV (SV1+2+3) | |
| main_nspec | smallint | Number of coadded spectra for this TARGETID in Main survey | |
| main_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in Main survey | |
| zcat_nspec | smallint | Number of coadded spectra for this TARGETID in this zcatalog | |
| zcat_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in this zcatalog | |
| min_mjd | double | days | Minimum value of the Modified Julian Date (when the shutter was open for the first exposure used in the coadded spectrum) |
| mean_mjd | double | days | Mean value of the Modified Julian Date (when the shutter was open for exposures used in the coadded spectrum) |
| max_mjd | double | days | Maximum value of the Modified Julian Date (when the shutter was open for the last exposure used in the coadded spectrum) |
| desiname | varchar | Human-readable identifier of a sky location DESI JXXX.XXXX[+/-]YY.YYYY, where X,Y=truncated decimal target_ra, target_dec, precise to 0.36 arcsec. |
Indexes¶
surveyprogramspgrpspgrpvalhealpixzzwarnspectypesubtypedesinameid(primary key)targetid(foreign key on photometry)targetid,survey,program(unique identifier)
Changes¶
- The EDR table
fuji.zpixdoes not havedesiname. - The EDR table
fuji.zpixhas the columnsfirstnight,lastnight. These columns were removed in DR1, since they are not as meaningful for HEALPixel-based coadded spectra. However, the columnsmin_mjd,mean_mjd,max_mjddo have useful information about when observations were obtained.
ztile¶
Columns¶
| Column | Type | Units | Description |
|---|---|---|---|
| id | numeric | Arbitrary primary key composed from targetid, survey, program | |
| targetphotid | numeric | Foreign key on the target table | |
| targetid | bigint | Unique DESI target ID | |
| survey | varchar | Survey name | |
| program | varchar | DESI program type - BRIGHT, DARK, or BACKUP | |
| spgrp | varchar | Type of spectral grouping. For ztile table this can be = cumulative, perexp, or pernight | |
| spgrpval | integer | Value corresponding to the grouping type indicated in the spgrp column. For ztile table this is a night or exposure id | |
| z | double | Redshift measured by Redrock | |
| zerr | double | Redshift error from Redrock | |
| zwarn | bigint | Redshift warning bitmask measured by Redrock | |
| chi2 | double | Best fit chi squared | |
| coeff_0 | double | Redrock template coefficients | |
| coeff_1 | double | Redrock template coefficients | |
| coeff_2 | double | Redrock template coefficients | |
| coeff_3 | double | Redrock template coefficients | |
| coeff_4 | double | Redrock template coefficients | |
| coeff_5 | double | Redrock template coefficients | |
| coeff_6 | double | Redrock template coefficients | |
| coeff_7 | double | Redrock template coefficients | |
| coeff_8 | double | Redrock template coefficients | |
| coeff_9 | double | Redrock template coefficients | |
| npixels | bigint | Number of unmasked wavelengths that contributed to the redshift fit | |
| spectype | varchar | Spectype from Redrock file | |
| subtype | varchar | Spectral subtype | |
| ncoeff | bigint | Number of Redrock template coefficients | |
| deltachi2 | double | Delta-chi-squared for template fit from Redrock | |
| coadd_fiberstatus | integer | Bitwise AND of the FIBERSTATUS values of the spectra used in the coadd | |
| tileid | integer | Unique DESI tile ID | |
| coadd_numexp | smallint | Number of exposures included in the coadd for this target | |
| coadd_exptime | real | seconds | Sum of the exposure times contributing to the coadd for this target |
| coadd_numnight | smallint | Number of different nights included in the coadd for this target | |
| coadd_numtile | smallint | Number of different tiles included in the coadd for this target | |
| mean_delta_x | real | mm | Mean (over exposures) fiber difference between measured and requested CS5 X location on focal plane |
| rms_delta_x | real | mm | RMS (over exposures) of the fiber difference between measured and requested CS5 X location on focal plane |
| mean_delta_y | real | mm | Mean (over exposures) fiber difference between measured and requested CS5 Y location on focal plane |
| rms_delta_y | real | mm | RMS (over exposures) of the fiber difference between measured and requested CS5 Y location on focal plane |
| mean_fiber_ra | double | deg | Mean (over exposures) RA of actual fiber position |
| std_fiber_ra | real | deg | Standard deviation (over exposures) of RA of actual fiber position |
| mean_fiber_dec | double | deg | Mean (over exposures) DEC of actual fiber position |
| std_fiber_dec | real | deg | Standard deviation (over exposures) of DEC of actual fiber position |
| mean_psf_to_fiber_specflux | real | Mean of the PSF_TO_FIBER_SPECFLUX values of the spectra used in the coadd | |
| mean_fiber_x | real | mm | Mean (over exposures) fiber CS5 X location on focal plane |
| mean_fiber_y | real | mm | Mean (over exposures) fiber CS5 Y location on focal plane |
| tsnr2_gpbdark_b | real | GPBDARK B template (S/N)^2 | |
| tsnr2_elg_b | real | ELG B template (S/N)^2 | |
| tsnr2_gpbbright_b | real | GPBBRIGHT B template (S/N)^2 | |
| tsnr2_lya_b | real | LYA B template (S/N)^2 | |
| tsnr2_bgs_b | real | BGS B template (S/N)^2 | |
| tsnr2_gpbbackup_b | real | GPBBACKUP B template (S/N)^2 | |
| tsnr2_qso_b | real | QSO B template (S/N)^2 | |
| tsnr2_lrg_b | real | LRG B template (S/N)^2 | |
| tsnr2_gpbdark_r | real | GPBDARK R template (S/N)^2 | |
| tsnr2_elg_r | real | ELG R template (S/N)^2 | |
| tsnr2_gpbbright_r | real | GPBBRIGHT R template (S/N)^2 | |
| tsnr2_lya_r | real | LYA R template (S/N)^2 | |
| tsnr2_bgs_r | real | BGS R template (S/N)^2 | |
| tsnr2_gpbbackup_r | real | GPBBACKUP R template (S/N)^2 | |
| tsnr2_qso_r | real | QSO R template (S/N)^2 | |
| tsnr2_lrg_r | real | LRG R template (S/N)^2 | |
| tsnr2_gpbdark_z | real | GPBDARK Z template (S/N)^2 | |
| tsnr2_elg_z | real | ELG Z template (S/N)^2 | |
| tsnr2_gpbbright_z | real | GPBBRIGHT Z template (S/N)^2 | |
| tsnr2_lya_z | real | LYA Z template (S/N)^2 | |
| tsnr2_bgs_z | real | BGS Z template (S/N)^2 | |
| tsnr2_gpbbackup_z | real | GPBBACKUP Z template (S/N)^2 | |
| tsnr2_qso_z | real | QSO Z template (S/N)^2 | |
| tsnr2_lrg_z | real | LRG Z template (S/N)^2 | |
| tsnr2_gpbdark | real | GPBDARK template (S/N)^2 summed over B, R, Z | |
| tsnr2_elg | real | ELG template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbright | real | GPBBRIGHT template (S/N)^2 summed over B, R, Z | |
| tsnr2_lya | real | LYA template (S/N)^2 summed over B, R, Z | |
| tsnr2_bgs | real | BGS template (S/N)^2 summed over B, R, Z | |
| tsnr2_gpbbackup | real | GPBBACKUP template (S/N)^2 summed over B, R, Z | |
| tsnr2_qso | real | QSO template (S/N)^2 summed over B, R, Z | |
| tsnr2_lrg | real | LRG template (S/N)^2 summed over B, R, Z | |
| sv_nspec | smallint | Number of coadded spectra for this TARGETID in SV (SV1+2+3) | |
| sv_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in SV (SV1+2+3) | |
| main_nspec | smallint | Number of coadded spectra for this TARGETID in Main survey | |
| main_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in Main survey | |
| zcat_nspec | smallint | Number of coadded spectra for this TARGETID in this zcatalog | |
| zcat_primary | boolean | Boolean flag (True/False) for the primary coadded spectrum in this zcatalog | |
| firstnight | integer | KPNO Calendar Date when the first exposure was obtained for the tile, regardless of data quality | |
| lastnight | integer | KPNO Calendar Date when the last exposure was obtained for the tile | |
| min_mjd | double | days | Minimum value of the Modified Julian Date (when the shutter was open for the first exposure used in the coadded spectrum) |
| mean_mjd | double | days | Mean value of the Modified Julian Date (when the shutter was open for exposures used in the coadded spectrum) |
| max_mjd | double | days | Maximum value of the Modified Julian Date (when the shutter was open for the last exposure used in the coadded spectrum) |
| desiname | varchar | Human-readable identifier of a sky location DESI JXXX.XXXX[+/-]YY.YYYY, where X,Y=truncated decimal target_ra, target_dec, precise to 0.36 arcsec. |
Indexes¶
surveyprogramspgrpspgrpvalzzwarnspectypesubtypedesinameid(primary key)targetphotid(foreign key on target)targetid(foreign key on photometry)tileid(foreign key on tile)targetid,spgrp,spgrpval,tileid(unique identifier)
Changes¶
- The EDR table
fuji.ztiledoes not havedesiname.