{ "cells": [ { "cell_type": "raw", "metadata": { "tags": [ "remove-cell" ] }, "source": [ "---\n", "title: \"Coordinate Transformations\"\n", "teaching: 3000\n", "exercises: 0\n", "questions:\n", "\n", "- \"How do we transform celestial coordinates from one frame to another and save results in files?\"\n", "\n", "objectives:\n", "\n", "- \"Use Python string formatting to compose more complex ADQL queries.\"\n", "\n", "- \"Work with coordinates and other quantities that have units.\"\n", "\n", "- \"Download the results of a query and store them in a file.\"\n", "\n", "keypoints:\n", "\n", "- \"For measurements with units, use `Quantity` objects that represent units explicitly and check for errors.\"\n", "\n", "- \"Use the `format` function to compose queries; it is often faster and less error-prone.\"\n", "\n", "- \"Develop queries incrementally: start with something simple, test it, and add a little bit at a time.\"\n", "\n", "- \"Once you have a query working, save the data in a local file. If you shut down the notebook and come back to it later, you can reload the file; you don't have to run the query again.\"\n", "\n", "---\n", "\n", "{% include links.md %}\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# 2. Coordinates and Units\n", "\n", "In the previous lesson, we wrote ADQL queries and used them to select and download data from the Gaia server.\n", "\n", "In this lesson, we'll pick up where we left off and write a query to select stars from a particular region of the sky." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Outline\n", "\n", "We'll start with an example that does a \"cone search\"; that is, it selects stars that appear in a circular region of the sky.\n", "\n", "Then, to select stars in the vicinity of GD-1, we'll:\n", "\n", "* Use `Quantity` objects to represent measurements with units.\n", "\n", "* Use Astropy to convert coordinates from one frame to another.\n", "\n", "* Use the ADQL keywords `POLYGON`, `CONTAINS`, and `POINT` to select stars that fall within a polygonal region.\n", "\n", "* Submit a query and download the results.\n", "\n", "* Store the results in a FITS file.\n", "\n", "After completing this lesson, you should be able to\n", "\n", "* Use Python string formatting to compose more complex ADQL queries.\n", "\n", "* Work with coordinates and other quantities that have units.\n", "\n", "* Download the results of a query and store them in a file." ] }, { "cell_type": "markdown", "metadata": { "tags": [ "remove-cell" ] }, "source": [ "## Installing libraries\n", "\n", "If you are running this notebook on Colab, you can run the following cell to install the libraries we'll use.\n", "\n", "If you are running this notebook on your own computer, you might have to install these libraries yourself. See the instructions in the preface." ] }, { "cell_type": "code", "execution_count": 1, "metadata": { "tags": [ "remove-cell" ] }, "outputs": [], "source": [ "# If we're running on Colab, install libraries\n", "\n", "# TODO: When Colab can install gala, switch from astro-gala\n", "\n", "import sys\n", "IN_COLAB = 'google.colab' in sys.modules\n", "\n", "if IN_COLAB:\n", " !pip install astroquery astro-gala" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Working with Units\n", "\n", "The measurements we will work with are physical quantities, which means that they have two parts, a value and a unit.\n", "For example, the coordinate $30^{\\circ}$ has value 30 and its units are degrees.\n", "\n", "Until recently, most scientific computation was done with values only; units were left out of the program altogether, [often with catastrophic results](https://en.wikipedia.org/wiki/Mars_Climate_Orbiter#Cause_of_failure).\n", "\n", "Astropy provides tools for including units explicitly in computations, which makes it possible to detect errors before they cause disasters.\n", "\n", "To use Astropy units, we import them like this:" ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [], "source": [ "import astropy.units as u" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "`u` is an object that contains most common units and all SI units.\n", "\n", "You can use `dir` to list them, but you should also [read the documentation](https://docs.astropy.org/en/stable/units/)." ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "['A',\n", " 'AA',\n", " 'AB',\n", " 'ABflux',\n", " 'ABmag',\n", " 'AU',\n", " 'Angstrom',\n", " 'B',\n", " 'Ba',\n", " 'Barye',\n", " 'Bi',\n", " 'Biot',\n", " 'Bol',\n", " 'Bq',\n", " 'C',\n", " 'Celsius',\n", " 'Ci',\n", " 'CompositeUnit',\n", " 'D',\n", " 'Da',\n", " 'Dalton',\n", " 'Debye',\n", " 'Decibel',\n", " 'DecibelUnit',\n", " 'Dex',\n", " 'DexUnit',\n", " 'EA',\n", " 'EAU',\n", " 'EB',\n", " 'EBa',\n", " 'EC',\n", " 'ED',\n", " 'EF',\n", " 'EG',\n", " 'EGal',\n", " 'EH',\n", " 'EHz',\n", " 'EJ',\n", " 'EJy',\n", " 'EK',\n", " 'EL',\n", " 'EN',\n", " 'EOhm',\n", " 'EP',\n", " 'EPa',\n", " 'ER',\n", " 'ERy',\n", " 'ES',\n", " 'ESt',\n", " 'ET',\n", " 'EV',\n", " 'EW',\n", " 'EWb',\n", " 'Ea',\n", " 'Eadu',\n", " 'Earcmin',\n", " 'Earcsec',\n", " 'Eau',\n", " 'Eb',\n", " 'Ebarn',\n", " 'Ebeam',\n", " 'Ebin',\n", " 'Ebit',\n", " 'Ebyte',\n", " 'Ecd',\n", " 'Echan',\n", " 'Ecount',\n", " 'Ect',\n", " 'Ed',\n", " 'Edeg',\n", " 'Edyn',\n", " 'EeV',\n", " 'Eerg',\n", " 'Eg',\n", " 'Eh',\n", " 'EiB',\n", " 'Eib',\n", " 'Eibit',\n", " 'Eibyte',\n", " 'Ek',\n", " 'El',\n", " 'Elm',\n", " 'Elx',\n", " 'Elyr',\n", " 'Em',\n", " 'Emag',\n", " 'Emin',\n", " 'Emol',\n", " 'Eohm',\n", " 'Epc',\n", " 'Eph',\n", " 'Ephoton',\n", " 'Epix',\n", " 'Epixel',\n", " 'Erad',\n", " 'Es',\n", " 'Esr',\n", " 'Eu',\n", " 'Evox',\n", " 'Evoxel',\n", " 'Eyr',\n", " 'F',\n", " 'Farad',\n", " 'Fr',\n", " 'Franklin',\n", " 'FunctionQuantity',\n", " 'FunctionUnitBase',\n", " 'G',\n", " 'GA',\n", " 'GAU',\n", " 'GB',\n", " 'GBa',\n", " 'GC',\n", " 'GD',\n", " 'GF',\n", " 'GG',\n", " 'GGal',\n", " 'GH',\n", " 'GHz',\n", " 'GJ',\n", " 'GJy',\n", " 'GK',\n", " 'GL',\n", " 'GN',\n", " 'GOhm',\n", " 'GP',\n", " 'GPa',\n", " 'GR',\n", " 'GRy',\n", " 'GS',\n", " 'GSt',\n", " 'GT',\n", " 'GV',\n", " 'GW',\n", " 'GWb',\n", " 'Ga',\n", " 'Gadu',\n", " 'Gal',\n", " 'Garcmin',\n", " 'Garcsec',\n", " 'Gau',\n", " 'Gauss',\n", " 'Gb',\n", " 'Gbarn',\n", " 'Gbeam',\n", " 'Gbin',\n", " 'Gbit',\n", " 'Gbyte',\n", " 'Gcd',\n", " 'Gchan',\n", " 'Gcount',\n", " 'Gct',\n", " 'Gd',\n", " 'Gdeg',\n", " 'Gdyn',\n", " 'GeV',\n", " 'Gerg',\n", " 'Gg',\n", " 'Gh',\n", " 'GiB',\n", " 'Gib',\n", " 'Gibit',\n", " 'Gibyte',\n", " 'Gk',\n", " 'Gl',\n", " 'Glm',\n", " 'Glx',\n", " 'Glyr',\n", " 'Gm',\n", " 'Gmag',\n", " 'Gmin',\n", " 'Gmol',\n", " 'Gohm',\n", " 'Gpc',\n", " 'Gph',\n", " 'Gphoton',\n", " 'Gpix',\n", " 'Gpixel',\n", " 'Grad',\n", " 'Gs',\n", " 'Gsr',\n", " 'Gu',\n", " 'Gvox',\n", " 'Gvoxel',\n", " 'Gyr',\n", " 'H',\n", " 'Henry',\n", " 'Hertz',\n", " 'Hz',\n", " 'IrreducibleUnit',\n", " 'J',\n", " 'Jansky',\n", " 'Joule',\n", " 'Jy',\n", " 'K',\n", " 'Kayser',\n", " 'Kelvin',\n", " 'KiB',\n", " 'Kib',\n", " 'Kibit',\n", " 'Kibyte',\n", " 'L',\n", " 'L_bol',\n", " 'L_sun',\n", " 'LogQuantity',\n", " 'LogUnit',\n", " 'Lsun',\n", " 'MA',\n", " 'MAU',\n", " 'MB',\n", " 'MBa',\n", " 'MC',\n", " 'MD',\n", " 'MF',\n", " 'MG',\n", " 'MGal',\n", " 'MH',\n", " 'MHz',\n", " 'MJ',\n", " 'MJy',\n", " 'MK',\n", " 'ML',\n", " 'MN',\n", " 'MOhm',\n", " 'MP',\n", " 'MPa',\n", " 'MR',\n", " 'MRy',\n", " 'MS',\n", " 'MSt',\n", " 'MT',\n", " 'MV',\n", " 'MW',\n", " 'MWb',\n", " 'M_bol',\n", " 'M_e',\n", " 'M_earth',\n", " 'M_jup',\n", " 'M_jupiter',\n", " 'M_p',\n", " 'M_sun',\n", " 'Ma',\n", " 'Madu',\n", " 'MagUnit',\n", " 'Magnitude',\n", " 'Marcmin',\n", " 'Marcsec',\n", " 'Mau',\n", " 'Mb',\n", " 'Mbarn',\n", " 'Mbeam',\n", " 'Mbin',\n", " 'Mbit',\n", " 'Mbyte',\n", " 'Mcd',\n", " 'Mchan',\n", " 'Mcount',\n", " 'Mct',\n", " 'Md',\n", " 'Mdeg',\n", " 'Mdyn',\n", " 'MeV',\n", " 'Mearth',\n", " 'Merg',\n", " 'Mg',\n", " 'Mh',\n", " 'MiB',\n", " 'Mib',\n", " 'Mibit',\n", " 'Mibyte',\n", " 'Mjup',\n", " 'Mjupiter',\n", " 'Mk',\n", " 'Ml',\n", " 'Mlm',\n", " 'Mlx',\n", " 'Mlyr',\n", " 'Mm',\n", " 'Mmag',\n", " 'Mmin',\n", " 'Mmol',\n", " 'Mohm',\n", " 'Mpc',\n", " 'Mph',\n", " 'Mphoton',\n", " 'Mpix',\n", " 'Mpixel',\n", " 'Mrad',\n", " 'Ms',\n", " 'Msr',\n", " 'Msun',\n", " 'Mu',\n", " 'Mvox',\n", " 'Mvoxel',\n", " 'Myr',\n", " 'N',\n", " 'NamedUnit',\n", " 'Newton',\n", " 'Ohm',\n", " 'P',\n", " 'PA',\n", " 'PAU',\n", " 'PB',\n", " 'PBa',\n", " 'PC',\n", " 'PD',\n", " 'PF',\n", " 'PG',\n", " 'PGal',\n", " 'PH',\n", " 'PHz',\n", " 'PJ',\n", " 'PJy',\n", " 'PK',\n", " 'PL',\n", " 'PN',\n", " 'POhm',\n", " 'PP',\n", " 'PPa',\n", " 'PR',\n", " 'PRy',\n", " 'PS',\n", " 'PSt',\n", " 'PT',\n", " 'PV',\n", " 'PW',\n", " 'PWb',\n", " 'Pa',\n", " 'Padu',\n", " 'Parcmin',\n", " 'Parcsec',\n", " 'Pascal',\n", " 'Pau',\n", " 'Pb',\n", " 'Pbarn',\n", " 'Pbeam',\n", " 'Pbin',\n", " 'Pbit',\n", " 'Pbyte',\n", " 'Pcd',\n", " 'Pchan',\n", " 'Pcount',\n", " 'Pct',\n", " 'Pd',\n", " 'Pdeg',\n", " 'Pdyn',\n", " 'PeV',\n", " 'Perg',\n", " 'Pg',\n", " 'Ph',\n", " 'PiB',\n", " 'Pib',\n", " 'Pibit',\n", " 'Pibyte',\n", " 'Pk',\n", " 'Pl',\n", " 'Plm',\n", " 'Plx',\n", " 'Plyr',\n", " 'Pm',\n", " 'Pmag',\n", " 'Pmin',\n", " 'Pmol',\n", " 'Pohm',\n", " 'Ppc',\n", " 'Pph',\n", " 'Pphoton',\n", " 'Ppix',\n", " 'Ppixel',\n", " 'Prad',\n", " 'PrefixUnit',\n", " 'Ps',\n", " 'Psr',\n", " 'Pu',\n", " 'Pvox',\n", " 'Pvoxel',\n", " 'Pyr',\n", " 'Quantity',\n", " 'QuantityInfo',\n", " 'QuantityInfoBase',\n", " 'R',\n", " 'R_earth',\n", " 'R_jup',\n", " 'R_jupiter',\n", " 'R_sun',\n", " 'Rayleigh',\n", " 'Rearth',\n", " 'Rjup',\n", " 'Rjupiter',\n", " 'Rsun',\n", " 'Ry',\n", " 'S',\n", " 'ST',\n", " 'STflux',\n", " 'STmag',\n", " 'Siemens',\n", " 'SpecificTypeQuantity',\n", " 'St',\n", " 'Sun',\n", " 'T',\n", " 'TA',\n", " 'TAU',\n", " 'TB',\n", " 'TBa',\n", " 'TC',\n", " 'TD',\n", " 'TF',\n", " 'TG',\n", " 'TGal',\n", " 'TH',\n", " 'THz',\n", " 'TJ',\n", " 'TJy',\n", " 'TK',\n", " 'TL',\n", " 'TN',\n", " 'TOhm',\n", " 'TP',\n", " 'TPa',\n", " 'TR',\n", " 'TRy',\n", " 'TS',\n", " 'TSt',\n", " 'TT',\n", " 'TV',\n", " 'TW',\n", " 'TWb',\n", " 'Ta',\n", " 'Tadu',\n", " 'Tarcmin',\n", " 'Tarcsec',\n", " 'Tau',\n", " 'Tb',\n", " 'Tbarn',\n", " 'Tbeam',\n", " 'Tbin',\n", " 'Tbit',\n", " 'Tbyte',\n", " 'Tcd',\n", " 'Tchan',\n", " 'Tcount',\n", " 'Tct',\n", " 'Td',\n", " 'Tdeg',\n", " 'Tdyn',\n", " 'TeV',\n", " 'Terg',\n", " 'Tesla',\n", " 'Tg',\n", " 'Th',\n", " 'TiB',\n", " 'Tib',\n", " 'Tibit',\n", " 'Tibyte',\n", " 'Tk',\n", " 'Tl',\n", " 'Tlm',\n", " 'Tlx',\n", " 'Tlyr',\n", " 'Tm',\n", " 'Tmag',\n", " 'Tmin',\n", " 'Tmol',\n", " 'Tohm',\n", " 'Torr',\n", " 'Tpc',\n", " 'Tph',\n", " 'Tphoton',\n", " 'Tpix',\n", " 'Tpixel',\n", " 'Trad',\n", " 'Ts',\n", " 'Tsr',\n", " 'Tu',\n", " 'Tvox',\n", " 'Tvoxel',\n", " 'Tyr',\n", " 'Unit',\n", " 'UnitBase',\n", " 'UnitConversionError',\n", " 'UnitTypeError',\n", " 'UnitsError',\n", " 'UnitsWarning',\n", " 'UnrecognizedUnit',\n", " 'V',\n", " 'Volt',\n", " 'W',\n", " 'Watt',\n", " 'Wb',\n", " 'Weber',\n", " 'YA',\n", " 'YAU',\n", " 'YB',\n", " 'YBa',\n", " 'YC',\n", " 'YD',\n", " 'YF',\n", " 'YG',\n", " 'YGal',\n", " 'YH',\n", " 'YHz',\n", " 'YJ',\n", " 'YJy',\n", " 'YK',\n", " 'YL',\n", " 'YN',\n", " 'YOhm',\n", " 'YP',\n", " 'YPa',\n", " 'YR',\n", " 'YRy',\n", " 'YS',\n", " 'YSt',\n", " 'YT',\n", " 'YV',\n", " 'YW',\n", " 'YWb',\n", " 'Ya',\n", " 'Yadu',\n", " 'Yarcmin',\n", " 'Yarcsec',\n", " 'Yau',\n", " 'Yb',\n", " 'Ybarn',\n", " 'Ybeam',\n", " 'Ybin',\n", " 'Ybit',\n", " 'Ybyte',\n", " 'Ycd',\n", " 'Ychan',\n", " 'Ycount',\n", " 'Yct',\n", " 'Yd',\n", " 'Ydeg',\n", " 'Ydyn',\n", " 'YeV',\n", " 'Yerg',\n", " 'Yg',\n", " 'Yh',\n", " 'Yk',\n", " 'Yl',\n", " 'Ylm',\n", " 'Ylx',\n", " 'Ylyr',\n", " 'Ym',\n", " 'Ymag',\n", " 'Ymin',\n", " 'Ymol',\n", " 'Yohm',\n", " 'Ypc',\n", " 'Yph',\n", " 'Yphoton',\n", " 'Ypix',\n", " 'Ypixel',\n", " 'Yrad',\n", " 'Ys',\n", " 'Ysr',\n", " 'Yu',\n", " 'Yvox',\n", " 'Yvoxel',\n", " 'Yyr',\n", " 'ZA',\n", " 'ZAU',\n", " 'ZB',\n", " 'ZBa',\n", " 'ZC',\n", " 'ZD',\n", " 'ZF',\n", " 'ZG',\n", " 'ZGal',\n", " 'ZH',\n", " 'ZHz',\n", " 'ZJ',\n", " 'ZJy',\n", " 'ZK',\n", " 'ZL',\n", " 'ZN',\n", " 'ZOhm',\n", " 'ZP',\n", " 'ZPa',\n", " 'ZR',\n", " 'ZRy',\n", " 'ZS',\n", " 'ZSt',\n", " 'ZT',\n", " 'ZV',\n", " 'ZW',\n", " 'ZWb',\n", " 'Za',\n", " 'Zadu',\n", " 'Zarcmin',\n", " 'Zarcsec',\n", " 'Zau',\n", " 'Zb',\n", " 'Zbarn',\n", " 'Zbeam',\n", " 'Zbin',\n", " 'Zbit',\n", " 'Zbyte',\n", " 'Zcd',\n", " 'Zchan',\n", " 'Zcount',\n", " 'Zct',\n", " 'Zd',\n", " 'Zdeg',\n", " 'Zdyn',\n", " 'ZeV',\n", " 'Zerg',\n", " 'Zg',\n", " 'Zh',\n", " 'Zk',\n", " 'Zl',\n", " 'Zlm',\n", " 'Zlx',\n", " 'Zlyr',\n", " 'Zm',\n", " 'Zmag',\n", " 'Zmin',\n", " 'Zmol',\n", " 'Zohm',\n", " 'Zpc',\n", " 'Zph',\n", " 'Zphoton',\n", " 'Zpix',\n", " 'Zpixel',\n", " 'Zrad',\n", " 'Zs',\n", " 'Zsr',\n", " 'Zu',\n", " 'Zvox',\n", " 'Zvoxel',\n", " 'Zyr',\n", " '__builtins__',\n", " '__cached__',\n", " '__doc__',\n", " '__file__',\n", " '__loader__',\n", " '__name__',\n", " '__package__',\n", " '__path__',\n", " '__spec__',\n", " 'a',\n", " 'aA',\n", " 'aAU',\n", " 'aB',\n", " 'aBa',\n", " 'aC',\n", " 'aD',\n", " 'aF',\n", " 'aG',\n", " 'aGal',\n", " 'aH',\n", " 'aHz',\n", " 'aJ',\n", " 'aJy',\n", " 'aK',\n", " 'aL',\n", " 'aN',\n", " 'aOhm',\n", " 'aP',\n", " 'aPa',\n", " 'aR',\n", " 'aRy',\n", " 'aS',\n", " 'aSt',\n", " 'aT',\n", " 'aV',\n", " 'aW',\n", " 'aWb',\n", " 'aa',\n", " 'aadu',\n", " 'aarcmin',\n", " 'aarcsec',\n", " 'aau',\n", " 'ab',\n", " 'abA',\n", " 'abC',\n", " 'abampere',\n", " 'abarn',\n", " 'abcoulomb',\n", " 'abeam',\n", " 'abin',\n", " 'abit',\n", " 'abyte',\n", " 'acd',\n", " 'achan',\n", " 'acount',\n", " 'act',\n", " 'ad',\n", " 'add_enabled_equivalencies',\n", " 'add_enabled_units',\n", " 'adeg',\n", " 'adu',\n", " 'adyn',\n", " 'aeV',\n", " 'aerg',\n", " 'ag',\n", " 'ah',\n", " 'ak',\n", " 'al',\n", " 'allclose',\n", " 'alm',\n", " 'alx',\n", " 'alyr',\n", " 'am',\n", " 'amag',\n", " 'amin',\n", " 'amol',\n", " 'amp',\n", " 'ampere',\n", " 'angstrom',\n", " 'annum',\n", " 'aohm',\n", " 'apc',\n", " 'aph',\n", " 'aphoton',\n", " 'apix',\n", " 'apixel',\n", " 'arad',\n", " 'arcmin',\n", " 'arcminute',\n", " 'arcsec',\n", " 'arcsecond',\n", " 'asr',\n", " 'astronomical_unit',\n", " 'astrophys',\n", " 'attoBarye',\n", " 'attoDa',\n", " 'attoDalton',\n", " 'attoDebye',\n", " 'attoFarad',\n", " 'attoGauss',\n", " 'attoHenry',\n", " 'attoHertz',\n", " 'attoJansky',\n", " 'attoJoule',\n", " 'attoKayser',\n", " 'attoKelvin',\n", " 'attoNewton',\n", " 'attoOhm',\n", " 'attoPascal',\n", " 'attoRayleigh',\n", " 'attoSiemens',\n", " 'attoTesla',\n", " 'attoVolt',\n", " 'attoWatt',\n", " 'attoWeber',\n", " 'attoamp',\n", " 'attoampere',\n", " 'attoannum',\n", " 'attoarcminute',\n", " 'attoarcsecond',\n", " 'attoastronomical_unit',\n", " 'attobarn',\n", " 'attobarye',\n", " 'attobit',\n", " 'attobyte',\n", " 'attocandela',\n", " 'attocoulomb',\n", " 'attocount',\n", " 'attoday',\n", " 'attodebye',\n", " 'attodegree',\n", " 'attodyne',\n", " 'attoelectronvolt',\n", " 'attofarad',\n", " 'attogal',\n", " 'attogauss',\n", " 'attogram',\n", " 'attohenry',\n", " 'attohertz',\n", " 'attohour',\n", " 'attohr',\n", " 'attojansky',\n", " 'attojoule',\n", " 'attokayser',\n", " 'attolightyear',\n", " 'attoliter',\n", " 'attolumen',\n", " 'attolux',\n", " 'attometer',\n", " 'attominute',\n", " 'attomole',\n", " 'attonewton',\n", " 'attoparsec',\n", " 'attopascal',\n", " 'attophoton',\n", " 'attopixel',\n", " 'attopoise',\n", " 'attoradian',\n", " 'attorayleigh',\n", " 'attorydberg',\n", " 'attosecond',\n", " 'attosiemens',\n", " 'attosteradian',\n", " 'attostokes',\n", " 'attotesla',\n", " 'attovolt',\n", " 'attovoxel',\n", " 'attowatt',\n", " 'attoweber',\n", " 'attoyear',\n", " 'au',\n", " 'avox',\n", " 'avoxel',\n", " 'ayr',\n", " 'b',\n", " 'bar',\n", " 'barn',\n", " 'barye',\n", " 'beam',\n", " 'beam_angular_area',\n", " 'becquerel',\n", " 'bin',\n", " 'binary_prefixes',\n", " 'bit',\n", " 'bol',\n", " 'brightness_temperature',\n", " 'byte',\n", " 'cA',\n", " 'cAU',\n", " 'cB',\n", " 'cBa',\n", " 'cC',\n", " 'cD',\n", " 'cF',\n", " 'cG',\n", " 'cGal',\n", " 'cH',\n", " 'cHz',\n", " 'cJ',\n", " 'cJy',\n", " 'cK',\n", " 'cL',\n", " 'cN',\n", " 'cOhm',\n", " 'cP',\n", " 'cPa',\n", " 'cR',\n", " 'cRy',\n", " 'cS',\n", " 'cSt',\n", " 'cT',\n", " 'cV',\n", " 'cW',\n", " 'cWb',\n", " 'ca',\n", " 'cadu',\n", " 'candela',\n", " 'carcmin',\n", " 'carcsec',\n", " 'cau',\n", " 'cb',\n", " 'cbarn',\n", " 'cbeam',\n", " 'cbin',\n", " 'cbit',\n", " 'cbyte',\n", " 'ccd',\n", " 'cchan',\n", " 'ccount',\n", " 'cct',\n", " 'cd',\n", " 'cdeg',\n", " 'cdyn',\n", " 'ceV',\n", " 'centiBarye',\n", " 'centiDa',\n", " 'centiDalton',\n", " 'centiDebye',\n", " 'centiFarad',\n", " 'centiGauss',\n", " 'centiHenry',\n", " 'centiHertz',\n", " 'centiJansky',\n", " 'centiJoule',\n", " 'centiKayser',\n", " 'centiKelvin',\n", " 'centiNewton',\n", " 'centiOhm',\n", " 'centiPascal',\n", " 'centiRayleigh',\n", " 'centiSiemens',\n", " 'centiTesla',\n", " 'centiVolt',\n", " 'centiWatt',\n", " 'centiWeber',\n", " 'centiamp',\n", " 'centiampere',\n", " 'centiannum',\n", " 'centiarcminute',\n", " 'centiarcsecond',\n", " 'centiastronomical_unit',\n", " 'centibarn',\n", " 'centibarye',\n", " 'centibit',\n", " 'centibyte',\n", " 'centicandela',\n", " 'centicoulomb',\n", " 'centicount',\n", " 'centiday',\n", " 'centidebye',\n", " 'centidegree',\n", " 'centidyne',\n", " 'centielectronvolt',\n", " 'centifarad',\n", " 'centigal',\n", " 'centigauss',\n", " 'centigram',\n", " 'centihenry',\n", " 'centihertz',\n", " 'centihour',\n", " 'centihr',\n", " 'centijansky',\n", " 'centijoule',\n", " 'centikayser',\n", " 'centilightyear',\n", " 'centiliter',\n", " 'centilumen',\n", " 'centilux',\n", " 'centimeter',\n", " 'centiminute',\n", " 'centimole',\n", " 'centinewton',\n", " 'centiparsec',\n", " 'centipascal',\n", " 'centiphoton',\n", " 'centipixel',\n", " 'centipoise',\n", " 'centiradian',\n", " 'centirayleigh',\n", " 'centirydberg',\n", " 'centisecond',\n", " 'centisiemens',\n", " 'centisteradian',\n", " 'centistokes',\n", " 'centitesla',\n", " 'centivolt',\n", " 'centivoxel',\n", " 'centiwatt',\n", " 'centiweber',\n", " 'centiyear',\n", " 'cerg',\n", " 'cg',\n", " 'cgs',\n", " 'ch',\n", " 'chan',\n", " 'ck',\n", " 'cl',\n", " 'clm',\n", " 'clx',\n", " 'clyr',\n", " 'cm',\n", " 'cmag',\n", " 'cmin',\n", " 'cmol',\n", " 'cohm',\n", " 'core',\n", " 'coulomb',\n", " 'count',\n", " 'cpc',\n", " 'cph',\n", " 'cphoton',\n", " 'cpix',\n", " 'cpixel',\n", " 'crad',\n", " 'cs',\n", " 'csr',\n", " 'ct',\n", " 'cu',\n", " 'curie',\n", " 'cvox',\n", " 'cvoxel',\n", " 'cy',\n", " 'cycle',\n", " 'cyr',\n", " 'd',\n", " 'dA',\n", " 'dAU',\n", " 'dB',\n", " 'dBa',\n", " 'dC',\n", " 'dD',\n", " 'dF',\n", " 'dG',\n", " 'dGal',\n", " 'dH',\n", " 'dHz',\n", " 'dJ',\n", " 'dJy',\n", " 'dK',\n", " 'dL',\n", " 'dN',\n", " 'dOhm',\n", " 'dP',\n", " 'dPa',\n", " 'dR',\n", " 'dRy',\n", " 'dS',\n", " 'dSt',\n", " ...]" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "dir(u)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To create a quantity, we multiply a value by a unit." ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "astropy.units.quantity.Quantity" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "angle = 10 * u.degree\n", "type(angle)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The result is a `Quantity` object.\n", "Jupyter knows how to display `Quantities` like this:" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/latex": [ "$10 \\; \\mathrm{{}^{\\circ}}$" ], "text/plain": [ "" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "angle" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Quantities provide a method called `to` that converts to other units. For example, we can compute the number of arcminutes in `angle`:" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/latex": [ "$600 \\; \\mathrm{{}^{\\prime}}$" ], "text/plain": [ "" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "angle_arcmin = angle.to(u.arcmin)\n", "angle_arcmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "If you add quantities, Astropy converts them to compatible units, if possible:" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/latex": [ "$10.5 \\; \\mathrm{{}^{\\circ}}$" ], "text/plain": [ "" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "angle + 30 * u.arcmin" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "If the units are not compatible, you get an error.\n", "For example:\n", "\n", "```\n", "angle + 5 * u.second\n", "```\n", "\n", "causes a `UnitConversionError`." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Exercise\n", "\n", "Create a quantity that represents 5 [arcminutes](https://en.wikipedia.org/wiki/Minute_and_second_of_arc) and assign it to a variable called `radius`.\n", "\n", "Then convert it to degrees." ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "5.0 arcmin\n" ] }, { "data": { "text/latex": [ "$0.083333333 \\; \\mathrm{{}^{\\circ}}$" ], "text/plain": [ "" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# Solution\n", "\n", "radius = 5 * u.arcmin\n", "print(radius)\n", "\n", "radius.to(u.degree)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Selecting a Region\n", "\n", "One of the most common ways to restrict a query is to select stars in a particular region of the sky.\n", "For example, here's a query from the [Gaia archive documentation](https://gea.esac.esa.int/archive-help/adql/examples/index.html) that selects objects in a circular region centered at (88.8, 7.4) with a search radius of 5 arcmin (0.08333 deg)." ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [], "source": [ "query_cone = \"\"\"SELECT \n", "TOP 10 \n", "source_id\n", "FROM gaiadr2.gaia_source\n", "WHERE 1=CONTAINS(\n", " POINT(ra, dec),\n", " CIRCLE(88.8, 7.4, 0.08333333))\n", "\"\"\"" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "This query uses three keywords that are specific to ADQL (not SQL):\n", "\n", "* `POINT`: a location in [ICRS coordinates](https://en.wikipedia.org/wiki/International_Celestial_Reference_System), specified in degrees of right ascension and declination.\n", "\n", "* `CIRCLE`: a circle where the first two values are the coordinates of the center and the third is the radius in degrees.\n", "\n", "* `CONTAINS`: a function that returns `1` if a `POINT` is contained in a shape and `0` otherwise.\n", "\n", "Here is the [documentation of `CONTAINS`](http://www.ivoa.net/documents/ADQL/20180112/PR-ADQL-2.1-20180112.html#tth_sEc4.2.12).\n", "\n", "A query like this is called a cone search because it selects stars in a cone.\n", "Here's how we run it." ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Created TAP+ (v1.2.1) - Connection:\n", "\tHost: gea.esac.esa.int\n", "\tUse HTTPS: True\n", "\tPort: 443\n", "\tSSL Port: 443\n", "Created TAP+ (v1.2.1) - Connection:\n", "\tHost: geadata.esac.esa.int\n", "\tUse HTTPS: True\n", "\tPort: 443\n", "\tSSL Port: 443\n" ] }, { "data": { "text/plain": [ "" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from astroquery.gaia import Gaia\n", "\n", "job = Gaia.launch_job(query_cone)\n", "job" ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "data": { "text/html": [ "Table length=10\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
source_id
int64
3322773965056065536
3322773758899157120
3322774068134271104
3322773930696320512
3322774377374425728
3322773724537891456
3322773724537891328
3322773930696321792
3322773724537890944
3322773930696322176
" ], "text/plain": [ "\n", " source_id \n", " int64 \n", "-------------------\n", "3322773965056065536\n", "3322773758899157120\n", "3322774068134271104\n", "3322773930696320512\n", "3322774377374425728\n", "3322773724537891456\n", "3322773724537891328\n", "3322773930696321792\n", "3322773724537890944\n", "3322773930696322176" ] }, "execution_count": 11, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = job.get_results()\n", "results" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Exercise\n", "\n", "When you are debugging queries like this, you can use `TOP` to limit the size of the results, but then you still don't know how big the results will be.\n", "\n", "An alternative is to use `COUNT`, which asks for the number of rows that would be selected, but it does not return them.\n", "\n", "In the previous query, replace `TOP 10 source_id` with `COUNT(source_id)` and run the query again. How many stars has Gaia identified in the cone we searched?" ] }, { "cell_type": "code", "execution_count": 12, "metadata": {}, "outputs": [ { "data": { "text/html": [ "Table length=1\n", "
\n", "\n", "\n", "\n", "
count
int64
594
" ], "text/plain": [ "\n", "count\n", "int64\n", "-----\n", " 594" ] }, "execution_count": 12, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# Solution\n", "\n", "query = \"\"\"SELECT \n", "COUNT(source_id)\n", "FROM gaiadr2.gaia_source\n", "WHERE 1=CONTAINS(\n", " POINT(ra, dec),\n", " CIRCLE(88.8, 7.4, 0.08333333))\n", "\"\"\"\n", "\n", "job = Gaia.launch_job(query)\n", "results = job.get_results()\n", "results" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Getting GD-1 Data\n", "\n", "From the Price-Whelan and Bonaca paper, we will try to reproduce Figure 1, which includes this representation of stars likely to belong to GD-1:\n", "\n", "" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The axes of this figure are defined so the x-axis is aligned with the stars in GD-1, and the y-axis is perpendicular.\n", "\n", "* Along the x-axis ($\\phi_1$) the figure extends from -100 to 20 degrees.\n", "\n", "* Along the y-axis ($\\phi_2$) the figure extends from about -8 to 4 degrees.\n", "\n", "Ideally, we would select all stars from this rectangle, but there are more than 10 million of them, so\n", "\n", "* That would be difficult to work with,\n", "\n", "* As anonymous Gaia users, we are limited to 3 million rows in a single query, and\n", "\n", "* While we are developing and testing code, it will be faster to work with a smaller dataset.\n", "\n", "So we'll start by selecting stars in a smaller rectangle near the center of GD-1, from -55 to -45 degrees $\\phi_1$ and -8 to 4 degrees $\\phi_2$.\n", "\n", "But first we let's see how to represent these coordinates with Astropy." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Transforming coordinates\n", "\n", "Astropy provides a `SkyCoord` object that represents sky coordinates relative to a specified frame.\n", "\n", "The following example creates a `SkyCoord` object that represents the approximate coordinates of [Betelgeuse](http://simbad.u-strasbg.fr/simbad/sim-basic?Ident=Betelgeuse) (alf Ori) in the ICRS frame.\n", "\n", "[ICRS](https://www.iers.org/IERS/EN/Science/ICRS/ICRS.html) is the\n", "\"International Celestial Reference System\", adopted in 1997 by the International Astronomical Union." ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 13, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from astropy.coordinates import SkyCoord\n", "\n", "ra = 88.8 * u.degree\n", "dec = 7.4 * u.degree\n", "coord_icrs = SkyCoord(ra=ra, dec=dec, frame='icrs')\n", "\n", "coord_icrs" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "`SkyCoord` provides a function that transforms to other frames.\n", "For example, we can transform `coords_icrs` to Galactic coordinates like this:" ] }, { "cell_type": "code", "execution_count": 14, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 14, "metadata": {}, "output_type": "execute_result" } ], "source": [ "coord_galactic = coord_icrs.transform_to('galactic')\n", "coord_galactic" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Notice that in the Galactic frame, the coordinates are called `l` and `b`, not `ra` and `dec`.\n", "\n", "To transform to and from GD-1 coordinates, we'll use a frame defined by [Gala](https://gala-astro.readthedocs.io/en/latest/), which is an Astropy-affiliated library that provides tools for galactic dynamics.\n", "\n", "Gala provides [`GD1Koposov10`](https://gala-astro.readthedocs.io/en/latest/_modules/gala/coordinates/gd1.html), which is \"a Heliocentric spherical coordinate system defined by the orbit of the GD-1 stream\"." ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 17, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from gala.coordinates import GD1Koposov10\n", "\n", "gd1_frame = GD1Koposov10()\n", "gd1_frame" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can use it to find the coordinates of Betelgeuse in the GD-1 frame, like this:" ] }, { "cell_type": "code", "execution_count": 18, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "coord_gd1 = coord_icrs.transform_to(gd1_frame)\n", "coord_gd1" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Notice that the coordinates are called `phi1` and `phi2`.\n", "These are the coordinates shown in the figure from the paper, above." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Exercise\n", "\n", "Let's find the location of GD-1 in ICRS coordinates.\n", "\n", "1. Create a `SkyCoord` object at 0°, 0° in the GD-1 frame.\n", "\n", "2. Transform it to the ICRS frame.\n", "\n", "Hint: Because ICRS is built into Astropy, you can specify it by name, `icrs` (as we did with `galactic`). " ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 19, "metadata": {}, "output_type": "execute_result" } ], "source": [ "# Solution\n", "\n", "origin_gd1 = SkyCoord(0*u.degree, 0*u.degree, frame=gd1_frame)\n", "\n", "# OR\n", "\n", "origin_gd1 = SkyCoord(phi1=0*u.degree, \n", " phi2=0*u.degree, \n", " frame=gd1_frame)\n", "\n", "# Note: because ICRS is built into Astropy, \n", "# we can identify it by string name\n", "origin_gd1.transform_to('icrs')\n", "\n", "# More formally, we could instantiate it\n", "from astropy.coordinates import ICRS\n", "icrs_frame = ICRS()\n", "origin_gd1.transform_to(icrs_frame)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Notice that the origin of the GD-1 frame maps to `ra=200`, exactly, in ICRS. That's by design." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Selecting a rectangle\n", "\n", "Now we'll use these coordinate transformations to define a rectangle in the GD-1 frame and transform it to ICRS. \n", "\n", "The following variables define the boundaries of the rectangle in $\\phi_1$ and $\\phi_2$." ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [], "source": [ "phi1_min = -55 * u.degree\n", "phi1_max = -45 * u.degree\n", "phi2_min = -8 * u.degree\n", "phi2_max = 4 * u.degree" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To create a rectangle, we'll use the following function, which takes the lower and upper bounds as parameters." ] }, { "cell_type": "code", "execution_count": 21, "metadata": {}, "outputs": [], "source": [ "def make_rectangle(x1, x2, y1, y2):\n", " \"\"\"Return the corners of a rectangle.\"\"\"\n", " xs = [x1, x1, x2, x2, x1]\n", " ys = [y1, y2, y2, y1, y1]\n", " return xs, ys" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The return value is a tuple containing a list of coordinates in `phi1` followed by a list of coordinates in `phi2`. " ] }, { "cell_type": "code", "execution_count": 22, "metadata": {}, "outputs": [], "source": [ "phi1_rect, phi2_rect = make_rectangle(\n", " phi1_min, phi1_max, phi2_min, phi2_max)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "`phi1_rect` and `phi2_rect` contains the coordinates of the corners of a rectangle in the GD-1 frame.\n", "\n", "In order to use them in a Gaia query, we have to convert them to ICRS. First we'll put them into a `SkyCoord` object." ] }, { "cell_type": "code", "execution_count": 23, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 23, "metadata": {}, "output_type": "execute_result" } ], "source": [ "corners = SkyCoord(phi1=phi1_rect, phi2=phi2_rect, frame=gd1_frame)\n", "corners" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Now we can use `transform_to` to convert to ICRS coordinates." ] }, { "cell_type": "code", "execution_count": 24, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "" ] }, "execution_count": 24, "metadata": {}, "output_type": "execute_result" } ], "source": [ "corners_icrs = corners.transform_to('icrs')\n", "corners_icrs" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Notice that a rectangle in one coordinate system is not necessarily a rectangle in another. In this example, the result is a (non-rectangular) polygon." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Defining a polygon\n", "\n", "In order to use this polygon as part of an ADQL query, we have to convert it to a string with a comma-separated list of coordinates, as in this example:\n", "\n", "```\n", "\"\"\"\n", "POLYGON(143.65, 20.98, \n", " 134.46, 26.39, \n", " 140.58, 34.85, \n", " 150.16, 29.01)\n", "\"\"\"\n", "```\n", "\n", "`SkyCoord` provides `to_string`, which produces a list of strings." ] }, { "cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "['146.275 19.2619',\n", " '135.422 25.8774',\n", " '141.603 34.3048',\n", " '152.817 27.1361',\n", " '146.275 19.2619']" ] }, "execution_count": 25, "metadata": {}, "output_type": "execute_result" } ], "source": [ "t = corners_icrs.to_string()\n", "t" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can use the Python string function `join` to join `t` into a single string (with spaces between the pairs):" ] }, { "cell_type": "code", "execution_count": 24, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'146.275 19.2619 135.422 25.8774 141.603 34.3048 152.817 27.1361 146.275 19.2619'" ] }, "execution_count": 24, "metadata": {}, "output_type": "execute_result" } ], "source": [ "s = ' '.join(t)\n", "s" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "That's almost what we need, but we have to replace the spaces with commas." ] }, { "cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'146.275, 19.2619, 135.422, 25.8774, 141.603, 34.3048, 152.817, 27.1361, 146.275, 19.2619'" ] }, "execution_count": 25, "metadata": {}, "output_type": "execute_result" } ], "source": [ "s.replace(' ', ', ')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The following function combines these steps." ] }, { "cell_type": "code", "execution_count": 26, "metadata": {}, "outputs": [], "source": [ "def skycoord_to_string(skycoord):\n", " \"\"\"Convert SkyCoord to string.\"\"\"\n", " t = skycoord.to_string()\n", " s = ' '.join(t)\n", " return s.replace(' ', ', ')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here's how we use it." ] }, { "cell_type": "code", "execution_count": 27, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'146.275, 19.2619, 135.422, 25.8774, 141.603, 34.3048, 152.817, 27.1361, 146.275, 19.2619'" ] }, "execution_count": 27, "metadata": {}, "output_type": "execute_result" } ], "source": [ "point_list = skycoord_to_string(corners_icrs)\n", "point_list" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Assembling the query\n", "\n", "Now we're ready to assemble the query. \n", "We need `columns` again (as we saw in the previous lesson)." ] }, { "cell_type": "code", "execution_count": 28, "metadata": {}, "outputs": [], "source": [ "columns = 'source_id, ra, dec, pmra, pmdec, parallax'" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "And here's the query base we used in the previous lesson:" ] }, { "cell_type": "code", "execution_count": 29, "metadata": {}, "outputs": [], "source": [ "query3_base = \"\"\"SELECT \n", "TOP 10 \n", "{columns}\n", "FROM gaiadr2.gaia_source\n", "WHERE parallax < 1\n", " AND bp_rp BETWEEN -0.75 AND 2\n", "\"\"\"" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Now we'll add a `WHERE` clause to select stars in the polygon we defined." ] }, { "cell_type": "code", "execution_count": 30, "metadata": {}, "outputs": [], "source": [ "query4_base = \"\"\"SELECT\n", "TOP 10\n", "{columns}\n", "FROM gaiadr2.gaia_source\n", "WHERE parallax < 1\n", " AND bp_rp BETWEEN -0.75 AND 2 \n", " AND 1 = CONTAINS(POINT(ra, dec), \n", " POLYGON({point_list}))\n", "\"\"\"" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The query base contains format specifiers for `columns` and `point_list`.\n", "\n", "We'll use `format` to fill in these values." ] }, { "cell_type": "code", "execution_count": 31, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "SELECT\n", "TOP 10\n", "source_id, ra, dec, pmra, pmdec\n", "FROM gaiadr2.gaia_source\n", "WHERE parallax < 1\n", " AND bp_rp BETWEEN -0.75 AND 2 \n", " AND 1 = CONTAINS(POINT(ra, dec), \n", " POLYGON(146.275, 19.2619, 135.422, 25.8774, 141.603, 34.3048, 152.817, 27.1361, 146.275, 19.2619))\n", "\n" ] } ], "source": [ "query4 = query4_base.format(columns=columns, \n", " point_list=point_list)\n", "print(query4)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "As always, we should take a minute to proof-read the query before we launch it." ] }, { "cell_type": "code", "execution_count": 32, "metadata": { "scrolled": true }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "INFO: Query finished. [astroquery.utils.tap.core]\n", "
\n", " name dtype unit description \n", "--------- ------- -------- ------------------------------------------------------------------\n", "source_id int64 Unique source identifier (unique within a particular Data Release)\n", " ra float64 deg Right ascension\n", " dec float64 deg Declination\n", " pmra float64 mas / yr Proper motion in right ascension direction\n", " pmdec float64 mas / yr Proper motion in declination direction\n", "Jobid: 1615815873808O\n", "Phase: COMPLETED\n", "Owner: None\n", "Output file: async_20210315094433.vot\n", "Results: None\n" ] } ], "source": [ "job = Gaia.launch_job_async(query4)\n", "print(job)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Here are the results." ] }, { "cell_type": "code", "execution_count": 33, "metadata": {}, "outputs": [ { "data": { "text/html": [ "Table length=10\n", "
\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
source_idradecpmrapmdec
degdegmas / yrmas / yr
int64float64float64float64float64
637987125186749568142.4830193599102321.75771616932985-2.51683846838757662.941813096629439
638285195917112960142.2545294134634422.4761681711413782.6627020143457996-12.165984395577347
638073505568978688142.6452855746807422.1669322495307818.30674739454163-7.950659620550862
638086386175786752142.5773943092603422.227919514013650.9877856720147953-2.584105480335548
638049655615392384142.5891356447861822.1107831666774180.24443878227817095-4.941079187010136
638267565075964032141.8176222899961422.375696125322275-3.4131745896607961.8838892877285924
638028902333511168143.1833980131767722.25124658123697.848511762712128-21.391145547787154
638085767700610432142.934731946458922.46244080823965-3.6585960944321476-12.486419770278376
638299863230178304142.2676974582326722.640183776884836-1.81683708922182971.0537342990941316
637973067758974208142.8955129286901221.612824100339875-8.645166256559063-44.41164172204947
" ], "text/plain": [ "\n", " source_id ra ... pmdec \n", " deg ... mas / yr \n", " int64 float64 ... float64 \n", "------------------ ------------------ ... -------------------\n", "637987125186749568 142.48301935991023 ... 2.941813096629439\n", "638285195917112960 142.25452941346344 ... -12.165984395577347\n", "638073505568978688 142.64528557468074 ... -7.950659620550862\n", "638086386175786752 142.57739430926034 ... -2.584105480335548\n", "638049655615392384 142.58913564478618 ... -4.941079187010136\n", "638267565075964032 141.81762228999614 ... 1.8838892877285924\n", "638028902333511168 143.18339801317677 ... -21.391145547787154\n", "638085767700610432 142.9347319464589 ... -12.486419770278376\n", "638299863230178304 142.26769745823267 ... 1.0537342990941316\n", "637973067758974208 142.89551292869012 ... -44.41164172204947" ] }, "execution_count": 33, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = job.get_results()\n", "results" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Finally, we can remove `TOP 10` run the query again.\n", "\n", "The result is bigger than our previous queries, so it will take a little longer." ] }, { "cell_type": "code", "execution_count": 34, "metadata": {}, "outputs": [], "source": [ "query5_base = \"\"\"SELECT\n", "{columns}\n", "FROM gaiadr2.gaia_source\n", "WHERE parallax < 1\n", " AND bp_rp BETWEEN -0.75 AND 2 \n", " AND 1 = CONTAINS(POINT(ra, dec), \n", " POLYGON({point_list}))\n", "\"\"\"" ] }, { "cell_type": "code", "execution_count": 35, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "SELECT\n", "source_id, ra, dec, pmra, pmdec\n", "FROM gaiadr2.gaia_source\n", "WHERE parallax < 1\n", " AND bp_rp BETWEEN -0.75 AND 2 \n", " AND 1 = CONTAINS(POINT(ra, dec), \n", " POLYGON(146.275, 19.2619, 135.422, 25.8774, 141.603, 34.3048, 152.817, 27.1361, 146.275, 19.2619))\n", "\n" ] } ], "source": [ "query5 = query5_base.format(columns=columns, \n", " point_list=point_list)\n", "print(query5)" ] }, { "cell_type": "code", "execution_count": 36, "metadata": { "scrolled": true }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "INFO: Query finished. [astroquery.utils.tap.core]\n", "
\n", " name dtype unit description \n", "--------- ------- -------- ------------------------------------------------------------------\n", "source_id int64 Unique source identifier (unique within a particular Data Release)\n", " ra float64 deg Right ascension\n", " dec float64 deg Declination\n", " pmra float64 mas / yr Proper motion in right ascension direction\n", " pmdec float64 mas / yr Proper motion in declination direction\n", "Jobid: 1615815886707O\n", "Phase: COMPLETED\n", "Owner: None\n", "Output file: async_20210315094446.vot\n", "Results: None\n" ] } ], "source": [ "job = Gaia.launch_job_async(query5)\n", "print(job)" ] }, { "cell_type": "code", "execution_count": 37, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "140339" ] }, "execution_count": 37, "metadata": {}, "output_type": "execute_result" } ], "source": [ "results = job.get_results()\n", "len(results)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "There are more than 100,000 stars in this polygon, but that's a manageable size to work with." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Saving results\n", "\n", "This is the set of stars we'll work with in the next step. But since we have a substantial dataset now, this is a good time to save it.\n", "\n", "Storing the data in a file means we can shut down this notebook and pick up where we left off without running the previous query again.\n", "\n", "Astropy `Table` objects provide `write`, which writes the table to disk." ] }, { "cell_type": "code", "execution_count": 38, "metadata": {}, "outputs": [], "source": [ "filename = 'gd1_results.fits'\n", "results.write(filename, overwrite=True)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Because the filename ends with `fits`, the table is written in the [FITS format](https://en.wikipedia.org/wiki/FITS), which preserves the metadata associated with the table.\n", "\n", "If the file already exists, the `overwrite` argument causes it to be overwritten.\n", "\n", "We can use `getsize` to confirm that the file exists and check the size:" ] }, { "cell_type": "code", "execution_count": 41, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "5.36407470703125" ] }, "execution_count": 41, "metadata": {}, "output_type": "execute_result" } ], "source": [ "from os.path import getsize\n", "\n", "MB = 1024 * 1024\n", "getsize(filename) / MB" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Summary\n", "\n", "In this notebook, we composed more complex queries to select stars within a polygonal region of the sky. Then we downloaded the results and saved them in a FITS file.\n", "\n", "In the next notebook, we'll reload the data from this file and replicate the next step in the analysis, using proper motion to identify stars likely to be in GD-1." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Best practices\n", "\n", "* For measurements with units, use `Quantity` objects that represent units explicitly and check for errors.\n", "\n", "* Use the `format` function to compose queries; code written this way is easier to read and less error-prone.\n", "\n", "* Develop queries incrementally: start with something simple, test it, and add a little bit at a time.\n", "\n", "* Once you have a query working, save the data in a local file. If you shut down the notebook and come back to it later, you can reload the file; you don't have to run the query again." ] }, { "cell_type": "raw", "metadata": {}, "source": [] } ], "metadata": { "celltoolbar": "Tags", "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.8.8" } }, "nbformat": 4, "nbformat_minor": 2 }