Astroquery

==================

New Tools and Services
----------------------

esa.esasky
^^^^^^^^^^

- Added Solar System Object functionality. [2106]

ipac
^^^^

- New namespace for IPAC services. [2131]

linelists.cdms
^^^^^^^^^^^^^^
- Molecular line catalog query tool provides an interface to the
Cologne Database for Molecular Spectroscopy. [2143]


Service fixes and enhancements
------------------------------

casda
^^^^^^

- Add ability to stage and download non image data which have been found
through the CASDA obscore table. [2158]

gaia
^^^^

- The bug which caused changing the ``MAIN_GAIA_TABLE`` option to have no
effect has been fixed. [2153]

ipac.ned
^^^^^^^^

- Keyword 'file_format' is added to ``get_image_list`` to enable obtaining
links to non-fits file formats, too. [2217]

jplhorizons
^^^^^^^^^^^

- Updated to use v1.0 of the new JPL Horizons API released 2021-09-15.
Included in this update, the default reference system is changed from
J2000 to ICRF, following API documentation. [2154]

- Query ``id_type`` behavior has changed:
* ``'majorbody'`` and ``'id'`` have been removed and the equivalent
functionality replaced with ``None``. ``None`` implements the Horizons
default, which is to search for major bodies first, then fall back to a
small body search when no matches are found. Horizons does not have a
major body only search. [2161]
* The default value was ``'smallbody'`` but it is now ``None``, which
follows Horizons's default behavior. [2161]

- Fix changes in column names that resulted KeyErrors. [2202]

jplspec
^^^^^^^

- JPLSpec now raises an EmptyResponseError if the returned result is empty.
The API for JPLspec's ``lookup_table.find`` function returns a dictionary
instead of values (for compatibility w/CDMS). [2144]

simbad
^^^^^^

- Fix result parsing issues by disabling caching of failed queries. [2187]

- Fix parsing of non-ascii bibcode responses. [2200]

splatalogue
^^^^^^^^^^^

- Splatalogue table merging can now handle unmasked columns. [2136]

vizier
^^^^^^

- It is now possible to specify 'galatic' centers in region queries to
have box queries oriented along the galactic axes. [2152]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

- Versions of astropy <4 and numpy <1.16 are no longer supported. [2163]

ipac
^^^^

- As part of the namespace restructure, now modules for the IPAC archives are
avalable as: ``ipac.irsa``, ``ipac.ned``, and ``ipac.nexsci``.
Additional services have also been moved to their parent organisations'
namespace. Acces from the top namespace have been deprecated for the
following modules: ``ibe``, ``irsa``, ``irsa_dust``,
``nasa_exoplanet_archive``, ``ned``, ``sha``. [2131]

==================

New Tools and Services
----------------------

esa.esasky
^^^^^^^^^^

- Download by observation id or source name. [2078]

- Added custom ADQL and TAP+ functionality. [2078]

- Enabled download of INTEGRAL data products. [2105]

esa.hubble
^^^^^^^^^^

- Module added to perform a cone search based on a set of criteria. [1855]

esa.xmm_newton
^^^^^^^^^^^^^^

- Adding the extraction epic light curves and spectra. [2017]

heasarc
^^^^^^^

- Add alternative instance of HEASARC Server, maintained by
INTEGRAL Science Data Center. [1988]

nasa_exoplanet_archive
^^^^^^^^^^^^^^^^^^^^^^

- Making module compatible with the NASA Exoplanet Archive 2.0 using TAP.
release. Support for querying old tables (exoplanets, compositepars, and
exomultpars) has been dropped. [2067]


Service fixes and enhancements
------------------------------

atomic
^^^^^^

- Change URL to https. [2088]

esa.xmm_newton
^^^^^^^^^^^^^^

- Fixed the generation of files with wrong extension. [2017]

- Use astroquery downloader tool to get progressbar, caching, and prevent
memory leaks. [2087]

gaia
^^^^

- Changed default of Gaia TAP Plus interface to instantiate silently. [2085]

heasarc
^^^^^^^

- Added posibility to query limited time range. [1988]

ibe
^^^

- Doubling default timeout to 120 seconds. [2108]

- Change URL to https. [2108]

irsa
^^^^

- Adding ``cache`` kwarg to the class methods to be able to control the use
of local cache. [2092]

- Making optional kwargs keyword only. [2092]

sha
^^^

- Change URL to https. [2108]

- A ``NoResultsWarning`` is now returned when there is return of any empty
table. [1837]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

- Fixed progressbar download to report the correct downloaded amount. [2091]

- Dropping Python 3.6 support. [2102]

==================

New Tools and Services
----------------------

cds.hips2fits
^^^^^^^^^^^^^

- New module HIPS2fits to provide access to fits/jpg/png image cutouts from a
HiPS + a WCS. [1734]

esa.iso
^^^^^^^

- New module to access ESA ISO mission. [1914]

esa.xmm_newton
^^^^^^^^^^^^^^

- New method ``get_epic_images`` is added to extract EPIC images from
tarballs. [1759]

- New method ``get_epic_metadata`` is added to download EPIC sources
metadata. [1814]

mast
^^^^

- Added Zcut functionality to astroquery [1911]

svo_fps
^^^^^^^

- New module to access the Spanish Virtual Observatory Filter Profile List. [1498]


Service fixes and enhancements
------------------------------

alma
^^^^

- The archive query interface has been deprecated in favour of
VirtualObservatory (VO) services such as TAP, ObsCore etc. The alma
library has been updated accordingly. [1689]

- ALMA queries using string representations will now convert to appropriate
coordinates before being sent to the server; previously they were treated as
whatever unit they were presented in. [1867]

- Download mechanism uses the ALMA Datalink service that allows exploring and
downloading entire tarball package files or just part of their
content. [1820]

- Fixed bug in ``get_data_info`` to ensure relevant fields are strings. [2022]

esa.esasky
^^^^^^^^^^

- All ESASky spectra now accessible. [1909]

- Updated ESASky module for version 3.5 of ESASky backend. [1858]

- Added row limit parameter for map queries. [1858]

esa.hubble
^^^^^^^^^^

- Module added to query eHST TAP based on a set of specific criteria and
asynchronous jobs are now supported. [1723]

gaia
^^^^
- Fixed RA/dec table edit capability. [1784]

- Changed file names handling when downloading data. [1784]

- Improved code to handle bit data type. [1784]

- Prepared code to handle new datalink products. [1784]

gemini
^^^^^^

- ``login()`` method to support authenticated sessions to the GOA. [1780]

- ``get_file()`` to support downloading files. [1780]

- fix syntax error in ``query_criteria()`` [1823]

- If QA and/or engineering parameters are explicitly passed, remove the
defaults of ``notengineering`` and/or ``NotFail``. [2000]

- Smarter defaulting of radius to None unless coordinates are specified, in
which case defaults to 0.3 degrees. [1998]

heasarc
^^^^^^^

- A ``NoResultsWarning`` is now returned when there is no matching rows were
found in query. [1829]

irsa
^^^^

- Used more specific exceptions in IRSA. [1854]

jplsbdb
^^^^^^^

- Returns astropy quantities, rather than scaled units. [2011]

lcogt
^^^^^

- Module has been removed after having been defunct due to upstream API
refactoring a few years ago. [2071]

mast
^^^^

- Added ``Observations.download_file`` method to download a single file from
MAST given an input data URI. [1825]

- Added case for passing a row to ``Observations.download_file``. [1881]

- Removed deprecated methods: ``Observations.get_hst_s3_uris()``,
``Observations.get_hst_s3_uri()``, ``Core.get_token()``,
``Core.enable_s3_hst_dataset()``, ``Core.disable_s3_hst_dataset()``; and
parameters: ``obstype`` and ``silent``. [1884]

- Fixed error causing empty products passed to ``Observations.get_product_list()``
to yeild a non-empty result. [1921]

- Changed AWS cloud access from RequesterPays to anonymous acces. [1980]

- Fixed error with download of Spitzer data. [1994]

sdss
^^^^

- Fix validation of field names. [1790]

splatalogue
^^^^^^^^^^^

- The Splatalogue ID querying is now properly cached in the astropy cache
directory. The scraping function has also been updated to reflect
the Splatalogue webpage. [1772]

- The splatalogue URL has changed to https://splatalogue.online, as the old site
stopped functioning in September 2020 [1817]

ukidss
^^^^^^

- Updated to ``UKIDSSDR11PLUS`` as the default data release. [1767]

vamdc
^^^^^

- Deprecate module due to upstream library dependence and compability
issues. [2070]

vizier
^^^^^^

- Refactor module to support list of coordinates as well as several fixes to
follow changes in upstream API. [2012]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

- HTTP requests and responses can now be logged when the astropy
logger is set to level "DEBUG" and "TRACE" respectively. [1992]

- Astroquery and all its modules now uses a logger similar to Astropy's. [1992]

==================

New Tools and Services
----------------------

esa.xmm_newton
^^^^^^^^^^^^^^

- A new ESA archive service for XMM-Newton access. [1557]

image_cutouts.first
^^^^^^^^^^^^^^^^^^^

- Module added to access FIRST survey radio images. [1733]

noirlab
^^^^^^^

- Module added to access the NOIRLab (formally NOAO) archive. [1638]


Service fixes and enhancements
------------------------------

alma
^^^^

- A new API was deployed in late February / early March 2020, requiring a
refactor. The user-facing API should remain mostly the same, but some
service interruption may have occurred. Note that the ``stage_data`` column
``uid`` has been renamed ``mous_uid``, which is a technical correction, and
several columns have been added. [1644, 1665, 1683]

- The contents of tarfiles can be shown with the ``expand_tarfiles`` keyword
to ``stage_data``. [1683]

- Bugfix: when accessing private data, auth credentials were not being passed
to the HEAD request used to acquire header data. [1698]

casda
^^^^^

- Add ability to stage and download ASKAP data. [1706]

cadc
^^^^

- Fixed authentication and enabled listing of async jobs. [1712]

eso
^^^

- New ``unzip`` parameter to control uncompressing the retrieved data. [1642]

gaia
^^^^
- Allow for setting row limits in query submissions through class
attribute. [1641]

gemini
^^^^^^

- Allow for additional search terms to be sent to query_criteria and passed to
the raw web query against the Gemini Archive. [1659]

jplhorizons
^^^^^^^^^^^

- Fix for changes in HORIZONS return results after their 2020 Feb 12
update. [1650]

nasa_exoplanet_archive
^^^^^^^^^^^^^^^^^^^^^^

- Update the NASA Exoplanet Archive interface to support all tables available
through the API. The standard astroquery interface is now implemented via the
``query_*[_async]`` methods. [1700]

nrao
^^^^

- Fixed passing ``project_code`` to the query [1720]

vizier
^^^^^^

- It is now possible to specify constraints to ``query_region()``
with the ``column_filters`` keyword. [1702]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

- Versions of astropy <3.1 are no longer supported. [1649]

- Fixed a bug that would prevent the TOP statement from being properly added
to a TAP query containing valid '\n'. The bug was revealed by changes to
the gaia module, introduced in version 0.4. [1680]

- Added new ``json`` keyword to BaseQuery requests. [1657]

================

New Tools and Services
----------------------

casda
^^^^^

- Module added to access data from the CSIRO ASKAP Science Data Archive. [1505]

dace
^^^^

- Added DACE Service. See DACE website for details. [1370]

gemini
^^^^^^

- Module added to access the Gemini archive. [1596]


Service fixes and enhancements
------------------------------

gaia
^^^^
- Add optional 'columns' parameter to select specific columns. [1548]

imcce
^^^^^

- Fix Skybot return for unumbered asteroids. [1598]

jplhorizons
^^^^^^^^^^^

- Fix for changes in HORIZONS return results after their 2020 Jan 21 update. [1620]

mast
^^^^

- Add Kepler to missions with cloud support,
Update ``get_cloud_uri`` so that if a file is not found it produces a warning
and returns None rather than throwing an exception. [1561]

nasa_exoplanet_archive
^^^^^^^^^^^^^^^^^^^^^^
- Redefined the query API so as to prevent downloading of the whole database.
Added two functions ``query_planet`` (to query for a specific exoplanet), and
``query_star`` (to query for all exoplanets under a specific stellar system) [1606]



splatalogue
^^^^^^^^^^^

- Added new 'only_astronomically_observed' option. [1600]

vo_conesearch
^^^^^^^^^^^^^

- ``query_region()`` now accepts ``service_url`` keyword and uses
``conf.pedantic`` and ``conf.timeout`` directly. As a result, ``URL``,
``PEDANTIC``, and ``TIMEOUT`` class attributes are no longer needed, so
they are removed from ``ConeSearchClass`` and ``ConeSearch``. [1528]

- The classic API ``conesearch()`` no longer takes ``timeout`` and ``pedantic``
keywords. It uses ``conf.pedantic`` and ``conf.timeout`` directly. [1528]

- Null result now emits warning instead of exception. [1528]

- Result is now returned as ``astropy.table.Table`` by default. [1528]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

utils
^^^^^

- Added timer functions. [1508]

===================

New Tools and Services
----------------------

astrometry_net
^^^^^^^^^^^^^^

- Module added to interface to astrometry.net plate-solving service. [1163]

cadc
^^^^

- Module added to access data at the Canadian Astronomy Data Centre. [1354, 1486]

esa
^^^

- Module added ``hubble`` for accessing the ESA Hubble Archive. [1373, 1534]

gaia
^^^^

- Added tables sharing, tables edition, upload from pytable and job results,
cross match, data access and datalink access. [1266]

imcce
^^^^^

- Service ``miriade`` added, querying asteroid and comets ephemerides. [1353]

- Service ``skybot`` added, identifying Solar System objects in a given
field at a given epoch. [1353]

mast
^^^^

- Addition of observation metadata query. [1473]

- Addition of catalogs.MAST PanSTARRS catalog queries. [1473]

mpc
^^^

- Functionality added to query observations database. [1350]


Service fixes and enhancements
------------------------------

alma
^^^^

- Fix some broken VOtable returns and a broken login URL. [1369]

- ``get_project_metadata()`` is added to query project metadata. [1147]

- Add access to the ``member_ous_id`` attribute. [1316]

cds
^^^

- Apply MOCPy v0.5.* API changes. [1343]

eso
^^^

- Try to re-authenticate when logged out from the ESO server. [1315]

heasarc
^^^^^^^

- Fixing error handling to filter out only the query errors. [1338]

jplhorizons
^^^^^^^^^^^

- Add ``refplane`` keyword to ``vectors_async`` to return data for different
available reference planes. [1335]

- Vector queries provide different aberrations, ephemerides queries provide
extra precision option. [1478]

- Fix crash when precision to the second on epoch is requested. [1488]

- Fix for missing H, G values. [1333]

jplsbdb
^^^^^^^

- Fix for missing values. [1333]

mast
^^^^

- Update query_criteria keyword obstype->intentType. [1366]

- Remove deprecated authorization code, fix unit tests, general code cleanup,
documentation additions. [1409]

- TIC catalog search update. [1483]

- Add search by object name to Tesscut, make resolver_object public, minor bugfixes. [1499]

- Add option to query TESS Candidate Target List (CTL) Catalog. [1503]

- Add verbose keyword for option to silence logger info and warning about S3
in enable_cloud_dataset(). [1536]

nasa_ads
^^^^^^^^

- Fix an error in one of the default keys, citations->citation. [1337]

nist
^^^^

- Fixed an upstream issue where js was included in returned data. [1359]

- Unescape raw HTML codes in returned data back into Unicode equivalents to
stop them silently breaking Table parsing. [1431]

nrao
^^^^

- Fix parameter validation allowing for hybrid telescope configuration. [1283]

sdss
^^^^

- Update to SDSS-IV URLs and general clean-up. [1308]

vizier
^^^^^^

- Support using the output values of ``find_catalog`` in ``get_catalog``. [603]

- Fix to ensure to fall back on the default catalog when it's not provided as
part of the query method. [1328]

- Fix swapped width and length parameters. [1406]

xmatch
^^^^^^

- Add parameter ``area`` to restrict sky region considered. [1476]


Infrastructure, Utility and Other Changes and Additions
-------------------------------------------------------

- HTTP user-agent now has the string ``_testrun`` in the version number of astroquery,
for queries triggered by testing. [1307]

- Adding deprecation decorators to ``utils`` from astropy to be used while we
support astropy <v3.1.2. [1435]

- Added tables sharing, tables edition, upload from pytable and job results,
data access and datalink access to ``utils.tap``. [1266]

- Added a new ``astroquery.__citation__`` and ``astroquery.__bibtex__``
attributes which give a citation for astroquery in bibtex format. [1391]