SciKits

Quick search

scikit-dataaccess

version 1.9.6.post1

Scikit Data Access Package for accessing scientific data sets.

Download: https://pypi.python.org/pypi/scikit-dataaccess
Homepage: https://github.com/MITHaystack/scikit-dataaccess
PyPI: http://pypi.python.org/pypi/scikit-dataaccess
People: MITHAGI

Description

.. image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/skdaccess_logo360x100.png
:alt: Scikit Data Access

- Import scientific data from various sources through one easy Python
API.
- Use iterator patterns for each data source (configurable data
generators + functions to get next data chunk).
- Skip parser programming and file format handling.
- Enjoy a common namespace for all data and unleash the power of data
fusion.
- Handle data distribution in different modes: (1) local download, (2)
caching of accessed data, or (3) online stream access
- Easily pull data on cloud servers through Python scripts and
facilitate large-scale parallel processing.
- Build on an extensible plattform: Adding access to a new data source
only requires addition of its \"DataFetcher.py\".
- Open source (MIT License)

.. image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/skdaccess_overviewdiag.png
\t :alt: Scikit Data Access Overview
\t :width: 810


Supported data sets (For updates, follow https://twitter.com/scikit_data and https://twitter.com/mithaystack)


.. csv-table::
:header: \"Namespace\", \"Description\", \"Preview\", \"Data Source\"

|astro_icon| astro.kepler , |nasa_logo| \t |kepler_desc| , |kepler_preview| , |kepler_url|
|astro_icon| astro.voyager , |nasa_logo| \t |voyager_desc| , |voyager_preview| , |voyager_url|
|geo_icon| geo.groundwater , |usgs_logo|\t |groundwater_desc| , |groundwater_preview|\t , |groundwater_url|
|geo_icon| geo.pbo , |unavaco_logo|\t |pbo_desc| , |pbo_preview|\t\t , |pbo_url|
|geo_icon| geo.grace , |nasa_logo|\t |grace_desc| , |grace_preview|\t , |grace_url|
|geo_icon| geo.gldas , |nasa_logo|\t |gldas_desc| , |gldas_preview|\t , |gldas_url|
|geo_icon| geo.modis , |nasa_logo|\t |modis_desc| , |modis_preview|\t , |modis_url|
|geo_icon| geo.magnetometer , |usgs_logo|\t |magnetometer_desc| , |magnetometer_preview| , |magnetometer_url|
|geo_icon| geo.mahali.rinex , |mit_logo| |nsf_logo| |mahali_rinex_desc| , |mahali_rinex_preview| , |mahali_url|
|geo_icon| geo.mahali.tec , |mit_logo| |nsf_logo| |mahali_tec_desc| , |mahali_tec_preview| , |mahali_url|
|geo_icon| geo.mahali.temperature, |mit_logo| |nsf_logo| |mahali_temperature_desc|, |mahali_temperature_preview|, |mahali_url|
|solar_icon| solar.sdo , |nasa_logo| \t |sdo_desc| , |sdo_preview| , |sdo_url|

.. Data type icons
.. |astro_icon| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_astro.png
.. |geo_icon| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_geo.png
.. |solar_icon| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_solar.png



.. Logos
.. |nasa_logo| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_datasource_logo_nasa.png
.. |usgs_logo| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_datasource_logo_usgs.png
.. |unavaco_logo| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_datasource_logo_unavco.png
.. |mit_logo| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_datasource_logo_mit.png
.. |nsf_logo| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_datasource_logo_nsf.png

.. Preview images
.. |kepler_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.astro.kepler.png
\t :target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Kepler.ipynb

.. |voyager_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.astro.voyager.png
\t\t :target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Voyager.ipynb

.. |sdo_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.solar.sdo.png
\t\t:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_SDO.ipynb

.. |groundwater_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.groundwater.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Groundwater.ipynb

.. |pbo_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.pbo.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_PBO.ipynb

.. |grace_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.grace.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_GRACE.ipynb

.. |gldas_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.gldas.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_GLDAS.ipynb

.. |modis_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.modis.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_MODIS.ipynb

.. |magnetometer_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.magnetometer.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Magnetometer.ipynb

.. |mahali_rinex_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.mahali.rinex.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Mahali_Rinex.ipynb

.. |mahali_tec_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.mahali.tec.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Mahali_TEC.ipynb

.. |mahali_temperature_preview| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/icon_skdaccess.geo.mahali.temperature.png
:target: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/examples/Demo_Temperature.ipynb

.. URLS
.. |kepler_url| replace::

\thttps://keplerscience.arc.nasa.gov

.. |voyager_url| replace::

\thttps://spdf.gsfc.nasa.gov

.. |sdo_url| replace::

\thttps://sdo.gsfc.nasa.gov

.. |groundwater_url| replace::

\thttps://waterservices.usgs.gov

.. |pbo_url| replace::

\thttp://www.unavco.org/projects/major-projects/pbo/pbo.html

.. |grace_url| replace::

\thttps://grace.jpl.nasa.gov/data/get-data/monthly-mass-grids-land

.. |gldas_url| replace::

\thttps://grace.jpl.nasa.gov/data/get-data/land-water-content

.. |modis_url| replace::

\thttps://modis.gsfc.nasa.gov

.. |magnetometer_url| replace::

\thttps://geomag.usgs.gov

.. |mahali_url| replace::

\thttp://mahali.mit.edu


.. Descriptions
.. |kepler_desc| replace::

\t\t Light curves for stars imaged by the NASA Kepler Space Telescope

.. |voyager_desc| replace::

\t\t Data from the Voyager mission

.. |sdo_desc| replace::

\t\t Images from the Solar Dynamics Observatory

.. |groundwater_desc| replace::

\t\t United States groundwater monitoring wells measuring the depth to water level

.. |pbo_desc| replace::

\t EarthScope - Plate Boundary Observatory (PBO): Daily GPS displacement time series measurements throughout the United States

.. |grace_desc| replace::

\t\tNASA GRACE Tellus Monthly Mass Grids. 30-day measurements of changes in Earth\u2019s gravity field to quantify equivalent water thickness

.. |gldas_desc| replace::

\t\tLand hydrology model produced by NASA. This version of the data is generated to match the GRACE temporal and spatial characteristics and is available as a complementary data product

.. |modis_desc| replace::

\t\tSpectroradiometer aboard the NASA Terra and Aqua image satellites. Generates approximately daily images of the Earth\u2019s surface

.. |magnetometer_desc| replace::

\t\t Data collected at magnetic observatories operated by the U.S. Geological Survey

.. |mahali_rinex_desc| replace::

\t\t Rinex files from the MIT led NSF project studying the Earth\u2019s ionosphere with GPS

.. |mahali_tec_desc| replace::

\t\t Total Electron Content from the MIT led NSF project studying the Earth\u2019s ionosphere with GPS

.. |mahali_temperature_desc| replace::

\t\t\t Temperature data from the MIT led NSF project studying the Earth\u2019s ionosphere with GPS

Install
~~~~~~~

.. code:: python

pip install scikit-dataaccess


Documentation
~~~~~~~~~~~~~


- User Manual: `/docs/skdaccess_manual.pdf`_
- Code documentation (Doxygen): `/docs/skdaccess_doxygen.pdf`_
- Code visualization (treemap): `/docs/skdaccess_treemap.png`_
- Code class diagrams: `/docs/class_diagrams`_

.. _/docs/skdaccess_manual.pdf: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/docs/skdaccess_manual.pdf
.. _/docs/skdaccess_doxygen.pdf: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/docs/skdaccess_doxygen.pdf
.. _/docs/skdaccess_treemap.png: https://github.com/MITHaystack/scikit-dataaccess/blob/master/skdaccess/docs/skdaccess_treemap.png
.. _/docs/class_diagrams: https://github.com/MITHaystack/scikit-dataaccess/tree/master/skdaccess/docs/class_diagrams


Contributors
~~~~~~~~~~~~

| Project lead: `Victor Pankratius (MIT) <http://www.victorpankratius.com>`_
| Contributors: Cody M. Rude, Justin D. Li, David M. Blair, Michael G. Gowanlock, Victor Pankratius
|
| New contributors welcome! Contact |skdaccess_contact| to contribute and add interface code for your own datasets |smiley|

.. |smiley| unicode:: 0x1F604

.. |skdaccess_contact| image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/skdaccess_cont.png

Acknowledgements
~~~~~~~~~~~~~~~~

We acknowledge support from NASA AIST14-NNX15AG84G, NASA AIST16-80NSSC17K0125, NSF ACI-1442997, and NSF AGS-1343967.

Examples
--------

Code examples (Jupyter notebooks) for all datasets listed above are available at:
`/skdaccess/examples <https://github.com/MITHaystack/scikit-dataaccess/tree/master/skdaccess/examples>`__

.. image:: https://github.com/MITHaystack/scikit-dataaccess/raw/master/skdaccess/docs/images/skdaccess-quickexamples-combined.png
:alt: Scikit Data Access Overview
\t :width: 500

Installation

PyPI

You can download the latest distribution from PyPI here: http://pypi.python.org/pypi/scikit-dataaccess

Using pip

You can install scikit-dataaccess for yourself from the terminal by running:

pip install --user scikit-dataaccess

If you want to install it for all users on your machine, do:

pip install scikit-dataaccess
On Linux, do sudo pip install scikit-dataaccess.

If you don't yet have the pip tool, you can get it following these instructions.

This package was discovered in PyPI.