{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "**Brian Blaylock** \n", "*January 13, 2021*\n", "\n", "# Download GOES Data: Nearest Time\n", "For all options, refer to the GOES-2-go Reference Guide: [goes2go.data.goes_nearesttime](https://goes2go.readthedocs.io/en/latest/reference_guide/index.html#goes2go.data.goes_nearesttime)" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [], "source": [ "from goes2go.data import goes_nearesttime\n", "\n", "from datetime import datetime, timedelta\n", "import pandas as pd" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Specify the time you want to go data nearest to.\n", "May be a datetime or pandas-style datetime object, or a string that pandas can decode." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "---\n", "### Example 1: \n", "Download an ABI file from GOES-East nearest the time **10:00 UTC December 12, 2020**. Return the data opened with xarray." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " _______________________________\n", " | Satellite: noaa-goes16 |\n", " | Product: ABI-L2-MCMIPC |\n", " | Domain: C |\n", "📦 Finished downloading [1] files to [/p/home/blaylock/data/noaa-goes16/ABI-L2-MCMIPC]. \n", "📚 Finished reading [1] files into xarray.Dataset. \n" ] } ], "source": [ "g = goes_nearesttime(\n", " datetime(2020, 12, 25, 10), satellite=\"goes16\", product=\"ABI\", return_as=\"xarray\"\n", ")" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "\n", "
<xarray.Dataset>\n",
       "Dimensions:                                 (band: 1, number_of_image_bounds: 2, number_of_time_bounds: 2, x: 2500, y: 1500)\n",
       "Coordinates:\n",
       "    t                                       datetime64[ns] 2020-12-25T10:02:3...\n",
       "  * y                                       (y) float32 0.1282 ... 0.04427\n",
       "  * x                                       (x) float32 -0.1013 ... 0.03861\n",
       "    y_image                                 float32 0.08624\n",
       "    x_image                                 float32 -0.03136\n",
       "    band_wavelength_C01                     (band) float32 0.47\n",
       "    band_wavelength_C02                     (band) float32 0.64\n",
       "    band_wavelength_C03                     (band) float32 0.87\n",
       "    band_wavelength_C04                     (band) float32 1.38\n",
       "    band_wavelength_C05                     (band) float32 1.61\n",
       "    band_wavelength_C06                     (band) float32 2.25\n",
       "    band_wavelength_C07                     (band) float32 3.89\n",
       "    band_wavelength_C08                     (band) float32 6.17\n",
       "    band_wavelength_C09                     (band) float32 6.93\n",
       "    band_wavelength_C10                     (band) float32 7.34\n",
       "    band_wavelength_C11                     (band) float32 8.44\n",
       "    band_wavelength_C12                     (band) float32 9.61\n",
       "    band_wavelength_C13                     (band) float32 10.33\n",
       "    band_wavelength_C14                     (band) float32 11.19\n",
       "    band_wavelength_C15                     (band) float32 12.27\n",
       "    band_wavelength_C16                     (band) float32 13.27\n",
       "    band_id_C01                             (band) int8 1\n",
       "    band_id_C02                             (band) int8 2\n",
       "    band_id_C03                             (band) int8 3\n",
       "    band_id_C04                             (band) int8 4\n",
       "    band_id_C05                             (band) int8 5\n",
       "    band_id_C06                             (band) int8 6\n",
       "    band_id_C07                             (band) int8 7\n",
       "    band_id_C08                             (band) int8 8\n",
       "    band_id_C09                             (band) int8 9\n",
       "    band_id_C10                             (band) int8 10\n",
       "    band_id_C11                             (band) int8 11\n",
       "    band_id_C12                             (band) int8 12\n",
       "    band_id_C13                             (band) int8 13\n",
       "    band_id_C14                             (band) int8 14\n",
       "    band_id_C15                             (band) int8 15\n",
       "    band_id_C16                             (band) int8 16\n",
       "    dataset_name                            <U74 'OR_ABI-L2-MCMIPC-M6_G16_s20...\n",
       "    date_created                            <U22 '2020-12-25T10:04:10.7Z'\n",
       "    time_coverage_start                     <U22 '2020-12-25T10:01:17.9Z'\n",
       "    time_coverage_end                       <U22 '2020-12-25T10:03:55.8Z'\n",
       "Dimensions without coordinates: band, number_of_image_bounds, number_of_time_bounds\n",
       "Data variables:\n",
       "    CMI_C01                                 (y, x) float32 ...\n",
       "    DQF_C01                                 (y, x) float32 ...\n",
       "    CMI_C02                                 (y, x) float32 ...\n",
       "    DQF_C02                                 (y, x) float32 ...\n",
       "    CMI_C03                                 (y, x) float32 ...\n",
       "    DQF_C03                                 (y, x) float32 ...\n",
       "    CMI_C04                                 (y, x) float32 ...\n",
       "    DQF_C04                                 (y, x) float32 ...\n",
       "    CMI_C05                                 (y, x) float32 ...\n",
       "    DQF_C05                                 (y, x) float32 ...\n",
       "    CMI_C06                                 (y, x) float32 ...\n",
       "    DQF_C06                                 (y, x) float32 ...\n",
       "    CMI_C07                                 (y, x) float32 ...\n",
       "    DQF_C07                                 (y, x) float32 ...\n",
       "    CMI_C08                                 (y, x) float32 ...\n",
       "    DQF_C08                                 (y, x) float32 ...\n",
       "    CMI_C09                                 (y, x) float32 ...\n",
       "    DQF_C09                                 (y, x) float32 ...\n",
       "    CMI_C10                                 (y, x) float32 ...\n",
       "    DQF_C10                                 (y, x) float32 ...\n",
       "    CMI_C11                                 (y, x) float32 ...\n",
       "    DQF_C11                                 (y, x) float32 ...\n",
       "    CMI_C12                                 (y, x) float32 ...\n",
       "    DQF_C12                                 (y, x) float32 ...\n",
       "    CMI_C13                                 (y, x) float32 ...\n",
       "    DQF_C13                                 (y, x) float32 ...\n",
       "    CMI_C14                                 (y, x) float32 ...\n",
       "    DQF_C14                                 (y, x) float32 ...\n",
       "    CMI_C15                                 (y, x) float32 ...\n",
       "    DQF_C15                                 (y, x) float32 ...\n",
       "    CMI_C16                                 (y, x) float32 ...\n",
       "    DQF_C16                                 (y, x) float32 ...\n",
       "    time_bounds                             (number_of_time_bounds) datetime64[ns] ...\n",
       "    goes_imager_projection                  int32 -2147483647\n",
       "    y_image_bounds                          (number_of_image_bounds) float32 ...\n",
       "    x_image_bounds                          (number_of_image_bounds) float32 ...\n",
       "    nominal_satellite_subpoint_lat          float64 0.0\n",
       "    nominal_satellite_subpoint_lon          float64 -75.2\n",
       "    nominal_satellite_height                float64 3.579e+04\n",
       "    geospatial_lat_lon_extent               float32 9.969e+36\n",
       "    outlier_pixel_count_C01                 float64 0.0\n",
       "    min_reflectance_factor_C01              float64 0.0\n",
       "    max_reflectance_factor_C01              float64 0.0013\n",
       "    mean_reflectance_factor_C01             float64 7.66e-05\n",
       "    std_dev_reflectance_factor_C01          float64 1.62e-05\n",
       "    outlier_pixel_count_C02                 float64 0.0\n",
       "    min_reflectance_factor_C02              float64 0.0\n",
       "    max_reflectance_factor_C02              float64 0.01686\n",
       "    mean_reflectance_factor_C02             float64 0.0004737\n",
       "    std_dev_reflectance_factor_C02          float64 0.0006462\n",
       "    outlier_pixel_count_C03                 float64 0.0\n",
       "    min_reflectance_factor_C03              float64 0.0\n",
       "    max_reflectance_factor_C03              float64 0.009648\n",
       "    mean_reflectance_factor_C03             float64 0.0001223\n",
       "    std_dev_reflectance_factor_C03          float64 0.0002471\n",
       "    outlier_pixel_count_C04                 float64 0.0\n",
       "    min_reflectance_factor_C04              float64 0.0\n",
       "    max_reflectance_factor_C04              float64 0.01254\n",
       "    mean_reflectance_factor_C04             float64 0.0001181\n",
       "    std_dev_reflectance_factor_C04          float64 0.000219\n",
       "    outlier_pixel_count_C05                 float64 0.0\n",
       "    min_reflectance_factor_C05              float64 0.0\n",
       "    max_reflectance_factor_C05              float64 0.04088\n",
       "    mean_reflectance_factor_C05             float64 0.0001563\n",
       "    std_dev_reflectance_factor_C05          float64 0.0003238\n",
       "    outlier_pixel_count_C06                 float64 0.0\n",
       "    min_reflectance_factor_C06              float64 0.0\n",
       "    max_reflectance_factor_C06              float64 0.03812\n",
       "    mean_reflectance_factor_C06             float64 8.81e-05\n",
       "    std_dev_reflectance_factor_C06          float64 0.0001417\n",
       "    outlier_pixel_count_C07                 float64 0.0\n",
       "    min_brightness_temperature_C07          float64 104.6\n",
       "    max_brightness_temperature_C07          float64 299.3\n",
       "    mean_brightness_temperature_C07         float64 270.1\n",
       "    std_dev_brightness_temperature_C07      float64 21.6\n",
       "    outlier_pixel_count_C08                 float64 0.0\n",
       "    min_brightness_temperature_C08          float64 201.9\n",
       "    max_brightness_temperature_C08          float64 253.3\n",
       "    mean_brightness_temperature_C08         float64 236.7\n",
       "    std_dev_brightness_temperature_C08      float64 10.11\n",
       "    outlier_pixel_count_C09                 float64 0.0\n",
       "    min_brightness_temperature_C09          float64 201.5\n",
       "    max_brightness_temperature_C09          float64 262.4\n",
       "    mean_brightness_temperature_C09         float64 244.8\n",
       "    std_dev_brightness_temperature_C09      float64 12.32\n",
       "    outlier_pixel_count_C10                 float64 0.0\n",
       "    min_brightness_temperature_C10          float64 201.5\n",
       "    max_brightness_temperature_C10          float64 269.3\n",
       "    mean_brightness_temperature_C10         float64 251.4\n",
       "    std_dev_brightness_temperature_C10      float64 14.25\n",
       "    outlier_pixel_count_C11                 float64 0.0\n",
       "    min_brightness_temperature_C11          float64 200.6\n",
       "    max_brightness_temperature_C11          float64 295.0\n",
       "    mean_brightness_temperature_C11         float64 266.7\n",
       "    std_dev_brightness_temperature_C11      float64 21.59\n",
       "    outlier_pixel_count_C12                 float64 0.0\n",
       "    min_brightness_temperature_C12          float64 208.2\n",
       "    max_brightness_temperature_C12          float64 275.0\n",
       "    mean_brightness_temperature_C12         float64 248.8\n",
       "    std_dev_brightness_temperature_C12      float64 17.01\n",
       "    outlier_pixel_count_C13                 float64 0.0\n",
       "    min_brightness_temperature_C13          float64 201.3\n",
       "    max_brightness_temperature_C13          float64 298.0\n",
       "    mean_brightness_temperature_C13         float64 268.1\n",
       "    std_dev_brightness_temperature_C13      float64 22.46\n",
       "    outlier_pixel_count_C14                 float64 0.0\n",
       "    min_brightness_temperature_C14          float64 201.0\n",
       "    max_brightness_temperature_C14          float64 298.2\n",
       "    mean_brightness_temperature_C14         float64 267.5\n",
       "    std_dev_brightness_temperature_C14      float64 22.79\n",
       "    outlier_pixel_count_C15                 float64 0.0\n",
       "    min_brightness_temperature_C15          float64 200.5\n",
       "    max_brightness_temperature_C15          float64 295.6\n",
       "    mean_brightness_temperature_C15         float64 266.1\n",
       "    std_dev_brightness_temperature_C15      float64 22.22\n",
       "    outlier_pixel_count_C16                 float64 0.0\n",
       "    min_brightness_temperature_C16          float64 201.3\n",
       "    max_brightness_temperature_C16          float64 278.9\n",
       "    mean_brightness_temperature_C16         float64 256.4\n",
       "    std_dev_brightness_temperature_C16      float64 17.86\n",
       "    percent_uncorrectable_GRB_errors        float64 0.0\n",
       "    percent_uncorrectable_L0_errors         float64 0.0\n",
       "    dynamic_algorithm_input_data_container  int32 -2147483647\n",
       "    algorithm_product_version_container     int32 -2147483647\n",
       "Attributes:\n",
       "    naming_authority:          gov.nesdis.noaa\n",
       "    Conventions:               CF-1.7\n",
       "    Metadata_Conventions:      Unidata Dataset Discovery v1.0\n",
       "    standard_name_vocabulary:  CF Standard Name Table (v35, 20 July 2016)\n",
       "    institution:               DOC/NOAA/NESDIS > U.S. Department of Commerce,...\n",
       "    project:                   GOES\n",
       "    production_site:           NSOF\n",
       "    production_environment:    OE\n",
       "    spatial_resolution:        2km at nadir\n",
       "    orbital_slot:              GOES-East\n",
       "    platform_ID:               G16\n",
       "    instrument_type:           GOES R Series Advanced Baseline Imager\n",
       "    scene_id:                  CONUS\n",
       "    instrument_ID:             FM1\n",
       "    iso_series_metadata_id:    8c9e8150-3692-11e3-aa6e-0800200c9a66\n",
       "    keywords_vocabulary:       NASA Global Change Master Directory (GCMD) Ear...\n",
       "    title:                     ABI L2 Cloud and Moisture Imagery\n",
       "    summary:                   Multiple reflectance and emissive channel Clou...\n",
       "    license:                   Unclassified data.  Access is restricted to ap...\n",
       "    keywords:                  ATMOSPHERE > ATMOSPHERIC RADIATION > REFLECTAN...\n",
       "    cdm_data_type:             Image\n",
       "    processing_level:          National Aeronautics and Space Administration ...\n",
       "    timeline_id:               ABI Mode 6\n",
       "    production_data_source:    Realtime\n",
       "    id:                        5200b893-323e-4b7f-9485-812d93c1f864
" ], "text/plain": [ "\n", "Dimensions: (band: 1, number_of_image_bounds: 2, number_of_time_bounds: 2, x: 2500, y: 1500)\n", "Coordinates:\n", " t datetime64[ns] ...\n", " * y (y) float32 0.1282 ... 0.04427\n", " * x (x) float32 -0.1013 ... 0.03861\n", " y_image float32 ...\n", " x_image float32 ...\n", " band_wavelength_C01 (band) float32 ...\n", " band_wavelength_C02 (band) float32 ...\n", " band_wavelength_C03 (band) float32 ...\n", " band_wavelength_C04 (band) float32 ...\n", " band_wavelength_C05 (band) float32 ...\n", " band_wavelength_C06 (band) float32 ...\n", " band_wavelength_C07 (band) float32 ...\n", " band_wavelength_C08 (band) float32 ...\n", " band_wavelength_C09 (band) float32 ...\n", " band_wavelength_C10 (band) float32 ...\n", " band_wavelength_C11 (band) float32 ...\n", " band_wavelength_C12 (band) float32 ...\n", " band_wavelength_C13 (band) float32 ...\n", " band_wavelength_C14 (band) float32 ...\n", " band_wavelength_C15 (band) float32 ...\n", " band_wavelength_C16 (band) float32 ...\n", " band_id_C01 (band) int8 ...\n", " band_id_C02 (band) int8 ...\n", " band_id_C03 (band) int8 ...\n", " band_id_C04 (band) int8 ...\n", " band_id_C05 (band) int8 ...\n", " band_id_C06 (band) int8 ...\n", " band_id_C07 (band) int8 ...\n", " band_id_C08 (band) int8 ...\n", " band_id_C09 (band) int8 ...\n", " band_id_C10 (band) int8 ...\n", " band_id_C11 (band) int8 ...\n", " band_id_C12 (band) int8 ...\n", " band_id_C13 (band) int8 ...\n", " band_id_C14 (band) int8 ...\n", " band_id_C15 (band) int8 ...\n", " band_id_C16 (band) int8 ...\n", " dataset_name U.S. Department of Commerce,...\n", " project: GOES\n", " production_site: NSOF\n", " production_environment: OE\n", " spatial_resolution: 2km at nadir\n", " orbital_slot: GOES-East\n", " platform_ID: G16\n", " instrument_type: GOES R Series Advanced Baseline Imager\n", " scene_id: CONUS\n", " instrument_ID: FM1\n", " iso_series_metadata_id: 8c9e8150-3692-11e3-aa6e-0800200c9a66\n", " keywords_vocabulary: NASA Global Change Master Directory (GCMD) Ear...\n", " title: ABI L2 Cloud and Moisture Imagery\n", " summary: Multiple reflectance and emissive channel Clou...\n", " license: Unclassified data. Access is restricted to ap...\n", " keywords: ATMOSPHERE > ATMOSPHERIC RADIATION > REFLECTAN...\n", " cdm_data_type: Image\n", " processing_level: National Aeronautics and Space Administration ...\n", " timeline_id: ABI Mode 6\n", " production_data_source: Realtime\n", " id: 5200b893-323e-4b7f-9485-812d93c1f864" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "g" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "---\n", "### Example 2:\n", "Download a GLM file from GOES-West nearest the time **12:00 UTC January 1, 2021**. Return the data as a list of files." ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " _______________________________\n", " | Satellite: noaa-goes17 |\n", " | Product: GLM-L2-LCFA |\n", "📦 Finished downloading [1] files to [/p/home/blaylock/data/noaa-goes17/GLM-L2-LCFA]. \n" ] } ], "source": [ "g = goes_nearesttime(\n", " \"2021-01-01 12:00\", satellite=\"goes17\", product=\"GLM\", return_as=\"filelist\"\n", ")" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
filestartendcreation
0noaa-goes17/GLM-L2-LCFA/2021/001/12/OR_GLM-L2-...2021-01-01 12:00:002021-01-01 12:00:20.4002021-01-01 12:00:20.600
\n", "
" ], "text/plain": [ " file start \\\n", "0 noaa-goes17/GLM-L2-LCFA/2021/001/12/OR_GLM-L2-... 2021-01-01 12:00:00 \n", "\n", " end creation \n", "0 2021-01-01 12:00:20.400 2021-01-01 12:00:20.600 " ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "g" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "{'satellite': 'noaa-goes17',\n", " 'product': 'GLM-L2-LCFA',\n", " 'start': Timestamp('2021-01-01 11:00:00'),\n", " 'end': Timestamp('2021-01-01 13:00:00'),\n", " 'filePath': PosixPath('/p/home/blaylock/data')}" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "g.attrs" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Show the files on my home drive..." ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "/p/home/blaylock/data\n", "├── noaa-goes16\n", "│   └── ABI-L2-MCMIPC\n", "│   └── 2020\n", "│   └── 360\n", "│   └── 10\n", "│   └── OR_ABI-L2-MCMIPC-M6_G16_s20203601001179_e20203601003558_c20203601004107.nc\n", "└── noaa-goes17\n", " └── GLM-L2-LCFA\n", " └── 2021\n", " └── 001\n", " └── 12\n", " └── OR_GLM-L2-LCFA_G17_s20210011200000_e20210011200204_c20210011200206.nc\n", "\n", "10 directories, 2 files\n" ] } ], "source": [ "%%bash\n", "tree ~/data" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.9" } }, "nbformat": 4, "nbformat_minor": 4 }