ESGF_RSS_Feeds - ESGF/esgf.github.io GitHub Wiki

Wiki Reorganisation
This page has been classified for reorganisation. It has been given the category MOVE.
The content of this page will be revised and moved to one or more other pages in the new wiki structure.

ESGF RSS Feeds

ESGF provides powerful RSS notification feeds that are based on the underlying ESGF Search Services. For a general description of RSS feeds in ESGF, please see the ESGF RSS User Guide . This document contains additional information that describes some of the current implementation details and choices, as well as example RSS documents.

As described in the user's guide, ESGF RSS feeds can be of two types, depending on the nature of the items they contain: Dataset feeds and File feeds. Additionally, a feed can cover the whole ESGF federation (because the underlying query is distributed across all sites), or just a single ESGF node (non-distributed query). Dataset-level feeds are used to notify users of new publishing activity: they return the first 1000 datasets that were updated in the last 10 days. File-level feeds are used to list the exact content of a given dataset: they are immutable, except when a new version of that dataset is published.

Dataset-level feeds include both dataset master copies and replicas, so that whenever a new replica is published, any subscribed user will be notified. File-level feeds are dataset-specific, wether that dataset is a master copy of a replica.

RSS feeds contain the following metadata:

  • The <title> element is composed of the record _ title _ or _ id _ , and the record _ version _ , so that an RSS application will display that item as _ new _ when the title changes.

  • The element contains additional information about each item.

  • The element always references the HTML page of the corresponding THREDDS catalog, for a given dataset or file. This element is displayed as the main hyperlink by all RSS client applications.

  • The element always reference the XML THREDDS catalog, for a given dataset or file. This element is typically not displayed by RSS applications, but it could be used by a custom RSS parser.

  • The (zero, one or more) elements are populated as follows:

    • For dataset-level feeds, each dataset item references the corresponding file-level feed, so that all files could be retrieved
    • For file-level feeds, each file item references all available access URLs for that file.

  • The element contains additional information for the item, obtained from the dataset or file facets, including replica information (the replica flag and master_id).

  • The element contains the unique dataset or file identifier

  • The element contains the record last update date and time

Examples of RSS items

Example of metadata content of an item of type Dataset:

   <item>
      <title>obs4MIPs CNES AVISO L4 Monthly Data (v1)</title>
      <link>http://esg-datanode.jpl.nasa.gov/thredds/esgcet/1/obs4MIPs.CNES.AVISO.mon.v1.html#obs4MIPs.CNES.AVISO.mon.v1</link>
      <description>obs4MIPs.CNES.AVISO.mon</description>
      <source url="http://esg-datanode.jpl.nasa.gov/thredds/esgcet/1/obs4MIPs.CNES.AVISO.mon.v1.xml#obs4MIPs.CNES.AVISO.mon.v1">obs4MIPs.CNES.AVISO.mon</source>
      <enclosure url="http://esg-datanode.jpl.nasa.gov/esg-search/feed/dataset/obs4MIPs.CNES.AVISO.mon.rss" type="application/rss+xml" />
      <category domain="http://www.esgf.org/cv/0.1/type">Dataset</category>
      <category domain="http://www.esgf.org/cv/0.1/replica">false</category>
      <category domain="http://www.esgf.org/cv/0.1/master_id">obs4MIPs.CNES.AVISO.mon</category>
      <category domain="http://www.esgf.org/cv/0.1/cf_variable">Sea Surface Height Above Geoid Number of Observations</category>
      <category domain="http://www.esgf.org/cv/0.1/cf_variable">Sea Surface Height Above Geoid Standard Error</category>
      <category domain="http://www.esgf.org/cv/0.1/cf_variable">Sea Surface Height Above Geoid</category>
      <category domain="http://www.esgf.org/cv/0.1/data_structure">grid</category>
      <category domain="http://www.esgf.org/cv/0.1/experiment">obs</category>
      <category domain="http://www.esgf.org/cv/0.1/experiment_family">All</category>
      <category domain="http://www.esgf.org/cv/0.1/institute">CNES</category>
      <category domain="http://www.esgf.org/cv/0.1/model">Obs-AVISO</category>
      <category domain="http://www.esgf.org/cv/0.1/processing_level">L4</category>
      <category domain="http://www.esgf.org/cv/0.1/product">observations</category>
      <category domain="http://www.esgf.org/cv/0.1/project">obs4MIPs</category>
      <category domain="http://www.esgf.org/cv/0.1/realm">ocean</category>
      <category domain="http://www.esgf.org/cv/0.1/source_id">AVISO</category>
      <category domain="http://www.esgf.org/cv/0.1/time_frequency">mon</category>
      <category domain="http://www.esgf.org/cv/0.1/variable">zosNobs</category>
      <category domain="http://www.esgf.org/cv/0.1/variable">zosStderr</category>
      <category domain="http://www.esgf.org/cv/0.1/variable">zos</category>
      <category domain="http://www.esgf.org/cv/0.1/variable">zos</category>
      <category domain="http://www.esgf.org/cv/0.1/version">1</category>
      <pubDate>Fri, 18 Nov 2011 16:20:45 GMT</pubDate>
      <guid isPermaLink="false">obs4MIPs.CNES.AVISO.mon</guid>
    </item>

Example metadata content for an item of type File:

    <item>
      <title>tosNobs_AMSRE_L3_v7_200206-201012.nc (v1)</title>
      <link>http://esg-datanode.jpl.nasa.gov/thredds/esgcet/1/obs4MIPs.REMSS.AMSRE.mon.v1.html?dataset=obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc</link>
      <description>obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc</description>
      <source url="http://esg-datanode.jpl.nasa.gov/thredds/esgcet/1/obs4MIPs.REMSS.AMSRE.mon.v1.xml?dataset=obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc">obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc</source>
      <enclosure url="http://esg-datanode.jpl.nasa.gov/thredds/fileServer/esg_dataroot/obs4MIPs/observations/ocean/tosNobs/mon/grid/REMSS/AMSRE/v20111031/tosNobs_AMSRE_L3_v7_200206-201012.nc" type="application/netcdf" />
      <enclosure url="http://esg-datanode.jpl.nasa.gov/thredds/dodsC/esg_dataroot/obs4MIPs/observations/ocean/tosNobs/mon/grid/REMSS/AMSRE/v20111031/tosNobs_AMSRE_L3_v7_200206-201012.nc.html" type="application/opendap-html" />
      <category domain="http://www.esgf.org/cv/0.1/type">File</category>
      <category domain="http://www.esgf.org/cv/0.1/dataset_id">obs4MIPs.REMSS.AMSRE.mon</category>
      <category domain="http://www.esgf.org/cv/0.1/replica">false</category>
      <category domain="http://www.esgf.org/cv/0.1/master_id">obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc</category>
      <category domain="http://www.esgf.org/cv/0.1/cf_variable">Sea Surface Temperature Number of Observations</category>
      <category domain="http://www.esgf.org/cv/0.1/data_structure">grid</category>
      <category domain="http://www.esgf.org/cv/0.1/experiment">obs</category>
      <category domain="http://www.esgf.org/cv/0.1/experiment_family">All</category>
      <category domain="http://www.esgf.org/cv/0.1/institute">REMSS</category>
      <category domain="http://www.esgf.org/cv/0.1/model">Obs-AMSRE</category>
      <category domain="http://www.esgf.org/cv/0.1/processing_level">L3</category>
      <category domain="http://www.esgf.org/cv/0.1/product">observations</category>
      <category domain="http://www.esgf.org/cv/0.1/project">obs4MIPs</category>
      <category domain="http://www.esgf.org/cv/0.1/realm">ocean</category>
      <category domain="http://www.esgf.org/cv/0.1/source_id">AMSRE</category>
      <category domain="http://www.esgf.org/cv/0.1/time_frequency">mon</category>
      <category domain="http://www.esgf.org/cv/0.1/tracking_id">20fbfb71-3790-483a-bba8-1ec219d9b8f8</category>
      <category domain="http://www.esgf.org/cv/0.1/variable">tosNobs</category>
      <category domain="http://www.esgf.org/cv/0.1/version">1</category>
      <pubDate>Fri, 18 Nov 2011 16:20:48 GMT</pubDate>
      <guid isPermaLink="false">obs4MIPs.REMSS.AMSRE.mon.v1.tosNobs_AMSRE_L3_v7_200206-201012.nc</guid>
    </item>

References

Add a custom footer
⚠️ **GitHub.com Fallback** ⚠️