Deprecated_New MDS Broker - Mobility-Data-Space/mobility-data-space GitHub Wiki

What is the Broker?

The MDS Broker is the data catalog of the MDS, which displays the data offers provided by the members of the MDS via the Connector. The advantage compared to the previous software component is that members can see the status of a data offer and inactive data offers that are not available become invisible. In distinction to the data offer on our homepage, only the data that is already live and available is actually displayed in the Broker. The broker is available:

Which features have been implemented?

  • Display of data offers including status (online, offline)
  • Automatic crawling of connectors and data offers (crawling frequency predefined: max. 20 seconds for active connectors, max. 5 minutes for new/reactivated connectors - offers appear only after a crawl is completed)
  • Search, sort and filter functionality
  • Selection of data spaces (MDS, Mobilithek)
  • Sorting by popularity of offers

What changes for those who use the CaaS offering?

By implementing a so-called "crawling mechanism", connectors and data offers are periodically requested by the broker and listed accordingly.

What changes for those who have installed the EDC Connector on prem?

The introduction of the new MDS Broker has a minimal impact on the MDS Connector. All actively existing data offers are automatically listed in the MDS Broker 1.0. Existing use cases are not affected. We recommend disabling the previous broker extension in the MDS Connector by changing an environment variable ("docker-compose" file). To do this, perform the following steps:

  1. if the Connector is running: Stop the Connector.
  2. open the "docker-compose.yaml" and set the attribute "BROKER_CLIENT_EXTENSION_ENABLED:" to "FALSE"
  3. start the connector again.

For new installations, the updated release of the MDS Connector with the disabled broker extension is available.

What needs to be considered from an IT perspective?

Changed behavior of the catalog: Automatic crawling of connectors and data offers (crawling frequency predefined: max. 20 seconds for active connectors, max. 5 minutes for new and reactivated connectors - offers only appear after a run is complete) can be used to display the status of data offers.

Known Issues:

Problem: Deletion of "Contract Definitions" from the MDS Connector is not possible. Solution: Set the attribute "BROKER_CLIENT_EXTENSION_ENABLED" to "FALSE" (see recommendation above).

Problem: Connectors with the custom path in the connector address (e.g. https://connector.com/custompath) are not automatically registered in the MDS broker. For normal domain addresses (e.g. https://connector.com/) this problem does not exist. Workaround: please send mail to [email protected] to register the connector manually. Solution: As we continue to develop the MDS, we will automate this process.

Problem: When sharing an asset multiple times via "Contract Definitions", the number of "Contract Offers" increases by (assets)^(contractDefinitions). **Solution: **This is a known bug in EDC Core MS8. This will be fixed later by moving to the next EDC Core version.