MDS Kafka Streaming Cookbook

A comprehensive guide to building and deploying Kafka-based data streaming solutions in the Mobility Data Space (MDS) using Eclipse Dataspace Connector (EDC) and the MDS Kafka extension.

Documentation

For detailed information, refer to the following documentation:

• MDS Kafka Streaming: Design and Concepts
• Data Provider Setup Guide
• Data Consumer Setup Guide

Quick Start

For Data Providers

1. Set up MDS Connector with Kafka extension
2. Create assets, policies, and contract definitions
3. Implement Kafka producers
4. See Provider Setup Guide for details

For Data Consumers

1. Deploy MDS Kafka Client Backend
2. Browse catalogs and negotiate contracts
3. Initiate transfer processes
4. Access consumed data via REST API
5. See Consumer Setup Guide for details

Production Deployment Considerations

1. TLS Encryption: Enable SSL/TLS for all communications
2. Authentication: Use proper OIDC providers and certificate-based authentication
3. Network Security: Implement proper firewall rules and VPN access
4. Secret Management: Use secure vaults for storing credentials

Support and Community

• GitHub Issues: Report bugs and feature requests
• Eclipse EDC: Official documentation
• IDSA: Dataspace Protocol specification
• MDS Community: Join the discussion

This cookbook provides a foundation for building Kafka-based streaming solutions in the Mobility Data Space. For specific use cases or advanced configurations, refer to the individual component documentation and community resources.