PubSub - bobbae/gcp GitHub Wiki
Cloud Pub/Sub is a fully-managed real-time messaging service that allows you to send and receive messages between independent applications.
https://www.youtube.com/watch?v=pU1zA-DMlWk
PubSub Lite
https://cloud.google.com/pubsub/lite/docs
https://cloud.google.com/pubsub/docs/choosing-pubsub-or-lite
Reservations
Choosing PubSub or PubSub lite
https://cloud.google.com/pubsub/docs/choosing-pubsub-or-lite
Using Terraform to create BigQuery subscriptions to read from PubSub
Cloud Tasks
https://cloud.google.com/pubsub/docs/choosing-pubsub-or-cloud-tasks
PubSub IoT Example
Cloud IoT Core to push airline data to PubSub, Dataflow, and BigQuery.
https://www.youtube.com/watch?v=-y3s6XY70Os
A list of task queues
Kafka
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications.
Kafka is open source. You can see its implementation:
https://github.com/apache/kafka
Review some examples:
https://github.com/apache/kafka/tree/trunk/examples/src/main/java/kafka/examples
Using Kafka and Confluent allows customers to integrate legacy systems and Google services like BigQuery and Dataflow in real time.
https://www.youtube.com/watch?v=LjF8IqKKbWc
MQTT
https://www.integrasources.com/blog/mqtt-protocol-iot-devices/
AWS SQS, SNS, Kinesis
Mocking Events in Pub/Sub
Secure pub sub flow with terraform
https://medium.com/google-cloud/setting-up-secure-pub-sub-flow-with-go-and-terraform-6b779026a3e1
Push messages to Cloud Function endpoint in a different GCP project
Qwiklabs
Google Cloud Pub/Sub: Qwik Start - Python
Getting Started with Apache Kafka and Confluent Platform on Google Cloud