AWS Glue Dummy or Network connection - isgaur/AWS-BigData-Solutions GitHub Wiki

If you want to connect RDS or any other database related instance programmatically using AWS glue follow these instructions :

From the drop down Choose "Network" and Create a "Dummy" JDBC glue connection via console that would contain dummy information for the database address ,db username, db password except the correct vpc, subnet and the security group.

Reason being glue job launches in its own VPC, therefore it does require a "Dummy" glue connection. This "Dummy" glue connection will attach an ENI (Elastic Network Interface) to the respective glue job resulting in a connection to the RDS instance in question.

This "Dummy" glue connection would not store any credentials( passwords etc.) and helps us in a way to attach an ENI. We are creating this "Dummy" Glue Connection solely in order to get this backend ENI. Hence any calls or traffic to an RDS instance will be handled by this ENI.

We do require this supplemental ENI to be setup by Glue so that all the traffic directed towards the RDS instance will be routed through an ENI.Doing so, the glue job would be assigned an ENI (Elastic Network Interface) which can access the required AWS resources used in the glue ETL job.

Once the "Dummy" glue connection is created , please select this "Dummy" connection as the required connection by editing an existing job or while creating a new glue job.Once done try running the glue job and check if the connection goes through.