Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Connecting to DocumentDB from AWS Glue

For a current ETL job, I am trying to create a Python Shell Job in Glue. The transformed data needs to be persisted in DocumentDB. I am unable to access the DocumentDB from Glue.

Since the DocumentDb cluster resides in a VPC, I thought of creating a Interface gateway to access the Document DB from Glue but DocumentDB was not one of the approved service in Interface gateway. I see tunneling as a suggested option but I do not wanna do that.

So, I want to know is there a way to connect to DocumentDB from Glue.

like image 441
Rahul Avatar asked Oct 25 '25 07:10

Rahul


2 Answers

Create a dummy JDBC connection in AWS Glue. You will not need to do a test connection but this will allow ENIs to be created in the VPC. Attach this connection to your python shell job. This will allow you to interact with your resources.

like image 160
Eman Avatar answered Oct 26 '25 21:10

Eman


Have you tried using the mongo db connection in glue connections, we can connect document db through that option.

like image 26
Shubham Jain Avatar answered Oct 26 '25 20:10

Shubham Jain