Calling stored procedure from aws Glue Script

Question

After the ETL Job is done, What is the best way to call stored procedure in AWS Glue script?

I am using PySpark to fetch the data from S3 and storing in staging table. After this process, need to call a stored procedure. This stored procedure loads data from the staging table into the appropriate MDS tables.

If I have to call a Stored Procedure after ETL Job is done, what is the best way? If I consider AWS lambda, is there any way that lambda can be notified after the ETL.

Answer 1

you can do it using py4j and all your code will be in one place, IMHO way better solution than others

How to run arbitrary / DDL SQL statements or stored procedures using AWS Glue