I need to query data in regions other than the region where Athena running.
Trying this: https://docs.aws.amazon.com/athena/latest/ug/json.html Followed the docs, And Even I can't query bucket in the same region.
Say my current S3 and Athena both are us-east-1, then
LOCATION 's3://mybucket/data/' . (Working)
LOCATION 's3://mybucket-us-east-1/data/' (Not Working)
I need to query data from eu-central-1 LOCATION 's3://my-another-bucket-eu-central-1/data/' (Not Working)
Any Help?
Error : FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. com.amazon.ws.emr.hadoop.fs.shaded.com.amazonaws.services.s3.model.AmazonS3Exception: The specified bucket does not exist (Service: Amazon S3; Status Code: 404; Error Code: NoSuchBucket;
I believe the note in JSON SerDe Libraries page is specific to Amazon's example data for Athena in buckets at s3://athena-examples-us-east-1 and other regions:
Note
You can query data in regions other than the region where you run Athena. Standard inter-region data transfer rates for Amazon S3 apply in addition to standard Athena charges. To reduce data transfer charges, replace myregion in s3://athena-examples-myregion/path/to/data/ with the region identifier where you run Athena, for example, s3://athena-examples-us-east-1/path/to/data/.
You should reference your own buckets by their name, and they should work even if they are in another region.
If you love us? You can donate to us via Paypal or buy me a coffee so we can maintain and grow! Thank you!
Donate Us With