outputLocation is not a valid S3 path. Athena Exception

Question

I am trying to execute athena query using c# athena driver.

Amazon.Athena.Model.ResultConfiguration resultConfig = new Amazon.Athena.Model.ResultConfiguration();
resultConfig.OutputLocation = "https://s3.us-east-2.amazonaws.com/testbucket/one/2018-02-06/";
//other inputs i have tried
//"s3://testbucket/one/2018-02-06/"
//testbucket

//Populate the request object
                Amazon.Athena.Model.StartQueryExecutionRequest queryExec = new Amazon.Athena.Model.StartQueryExecutionRequest();
                queryExec.QueryString = query.QueryString;
                queryExec.QueryExecutionContext = queryExecutionContext;
                queryExec.ResultConfiguration = resultConfig;

StartQueryExecutionResponse athenaResponse = athenaClient.StartQueryExecution(queryExec);//throws exception

Exception for different cases:

outputLocation is not a valid S3 path. Provided https://s3.us-east-2.amazonaws.com/testbucket/one/2018-02-06/

Unable to verify/create output bucket testbucket. Provided s3://testbucket/one/2018-02-06/

Unable to verify/create output bucket testbucket. Provided testbucket

Can someone help me out with the right s3 format?

Thanks in advance.

score 6 · Answer 1 · answered Feb 14 '18 at 07:21

6

The output location needs to be in the following format:

s3://{bucketname}/{path}

In your case this would lead to the following location:

resultConfig.OutputLocation = "s3://testbucket/one/2018-02-06/";

answered Feb 14 '18 at 07:21

jens walter

13,269
2
56
54

I have tried this as well . Check the second exception case. It fails – kaarthick raman Feb 14 '18 at 07:36
It says that you do not own "testbucket". You have to use a bucket that you can access. – jens walter Feb 14 '18 at 09:01
I have updated the error for case 2 & 3 .It says unable to verify or create bucket. The profile has all privileges to read and write in s3. – kaarthick raman Feb 14 '18 at 09:32

score 1 · Answer 2 · edited Aug 20 '18 at 11:51

Amazon.Athena.AmazonAthenaClient _client = new Amazon.Athena.AmazonAthenaClient(AwsAccessKeyId, AwsSecretAccessKey, EndPoint);
                Amazon.Athena.Model.ResultConfiguration resultConfig = new Amazon.Athena.Model.ResultConfiguration();
                resultConfig.OutputLocation = "s3://"+BucketName+"/key1/";                
                string query = "SELECT * FROM copalanadev.logs";
                //Populate the request object
                Amazon.Athena.Model.StartQueryExecutionRequest queryExec = new Amazon.Athena.Model.StartQueryExecutionRequest();
                queryExec.QueryString = query;
                //queryExec.QueryExecutionContext = queryExecutionContext;
                queryExec.ResultConfiguration = resultConfig;

            StartQueryExecutionResponse athenaResponse = _client.StartQueryExecution(queryExec);//throws exception

outputLocation is not a valid S3 path. Athena Exception

2 Answers2