Stack Overflow
Stack Overflow

Questions tagged [amazon-s3-access-points]

26 questions
4
votes
1 answer

Is it possible to read parquet files from S3 access point using pyarrow

It is possible to read parquet files from S3 as shown here or here. I am working with S3 access points. Having S3 access point ARN is it possible to read parquet files from it? I am trying with the following sample code: import s3fs import…
Krzysztof Słowiński
  • 6,239
  • 8
  • 44
  • 62
4
votes
0 answers

How to write to S3 access point using pyspark

I have pyspark code that writes to an s3 bucket like below: df.write.mode('overwrite').parquet([S3_BUCKET_PATH]) I am testing writing to the bucket via the bucket's access point instead. The AWS documentation has an example writing to the access…
Melissa Guo
  • 948
  • 9
  • 32
4
votes
2 answers

Read and write from/to S3 bucket using access points with boto3

I have to access S3 bucket using access points with boto3. I have created an access point with a policy to allow reading and writing ( is my access point ARN): { "Version": "2012-10-17", "Statement": [ { …
Krzysztof Słowiński
  • 6,239
  • 8
  • 44
  • 62
2
votes
2 answers

How to create a public Multi-Region Access Point policy?

I am experimenting with multi-region access points and their over-complicated policy syntax, and I can't get the simplest things to work. I have 3 buckets spawned across the globa and created a single access point. All my items are private as my…
HelloWorld
  • 2,392
  • 3
  • 31
  • 68
2
votes
1 answer

Authorize a role to Amazon S3 through access point

The goal is to limit an Amazon S3 Read-Write (list,get,put,delete) access to a single role and access S3 only through access point, with a bucket policy locked to access point only. The setup I did so far is Delegated a partial…
Vladimir Avdoshka
  • 439
  • 4
  • 13
1
vote
1 answer

How to restrict all access to the AWS s3 bucket

I want to restrict aws s3 bucket to not get access from anywhere, I want block all access public, private, bucket, folder, file everything of that bucket after that then i want to create an access point of s3 then I want to give permission to an IAM…
shrijay
  • 23
  • 3
1
vote
0 answers

.NET AWS SDK - Region missing in ARN for multi region access point

I am trying to write a simple .NET console app that puts an object into an AWS S3 bucket via a multi region access point. I get the following error: Amazon.Runtime.AmazonClientException: AWS region is missing in access point ARN My arn format for…
Chris Meyer
  • 11
  • 2
1
vote
1 answer

Terraform: How to check if s3 access point exists before creating it?

I have a resource that creates multiple s3 access points depending on the input provided. The input is a map with s3 uri as the key and parsed bucket name as the value. Example: { "s3://my_bucket/model1.tar.gz" ->…
Riley Hun
  • 2,541
  • 5
  • 31
  • 77
1
vote
0 answers

Make S3 Multi-region access point public

I created a multi-region access point for two buckets, both of which are public. However, when I try to access the objects using the multi-region hostname, I get an XML response stating that the request is invalid. I have checked off all the boxes…
Hazem
  • 33
  • 1
  • 4
1
vote
0 answers

How to use the Multi Region Access Point in AWS S3 using the hostname?

According to the documentation here we should be able to use the Multi Region Access Point using the format .accesspoint.s3-global.amazonaws.com hostname but this doesn't seem to work for me. I can access the access point using the ARN,…
Gaurav Peswani
  • 11
  • 2
1
vote
1 answer

Is it possible to use S3 Access Point as a static website?

I'm trying to figure out whether it is possible to use AWS S3 Access Point for hosting a static S3 website. S3WebsiteBucket.WebsiteURL resource described below works great but I need to use Access Point instead. Failure message whenever I request…
BinaryButterfly
  • 18,137
  • 13
  • 50
  • 91
1
vote
1 answer

Using s3a on linux machine fail for >100 columns parquet

I am using s3a to read from database into dataframe and write to .parquet(s3a://bucketname//folder). It works for <100 column dataframe but crashes.exits spark-shell for >~100 columns. cannot find any material if this is column limitation/version…
Nnerdscience
  • 21
  • 3
1
vote
0 answers

List S3 bucket objects with access point using Boto3

I am trying to use the list_objects_v2 function of the Python3 Boto3 S3 API client to list objects from an S3 access point. Sample Code: import boto3 import botocore access_point_arn = "arn:aws:s3:region:account-id:accesspoint/resource" client =…
Yun Ling
  • 113
  • 1
  • 8
0
votes
1 answer

Not able to read from s3a path from EMR on EKS with pyspark code from jupterlab

Trying to run following code on Pyspark kernel from EMR on EKS(using managed endpoint), I tried to set some s3a related spark config but seems not working from pyspark.sql import SparkSession # Create a SparkSession spark = SparkSession.builder \ …
Trupal Patel
  • 1
0
votes
1 answer

Unable to upload files to AWS S3 bucket via S3 Access Point

I am trying to understand how S3 access point works and testing it out. What I am trying to do is that I am allowing an IAM using with Read only permissions to S3 bucket upload files into the bucket through the S3 Access Point. But it's not working…
Wai Yan Hein
  • 13,651
  • 35
  • 180
  • 372
1
2