Stack Overflow
Stack Overflow

Questions tagged [aws.s3]

9 questions
2
votes
0 answers

docker aws.s3 package installed for R enviroment but not found while Docker run image

# dockerfile FROM requiredimg #FROM rocker/r-rmd:latest WORKDIR /parentfolder COPY . . WORKDIR /parentfolder RUN R -e "install.packages('aws.s3', repos = c('https://RForge.net', 'https://cloud.R-project.org'))" # CMD cd scripts" # CMD ls CMD…
shrey patel
  • 47
  • 8
1
vote
1 answer

Using R function put_object from package aws.s3 to load files into a specific S3 bucket

I can successfully put an object (pdf file) into my S3 bucket base folder using the put_object function from aws.s3. However, it doesn't work when I specify a folder in the function. I don't get any error messages and the output in R looks like it…
Micharro
  • 41
  • 3
0
votes
1 answer

Find and replace in a aws.s3 object during json-streamin

I have a fairly practical question, where it's hard to provide a regex - sorry for that. So I try to explain it properly. A script connects to a AWS s3 bucket with the aws.s3 package. In that bucket there are .gz-files which contain JSON.…
Andi
  • 122
  • 7
0
votes
0 answers

using an argument list with aws.s3 in R

I want to use connection arguments multiple times in R but I can't find away to declare and then reuse them with the aws.s3 library. For example - this works: library(aws.s3) object_exists( object = "some_object_name" ,bucket =…
Sanchez333
  • 318
  • 3
  • 11
0
votes
1 answer

How to customize prefix argument in s3sync function using R

I want to download a set of csv files from a S3 subfolder with example path s3://folder/subfolder/date=2023-03-20. The subfolder has folders containing these csv files, which are created everyday with pattern: /date=/. I am unable to…
Sandhya
  • 1
0
votes
0 answers

In a AWS Lambda custom runtime of R programming, how would you save a PDF to S3 using the aws.s3 R library?

In an AWS Lambda with a custom runtime of R 4.2.0, after creating several PDFs using ggplot2::ggsave(plot=x, filename=paste0('/tmp/test_',[i],'.pdf) saving them in the AWS Lambda container '/tmp' directory, then combining them…
calycolor
  • 726
  • 1
  • 7
  • 19
0
votes
1 answer

s3sync() Exclude Directory

I'm trying to pull down all files in a given bucket, except those in a specific directory, using R. In the aws cli, I can use... aws s3 sync s3://my_bucket/my_prefix ./my_destination --exclude="*bad_directory*" In aws.s3::s3sync(), I'd like to do…
burchz
  • 55
  • 5
0
votes
1 answer

How to inspect/read an .h5 file stored remotely in a AWS bucket?

I have decided to read/copy files straight from their online repository to avoid download the files at first. Given this is my first attempt at this, this's been my first interaction with aws.s3 . First, just to make sure I could run something…
Jxson99
  • 347
  • 2
  • 16
0
votes
1 answer

AWS key and secret for Docker R script using feather deployed in ECR

So on my local machine something like this work fine: library(arrow) library(aws.s3) Sys.setenv( "AWS_ACCESS_KEY_ID" = Sys.getenv("awsaccesskey"), "AWS_SECRET_ACCESS_KEY" = Sys.getenv("awssecret"), "AWS_DEFAULT_REGION" =…
cs0815
  • 16,751
  • 45
  • 136
  • 299