Questions tagged [aws-pipeline]

44 questions
6
votes
1 answer

How do you UNLOAD data to S3 from Redshift in AWS Pipeline and include a date in the filename

I have a database table on Redshift I want to UNLOAD to S3 each month [through AWS Pipeline]. I have this code that works, but ideally I'd like to add in the current month to the filename too UNLOAD (' select * from…
ewan123uk
  • 305
  • 2
  • 4
  • 12
3
votes
2 answers

Use the AWS CLI in a CDK ShellStep (pipeline) step

I have a CDK Pipeline stack that synths and deploys some infrastructure. After the infrastructure is created, I want to build a frontend react app that knows the URL to the newly constructed API Gateway. Once the app is built, I want to move the…
jhummel
  • 1,724
  • 14
  • 20
2
votes
2 answers

AWS CodeBuild get Github OAuth token

My use-case: I have private GitHub repository and private GitHub NPM registry for dependencies. Repository imports dependencies from private registries. For GitHub actions CI pipeline, GitHub generates a temporary token, which could be used to…
Kirill
  • 7,580
  • 6
  • 44
  • 95
2
votes
0 answers

Pipeline stack which uses cross-environment actions must have an explicitly set region

I am trying to create an AWS Code Pipeline to create a DynamoDB table in one of the stages. I was able to successfully deploy the same code with CDK v1. now trying to replicate the same on CDK v2. I am getting an error Pipeline stack which uses…
Gowtham M
  • 349
  • 3
  • 18
2
votes
1 answer

Can I tag my code on Github when building it through a CDK Pipeline on AWS?

I have some GitHub repositories with my project source codes and I build them through CDK Pipelines on AWS. I basically grab the source code, build the docker images and push them to the ECR. I was wondering if I could tag the versions on the code…
2
votes
1 answer

AWS SageMaker Pipeline Issue - Pipeline variables do not support __str__ operation

I'm trying to build SageMaker Pipeline based on Tensorflow framework. I have only Training, Evaluating steps, and Register model. On the evaluation step I declared MetricsSource for ModelMetrics and received an error. Code is below: pipeline_model =…
Cindy
  • 568
  • 7
  • 20
2
votes
1 answer

Init CodeCommit repository with seed-code stored in S3 using CDK

I'm trying to convert the MLOps template for model building, training, and deployment CloudFormation template into a CDK project so I can easily update the definitions, synth the template and upload it into CloudCatalog in order to be used as a…
1
vote
1 answer

I want to copy files to AWS ec2 using buildspec.yml file, the 22 port is open for all the traffic. How to restrict the 22nd port for only codebuild?

I want to ssh to the aws ec2 server on port 22. The port is open for all traffic. I want to restrict the traffic for only aws codebuild pipeline. How I can do this? I want to ssh to the aws ec2 server on port 22. The port is open for all traffic. I…
1
vote
1 answer

appspec.yml does not execute scipts

I am building the code pipeline using aws code pipeline and for that I build a appspec.yml file to deploy on server the appspec files portion work correctly and bring the code from source to destination and then It does not execute the Scripts in…
1
vote
1 answer

AWS CI/CD code deploy success even if unit test fails in git action | Laravel

I just set up a CI-CD pipeline from AWS to github for my laravel project. I'm no expert in CI-CD or devops. It appears that code deploy is always success in aws pipeline even if I set a unit test false or test fails. Please see the image.code You…
Rana
  • 11
  • 3
1
vote
0 answers

Accessing process.env.secrets in Amplify Build Commands

I'm following these docs on Environment Secrets and am trying to access my secret in a build command to provide an api key for my Next.js app. The docs say: Accessing an environment secret during a build is similar to accessing environment…
av0000
  • 1,917
  • 6
  • 31
  • 51
1
vote
2 answers

Where to store environment variables when using AWS CDK Pipelines?

I've followed this tutorial to set up CDK Pipelines using Python with a trigger from Github. It looks something like this: import aws_cdk as cdk from constructs import Construct from aws_cdk.pipelines import CodePipeline, CodePipelineSource,…
D Malan
  • 10,272
  • 3
  • 25
  • 50
1
vote
0 answers

Bitbucket Pipeline for amplify

I have setup the CICD pipeline in bitbucket and I have amplify the folder in the repository to get the backend configuration. Right now I have setup the development environment and works fine. Existing bitbucket-pipeline.yml pipelines: default: …
1
vote
1 answer

AWS Sagemaker: Can I pass a sagemaker.workflow.parameters.ParameterString to an SKLearnProcessor

I am working on creating a Sagemaker pipeline. In the evaluation step, I would like to pass an argument to my preprocess.py script. There are a few examples online of how to do so (a sample below) but they all use static values. I want to pass a…
1
vote
0 answers

Update config.json file for a static frontend React site, using AWS CodePipeline and CDK

I'm building a CDK Pipeline that with update another CDK template. This CDK template is a static frontend react app. The backend uses an AWS Lambda, API Gateway, and CloudFront Distribution to host the site. I want to put the api's in the…
1
2 3