Questions tagged [aws-pipeline]
44 questions
6
votes
1 answer
How do you UNLOAD data to S3 from Redshift in AWS Pipeline and include a date in the filename
I have a database table on Redshift I want to UNLOAD to S3 each month [through AWS Pipeline]. I have this code that works, but ideally I'd like to add in the current month to the filename too
UNLOAD ('
select *
from…

ewan123uk
- 305
- 2
- 4
- 12
3
votes
2 answers
Use the AWS CLI in a CDK ShellStep (pipeline) step
I have a CDK Pipeline stack that synths and deploys some infrastructure. After the infrastructure is created, I want to build a frontend react app that knows the URL to the newly constructed API Gateway. Once the app is built, I want to move the…

jhummel
- 1,724
- 14
- 20
2
votes
2 answers
AWS CodeBuild get Github OAuth token
My use-case: I have private GitHub repository and private GitHub NPM registry for dependencies. Repository imports dependencies from private registries. For GitHub actions CI pipeline, GitHub generates a temporary token, which could be used to…

Kirill
- 7,580
- 6
- 44
- 95
2
votes
0 answers
Pipeline stack which uses cross-environment actions must have an explicitly set region
I am trying to create an AWS Code Pipeline to create a DynamoDB table in one of the stages. I was able to successfully deploy the same code with CDK v1. now trying to replicate the same on CDK v2. I am getting an error Pipeline stack which uses…

Gowtham M
- 349
- 3
- 18
2
votes
1 answer
Can I tag my code on Github when building it through a CDK Pipeline on AWS?
I have some GitHub repositories with my project source codes and I build them through CDK Pipelines on AWS. I basically grab the source code, build the docker images and push them to the ECR. I was wondering if I could tag the versions on the code…

Paulo Neves
- 21
- 3
2
votes
1 answer
AWS SageMaker Pipeline Issue - Pipeline variables do not support __str__ operation
I'm trying to build SageMaker Pipeline based on Tensorflow framework. I have only Training, Evaluating steps, and Register model. On the evaluation step I declared MetricsSource for ModelMetrics and received an error.
Code is below:
pipeline_model =…

Cindy
- 568
- 7
- 20
2
votes
1 answer
Init CodeCommit repository with seed-code stored in S3 using CDK
I'm trying to convert the MLOps template for model building, training, and deployment CloudFormation template into a CDK project so I can easily update the definitions, synth the template and upload it into CloudCatalog in order to be used as a…

AronNeewart
- 461
- 6
- 18
1
vote
1 answer
I want to copy files to AWS ec2 using buildspec.yml file, the 22 port is open for all the traffic. How to restrict the 22nd port for only codebuild?
I want to ssh to the aws ec2 server on port 22. The port is open for all traffic. I want to restrict the traffic for only aws codebuild pipeline. How I can do this?
I want to ssh to the aws ec2 server on port 22. The port is open for all traffic. I…

muhammad adil
- 29
- 3
1
vote
1 answer
appspec.yml does not execute scipts
I am building the code pipeline using aws code pipeline and for that I build a appspec.yml file to deploy on server the appspec files portion work correctly and bring the code from source to destination and then It does not execute the Scripts in…

Rehan Akhtar
- 35
- 3
1
vote
1 answer
AWS CI/CD code deploy success even if unit test fails in git action | Laravel
I just set up a CI-CD pipeline from AWS to github for my laravel project. I'm no expert in CI-CD or devops.
It appears that code deploy is always success in aws pipeline even if I set a unit test false or test fails. Please see the image.code
You…

Rana
- 11
- 3
1
vote
0 answers
Accessing process.env.secrets in Amplify Build Commands
I'm following these docs on Environment Secrets and am trying to access my secret in a build command to provide an api key for my Next.js app.
The docs say:
Accessing an environment secret during a build is similar to accessing environment…

av0000
- 1,917
- 6
- 31
- 51
1
vote
2 answers
Where to store environment variables when using AWS CDK Pipelines?
I've followed this tutorial to set up CDK Pipelines using Python with a trigger from Github.
It looks something like this:
import aws_cdk as cdk
from constructs import Construct
from aws_cdk.pipelines import CodePipeline, CodePipelineSource,…

D Malan
- 10,272
- 3
- 25
- 50
1
vote
0 answers
Bitbucket Pipeline for amplify
I have setup the CICD pipeline in bitbucket and I have amplify the folder in the repository to get the backend configuration.
Right now I have setup the development environment and works fine.
Existing bitbucket-pipeline.yml
pipelines:
default:
…
1
vote
1 answer
AWS Sagemaker: Can I pass a sagemaker.workflow.parameters.ParameterString to an SKLearnProcessor
I am working on creating a Sagemaker pipeline. In the evaluation step, I would like to pass an argument to my preprocess.py script.
There are a few examples online of how to do so (a sample below) but they all use static values. I want to pass a…

Abdelrahman Shoman
- 2,882
- 7
- 36
- 61
1
vote
0 answers
Update config.json file for a static frontend React site, using AWS CodePipeline and CDK
I'm building a CDK Pipeline that with update another CDK template.
This CDK template is a static frontend react app.
The backend uses an AWS Lambda, API Gateway, and CloudFront Distribution to host the site.
I want to put the api's in the…

Seb
- 133
- 1
- 12