Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-deployer-kubernetes]

14 questions
2
votes
1 answer

Worker pod resource limit in spring batch and spring cloud deployer kubernetes

I am trying to run a Spring Batch application in kubernetes cluster. I am able to enforce resource limits to the main application pod by placing the following snippet in the deployment yaml: resources: limits: cpu: 500m ephemeral-storage:…
Abhinav Sharma
  • 27
  • 8
1
vote
1 answer

Spring batch worker pods getting scheduled only 2 worker nodes

I am running Spring Batch application in Kubernetes environment. The k8s cluster have one master and three worker nodes. I am testing spring batch under high load, which is spawning around 100 worker pods. However, all the 100 pods are coming up…
Abhinav Sharma
  • 27
  • 8
1
vote
1 answer

Spring batch worker pods are unable to pick custom service account for spring cloud deployer kubernetes

I am trying to run a spring batch with remote partitioning on K8s cluster using spring-cloud-deployer-kubernetes. Eventhough I have configured a service account and mentioned in my application properties the below…
Kranthi
  • 37
  • 6
1
vote
1 answer

Spring Cloud Data Flow + Kubernetes, asking for the task pod to be deployed on non-default namespaces

I have a setup with scdf-server on kubernetes working fine, it deploys each task in an on-demand pod on the very same default namespace, the one that hosts the scdf-server pod. Now, I need to deploy a pod in another namespace and I can't find the…
Whimusical
  • 6,401
  • 11
  • 62
  • 105
0
votes
0 answers

Does spring.cloud.deployer.kubernetes.readiness-command-probe-command work at all?

I have set the property spring.cloud.deployer.kubernetes.readiness-command-probe-command=echo live and when I check in the pods yaml, I don't see any readiness configuration present. The same applies for liveness as well. I even tried with…
Ronit Mishra
  • 105
  • 11
0
votes
1 answer

Spring Cloud Data Flow - Unable to set securityContext/allowPrivilegeEscalation while deploying a stream

Creating a simple TEST Stream in Spring Cloud Data Flow (2.9.4) > stream create --name "words" --definition "http --server.port=9001 | splitter --expression=payload.split(' ') | log" > stream deploy --name "words" --propertiesFile…
gathreya
  • 45
  • 1
  • 9
0
votes
0 answers

Add volumes and volumeMounts using spring cloud deployer kubernetes

I am trying to run a spring batch application in Kubernetes which launches N number of worker pods. Each of the worker pod is supposed to read from an input file, and generate and save the output file on disk. I am using…
Abhinav Sharma
  • 27
  • 8
0
votes
1 answer

deploymentServiceAccountName does not work for schedules in spring cloud dataflow

I am using spring cloud dataflow for spring batches(with remote partitioning) wrapped with spring cloud task, deployed in kubernetes. I have also created a service account for the same. The batch runs fine when I use the launch option on tasks tab…
Kranthi
  • 37
  • 6
0
votes
2 answers

Spring Cloud Data Flow : Asynchronous DeploymentPartitionHanlder

TL;DR I used this example to build a simple application that uses Spring Batch (remote partitioning) and Spring Cloud data flow to deploy worker pods on Kubernetes. Looking at the logs for the "partitionedJob" pod created on Kubernetes, I see that…
Ping
  • 587
  • 5
  • 27
0
votes
1 answer

Automatic job restart

I have a job that can take up to several hours. It is possible that for some reason (like out of memory, or cluster rebalance) it just fails. The problem is that the job is usually run overnight, and someone needs to check on it in the morning, and…
Michał Dębski
  • 527
  • 4
  • 16
0
votes
0 answers

Step ExecutionContext not promoted using Spring Cloud Task on Spring Cloud Data Flow

I successfully deployed a remote partitioned job using Spring Cloud Data Flow and Spring Cloud Task; the installation is based on Kubernetes, so I added the Kubernetes implementation of Spring Cloud Deployer to the project. But it seems that it's…
Claudio Tasso
  • 417
  • 5
  • 13
0
votes
1 answer

Forbidden error using paritioned job with Spring Cloud Data Flow on Kubernetes

I want to implement a remote partitioned job using Spring Cloud Data Flow on Kuberentes. The Skipper server is not installed because I just need to run tasks and jobs. I modified the partitioned batch job sample project using…
Claudio Tasso
  • 417
  • 5
  • 13
0
votes
1 answer

Cloud Run error: Container failed to start. Failed to start and then listen on the port defined by the PORT environment variable

I'm trying to integrate a Whatsapp Chatbot using Cloud and I get this error when trying to deploy. I'm new to this part of coding so any help would be appreciated. I followed this link:…
Shaamil Karim
  • 1
  • 1
0
votes
1 answer

Changing the count of instances in a stream in Spring Cloud Data Flow has no effect

I'm using SCDF 2.2.1.RELEASE with the Skipper Kubernetes deployer 2.1.2.RELEASE and I'm facing a weird behaviour which I would like to understand whether it's actually intended or an issue or just a no-feature. When I deploy a stream, I can…
Enrique Medina
  • 197
  • 1
  • 12