Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-dataflow-ui]

49 questions
2
votes
1 answer

Spring Cloud Data Flow Pod Cleanup

We are repeatedly seeing resource quota limitation issues in logs and Task jobs fail on the SCDF running on Kubernetes. Problem is, there are so many pods in "running" status even after they completed. I understand, SCDF does not delete the pods and…
Sudhakar Master
  • 43
  • 7
2
votes
2 answers

Spring cloud data flow custom application properties

I created a custom spring cloud data flow application. I would like to create a stream with it and put some application properties in it, as we can add for the provided application log (0/3 properties): I tried with application.yml file in…
marie
  • 457
  • 8
  • 27
1
vote
0 answers

I can't attach new local Docker containers to preexistent network using Spring Cloud Deployer

I am working on a data ingestion flow based on the Spring Cloud Data Flow framework. I have created two custom microservices that use Kafka as a messaging broker and I use MongoDB pre-built sink to bulk the information. In a first phase, I would…
Sergio Sánchez Sánchez
  • 1,694
  • 3
  • 28
  • 48
1
vote
0 answers

How can we stop spring cloud task in spring cloud data flow?

I am trying to stop a running task in spring cloud data flow , but the spring batch application didn't get terminated and in spring cloud data flow server task status it is still running. Is there any way we can stop the task and can get status as…
Abhi Ram
  • 41
  • 1
1
vote
1 answer

spring cloud dataflow UI, which is configured with k8s, redirects to port 8000

We have spring cloud dataflow services deployed in our EKS(Elastic Kubernetes Service in AWS). The service was deployed with helm chart with default configuration more or less, the only thing we configured really is Spring Cloud Data Flow external…
nadavgam
  • 2,014
  • 5
  • 20
  • 48
1
vote
0 answers

Spring Cloud Data Flow Server OAuth2 with Azure AD

I am trying to setup OAuth authentication (OpenID Connect) with Azure AD and Spring Cloud Data Flow server. Following below documentation reference but no…
Mihir P
  • 17
  • 3
1
vote
1 answer

Why Spring Cloud Dataflow Supplier properties does not appear?

I have configuration properties for de Supplier: @Data @NoArgsConstructor @ConfigurationProperties("sybase.supplier") public class SybaseSupplierProperties { private short canal = 0; private int pollSize = 10; } I am injecting it on the…
Thiago Sayão
  • 2,197
  • 3
  • 27
  • 41
1
vote
1 answer

How to create multiple tasks in one jar(Spring Cloud Task)?

Use case(Spring cloud task): I have different tasks which are independent of each other. I want to create those tasks in one jar and trigger task from command line. Is it possible ? Also I want to schedule them using crontab. Please suggest.
Barkha Bajaj
  • 33
  • 6
1
vote
0 answers

SCDF - Create Metadata tables in different schema and work the Batch Job with different schema

I'm using Spring Batch which loads data from Oracle and put it into the MongoDB. I'm looking to use the Spring Cloud Data Flow, but SCDF doesn't have support for the MongoDB. Is there any way if we can maintain the SCDF Metadata into the Postgres…
Jeff Cook
  • 7,956
  • 36
  • 115
  • 186
1
vote
2 answers

Caused by: org.flywaydb.core.api.FlywayException: Migration failed ! and Spring Cloud DataFlow

I'm working on Spring batch and Spring Cloud Data Flow example. In this example, I've developed spring-cloud-data-flow-server and MySQL DB instead of default H2 DB by taking reference from Database Configs for MySQL DB It looks like there is a issue…
PAA
  • 1
  • 46
  • 174
  • 282
1
vote
1 answer

Caused by:org.flywaydb.core.internal.license.FlywayEditionUpgradeRequiredException:Flyway Enterprise Edition or MySQL upgrade required: MySQL 5.5-SCDF

I am working on Spring Batch and SCDF example. In this example, I am creating spring-cloud-data-flow-server using Spring Boot code and trying to connect to the MySQL DB by looking at: SCDF Task DB Configurations, but getting below…
Jeff Cook
  • 7,956
  • 36
  • 115
  • 186
1
vote
1 answer

Caused by: org.apache.http.conn.HttpHostConnectException: Connect to localhost:7577 [localhost/127.0.0.1, localhost/0:0:0:0:0:0:0:1] failed:

I am using Spring Cloud Data Flow with the Spring Batch by taking a reference from : https://codenotfound.com/spring-batch-admin-example.html. Now I've used latest version of Spring Boot v2.2.6.RELEASE.…
PAA
  • 1
  • 46
  • 174
  • 282
1
vote
1 answer

How to display all processor in graphical view?

Tool: Spring Cloud Data Flow I have created a sample with Source, Processor and Sink. The graphical view of the whole app is As I have an existing application which contains multiple Processor in a single project and enabled at once using code…
Yogesh Prajapati
  • 4,770
  • 2
  • 36
  • 77
0
votes
0 answers

Spring cloud task(composed Task) restart from the failed job

I have a spring cloud composed task which has nearly 10 jobs . If any of the job fails from the composed task, I have to continue the flow from the failed job. For Eg: After launching the composed task, if 4'th job fails , I don't want to run again…
17_4088_ Subashini.S
  • 1
0
votes
1 answer

Spring Cloud Dataflow Stream - org.springframework.cloud.skipper.SkipperException: Can not find a package named

While deploying Streams in SCDF 2.9.2 with skipper 2.8.2, I observed frequent scenarios, wherein if a stream deployment fails for some reason, I cannot destroy the stream definition or re-deploy the stream definition. It fails with the following…
Aravind1986
  • 15
  • 5
1
2 3 4