Stack Overflow
Stack Overflow

Questions tagged [spring-cloud-dataflow]

Spring Cloud Data Flow is a toolkit for building data integration and real-time data processing pipelines. Pipelines consist of Spring Boot apps, built using the Spring Cloud Stream or Spring Cloud Task microservice frameworks. This makes Spring Cloud Data Flow suitable for a range of data processing use cases, from import/export to event streaming and predictive analytics.

Use this tag for questions about the Spring Cloud Data Flow project. It is not intended for general questions about integrating other Spring projects with other technologies.

Spring Cloud Data Flow's Official Project Site

Spring Cloud Data Flow Website

Spring Cloud Data Flow's Github Repo

How to contribute

How to report issues

Related tags , , , , , .

1276 questions
15
votes
1 answer

JsonPath not working properly in Spring Cloud Data Flow filter component

I'm trying to write a simple SCDF flow that reads from Kafka, filters the messages by presence of specific value and pushes data into Mongo. As part of this i had to wrote following #jsonPath …
Ján Srniček
  • 505
  • 1
  • 10
  • 34
11
votes
2 answers

Spring Integration or Spring Cloud Data Flow

I'm in the process of moving some of my application to microservices. One example service is a RSS crawler which uses Spring Integration to send items to Kafka. I also see there is Spring Cloud Data Flow which uses Spring Integration and Spring…
Swordfish
  • 1,127
  • 24
  • 46
9
votes
2 answers

Hikari "Add connection elided"

I am getting the following messages running a task in spring cloud data flow. DEBUG 13167 --- [spring_batch146] com.zaxxer.hikari.pool.HikariPool : HikariPool-2 - Add connection elided, waiting 1, queue 2 I can't find any information on it.
Sam Donato
  • 471
  • 6
  • 12
9
votes
3 answers

how to send and receive from the same topic within spring cloud stream and kafka

I have a spring-cloud-stream application with kafka binding. I would like to send and receive a message from the same topic from within the same executable(jar). I have my channel definitions such as below:- public interface ChannelDefinition { …
Jimm
  • 8,165
  • 16
  • 69
  • 118
8
votes
2 answers

Apache Spark vs Spring Cloud data flow

I'm new to big data processing and I'm reading about tools for stream processing and building data pipelines. I found Apache Spark and Spring Cloud Data Flow. I want to know the main differences and the pros and cons of them. Could anybody help me?
Alireza Mohammadi
  • 113
  • 1
  • 5
7
votes
1 answer

Storing Key Value Like Data in Google Cloud Storage

Since Google Cloud Storage supports Object Change Notifications, it fits in a good programming model of enriching objects inserted to a bucket where a service can detect the item and react accordingly. This takes away the need to manually build a…
Ravindranath Akila
  • 209
  • 3
  • 35
  • 45
6
votes
2 answers

spring data flow : IAM role assignment to pods using pod-annotations

We are currently in the process of deploying a new spring data flow stream application in our aws EKS cluster. As part of this, the pods launched by the skipper should have the IAM roles defined in the annotation so that they can access the required…
SimbuStar
  • 623
  • 1
  • 7
  • 18
5
votes
1 answer

java.lang.NoSuchMethodError: org.springframework.boot.builder.SpringApplicationBuilder.([Ljava/lang/Object;)V

I am writing simple application to be familiar with spring batch. I wanted to learn spring batch admin but I found that it is deprecated so I have to use spring cloud data flow instead. I've found a tutorial about spring cloud data and did first…
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
5
votes
2 answers

Spring Cloud Data Flow ignores datasources configured by a spring batch app

I'm setting up an instance of Spring Cloud Data Flow. I've run the following commands: 1. Run skipper server: java -jar spring-cloud-skipper-server-2.0.3.RELEASE.jar & 2. Run Dataflow server: java -jar spring-cloud-dataflow-server-2.1.2.RELEASE.jar…
Giuliana Bezerra
  • 152
  • 7
5
votes
3 answers

spring-cloud-dataflow: Stream Deployments Fail on OSX

I am unable to deploy and execute a basic http | log stream following the getting-started stream guide: wget https://raw.githubusercontent.com/spring-cloud/spring-cloud-dataflow/2.1.0.RELEASE/spring-cloud-dataflow-server/docker-compose.yml; export…
JJ Zabkar
  • 3,792
  • 7
  • 45
  • 65
5
votes
2 answers

How to Register Local Spring cloud task project jar file to spring cloud data flow dashboard

I am trying to register my local spring cloud task jar file into spring cloud task data flow graphical interface. While registering the application local path is not getting identified and Register button is not getting enabled. My jar file location…
Mukesh Kumar
  • 101
  • 3
  • 6
5
votes
1 answer

How to debug spring cloud dataflow deployed app

im using spring cloud data flow local server deployed my stream apps. i want to using intelliJ remote debug one of my app
zjunothing
  • 61
  • 3
5
votes
1 answer

What are the Benefits of Spring Cloud Dataflow?

Based on what I've seen, creating a stream in Spring Cloud Dataflow (SCDF) will deploy the underlying applications, bind the communication service (like RabbitMQ), set the Spring Cloud Stream environment variables, and start the applications. This…
user6448130
5
votes
1 answer

Spring Cloud data flow documentation

Any update on when the Spring Cloud Data Flow documentation will be ready for prime time. It is really hard to plan for any significant deployment in the future, without complete developer documentation. Since Spring Cloud Data Flow draws off Spring…
Vinay Joshi
  • 51
  • 1
4
votes
1 answer

Spring Cloud Data Flow Grafana Prometheus not showing stream data

I launch Spring cloud data flow with docker-compose base on this website. https://dataflow.spring.io/docs/installation/local/docker/ I created 3 apps, Source, Processor & Sink. I ran export…
Ninja Dude
  • 1,332
  • 4
  • 27
  • 54
1
2 3
…
84 85