Stack Overflow
Stack Overflow

Questions tagged [dataflow]

Dataflow programming is a programming paradigm in which computations are modeled through directed graphs: nodes are instructions and data flows through the connections between them.

Dataflow programming is a programming paradigm which models programs as directed graphs and calculation proceeds in a way similar to electrical circuits. More precisely:

  • nodes are instructions that takes one or more inputs, perform calculation on them and present the result(s) as output;
  • edges connects inputs and outputs of the instructions -- this way the output of an instruction can be fed directly to the input on another node to trigger another calculation;
  • data "travels" using the directed edges and triggers the instructions as they pass through the nodes.

Often dataflow programming languages are visual, the most prominent example being LabView.

Resources

1152 questions
87
votes
10 answers

Dataflow Programming Languages

What is a dataflow programming language? Why use it? And are there any benefits to it?
Anton
  • 12,285
  • 20
  • 64
  • 84
32
votes
1 answer

What is the difference between Dataflow programming and Reactive programming?

I really can't see the difference between them. They are both about data flowing through instructions and the propagation of changes in the input data. I've read this book (authored by Matt Carcki) and it clearly says that they are both the same. On…
Augusto Altman Quaranta
  • 1,526
  • 1
  • 21
  • 32
27
votes
2 answers

What is low latency access of data?

What do you mean by low latency access of data? I am actually confused about the definition of the term "LATENCY". Can anyone please elaborate the term "Latency".
Debashisenator
  • 1,621
  • 4
  • 17
  • 16
23
votes
2 answers

Dataflow anomaly analysis warnings from PMD

I am using Eclipse with the PMD Plug-in (4.0.0.v20130510-1000) and get a lot of those violations: Found 'DD'-anomaly for variable 'freq' (lines '187'-'189'). Found 'DU'-anomaly for variable 'freq' (lines '189'-'333'). In this SO answer, it says that…
brimborium
  • 9,362
  • 9
  • 48
  • 76
19
votes
10 answers

What is the best programming language to implement neural networks?

I'm not looking for a Neural Networks library, since I'm creating new kinds of networks. For that I need a good "dataflow" language. Of course you can do this in C, C++, Java and co. but dealing from scratch with the multithreading etc. would be a…
Blacksad
  • 14,906
  • 15
  • 70
  • 81
19
votes
10 answers

Does this language feature already exist?

I'm currently developing a new language for programming in a continuous environment (compare it to electrical engineering), and I've got some ideas on a certain language construction. Let me explain the feature by explanation and then by…
Pindatjuh
  • 10,550
  • 1
  • 41
  • 68
18
votes
4 answers

Dataflow setting Controller Service Account

I try to set up controller service account for Dataflow. In my dataflow options I have: options.setGcpCredential(GoogleCredentials.fromStream( new FileInputStream("key.json")).createScoped(someArrays));…
Magda Kiwi
  • 501
  • 1
  • 3
  • 15
17
votes
1 answer

Apparent BufferBlock.Post/Receive/ReceiveAsync race/bug

cross-posted to http://social.msdn.microsoft.com/Forums/en-US/tpldataflow/thread/89b3f71d-3777-4fad-9c11-50d8dc81a4a9 I know... I'm not really using TplDataflow to its maximum potential. ATM I'm simply using BufferBlock as a safe queue for message…
spender
  • 117,338
  • 33
  • 229
  • 351
16
votes
1 answer

What are the use cases for TPL Dataflow over Reactive Extensions (Rx)

I'm specifically looking at writing some signal processing algorithms in one or other, or maybe some combination of both of these. Performance isn't a big concern, clarity of expressing intent is more important. I'd be looking to implement the…
stevenrcfox
  • 1,547
  • 1
  • 14
  • 37
16
votes
11 answers

Dataflow Programming - Patterns and Frameworks

I just came across the proposed Boost::Dataflow library. It seems like an interesting approach and I was wondering if there are other such alternative frameworks for C++, and if there are any related design patterns. I have not ruled out…
Styrac
16
votes
3 answers

What is the difference between Data Flow Analysis and Abstract Interpretation

What is the difference between Data Flow Analysis and Abstract Interpretation and are they used for the same purpose? What are the pros and cons of these two relative to each other.
MetallicPriest
  • 29,191
  • 52
  • 200
  • 356
15
votes
1 answer

Is it possible to write a luigi wrapper task that tolerates failed sub-tasks?

I have a luigi task that performs some non-stable computations. Think of an optimization process that sometimes does not converge. import luigi MyOptimizer(luigi.Task): input_param: luigi.Parameter() output_filename =…
DalyaG
  • 2,979
  • 2
  • 16
  • 19
13
votes
3 answers

Lazy data-flow (spreadsheet like) properties with dependencies in Python

My problem is the following: I have some python classes that have properties that are derived from other properties; and those should be cached once they are calculated, and the cached results should be invalidated each time the base properties are…
fortran
  • 74,053
  • 25
  • 135
  • 175
12
votes
6 answers

How do I get SSIS Data Flow to put '0.00' in a flat file?

I have an SSIS package with a Data Flow that takes an ADO.NET data source (just a small table), executes a select * query, and outputs the query results to a flat file (I've also tried just pulling the whole table and not using a SQL select). The…
theog
  • 1,064
  • 2
  • 20
  • 33
11
votes
8 answers

Graphical dataflow composition framework

I am interested to embed a MathWorks Simulink like type tool into my application. In this embedded tool units are expressed as blocks with their input and output ports and parameters for each block using my block definition files written in any way…
iCode
  • 4,308
  • 10
  • 44
  • 77
1
2 3
…
76 77