Stack Overflow
Stack Overflow

Questions tagged [batching]

193 questions
33
votes
6 answers

Execute batch of promises in series. Once Promise.all is done go to the next batch

I have an array that contains an array of promises, and each inner array could have either 4k, 2k or 500 promises. In total there are around 60k promises and I may test it with other values as well. I need to execute the first batch…
user1554966
  • 383
  • 1
  • 3
  • 7
14
votes
3 answers

how to fix "OperatorNotAllowedInGraphError " error in Tensorflow 2.0

I'm learn tensorflow2.0 from official tutorials.I can understand the result from below code. def square_if_positive(x): return [i ** 2 if i > 0 else i for i in x] square_if_positive(range(-5, 5)) # result [-5, -4, -3, -2, -1, 0, 1, 4, 9, 16] But…
sunny
  • 213
  • 1
  • 2
  • 9
13
votes
3 answers

Batching on duration or threshold using TPL Dataflow

I have implemented a producer..consumer pattern using TPL Dataflow. The use case is that code reads messages from the Kafka bus. For efficiency, we need to process messages in batches when going to the database. Is there a way in TPL data flow to…
Ashish Bhatia
  • 161
  • 1
  • 6
11
votes
1 answer

GraphQL Dataloader not knowing keys in advance

Dataloader is able to batch and cache requests, but it can only be used by either calling load(key) or loadMany(keys). The problem I am having is that sometimes I do not know they keys of the items I want to load in advance. I am using an sql…
Lionel Tay
  • 1,274
  • 2
  • 16
  • 28
11
votes
2 answers

Rx Buffer without empty calls to subscriber

In my WPF application using .Net 4.6 I have an event which fires new data points at a high rate (several hundred per second), but not all the time. This data is displayed in a chart. I would like to update the chart every 50 ms and not after each…
Christoph Fink
  • 22,727
  • 9
  • 68
  • 113
9
votes
1 answer

State of the art Culling and Batching techniques in rendering

I'm currently working with upgrading and restructuring an OpenGL render engine. The engine is used for visualising large scenes of architectural data (buildings with interior), and the amount of objects can become rather large. As is the case with…
Kristian Skarseth
  • 91
  • 3
8
votes
2 answers

Java: batching integers

I was wondering what the best way is to batch a given set of numbers in terms of a processing time. Take items: 9, 18, 7, 8, 4, 9, 11, 15, 3, 8, (item 1 has a processing time of 9, item 2 has a processing time of 18, etc.) If the batch processing…
binary101
  • 1,013
  • 3
  • 23
  • 34
7
votes
2 answers

Kafka get to know when related messages are consumed

is there any way, in Kafka, to produce a message once several related messages have been consumed ? (without having to manually control it at the application code...) The use case would be to pick a huge file, split it into several chunks, publish a…
Luiz Henrique Martins Lins Rol
  • 2,501
  • 5
  • 30
  • 43
7
votes
3 answers

How to add batching implicit for client?

Lets consider following code: Client code: public class MyClient { private final MyClientSideService myClientSideService; public MyClient(MyClientSideService myClientSideService) { this.myClientSideService = myClientSideService; …
gstackoverflow
  • 36,709
  • 117
  • 359
  • 710
6
votes
1 answer

AspNETCore Odata Batching

I'm having some issues trying to configure batching for OData on an AspNETCore Web Application. I've searched everywhere (almost) and couldn't find a proper answer. I'm not sure that the current AspNetCore.Odata version 7.0.0 which is still beta has…
Iustinian Andrioaie
  • 144
  • 9
6
votes
2 answers

OpenGL state redundancy elimination Tree, render state priorities

I am working on a Automatic OpenGL batching method in my Game Engine, to reduce draw calls and redundant calls. My batch tree design begins with the most expensive states and adds leafs down for each less expensive state. Example: Tree Root: Shaders…
Zeto
  • 91
  • 6
5
votes
2 answers

Spark. Split RDD into batches

I have RDD, where each record is int: [0,1,2,3,4,5,6,7,8] All I need to do is split this RDD into batches. I.e. make another RDD where each element is fixed size list of elements: [[0,1,2], [3,4,5], [6,7,8]] This sounds trivial, however, I am…
Dmitry
  • 221
  • 3
  • 6
5
votes
2 answers

MSBuild Batching on Three Independent Variables

I have been writing a build system based on MSBuild, and am to the end of the project where I need to essentially run the one msbuild file 88 times by batching over three variables: Configuration = Debug; Beta; Release; Evaluation Platform = x86;…
Brian Gillespie
  • 3,213
  • 5
  • 27
  • 37
5
votes
0 answers

NancyFX: batch requests support

The problem is simple: I need add batch requests support for NancyFX. Recently I found issue on github about Nancy batching support. The issue was created a long time ago, but there is still no any working solution. And this issue - is the ONLY…
Harry Burns
  • 770
  • 5
  • 19
4
votes
1 answer

How to read remaining items in Channel less than batch size, if there is no new items coming to channel within X minutes?

I am using Channel from System.Threading.Channels and wants to read items in batch (5 items) and I have a method like below, public class Batcher { private readonly Channel _channel; public Batcher() { …
user584018
  • 10,186
  • 15
  • 74
  • 160
1
2 3
…
12 13