Stack Overflow
Stack Overflow

Questions tagged [bulk]

The meaning of bulk is the major portion or greater part of any size, mass, or volume.

946 questions
238
votes
14 answers

Import CSV file into SQL Server

I am looking for help to import a .csv file into SQL Server using BULK INSERT and I have few basic questions. Issues: The CSV file data may have , (comma) in between (Ex: description), so how can I make import handling these data? If the client…
Prabhat
  • 4,164
  • 4
  • 17
  • 12
74
votes
9 answers

Bulk Update in C#

For inserting a huge amount of data in a database, I used to collect all the inserting information into a list and convert this list into a DataTable. I then insert that list to a database via SqlBulkCopy. Where I send my generated list LiMyList…
Amit Bisht
  • 4,870
  • 14
  • 54
  • 83
73
votes
5 answers

Bulk update mysql with where statement

How to update mysql data in bulk ? How to define something like this : UPDATE `table` WHERE `column1` = somevalues SET `column2` = othervalues with somevalues like : VALUES ('160009'), ('160010'), ('160011'); and othervalues…
user3673384
  • 871
  • 2
  • 8
  • 13
61
votes
12 answers

Faster bulk inserts in sqlite3?

I have a file of about 30000 lines of data that I want to load into a sqlite3 database. Is there a faster way than generating insert statements for each line of data? The data is space-delimited and maps directly to an sqlite3 table. Is there any…
scubabbl
  • 12,657
  • 7
  • 36
  • 36
54
votes
11 answers

Sending mass email using PHP

I am currently writing a music blog. The administrator posts a new article every 2-3 days. Once the administrator posts an article, a mass email will be sent to around 5000 subscribers immediately. What is the best way to implement the mass mail…
Alan
  • 2,888
  • 7
  • 34
  • 36
35
votes
5 answers

MySQL bulk INSERT or UPDATE

Is there any way of performing in bulk a query like INSERT OR UPDATE on the MySQL server? INSERT IGNORE ... won't work, because if the field already exists, it will simply ignore it and not insert anything. REPLACE ... won't work, because if the…
rid
  • 61,078
  • 31
  • 152
  • 193
30
votes
2 answers

Bulk update for many to many fields

I have two models as Follows: class Book(models.Model): title = models.CharField(max_length=100) year = models.IntegerField(max_lenght=4) author = models.ManyToManyField(null=true, blank=true) class Author(models.CustomUser): #…
Amyth
  • 32,527
  • 26
  • 93
  • 135
29
votes
4 answers

Override django's model delete method for bulk deletion

I'm overriding Django's model delete method in order to delete orphan files in the disk for image fields, something like this: class Image(models.Model): img = models.ImageField(upload_to=get_image_path) ... def delete(self, *args,…
Kilian Perdomo Curbelo
  • 1,281
  • 1
  • 15
  • 31
29
votes
18 answers

Cannot fetch a row from OLE DB provider "BULK" for linked server "(null)"

I try to load my database with tons of data from a .csv file sized 1.4 GB. But when I try to run my code I get errors. Here's my code: USE [Intradata NYSE] GO CREATE TABLE CSVTest1 (Ticker varchar(10) NULL, dateval date NULL, timevale time(0)…
Espen Skeie
  • 313
  • 3
  • 5
  • 8
27
votes
3 answers

C# mongodb driver 2.0 - How to upsert in a bulk operation?

I migrated from 1.9 to 2.2 and reading the documentation I was surprised to discover that is not possible to upsert during a bulk operation anymore, since operations don't allow options. bulkOps.Add(new UpdateOneModel(filter,…
Adrian Lopez
  • 2,601
  • 5
  • 31
  • 48
26
votes
2 answers

django bulk create ignore duplicates

I'm trying to bulk insert into a MySQL db for a very large dataset and would love to use django's bulk_create while ignoring duplicate errors. Sample model: class MyModel(models.Model): my_id=models.IntegerField(primary_key=True) start_time…
tr33hous
  • 1,622
  • 1
  • 15
  • 26
21
votes
4 answers

How to use update all, when all records are different?

How can I use update_all, if I want to update a column of 300,000 records all with a variety of different values? What I want to do is something like: Model.update_all(:column => [2,33,94,32]).where(:id => [22974,22975,22976,22977]) But…
Markus
  • 3,948
  • 8
  • 48
  • 64
16
votes
4 answers

Elasticsearch partial bulk update

I have 6k of data to update in ElasticSearch. And I have to use PHP. I search in the documentation and I have found this, Bulk Indexing but this is not keeping the previous data. I have structure: [ { 'name': 'Jonatahn', 'age' : 21 …
Jonathan Machado
  • 522
  • 4
  • 14
16
votes
6 answers

Avoid being blocked by web mail companies for mass/bulk emailing?

Our company is sending out a lot of emails per day and planning to send even more in future. (thousands) Also there are mass mailouts as well in the ten thousands every now and then. Anybody has experience with hotmail, yahoo (web.de, gmx.net) and…
Johannes
  • 3,002
  • 4
  • 33
  • 36
14
votes
2 answers

RESTful API and bulk operations

I have a middle tier which performs CRUD operations on a shared database. When I converted the product to .NET Core I thought I'd also look at using REST for the API as CRUD is supposed to be what it does well. It seems like REST is a great…
Quark Soup
  • 4,272
  • 3
  • 42
  • 74
1
2 3
…
62 63