Stack Overflow
Stack Overflow

Questions tagged [vldb]

VLDB is the acronym for very large database (>1TByte of data)

20 questions
31
votes
7 answers

20 Billion Rows/Month - Hbase / Hive / Greenplum / What?

I'd like to use your wisdom for picking up the right solution for a data-warehouse system. Here are some details to better understand the problem: Data is organized in a star schema structure with one BIG fact and ~15 dimensions. 20B fact rows…
Haggai
4
votes
3 answers

Recommendations for TimeSeries db

preferably open source for storing tick info.
Kumar
  • 10,997
  • 13
  • 84
  • 134
3
votes
2 answers

SQL Server Automatic Partitioning of Large Database Tables

I am dealing with database tables with tens of millions of rows (with the potential to go to the hundreds of millions over time), and am looking at implementing database partitioning to try to keep performance stable as the row count increases. This…
mike
  • 3,146
  • 5
  • 32
  • 46
2
votes
3 answers

Optimize Oracle 11g Procedure

I have a procedure to find the first, last, max and min prices for a series of transactions in a very large table which is organized by date, object name, and a code. I also need the sum of quantities transacted. There are about 3 billion rows in…
anti_ml
  • 481
  • 4
  • 15
2
votes
1 answer

Performance for RBAR vs. set-based processing with varying transactional sizes

It is conventional wisdom that set based processing of tables should always be preferred over RBAR - especially when the tables grow larger and/or you need to update many rows. But does that always hold? I have experienced quite a few situations -…
user806549
1
vote
2 answers

Replacing with a copy of a table with subset of data, instead of deleting from table - best method

We have a table with 800M rows and 93 columns that needs historical data removed. The data to be removed makes up > 95%. So far, attempts to delete in batches have failed, estimating at least one week to complete. The existing indexes are the main…
cloudsafe
  • 2,444
  • 1
  • 8
  • 24
1
vote
1 answer

Reclaim disk space after PAGE data compression on SQL 2014+ VLDB

I have a very large read-only DB with ~30 tables. The total size of the DB is around 13TB, with the largest table around 4.5 TB. (There are 10 or so tables with size 1TB+, and then several smaller tables.) Currently the DB is split up into 8…
capnsue
  • 51
  • 2
  • 5
1
vote
1 answer

How to use visual leak detecter ( vld ) for com/atl dll projects?

I included vld.h file in my activex dll project. when i try to compile my project from visual studio 2008.I am getting the following error, 1>Registering output... 1>Project : error PRJ0050: Failed to register output. Please ensure you have the…
srajeshnkl
  • 883
  • 3
  • 16
  • 49
0
votes
1 answer

SQL Server What size is VLDB

Is it 1TB minimum or is it 2? My current client has sub 1 TB and I wanted to know if I write that they are on the verge of a re-classification due to their size they should consider these BOATLOAD of issues. :) TIA
__Stephen
0
votes
0 answers

I want to partition my oracle's table dynamically where number of partitions could be in 2000s

My database table is going to have around 1.5 billion to 3 billion rows. Splitting that table in many small tables is not going to be an option for me. My Table schema is: OBJECT_PRIMARY_KEY VARCHAR2(36) PRIMARY_KEY, OBJECT_TYPE…
user3111249
  • 1
  • 1
0
votes
0 answers

MSVC shows memory leaks, while VLD doesn't

ALL, I'm developing a program and compiling with MSVC 2017 Community. I am also using VLD to identify and fix memory leaks. The problem I'm seeing is that on exit MSVC reports memory leaks, while VLD says: "No memory leaks detected". So now I'm at a…
Igor
  • 5,620
  • 11
  • 51
  • 103
0
votes
1 answer

Log shipping a large database

I have Question on log shipping: I am migrating a VLDB (12TB) SQL database from a physical environment (server A) to virtual environment (server B), and from version SQL 2008 R2 to SQL 2014. The high-level plan for migration is to log ship from…
salty2468
  • 1
0
votes
4 answers

Column store on top of hadoop?

Is there a column store similar to Vertica that is built on top of Hadoop.. I am not talking about HBase as it is sparse matrix store and can not get the level of compression that can be achieved by something like Vertica? Thanks
StackUnderflow
  • 24,080
  • 14
  • 54
  • 77
0
votes
1 answer

MicroStrategy dimension tables left outer join fact tables scenario

I am trying to mimic following SQL in MicroStrategy using given tables master_dimension - Itemkey, color, weight, season, target_age_group... 1000 rows with 1000 unique items sub_dimension - item_key, need_special_handling - 400 rows with only…
androboy
  • 817
  • 1
  • 12
  • 24
0
votes
1 answer

Can a mySQL Database have multiple files to spread out the IO?

In SQL Server for an IO Intensive database or often for VLDB's we create multiple database files and put them on individual Disks/Luns, to spread the IO workload. I cant see how this is possible with mySQL, as all databases are created in the…
wilson_smyth
  • 1,202
  • 1
  • 14
  • 39
1
2