Stack Overflow
Stack Overflow

Questions tagged [partitioned-view]

16 questions
4
votes
1 answer

Partitioned-View not working with parameters

We currenlty have a few customers where their querys would take ages to get results out of a partitioned view. On closer inspection we found the execution plan to scan every table, instead of just the ones with the relevant data. To isolate this…
DeveloperExceptionError
  • 689
  • 11
  • 22
2
votes
1 answer

pyspark Loading multiple partitioned files in a single load

I am trying to load multiple files in a single load. They are all partitioned files When I tried it with 1 file it works, but when I listed down 24 files, it gives me this error and I could not find any documentation of the limitation and a…
E B
  • 1,073
  • 3
  • 23
  • 36
2
votes
1 answer

Partitioned View filter doesnt work correct

I have next partition view: vwSalesOutH. It consists of several tables named "SalesOutH" in different databases. When I use the next query, it works fine, searching is by one table vwSalesOutH: select vwSalesOutH.* from vwSalesOutH inner join…
Olexandr
  • 23
  • 4
2
votes
1 answer

Partitioned view read all the tables when there are more rows or the queries get more complex? SQL Server 2008 bug?

The following is the set up and test scripts. The test script suppose to scan table T4 only. However, it starts to scan both tables T1 and T4 when they have more than 10000 rows. create table T1 (A varchar(5) check ((A='S4' or A='S3' or A='S2' or…
ca9163d9
  • 27,283
  • 64
  • 210
  • 413
1
vote
0 answers

How to choose between partitioned table vs partitioned view?

We are importing daily data (~600K rows) from Google GA4 into our data warehouse. We are trying to decide how we are going to store the data. We're considering either a partitioned table or a partitioned view that queries daily tables, with the…
Matthew Walk
  • 1,014
  • 2
  • 16
  • 36
1
vote
1 answer

Synapse serverless query delta lake partitioned data displays data duplicated

We have an elt process to store data partitioned by Year in a delta lake processed through Databricks. In Databricks the queried location displays data correctly with no duplications and no total count variation. When I create a view using Synapse…
devhack_wasd
  • 11
  • 1
1
vote
1 answer

Joining Table with Partitioned/Clustered Table in BQ

As always I'm thankful for any pointer in the right direction. My Scenario is included two tables with one being a default table while the second one is clustered and partitioned by ID and Date. I believed this to be sufficient solution to my…
Aleko
  • 103
  • 8
1
vote
0 answers

Odd execution plan when constraint is added to partition view

I have a weird issue with a partitioned view I setup. For example sake, lets say I have an Orders & Orders_Archive table which is accessed via a partitioned view. Each order has an OrderType, which is accessed via a foreign key and stored in a look…
emess
  • 33
  • 3
1
vote
1 answer

My partitioned view is still accessing all underlying base tables

I am trying to create a partitioned view, however my execution plan is showing that it is still accessing both underlying tables. SQL Fiddle here Why is my query still accessing both underlying tables and then concatenating them?
Lock
  • 5,422
  • 14
  • 66
  • 113
1
vote
0 answers

Improving query performance on partitioned views with large number of tables

Background I'm migrating an application away from a schema with a single event table holding 0.5-1.3 billion records to partitioned views with 30-180 identical underlying tables that each hold a fraction of that number of records which considerably…
Dan Hermann
  • 1,107
  • 1
  • 13
  • 27
0
votes
1 answer

How to create and maintain a partitioned view with last 7 days and archive records in SQL Server 2005?

I have a rather large table which I need to query for a reporting application. Most of the time users will be interested in last 7 days worth of data but they want to be able to query the older (archive data) every now and then. Since they want…
Vlad
  • 10,602
  • 2
  • 36
  • 38
0
votes
0 answers

Querying Partitioned Table in Lambda

I have one partitioned table 'table1' and I'm able to run select clause on this table in Athena and it gives result as well. However, when I try to run the query on this Table 'table1' using Lambda Function, it gives me the following…
Varsha Venkatesh
  • 11
  • 2
0
votes
0 answers

How do I implement EntityFramework.Partitioned Views

So, I've been trying to implement EntityFramework.PartitionedViews all day and I'm not really any further than when I started. My problem is that I collect large quantities of data (scores of millions of rows per month), so want to partition the…
CodingCretin
  • 401
  • 4
  • 9
0
votes
0 answers

How to drop partitions from hive views?

I have a partitioned view and I am trying to drop an existing partition from the view definition using hive CLI. However, when I try to drop a partition, it throws me the following error: FAILED: Execution Error, return code 1 from…
Rishi Pathak
  • 1
0
votes
0 answers

Partitioned view on large parent and child table with foreign key

How can I do partitioned view on SQL Server (Standard edition) on two tables with foreign key - parent and child 1TB each - without changing queries called from application, so that queries are not inefficient? Here is the schema (simplified): ( or…
DropDropped
  • 1,253
  • 1
  • 22
  • 50
1
2