Stack Overflow
Stack Overflow

Questions tagged [azure-elastic-sharding]

22 questions
15
votes
2 answers

How to use database sharding with EF Core and C#"

I'm currently in the process of converting my 6 years old C# application to .NET Core v3 and EF Core (and also using Blazor). Most of it is working except for the Sharding part. Our application creates a new database for each client. We use more or…
Paul Meems
  • 3,002
  • 4
  • 35
  • 66
5
votes
1 answer

Cannot delete shard mapping using Azure SQL Elastic Scale

We have an entity in our system called an "identity program." That is also our sharding boundary, every identity program is stored in its own shard, so the identifier of the shard is the identifier of the identity program. We are in the process of…
Craig W.
  • 17,838
  • 6
  • 49
  • 82
4
votes
2 answers

Azure Elastic DB - Modify schema in each shard

I'm new to the Elastic DB Feature from Azure and it looks really awesome. But what i could not find is how you can update the schema of all shards. So if i have multiple Shards and i want to add/remove a Column, Table or just add/remove a Stored…
metabolic
  • 669
  • 1
  • 7
  • 24
2
votes
2 answers

How to use EF Core with Azure SQL Shards for .NET 5+?

We have a SaaS product with customer tenants, and we are trying to implement scalable database access, but it looks like the ElasticScale github project has been abandoned. Is there a new mechanism for this? How do you implement scalable, manageable…
Jeremy Holovacs
  • 22,480
  • 33
  • 117
  • 254
2
votes
0 answers

Elastic Queries with Dapper: Procedure expects parameter of type 'ntext/nchar/nvarchar'

I am trying to query a set of Azure SQL Databases using the sp_execute_remote SQL function with Dapper and DynamicParameters as follows: Task> ExecuteMultiShardCommand(SqlBuilder.Template Template, int Timeout = 120) { var mParams =…
Matt Kraatz
  • 63
  • 6
2
votes
1 answer

Should ShardMapManager and ShardMap objects be cached globally as a singleton?

I have an application with multiple Azure SQL databases sharded by a key. Every time we open a shard database connection, we retrieve the ShardMapManager and the ListShardMap: public static ShardMapManager CreateOrGetShardMapManager(string…
Code Slinger
  • 1,100
  • 1
  • 11
  • 16
1
vote
1 answer

Delete database shard mapping and shard databases in SQL Server to clean up tenant resources

We have a database for each tenant as shown in the screenshot below. I am trying to delete the tenant DB and clean up and reclaim the resources of a tenant I have anciently created. I tried the following code, however, even though this method…
Patola
  • 515
  • 8
  • 30
1
vote
2 answers

Azure Split/Merge Service, is it still relevant?

I have managed to get the C# and db setup using ListMappings. However, when I try to deploy the split/merge tool to Azure cloud classic the service it states 'The requested VM tier is currently not available in East US for this subscription. Please…
Jeremy
  • 41
  • 6
1
vote
0 answers

Can an Azure SQL with shard management have databases in different regions?

The documentation for shard management using the Elastic Database Tools seems to imply that all the database instances must be in the same Elastic Pool, and therefore on the same database VM instance. I want to have Azure SQL instances in different…
Phil Wright
  • 22,580
  • 14
  • 83
  • 137
1
vote
1 answer

Azure Database Horizontal Sharding the best solution for Multi-tenant C# asp.net application

We have an Enterprise application that we are in the midst of moving to the cloud. Up to this point our application has had multiple users accessing information through a database located on their main server. We are trying to figure out what the…
Eric
  • 212
  • 2
  • 15
1
vote
0 answers

Deploying a split-merge service for Azure SQL Elastic (sharded) databases

I am trying to follow the tutorial for deploying a split-merge service (Azure Elastic Database... tools). The first complication is that the doc instructs me to create an "Azure Cloud Service." The closest thing to that seems to be "Cloud service…
dudeNumber4
  • 4,217
  • 7
  • 40
  • 57
0
votes
0 answers

Should every entity owned by the tenant in a sharded DB have a shardkey

I'm developing a SAAS Application using a hybrid sharded DB model with EF Core / SQL Server (to be hosted on Azure). Is it best practice for every entity owned by the tenant to have a shard key (TenantId) or just the root entities. For instance, a…
Mat Guthrie
  • 543
  • 1
  • 6
  • 13
0
votes
0 answers

Elasticsearch unassigned shards : corrupt_index_exception, no_valid_shard_copy, e_o_f_exception

I am using helm chart for elastic 7.12.0 cluster (2 master , 2 data) deployment on K8s, with a stateful-set (for persistence i have a volume claim). getting a lot of unassigned shards, where the shards are corrupted. *"unassigned_info": { "reason":…
elransa
  • 1
  • 1
0
votes
0 answers

using and securing Sharding data

According to the description from Azure here, you use Sharding when you want to split large databases into smaller components. We want to use Sharding data, not because we have large amount of data, but because we have almost same schema from…
user217648
  • 3,338
  • 9
  • 37
  • 61
0
votes
1 answer

Shard Map Manager and query node in same DB

I'd like to consolidate DBs and have my shard map manager be in the same DB as my head query node. Following bellow link description. However, when I go to query, I get an error of "Error accessing the shard map manager database. Please verify…
chi nguyen
  • 45
  • 6
1
2