.Net Data structures: ArrayList, List, HashTable, Dictionary, SortedList, SortedDictionary -- Speed, memory, and when to use each?

Question

.NET has a lot of complex data structures. Unfortunately, some of them are quite similar and I'm not always sure when to use one and when to use another. Most of my C# and VB books talk about them to a certain extent, but they never really go into any real detail.

What's the difference between Array, ArrayList, List, Hashtable, Dictionary, SortedList, and SortedDictionary?

Which ones are enumerable (IList -- can do 'foreach' loops)? Which ones use key/value pairs (IDict)?

What about memory footprint? Insertion speed? Retrieval speed?

Are there any other data structures worth mentioning?

I'm still searching for more details on memory usage and speed (Big-O notation)

You should break this question apart. You're asking twenty different things, half of which a simple google search can answer. Please be more specific; its hard to help when your question is so scattered. — , Sep 24 '08 at 17:55
I thought about breaking it up, but realized that someone would likely be able to consolidate all these answers into one place. In fact, if someone can come up with a table profiling everything, it might become a wonderful resource on this site. — Pretzel, Sep 28 '08 at 15:25
Ryan, the articles at that link are 14 years old, (12 at the time of post). Side note I have been reading them for the last week myself. but they also do not include newer technology and desperately need updating. And more performance metrics and examples. — htm11h, May 17 '17 at 17:53
@Dracolyte I believe this question is what you wanted to ask and it was deleted. — Hogan, Mar 03 '21 at 17:25

score 167 · Accepted Answer · edited Feb 23 '17 at 11:59

167

Off the top of my head:

Array* - represents an old-school memory array - kind of like a alias for a normal type[] array. Can enumerate. Can't grow automatically. I would assume very fast insert and retrival speed.
ArrayList - automatically growing array. Adds more overhead. Can enum., probably slower than a normal array but still pretty fast. These are used a lot in .NET
List - one of my favs - can be used with generics, so you can have a strongly typed array, e.g. List<string>. Other than that, acts very much like ArrayList
Hashtable - plain old hashtable. O(1) to O(n) worst case. Can enumerate the value and keys properties, and do key/val pairs
Dictionary - same as above only strongly typed via generics, such as Dictionary<string, string>
SortedList - a sorted generic list. Slowed on insertion since it has to figure out where to put things. Can enum., probably the same on retrieval since it doesn't have to resort, but deletion will be slower than a plain old list.

I tend to use List and Dictionary all the time - once you start using them strongly typed with generics, its really hard to go back to the standard non-generic ones.

There are lots of other data structures too - there's KeyValuePair which you can use to do some interesting things, there's a SortedDictionary which can be useful as well.

edited Feb 23 '17 at 11:59

marc_s

732,580
175
1,330
1,459

answered Sep 24 '08 at 18:00

Sam Schutte

6,666
6
44
54

3

Hash Table is O(1), worst case (with collisions) can be O(n) – Justin Bozonier Oct 18 '08 at 16:00
7

There are many other data structures you need to add here. like LinkedList, Skip List, Stack, Queue, Heap, Trees, Graphs. These are very important data structures as well. – DarthVader Aug 25 '11 at 19:00
2

ConcurrentDictionary added in .Net 4.0 provides a generic dictionary with Thread Safety – Harindaka Dec 21 '12 at 16:34
2

Also BlockingCollection provides a thread safe producer/consumer implementation – Harindaka Dec 21 '12 at 16:36
8

`ArrayList` uses virtual methods, but `List` does not. `ArrayList` has been largely replaced with `List` for standard collections and `Collection` as a base class for custom collections. `Hashtable` has been largely replaced by `Dictionary`. I would recommend avoiding `ArrayList` and `Hashtable` for new code. – Sam Harwell May 23 '13 at 05:37
@280Z28 - You really should write a new answer -- Sam's was great but it is 5 years old at this point. – Hogan Jun 18 '13 at 15:07
1

Efficiency of hash tables is amortized O(1), not O(1). More details [here](http://stackoverflow.com/questions/2771368/can-hash-tables-really-be-o1) – RBT Mar 21 '17 at 09:07

score 30 · Answer 2 · answered Sep 24 '08 at 17:52

30

If at all possible, use generics. This includes:

List instead of ArrayList
Dictionary instead of HashTable

answered Sep 24 '08 at 17:52

Adam Tegen

25,378
33
125
153

score 24 · Answer 3 · edited Jan 06 '22 at 16:41

First, all collections in .NET implement IEnumerable.

Second, a lot of the collections are duplicates because generics were added in version 2.0 of the framework.

So, although the generic collections likely add features, for the most part:

List is a generic implementation of ArrayList.
Dictionary<T,K> is a generic implementation of Hashtable

Arrays are a fixed size collection that you can change the value stored at a given index.

SortedDictionary is an IDictionary<T,K> that is sorted based on the keys. SortedList is an IDictionary<T,K> that is sorted based on a required IComparer.

So, the IDictionary implementations (those supporting KeyValuePairs) are:

Hashtable
Dictionary<T,K>
SortedList<T,K>
SortedDictionary<T,K>

Another collection that was added in .NET 3.5 is the Hashset. It is a collection that supports set operations.

Also, the LinkedList is a standard linked-list implementation (the List is an array-list for faster retrieval).

blackwing · Answer 4 · 2016-12-05T03:17:39.873

20

Here are a few general tips for you:

You can use foreach on types that implement IEnumerable. IList is essentially an IEnumberable with Count and Item (accessing items using a zero-based index) properties. IDictionary on the other hand means you can access items by any-hashable index.
Array, ArrayList and List all implement IList. Dictionary, SortedDictionary, and Hashtable implement IDictionary.
If you are using .NET 2.0 or higher, it is recommended that you use generic counterparts of mentioned types.
For time and space complexity of various operations on these types, you should consult their documentation.
.NET data structures are in System.Collections namespace. There are type libraries such as PowerCollections which offer additional data structures.
To get a thorough understanding of data structures, consult resources such as CLRS.

edited Dec 05 '16 at 03:17

answered Sep 24 '08 at 18:05

blackwing

3,154
3
23
20

1

from [msdn](https://msdn.microsoft.com/en-us/library/system.collections.sortedlist(v=vs.110).aspx), it seems like sortedList implement IDictionnary - not IList – Haim Bendanan Nov 23 '16 at 18:45
Fixed. thanks for the comment. Seems like SortedList keeps a list of key/values, so it basically represents a dictionary's data. Don't remember how this class worked when I first wrote the answer ... – blackwing Dec 05 '16 at 03:18

score 11 · Answer 5 · edited Jun 20 '20 at 09:12

.NET data structures:

More to conversation about why ArrayList and List are actually different

Arrays

As one user states, Arrays are the "old school" collection (yes, arrays are considered a collection though not part of System.Collections). But, what is "old school" about arrays in comparison to other collections, i.e the ones you have listed in your title (here, ArrayList and List(Of T))? Let's start with the basics by looking at Arrays.

To start, Arrays in Microsoft .NET are, "mechanisms that allow you to treat several [logically-related] items as a single collection," (see linked article). What does that mean? Arrays store individual members (elements) sequentially, one after the other in memory with a starting address. By using the array, we can easily access the sequentially stored elements beginning at that address.

Beyond that and contrary to programming 101 common conceptions, Arrays really can be quite complex:

Arrays can be single dimension, multidimensional, or jadded (jagged arrays are worth reading about). Arrays themselves are not dynamic: once initialized, an array of n size reserves enough space to hold n number of objects. The number of elements in the array cannot grow or shrink. Dim _array As Int32() = New Int32(100) reserves enough space on the memory block for the array to contain 100 Int32 primitive type objects (in this case, the array is initialized to contain 0s). The address of this block is returned to _array.

According to the article, Common Language Specification (CLS) requires that all arrays be zero-based. Arrays in .NET support non-zero-based arrays; however, this is less common. As a result of the "common-ness" of zero-based arrays, Microsoft has spent a lot of time optimizing their performance; therefore, single dimension, zero-based (SZs) arrays are "special" - and really the best implementation of an array (as opposed to multidimensional, etc.) - because SZs have specific intermediary language instructions for manipulating them.

Arrays are always passed by reference (as a memory address) - an important piece of the Array puzzle to know. While they do bounds checking (will throw an error), bounds checking can also be disabled on arrays.

Again, the biggest hindrance to arrays is that they are not re-sizable. They have a "fixed" capacity. Introducing ArrayList and List(Of T) to our history:

ArrayList - non-generic list

The ArrayList (along with List(Of T) - though there are some critical differences, here, explained later) - is perhaps best thought of as the next addition to collections (in the broad sense). ArrayList inherit from the IList (a descendant of 'ICollection') interface. ArrayLists, themselves, are bulkier - requiring more overhead - than Lists.

IList does enable the implementation to treat ArrayLists as fixed-sized lists (like Arrays); however, beyond the additional functionallity added by ArrayLists, there are no real advantages to using ArrayLists that are fixed size as ArrayLists (over Arrays) in this case are markedly slower.

From my reading, ArrayLists cannot be jagged: "Using multidimensional arrays as elements... is not supported". Again, another nail in the coffin of ArrayLists. ArrayLists are also not "typed" - meaning that, underneath everything, an ArrayList is simply a dynamic Array of Objects: Object[]. This requires a lot of boxing (implicit) and unboxing (explicit) when implementing ArrayLists, again adding to their overhead.

Unsubstantiated thought: I think I remember either reading or having heard from one of my professors that ArrayLists are sort of the bastard conceptual child of the attempt to move from Arrays to List-type Collections, i.e. while once having been a great improvement to Arrays, they are no longer the best option as further development has been done with respect to collections

List(Of T): What ArrayList became (and hoped to be)

The difference in memory usage is significant enough to where a List(Of Int32) consumed 56% less memory than an ArrayList containing the same primitive type (8 MB vs. 19 MB in the above gentleman's linked demonstration: again, linked here) - though this is a result compounded by the 64-bit machine. This difference really demonstrates two things: first (1), a boxed Int32-type "object" (ArrayList) is much bigger than a pure Int32 primitive type (List); second (2), the difference is exponential as a result of the inner-workings of a 64-bit machine.

So, what's the difference and what is a List(Of T)? MSDN defines a List(Of T) as, "... a strongly typed list of objects that can be accessed by index." The importance here is the "strongly typed" bit: a List(Of T) 'recognizes' types and stores the objects as their type. So, an Int32 is stored as an Int32 and not an Object type. This eliminates the issues caused by boxing and unboxing.

MSDN specifies this difference only comes into play when storing primitive types and not reference types. Too, the difference really occurs on a large scale: over 500 elements. What's more interesting is that the MSDN documentation reads, "It is to your advantage to use the type-specific implementation of the List(Of T) class instead of using the ArrayList class...."

Essentially, List(Of T) is ArrayList, but better. It is the "generic equivalent" of ArrayList. Like ArrayList, it is not guaranteed to be sorted until sorted (go figure). List(Of T) also has some added functionality.

score 8 · Answer 6 · answered Jun 06 '20 at 06:41

8

I found "Choose a Collection" section of Microsoft Docs on Collection and Data Structure page really useful

C# Collections and Data Structures : Choose a collection

And also the following matrix to compare some other features

answered Jun 06 '20 at 06:41

pk_code

2,608
1
29
33

Andy Brown · Answer 7 · 2012-10-18T13:03:38.993

I sympathise with the question - I too found (find?) the choice bewildering, so I set out scientifically to see which data structure is the fastest (I did the test using VB, but I imagine C# would be the same, since both languages do the same thing at the CLR level). You can see some benchmarking results conducted by me here (there's also some discussion of which data type is best to use in which circumstances).

score 3 · Answer 8 · answered Sep 24 '08 at 17:54

3

They're spelled out pretty well in intellisense. Just type System.Collections. or System.Collections.Generics (preferred) and you'll get a list and short description of what's available.

answered Sep 24 '08 at 17:54

Joel Coehoorn

399,467
113
570
794

Chris · Answer 9 · 2008-09-28T14:57:53.877

3

Hashtables/Dictionaries are O(1) performance, meaning that performance is not a function of size. That's important to know.

EDIT: In practice, the average time complexity for Hashtable/Dictionary<> lookups is O(1).

edited Sep 28 '08 at 14:57

answered Sep 24 '08 at 21:04

Chris

3,664
6
34
44

5

There is no such thing as "performance". The complexity depends on operation. For example, if you insert n elements into Dictionary<>, it will not be O(1) due to rehashing. – Ilya Ryzhenkov Sep 24 '08 at 21:07
2

FYI, even with rehashing, Dictionary is still O(1). Consider the scenario just before the Dictionary expands. Half the elements--those that were added since the last expansion--will have been hashed once. Half of the remainder will have been hashed twice. Half of the remainder from that, three times, etc. The average number of hashing operations performed on each element will be 1+1/2+1/4+1/8...=2. The situation immediately after expansion is essentially the same, but with every element having been hashed one extra time (so average hash count is three). All other scenarios are between those. – supercat Mar 11 '11 at 22:24

score 3 · Answer 10 · answered Sep 28 '08 at 15:05

3

The generic collections will perform better than their non-generic counterparts, especially when iterating through many items. This is because boxing and unboxing no longer occurs.

answered Sep 28 '08 at 15:05

Russ Cam

124,184
33
204
266

score 2 · Answer 11 · answered Aug 27 '11 at 19:59

2

An important note about Hashtable vs Dictionary for high frequency systematic trading engineering: Thread Safety Issue

Hashtable is thread safe for use by multiple threads. Dictionary public static members are thread safe, but any instance members are not guaranteed to be so.

So Hashtable remains the 'standard' choice in this regard.

answered Aug 27 '11 at 19:59

Rob

109
1
6

This is partly true. The `Hashtable` is safe to use with only one writer and multiple readers concurrently. On the other hand, it is safe to use the `Dictionary` with multiple readers as long as it is not modified concurrently. – Bryan Menard Aug 27 '11 at 22:05
Definitely. In the trading space however, we're concurrently reading from live market data and running analytics that include the appended entries. It also depends on how many traders are utilizing the system - if it's just you, it obviously doesn't matter. – Rob Aug 28 '11 at 04:15
1

.NET 4.0 provides a ConcurrentDictionary – Rob Aug 28 '11 at 04:17

score 1 · Answer 12 · answered Sep 24 '08 at 21:11

1

There are subtle and not-so-subtle differences between generic and non-generic collections. They merely use different underlying data structures. For example, Hashtable guarantees one-writer-many-readers without sync. Dictionary does not.

answered Sep 24 '08 at 21:11

Ilya Ryzhenkov

11,782
1
40
50