Why does this firestore query require an index?

Question

I have a query with a where() method with an equality operator and then an orderBy() method and I can't figure out why it requires an index. The where method checks for a value in an object (a map) and the order by is with a number.

The documentation says

If you have a filter with a range comparison (<, <=, >, >=), your first ordering must be on the same field

So I would have thought that an equality filter would be fine.

Here is my query code:

this.afs.collection('posts').ref
.where('tags.' + this.courseID,'==',true)
.orderBy("votes")
.limit(5)
.get().then(snap => {
  snap.forEach(doc => {
    console.log(doc.data());
  });
});

Here is an example of the database structure

As Alex answered: Firestore automatically created an index for each individual field. But your query requires a composite index on `'tags.' + this.courseID` **and** `votes`, which is not auto-created. Note that you can simplify your query by [using an array and the `array-contains` operator](https://firebase.googleblog.com/2018/08/better-arrays-in-cloud-firestore.html). In addition to being simpler, that might not need an additional index. — Frank van Puffelen, Dec 15 '18 at 15:40
@FrankvanPuffelen Great thinking. `array-contains` does require an index but only one whereas I would need a new index for each courseID with the equality. Thanks! — tokism, Dec 18 '18 at 04:55

Alex Mamo · Accepted Answer · 2021-07-19T06:29:06.240

95

Why does this Firestore query require an index?

As you probably noticed, queries in Cloud Firestore are very fast and this is because Firestore automatically creates an index for any field you have in your document. So when you simply filter with a range comparison, Firestore creates the required index automatically. If you also try to order your results, another index is required. This kind of index is not created automatically. You should create it yourself. This can be done, by creating it manually in your Firebase Console or you'll find in your logs a message that sounds like this:

FAILED_PRECONDITION: The query requires an index. You can create it here: ...

You can simply click on that link or copy and paste the URL into a web browser and your index will be created automatically.

So Firestore requires an index so you can have very fast queries.

edited Jul 19 '21 at 06:29

answered Dec 15 '18 at 08:06

Alex Mamo

130,605
17
163
193

1

But what happens in the case where the collection is constantly being updated and new documents are being added all the time? Do I have to rebuild the index again and again or once I build it (right now with only 5 documents in the collection, for testing/development), it will automatically scale it for more documents later on in production mode? – Devashish Aug 19 '20 at 12:07
2

@Devashish There is no need to do anything, once you create an index. It will work with any number of documents. – Alex Mamo Aug 19 '20 at 12:11
I cannot find the link for creating the index in the new versions of cloud firestore. I have to manually build indexes from firebase console. My error only shows, "Error: [cloud_firestore/failed-precondition] Operation was rejected because the system is not in a state required for the operation's execution. If performing a query, ensure it has been indexed via the Firebase console.". How to fix this? – Rachit Rawat Jul 18 '21 at 18:48
@RachitRawat As the warning message states, most likely you should add the index directly in the Firebase Console. – Alex Mamo Jul 19 '21 at 06:29
But i have a lot of indexes that needs to be built. Is it possible to get this link from somewhere to ease out the process? – Rachit Rawat Jul 20 '21 at 21:19
@RachitRawat You can use [the Firebase CLI](https://firebase.google.com/docs/firestore/query-data/indexing#index_build_time). – Alex Mamo Jul 21 '21 at 05:13
@AlexMamo what if the collection id is dynamic?Like there can be many collection names that are unknown at the start. – Oooha Mar 07 '22 at 08:36
1

@Oooha I think that this [answer](https://stackoverflow.com/questions/47960930/how-to-automatically-create-indexes-for-cloud-firestore) will help. – Alex Mamo Mar 07 '22 at 09:41

trndjc · Answer 2 · 2023-05-23T18:56:12.963

An index is simply a database inventory, or a record, of what is where. And each index is a specific inventory of a specific thing, such as how many propertyX fields exist in a collection and what their values are, sorted (the fact that they are sorted is critical).

If this inventory didn't exist, to query for documents where propertyX is someValue, the machine would have to iterate over the entire collection to determine (1) which documents contain propertyX and (2) which documents contain propertyX equal to someValue. By keeping an index of queried properties, when a query is performed on propertyX, the machine can go straight to the propertyX index and gather the locations of all the documents that equal someValue and then fetch those documents from the collection and return them. Not only does the machine not need to touch the collection to know where the documents are but it doesn't even need to iterate over the entire index because it's always in order.

Indexes are why collection sizes have no impact on the performance of Firestore queries and why we only need to index properties that are ever queried.

Why does this firestore query require an index?

2 Answers2

Linked