In Vega Lite, is there a way to lock the axis while using pan and zoom so they don't go beyond the domain of your data?

Question

I have a pretty standard pan and zoom function in my vega lite set up:

const brush = vl.selectInterval().bind('scales').encodings("x").clear('dblclick')

I was just wondering if there was sa way to lock the x axis so that you couldn't pan outside of the domain.

I have tried to lock the domain in the actual chart, but nothing happened so I expect that the actual pan and zoom selector needs to be adjusted.