In short: after a while of inactivity, the application running your website/API is shut down. It will only start back up as soon as a new request comes in, but the initial start takes some time.
if your site doesn’t keep being viewed, your application pool may recycle, and that important visitor number 1 gets screwed waiting as your site rebuilds or your app pool to fire up.
Source: Keep your ASP.Net websites warm and fast 24/7
In Azure, make sure to enable Always On. This is a setting that helps prevent slow startups of web applications:
By default, web apps are unloaded if they are idle for some period of time. This lets the system conserve resources. In Basic or Standard mode, you can enable Always On to keep the app loaded all the time. If your app runs continuous WebJobs or runs WebJobs triggered using a CRON expression, you should enable Always On, or the web jobs may not run reliably.
Source: Configure web apps in Azure App Service