So it seems I have a variant of the problem described in continuous WebJob stops automatically. The variation being that I have afforded to use Basic and set the site to Always On.
Still there are times when my webjob is shut down due to website shutting down, that's fine, but then the webjob does not start again. Not until I log into the Azure Management Portal and click the WebJobs Tab, at which time the webjob gets a "Starting" state and moments later it is "Running".
If you take a look at this excerpt from the log file you can see that at 19:16:31 all three instances have stopped (yes the website is set to have three instances so the webjob also has three instances, all fine). It should start up immediately again because the website started (not shown here but I have the Monitor Data from the Azure Portal showing me that requests came in later and that server errors were 0 (zero)). Only when I logged into the Portal in the morning (at 06:44:35) and actively selected the webjobs tab did the webjob start again, all three instances, all looks good.
[10/15/2015 14:02:21 > c260d5: SYS INFO] WebJob is still running
[10/15/2015 19:16:17 > c260d5: SYS INFO] WebJob is stopping due to website shutting down
[10/15/2015 19:16:18 > c260d5: SYS INFO] Status changed to Stopping
[10/15/2015 19:16:22 > fe23db: SYS INFO] WebJob is stopping due to website shutting down
[10/15/2015 19:16:22 > fe23db: SYS INFO] Status changed to Stopping
[10/15/2015 19:16:22 > c260d5: SYS INFO] Status changed to Success
[10/15/2015 19:16:22 > c260d5: SYS INFO] Status changed to Stopped
[10/15/2015 19:16:25 > fe23db: SYS INFO] Status changed to Success
[10/15/2015 19:16:25 > fe23db: SYS INFO] Status changed to Stopped
[10/15/2015 19:16:29 > a81043: SYS INFO] WebJob is stopping due to website shutting down
[10/15/2015 19:16:29 > a81043: SYS INFO] Status changed to Stopping
[10/15/2015 19:16:31 > a81043: SYS INFO] Status changed to Success
[10/15/2015 19:16:31 > a81043: SYS INFO] Status changed to Stopped
[10/16/2015 06:44:35 > c260d5: SYS INFO] Status changed to Starting
[10/16/2015 06:44:50 > c260d5: SYS INFO] Run script 'webjob' with script host - 'WindowsScriptHost'
[10/16/2015 06:44:50 > c260d5: SYS INFO] Status changed to Running
[10/16/2015 06:44:53 > c260d5: INFO] Found the following functions:
[10/16/2015 06:44:53 > c260d5: INFO] WebJob.Handler.HandlePossibleJobsFromJobQueue.PossibleJobArrived
[10/16/2015 06:44:53 > c260d5: INFO] Job host started
[10/16/2015 06:44:54 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:44:54 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:44:54 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:06 > a81043: SYS INFO] Status changed to Starting
[10/16/2015 06:45:07 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:07 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:07 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:08 > a81043: SYS INFO] Run script 'webjob' with script host - 'WindowsScriptHost'
[10/16/2015 06:45:08 > a81043: SYS INFO] Status changed to Running
[10/16/2015 06:45:10 > a81043: INFO] Found the following functions:
[10/16/2015 06:45:10 > a81043: INFO] WebJob.Handler.HandlePossibleJobsFromJobQueue.PossibleJobArrived
[10/16/2015 06:45:10 > a81043: INFO] Job host started
[10/16/2015 06:45:11 > a81043: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:11 > a81043: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:11 > a81043: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:12 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:12 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:13 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:15 > fe23db: SYS INFO] Status changed to Starting
[10/16/2015 06:45:15 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:15 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:15 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:17 > fe23db: SYS INFO] Run script 'webjob' with script host - 'WindowsScriptHost'
[10/16/2015 06:45:17 > fe23db: SYS INFO] Status changed to Running
[10/16/2015 06:45:19 > fe23db: INFO] Found the following functions:
[10/16/2015 06:45:20 > fe23db: INFO] WebJob.Handler.HandlePossibleJobsFromJobQueue.PossibleJobArrived
[10/16/2015 06:45:20 > fe23db: INFO] Job host started
[10/16/2015 06:45:19 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
[10/16/2015 06:45:20 > c260d5: INFO] Executing: 'HandlePossibleJobsFromJobQueue.PossibleJobArrived' because New queue message detected on 'jobqueue'.
So why is this happening? And how can I avoid this problem?