python program doesnt stop once its built

Question

I start this program all.py

import subprocess
import os

scripts_to_run = ['AppFlatForRent.py','AppForSale.py','CommercialForSale.py','LandForSale.py','MultipleUnitsForSale.py','RentalWanted.py','RentCommercial.py','RoomsForRent.py','RoomsWanted.py','ShortTermDaily.py','ShortTermMonthly.py','VillaHouseForRent.py','VillaHouseForSale.py']


for s in scripts_to_run:
    subprocess.Popen(["python", os.path.join(os.getcwd(), s)])

Its running 13 programs at a time. The problem is that in the sublime - unlike other programs- this particular program doesnt cancel the built. it just keep running (I know because the program is inputting values in the database and it doesnt stop doing that)

I want it to be done via terminal.

any help?

Answer 1

To stop all child script, you could call .terminate(), .kill() methods:

import sys
import time
from subprocess import Popen

# start child processes
children = [Popen([sys.executable or 'python', scriptname])
            for scriptname in scripts_to_run]

time.sleep(30) # wait 30 seconds

for p in children:
    p.terminate() # or p.kill()

for p in children:
    p.wait() # wait until they exit

Answer 2

There are two approaches you can take.

The shell approach

If you only want to kill the child processes after the main app has finished but don't want the main app to handle this itself, for any reason (mostly its for debugging purposes), you can do it from the terminal:

   kill $(ps aux |grep -E 'python[[:space:]][[:alnum:]]+.py' |awk '{print $2}')  
             ▲     ▲                                      ▲            ▲  
             ║     ╚═══════════════════╦══════════════════╝            ║  
Get all ═════╝                         ║                               ║  
running                                ║                Get the second column  
processes                  Find all scripts executed         which is the PID 
                           by Python, ending with .py
                        (check Note 1 for more details)

Note 1: the regular expression in the upper example is just for demonstration purposes and it kills only scripts executed with a relative path like python script.py, but does not include processes like python /path/to/script.py. This is just an example, so make sure to adapt the regular expression to your specific needs.
Note 2: this approach is risky because it can kill unwanted applications, make sure you know what you are doing before using it.

The Python approach

The other approach offers more control, and is implemented in the main application itself. You can make sure that all child processes are exited when the main application ends by keeping track of all the processes you created, and killing them afterwards.

Example usage:
First change your process spawning code to keep the Popen objects of the running processes for later usage:

running_procs = []
for s in scripts_to_run:
    running_procs.append(
                  subprocess.Popen(["python", os.path.join(os.getcwd(), s)])
                        )

Then define the do_clean() function that will iterate through them and terminate them:

def do_clean():
    for p in running_procs:
        p.kill()

You can call this function manually whenever you wish to do this, or you can use the atexit module to do this when the application is terminating.

The atexit module defines a single function to register cleanup functions. Functions thus registered are automatically executed upon normal interpreter termination.

Note: The functions registered via this module are not called when the program is killed by a signal not handled by Python, when a Python fatal internal error is detected, or when os._exit() is called.

For example:

import atexit

atexit.register(do_clean)