Running separate infinite background thread in a python webapp (fastapi/flask/django)

Question

How can i launch an application which does below 2 things:

Expose rest endpoint via FastAPI.
Run a seperate thread infintely (rabbitmq consumer - pika) waiting for request.

Below is the code through which i am launching the fastAPI server. But when i try to run a thread, before execution of below line, it says coroutine was never awaited.

How can both be run parallely?

The error you are seeing is because you are not awaiting a `coroutine` — Irfanuddin, Feb 08 '22 at 08:47
The answer from https://stackoverflow.com/questions/70872276/fastapi-python-how-to-run-a-thread-in-the-background/70873984#70873984 is work for me. — chilin, Jul 20 '22 at 03:22

score 0 · Answer 1 · answered Feb 08 '22 at 08:36

0

Maybe this is not the answer you are looking for. There is a library called celery that makes multithreading easy to manage in python.

Check it out: https://docs.celeryproject.org/en/stable/getting-started/introduction.html

answered Feb 08 '22 at 08:36

Marco Amato

42
2

score 0 · Answer 2 · answered Feb 08 '22 at 08:56

import asyncio
from concurrent.futures import ThreadPoolExecutor
from fastapi import FastAPI
import uvicorn

app = FastAPI()


def run(corofn, *args):
    loop = asyncio.new_event_loop()
    try:
        coro = corofn(*args)
        asyncio.set_event_loop(loop)
        return loop.run_until_complete(coro)
    finally:
        loop.close()


async def sleep_forever():
    await asyncio.sleep(1000)


#
async def main():
    loop = asyncio.get_event_loop()
    executor = ThreadPoolExecutor(max_workers=2)
    futures = [loop.run_in_executor(executor, run, sleep_forever),
               loop.run_in_executor(executor, run, uvicorn.run, app)]
    print(await asyncio.gather(*futures))


if __name__ == '__main__':
    loop = asyncio.get_event_loop()
    loop.run_until_complete(main())

Note: This may hinder your FastAPI performance. Better approach would be to use a Celery Task

Running separate infinite background thread in a python webapp (fastapi/flask/django)

2 Answers2