Celery on AWS ECS - the art of background tasks & continuous deployment
3:25pm - 3:50pm on Saturday, October 7Jan Giacomelli
Description
This talk presents techniques, approaches, and practical configuration examples that allow you to run your Celery workers on top of AWS ECS with Fargate. It starts by presenting the problems you encounter when dealing with async tasks. Next, we’ll take a look at ECS and its configuration examples - which parameters to tweak to achieve the best result. After that, we’ll check Celery configuration examples that comply with ECS requirements. We’ll finish by overviewing techniques for implementing tasks in a way that supports ECS + Celery configuration while allowing zero downtime deploying all the time.