Modal labs lets you run containerized Python code with GPUs.
First follow the Modal setup instructions found here.
1
Setting up your Image
Overeasy requires a few dependencies that are not available in the base Python image.
In addition, to reduce cold start times its recommended to cache model weights in your image.