Or just download the wheel for manylinux (e.g. https://files.pythonhosted.org/packages/a1/c6/9ac4ae44c24c787a1738e5fb34dd987ada6533de5905a041aa6d5bea4553/pandas-1.1.1-cp36-cp36m-manylinux1_x86_64.whl) to your local machine, unzip it, rezip it as python.zip, then upload as layer.

There is no need to bother with Docker, because Amazon Linux downloads the same manylinux wheel.