Updating certificates for Heroku with Cloudflare

Do you have a app on Heroku, DNS on Cloudflare and your SSL certificate is automatically managed by Heroku?

I do. And yesterday I received email like this:

Hi,

Automated Certificate Management
has failed for the following domains:

Domain 	    ...