Summary: GitHub only issues one push event for multiple commits. This causes things to behave weirdly. My action now looks for a commit with a certain message and runs the subsequent steps on it. If there's more than one matching commit, it uses the last one. Not great, not terrible. Pull Request resolved: https://github.com/facebook/flipper/pull/1678 Test Plan: Ran it on my fork: https://github.com/passy/flipper-1/actions/runs/360332680 Reviewed By: nikoant Differential Revision: D24955986 Pulled By: passy fbshipit-source-id: 6dcbe11e69bf77c803e3907ced3185ca85483ec8