Disable autograding on first commit after clone

Hi! We just started experimenting with autograding and github classroom. Looks really promising but we ran into a few kinks/strange behaviour.

When we create a assignment for students and they accept it and their repo is created, it always runs the autograding automatically and it fails.
Is there a way to stop it from autograding on repo creation and only after the students do their first commit?