By splitting out the check for package.yaml into a separate check, we can avoid the constant massive shell reloads for the nix shell.