igraph: Only build and test x86_64-linux.

aarch64-linux tests fail on the community builder, so don't build there
until we have more evidence that failing tests are not a problem.