buildGoPackage: do not remove Go references if allowGoReferences is true

allowGoReference was only checked for disallowedReferences definition,
but the fixup of all output binaries removing references to the compiler
did not take this setting into account.