groff: explicitly disable X11 support in configure to avoid impure builds

Without this flag, the configure script will find /usr/X11 on host system and
assume that it can build with X11 support.