ruby: don't reference groff if not being used (not used by default)

Fixes cross build by removing false dependency.

If this is needed again, be careful about *which* "groff" is needed.
(which in terms of build vs host)