Properly build binary gem extensions.
    
    Because the gem extensions were built in `%{buildroot}` they referred
    `BUILDROOT` directory, which would be under normal circumstances
    reported by RPM, but there was a bug in RPM due to changes in grep:
    
    https://github.com/rpm-software-management/rpm/issues/1968