Revert "Run fedora-flags test on all architectures"
    
    This reverts commit bd66e3d65af3d1c350789b1b706c0fd4237f8f54.
    
    This test is wrong, because it tests the current version of clang
    from rawhide and not from the build being tested.