Some warning flags may cause errors during library detection code.  Do
the CFLAGS checks at the end.