Move the minor aarch64-specific logic to a dedicated variable so we can merge its configure logic up a level.
Mike Frysinger