I don't think that's required. The linker driver will use LTO automatically if the object files it's given contain LTO IR.

If anything you might want to explicitly do -fno-lto to not use LTO when you have fat objects.