After changing your app's provisioning profile, the Ship Addon fails. Typically the logs show a 500 internal server error.
Ship is currently in beta and we're still working out the bugs. In this case, there's a known issue where Ship will continue to search for the old provisioning profile even after the new one is uploaded.
If you encounter this issue, please contact support. We can resolve it for you in our backend systems.