I have been having nothing but trouble with Xcode Server for an OS X Application and using UI testing. Every step of the way at doing anything is as painful as this problem.
Xcode 7.2, OS X 10.11.3. OS X Server 5.0.15.
I am currently stuck as I am getting the following response when running an integration:
"The integration didn't complete as expected due to an internal Xcode Server error."
I would like to have the option of creating a completely new bot to see if that is the issue, but it took me over 3 hours and a large number of attempts at getting my repository credentials to verify yesterday before I was able to configure the bot to select the correct branches from the different submodules within the project. This was not because I had invalid credentials, but problems with Xcode Server being able to validate ssh credentials when there are multiple submodules.
Prior to the above message coming up I was getting failures of my UI tests when running on the server. This was because a dialog was being shown that said that the XCTRunner application had unexpectedly quit (as seen in the screenshots captured by Xcode Server when running UI tests). I made some changes because I had noticed that if pre test action scripts configured in the scheme editor fail they can cause the XCTRunner application to unexpectedly quit. After making these changes this was followed up with the internal Xcode Server error message.
I have spent ages hunting around in the log files like in the directories /Library/Developer/XcodeServer/Logs without finding anything useful to help me resolve these issues.
If I run our non UI testing integrations on the server they are running without error. This appears to be an issue specific to running OS X UI tests as an integration.
I would really appreciate any suggestions or ideas as to what the problem is.
Kevin