I've created a test plan that includes the below configurations.
{"configurations": [{
...
"options": {
"defaultTestExecutionTimeAllowance" : 60,
"maximumTestExecutionTimeAllowance" : 60,
"testTimeoutsEnabled" : true
}],
"defaultOptions": {
"defaultTestExecutionTimeAllowance" : 60,
"maximumTestExecutionTimeAllowance" : 60,
"testTimeoutsEnabled" : true,
....
}
...
}
If I write a test that intentionally will take longer than 60 seconds, executing the test locally fails as expected with the error message Test exceeded execution time allowance of 1 minute
let app = XCUIApplication()
app.launch()
let missingButton = app.buttons.firstMatch
XCTAssertTrue(missingButton.waitForExistence(timeout: 120), "When a timeout is > 60 seconds, the default max setting of 60 seconds is still enforced")
However, when this test is run using this test plan in XCode Cloud, it reports that it took 124 seconds to run and there is no message about exceeding execution time allowance.
How can the test step be configured in XCode Cloud to ensure that the execution time allowances are respected?
