Proper use of Sandbox test account in testing lifecycle?

We have an application where there is a high frequency of build cycles. We wish to run automated tests where the “Sandbox user” will be able to load the next version of the app (from Test Flight?) and iterate the tests.

We’re at the point where we can test this “one version” at a time, so we have Apple Pay Sandbox configurations working at least one build cycle at a time.

Where we are now is the following process:

  1. Build the app, push to App Store Connect, make app available via test flight to the developer account members
  2. One member pulls the build to their iOS device via test flight
  3. same user logs out of their Apple ID on their iOS device, logs back in using the SANDBOX TEST user account
  4. Sandbox user on same iOS device now loads the test cards in the wallet
  5. Sandbox user launches app, tests application
  6. device user now logs out of the device from their Sandbox user account, logs back into the device with their Apple ID Developer account.
  7. on next build, go back to step 1

What we would like to see is:

  1. Take an iOS Test Device, log into the device with the SANDBOX USER account, loads Test cards to wallet
  2. TestFlight notifies user of new build, SANDBOX USER loads new build
  3. Sandbox user runs tests
  4. Sandbox user waits for next build.

Are we doing the right thing? Is anyone else doing this? Comments please

Thanks

It looks like the difference between your current process and the process you would like is that you are signing in and out of test accounts and real accounts and would like to only stay signed into the test account. If you are using a Sandbox test environment and have a specific set of devices dedicated to Sandbox testing, and the users on these devices are configured in App Store Connect, what is the issue with leaving these test devices signed in as test users when a new version of your app is deployed on TestFlight?

Matt Eaton
DTS Engineering, CoreOS
meaton3@apple.com
Proper use of Sandbox test account in testing lifecycle?
 
 
Q