How to prevent Xcode builds Swift packages for all arches except using Debug configuration?

In Debug configuration, Xcode builds the packages for the currently active arch only. But if we create extra configuration by cloning Debug, those schemes make Xcode builds the packages for all architectures. It seems like Xcode misleading that the scheme is for release.

How to specify the option to build for active arch only, like Xcode build settings ONLY_ACTIVE_ARCH?