iOS 15 / Xcode 13 slows app down because of UIFocusSystem?

I have attached an image of Time Profiler of areas where the app hangs for 5-6 seconds at a time.

It happens in certain view controller (UIViewController) that has UICollectionView with UICollectionViewDiffableDataSource. Nothing else fancy going on here. Other view controllers with exact same or very similar set up in terms of layout and all are completely fine, but it's just this specific view controller always hangs whenever I tap on the collection view cell, invoking didSelectItemAt

This issue happens with Xcode 13.0 and 13.1 RC.

I have tried deleting all derived data/cached folder/ etc etc.