Scrolling to a specific offset using SwiftUI ScrollView

I am trying to build a grid where the first column is static yet the first row is a pinned header (it scrolls horizontally except the top left item) and the grid below it also scrolls horizontally. The entire first row must be pinned though as the user scrolls. To accomplish this, I had to use two different scroll views yet I want the scroll views to scroll together identically. The 3 screenshots below should do a good job demonstrating what I am trying to accomplish. I don't think explicitly controlling the scroll view offset is possible yet in SwiftUI, or is there a way around this?