Excessive ressource usage with NavigationLinks in LazyVStack

When a large number of NavigationLinks is within a LazyVStack (or LazyVGrid), ressource usage gets higher (and stays high) the further a user scrolls down.

A simple example to reproduce this:

NavigationStack {
    ScrollView {
        LazyVStack {
            ForEach(0..<5000) { number in
                NavigationLink(value: number) {
                    Text("Number \(number)")
                }
            }
        }
    }
    .navigationDestination(for: Int.self) { number in
        Text("Details for number \(number)")
    }
}

List does not exhibit this behavior but is not suitable for my use case.