Still being asked to allow keychain access even when allowing all applications to access item.

During our build process for our mac exe, there is a point where we run our newly built executable as a test. This executable tries to access the login keychain as part of our test. On the particular keychain item it is trying to access, we have selected to "Allow all applications to access this item". Even with this enabled, every new build and run of this exe is prompting that we "Allow Access" for this exe to access the keychain item.

This requires manual intervention for each new build to continue running. Any ideas as to what we can do to stop the prompting? We can avoid accessing the keychain during this test process, but I'd rather not remove testing that we have been doing for a years.

For background, this started a few weeks ago and was not a problem until recently. We also don't do any code signing of the exe in this process.