Signed Command Line Tool Rejected by spctl

First up, spctl is not a great techniques for evaluating whether something will pass Gatekeeper. The approach I recommend is the one described in Testing a Notarised Product.

Second, why are you disabling library validation? The only good reason to do that is that your program loads plug-ins from other third-party developers. Is that the case here?

The reason this matters is that library validation makes it harder to pass Gatekeeper.

Finally, did you notarise your tool. You will need to do this if you want it to run on arbitrary user systems.

See Notarizing macOS Software Before Distribution for background on notarisation. The technique it describes won’t work for a command-line tool, so you’ll need something custom. See Customizing the Notarization Workflow for hints on that front.

Oh, and my Signing a Mac Product For Distribution post has a whole bunch of hints and tips about this overall issue.

Note that ultimately this tool gets distributed in a ZIP file that contains Windows and Linux executables also; there is not, and ought not be, any macOS-specific installer.

That’s fine. The only gotcha is that the user may not be able to double click the tool in the Finder to run it in Terminal. However, if the user runs the tool directly from Terminal, or from a shell script, everything will work out just fine.

Info.plist:

You can add an information property list to a command-line tool (by using the linker’s -sectcreate option to put it in the __TEXT / __info_plist section) but that’s generally not necessary. In most cases it’s fine to ship a command-line tool with no information property list.

I think that’ll be enough for you to make progress but, if you still can’t get it working, post a status update here and I’ll take another look.

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

Library validation was inadvertent, entitlements file pulled from something else. Wasn't notarized (Distracted by docs saying command line tools can't be notarized or stapled). This tool is always run from Terminal or as a service, never double-clicked.

I did this:

% zip -j mytool.zip .../mytool
% xcrun notarytool submit mytool.zip --keychain-profile "my profile" --wait
Successfully received submission info
  createdDate: 2021-12-09T15:20:09.725Z
  id: myid
  name: mytool.zip
  status: Accepted
% xcrun notarytool log --keychain-profile "my profile" myid
{
  "logFormatVersion": 1,
  "jobId": "myid",
  "status": "Accepted",
  "statusSummary": "Ready for distribution",
  "statusCode": 0,
  "archiveFilename": "mytool.zip",
  "uploadDate": "2021-12-09T15:20:11.851Z",
  "sha256": "9d9e6ce02881e78cb9c7a54560b18894a2b4b70716656d29573413cebba64be7",
  "ticketContents": [
    {
      "path": "mytool.zip/mytool",
      "digestAlgorithm": "SHA-256",
      "cdhash": "485e2c31245e1ba4975a05f46556c2f47497be96",
      "arch": "x86_64"
    },
    {
      "path": "mytool.zip/mytool",
      "digestAlgorithm": "SHA-256",
      "cdhash": "156a4fc6de8e02f25e39ed2999b781ca3d88ab2f",
      "arch": "arm64"
    }
  ],
  "issues": null
}

(No stapling as there is none for command line tools, AFAIK.) Now I cd to a test directory and cp .../mytool . then run mytool... Killed. Same error reporting etc as originally with no notarization. This is on my same machine that it won't even run!!! (It runs fine in the original directory that is was signed in --- in the build log there is RegisterExecutionPolicyException step, not sure exactly what controls/starts that.)

Checking the system log, there are entries for each mytool startup:

EXC_BAD_ACCESS (SIGKILL (Code Signature Invalid))
Exception Subtype: UNKNOWN_0x32 at 0x0000000104060000
Exception Codes: 0x0000000000000032, 0x0000000104060000
Exception Note:  EXC_CORPSE_NOTIFY
Termination Reason: CODESIGNING 2 

But the code signing is fine:

% codesign --verify --strict -vvvv --check-notarization ./mytool
./mytool: valid on disk
./mytool: satisfies its Designated Requirement

This stuff just drives me INSANE. Not only are there way too many tools and hoops involved, the diagnostics just aren't acceptable.

If the product is signed, notarised, and stapled correctly, everything should work. If not, you’ll need to investigate why Gatekeeper is unhappy (2), fix that, and then retest.

"Fix that" !!!!!! No! Just no! There MUST be a way for Gatekeeper/spctl to render an exact description of whether or not it will run something (apps, command line tools, ...) on arbitrary customer machines, immediately, right away, from the development machine, bypassing any caching or anything else. How many thousands of 3rd party developer days need to be lost for one Apple developer to spend a few days to update spctl to produce 100% accurate and useful messaging? For example, the messaging out of notarytool was very good! It told me which of the half-dozen hoops I had to jump through next (keychains! app-specific passwords!). It just takes too too long to do the research to figure out what to do at all, only to be confronted with an inexplicable error. $237billion a year, and developers have to guess? Apple can do better. Sorry for the rant but it is necessary.

the diagnostics just aren't acceptable.

I agree. We already have a bug on file requesting better diagnostics (r. 60626159), but you should feel free to file your own.

This tool is always run from Terminal or as a service, never double-clicked.

Cool.

It runs fine in the original directory that [it] was signed in

Hmmm, that’s interesting. Try this:

% cmp /path/to/that/original/copy /path/to/your/new/copy ; echo $?

Does that report any differences?

Checking the system log, there are entries for each mytool startup:

OK. That should generate a crash report. Please grab that and post it here. See Posting a Crash Report for advice on that.

But the code signing is fine:

Unfortunately codesign, like spctl, has only a limited view of the world and thus can’t diagnose all code signing problems )-: Still, while we’re on the subject of codesign, please run the following and post the results:

% codesign -d -vvv --entitlements :- /path/to/your/tool

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

The cmp shows they are identical. It works in its as-compiled location only because Xcode has filed an exception for it... it wouldn't and doesn't otherwise pass Gatekeeper.

The crash report here is basically the same no matter what I've done with signing, notarizing, or nothing... I think it's just showing that external Gatekeeper code is killing the process before it actually starts. I haven't removed anything from the crash report, that's all there is.

-------------------------------------
Translated Report (Full Report Below)
-------------------------------------

Incident Identifier: 6A8A249E-72D3-4E2C-ADCA-65F0E41501FD
CrashReporter Key:   4B45CD78-5467-EBB0-3368-53DFA26A984D
Hardware Model:      Macmini9,1
Process:             mytool [62116]
Path:                /Users/USER/*/mytool
Identifier:          mytool
Version:             ???
Code Type:           ARM-64 (Native)
Role:                Unspecified
Parent Process:      csh [642]
Coalition:           com.apple.Terminal [560]
Responsible Process: Terminal [584]

Date/Time:           2021-12-10 16:55:19.7498 -0500
Launch Time:         2021-12-10 16:55:19.6591 -0500
OS Version:          macOS 12.0.1 (21A559)
Release Type:        User
Report Version:      104

Exception Type:  EXC_BAD_ACCESS (SIGKILL (Code Signature Invalid))
Exception Subtype: UNKNOWN_0x32 at 0x0000000102214000
Exception Codes: 0x0000000000000032, 0x0000000102214000
VM Region Info: 0x102214000 is in 0x102214000-0x102334000;  bytes after start: 0  bytes before end: 1179647
      REGION TYPE                    START - END         [ VSIZE] PRT/MAX SHRMOD  REGION DETAIL
      UNUSED SPACE AT START
--->  mapped file                 102214000-102334000    [ 1152K] r-x/r-x SM=COW  ...t_id=eeb0b059
      mapped file                 102334000-102338000    [   16K] rw-/rw- SM=COW  ...t_id=eeb0b059
Exception Note:  EXC_CORPSE_NOTIFY
Termination Reason: CODESIGNING 2 

Highlighted by Thread:  0

Backtrace not available

No thread state (register information) available

Binary Images:
               0x0 - 0xffffffffffffffff ??? (*) <00000000-0000-0000-0000-000000000000> ???

Error Formulating Crash Report:
_dyld_process_info_create failed with 6
dyld_process_snapshot_get_shared_cache failed
Failed to create CSSymbolicatorRef - corpse still valid ¯\_(ツ)_/¯

EOF

-----------
Full Report
-----------

{"app_name":"mytool","timestamp":"2021-12-10 16:55:23.00 -0500","app_version":"","slice_uuid":"5efeeec6-25e5-3266-9c57-c75428333889","build_version":"","platform":0,"share_with_app_devs":0,"is_first_party":1,"bug_type":"309","os_version":"macOS 12.0.1 (21A559)","incident_id":"6A8A249E-72D3-4E2C-ADCA-65F0E41501FD","name":"mytool"}
{
  "uptime" : 500000,
  "procLaunch" : "2021-12-10 16:55:19.6591 -0500",
  "procRole" : "Unspecified",
  "version" : 2,
  "userID" : 501,
  "deployVersion" : 210,
  "modelCode" : "Macmini9,1",
  "procStartAbsTime" : 12193149772326,
  "coalitionID" : 560,
  "osVersion" : {
    "train" : "macOS 12.0.1",
    "build" : "21A559",
    "releaseType" : "User"
  },
  "captureTime" : "2021-12-10 16:55:19.7498 -0500",
  "incident" : "6A8A249E-72D3-4E2C-ADCA-65F0E41501FD",
  "bug_type" : "309",
  "pid" : 62116,
  "procExitAbsTime" : 12193151937003,
  "translated" : false,
  "cpuType" : "ARM-64",
  "procName" : "mytool",
  "procPath" : "\/Users\/USER\/*\/mytool",
  "parentProc" : "csh",
  "parentPid" : 642,
  "coalitionName" : "com.apple.Terminal",
  "crashReporterKey" : "4B45CD78-5467-EBB0-3368-53DFA26A984D",
  "responsiblePid" : 584,
  "responsibleProc" : "Terminal",
  "sip" : "enabled",
  "vmRegionInfo" : "0x102214000 is in 0x102214000-0x102334000;  bytes after start: 0  bytes before end: 1179647\n      REGION TYPE                    START - END         [ VSIZE] PRT\/MAX SHRMOD  REGION DETAIL\n      UNUSED SPACE AT START\n--->  mapped file                 102214000-102334000    [ 1152K] r-x\/r-x SM=COW  ...t_id=eeb0b059\n      mapped file                 102334000-102338000    [   16K] rw-\/rw- SM=COW  ...t_id=eeb0b059",
  "isCorpse" : 1,
  "exception" : {"codes":"0x0000000000000032, 0x0000000102214000","rawCodes":[50,4330700800],"type":"EXC_BAD_ACCESS","signal":"SIGKILL (Code Signature Invalid)","subtype":"UNKNOWN_0x32 at 0x0000000102214000"},
  "termination" : {"namespace":"CODESIGNING","flags":0,"code":2},
  "vmregioninfo" : "0x102214000 is in 0x102214000-0x102334000;  bytes after start: 0  bytes before end: 1179647\n      REGION TYPE                    START - END         [ VSIZE] PRT\/MAX SHRMOD  REGION DETAIL\n      UNUSED SPACE AT START\n--->  mapped file                 102214000-102334000    [ 1152K] r-x\/r-x SM=COW  ...t_id=eeb0b059\n      mapped file                 102334000-102338000    [   16K] rw-\/rw- SM=COW  ...t_id=eeb0b059",
  "extMods" : {"caller":{"thread_create":0,"thread_set_state":0,"task_for_pid":0},"system":{"thread_create":0,"thread_set_state":988,"task_for_pid":6},"targeted":{"thread_create":0,"thread_set_state":0,"task_for_pid":0},"warnings":0},
  "usedImages" : [
  {
    "size" : 0,
    "source" : "A",
    "base" : 0,
    "uuid" : "00000000-0000-0000-0000-000000000000"
  }
],
  "legacyInfo" : {
  "threadHighlighted" : 0
},
  "trialInfo" : {
  "rollouts" : [
    {
      "rolloutId" : "60da5e84ab0ca017dace9abf",
      "factorPackIds" : {

      },
      "deploymentId" : 240000008
    },
    {
      "rolloutId" : "607844aa04477260f58a8077",
      "factorPackIds" : {
        "SIRI_MORPHUN_ASSETS" : "6103050cbfe6dc472e1c982a"
      },
      "deploymentId" : 240000066
    },
    {
      "rolloutId" : "601d9415f79519000ccd4b69",
      "factorPackIds" : {
        "SIRI_TEXT_TO_SPEECH" : "6194416dea7ed64a7812a429"
      },
      "deploymentId" : 240000322
    },
    {
      "rolloutId" : "5fc94383418129005b4e9ae0",
      "factorPackIds" : {

      },
      "deploymentId" : 240000174
    },
    {
      "rolloutId" : "602ad4dac86151000cf27e46",
      "factorPackIds" : {
        "SIRI_DICTATION_ASSETS" : "61ae8d06da72d16a4beb762e"
      },
      "deploymentId" : 240000290
    },
    {
      "rolloutId" : "5ffde50ce2aacd000d47a95f",
      "factorPackIds" : {

      },
      "deploymentId" : 240000081
    }
  ],
  "experiments" : [

  ]
},
  "reportNotes" : [
  "_dyld_process_info_create failed with 6",
  "dyld_process_snapshot_get_shared_cache failed",
  "Failed to create CSSymbolicatorRef - corpse still valid ¯\\_(ツ)_\/¯"
]
}

Here's what I get from codesign:

% codesign -d -vvv --entitlements :- /Code/project/macOS/mytool
Executable=/Users/frustrated/Code/project/macOS/mytool
Identifier=com.myorg.mytool
Format=Mach-O universal (x86_64 arm64)
CodeDirectory v=20500 size=10271 flags=0x10000(runtime) hashes=310+7 location=embedded
Hash type=sha256 size=32
CandidateCDHash sha256=40b0eb4b737a4d4c2fa86558e5a07ede4c1bb907
CandidateCDHashFull sha256=40b0eb4b737a4d4c2fa86558e5a07ede4c1bb9073f041403a7ce64113f891853
Hash choices=sha256
CMSDigest=40b0eb4b737a4d4c2fa86558e5a07ede4c1bb9073f041403a7ce64113f891853
CMSDigestType=2
CDHash=40b0eb4b737a4d4c2fa86558e5a07ede4c1bb907
Signature size=8951
Authority=Developer ID Application: My Org (G00BLEDY)
Authority=Developer ID Certification Authority
Authority=Apple Root CA
Timestamp=Dec 10, 2021 at 4:51:18 PM
Info.plist entries=19
TeamIdentifier=G00BLEDY
Runtime Version=12.0.0
Sealed Resources=none
Internal requirements count=1 size=180
Warning: Specifying ':' in the path is deprecated and will not work in a future release
<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE plist PUBLIC "-//Apple//DTD PLIST 1.0//EN" "https://www.apple.com/DTDs/PropertyList-1.0.dtd"><plist version="1.0"><dict><key>com.apple.security.automation.apple-events</key><true/></dict></plist>
 

Note that the embedded requirements have been fixed (needs apple-events to open things in the browser on occasion). The spctl -a -v --raw output is still the same. I've seen more transparent bricks.

The cmp shows they are identical.

Good.

It works in its as-compiled location only because Xcode has filed an exception for it... it wouldn't and doesn't otherwise pass Gatekeeper.

Is that comment based on the RegisterExecutionPolicyException build step. If so, be aware that last time I checked this was effectively a no-op. It demonstrates that Xcode is calling through to the Execution Policy framework but that currently has no impact on how system policy is enforced.

Here's what I get from codesign:

Thanks. This looks good.

Note that com.apple.security.automation.apple-events has the com.apple.security. prefix, and thus can be used by any code without being authorised by a provisioning profile. So, whatever is causing this problem it isn’t entitlements.

I haven't removed anything from the crash report, that's all there is.

Thanks for posting the whole log.

My best guess right now is that you’re being bitten by the issue discussed in Updating Mac Software. A good way to test this theory is to restart your Mac. Does that fix the problem?

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"

OK I had a nice response here but the forum timed me out after <2 hours and routed me to an error page and killed it with no recovery. How I hate that.

Synopsis: Thanks for pointing out the document and behavior. This is clearly a time-wasting gatekeeper bug. By definition, cache misses cause fetches to backing stores; gatekeeper must revalidate. The document's existence is self-incriminating. I've filed FB9807456 on it. Developers! Developers! Developers!

I've filed FB9807456 on it.

Thanks!

It’s actually super useful for me because your bug has been marked as a dup of the current lead bug tracking this issue, a bug that I hadn’t previously seen.

Share and Enjoy
—
Quinn “The Eskimo!” @ Developer Technical Support @ Apple
let myEmail = "eskimo" + "1" + "@" + "apple.com"