Create ML app seems to stop testing without error

I have a smallish image classifier I've been working on using the Create ML app. For a while everything was going fine, but lately, as the dataset has gotten larger, Create ML seems to stop during the testing phase with no error or test results.

You can see here that there is no score in the result box, even though there are testing started and completed messages:

No error message is shown in the Create ML app, but I do see these messages in the log:

default	14:25:36.529887-0500	MLRecipeExecutionService	[0x6000012bc000] activating connection: mach=false listener=false peer=false name=com.apple.coremedia.videodecoder
default	14:25:36.529978-0500	MLRecipeExecutionService	[0x41c5d34c0] activating connection: mach=false listener=true peer=false name=(anonymous)
default	14:25:36.530004-0500	MLRecipeExecutionService	[0x41c5d34c0] Channel could not return listener port.
default	14:25:36.530364-0500	MLRecipeExecutionService	[0x429a88740] activating connection: mach=false listener=false peer=true name=com.apple.xpc.anonymous.0x41c5d34c0.peer[1167].0x429a88740
default	14:25:36.534523-0500	MLRecipeExecutionService	[0x6000012bc000] invalidated because the current process cancelled the connection by calling xpc_connection_cancel()
default	14:25:36.534537-0500	MLRecipeExecutionService	[0x41c5d34c0] invalidated because the current process cancelled the connection by calling xpc_connection_cancel()
default	14:25:36.534544-0500	MLRecipeExecutionService	[0x429a88740] invalidated because the current process cancelled the connection by calling xpc_connection_cancel()
error	14:25:36.558788-0500	MLRecipeExecutionService	CreateWithURL:342: *** ERROR: err=24 (Too many open files) - could not open '<CFURL 0x60000079b540 [0x1fdd32240]>{string = file:///Users/kevin/Library/Mobile%20Documents/com~apple~CloudDocs/Binary%20Formations/Under%20My%20Roof/Core%20ML%20Training%20Data/Household%20Items/Output/2025.01.23_12.55.16/Test/Stove/Test480.webp, encoding = 134217984, base = (null)}'
default	14:25:36.559030-0500	MLRecipeExecutionService	Error: <private>
default	14:25:36.559077-0500	MLRecipeExecutionService	Error: <private>

Of particular interest is the "Too many open files" message from MLRecipeExecutionService referencing one of the test images.

There are a total of 2,555 test images, which I wouldn't think would be a very large set. The system doesn't seem to be running out of memory or anything like that.

Near the end of the test run there MLRecipeExecution service had 2934 file descriptors open according to lsof.

Has anyone else run into this or know of a workaround? So far I've tried rebooting and recreating the Create ML project.

Currently using Create ML Version 6.1 (150.3) on macOS 15.2 (24C101) running on a Mac Studio.

To rectify the problem, the testing set must have stopped at that particular dataset its referencing. If you can reshuffle the whole dataset and rerun, if it still reface the same data, then something is wrong with that particular dataset.Delete it and check it out.

If that doesn't work check your pipeline for bottleneck.

Create ML app seems to stop testing without error
 
 
Q