Create ML activity training problem

Question

corle OP

Created Apr ’23

Replies 1

Boosts 0

Views 1.2k

Participants 2

Hi everyone!

I’m trying to train an activity classification model with 3 classes. The problem is that only one class has precision and recall > 0 after training. Screenshot 2023-04-29 at 21.54.41.png Even with 2 classes result is the same First I’d thought that there is a problem with my data but when I switched “left” label to “right” and vice versa the results were the same: only “left”-labeled data get non-zero precision and recall.

Screenshot 2023-04-29 at 21.55.04.png

Boost

Answer 1

OP

Apple

Aug ’23

So what's happening in all 3 cases is that your model is predicting "left" 100% of the time. This gives you a recall of 100% for that class only! So it's not a great model, because there's no separation between the different classes. It has an okay F1 score because it's really good at telling you that all left examples are left, but it's not really useful. Would you be able to provide some of the training data to take a closer look at? There's a couple different things that could be happening:

The model hasn't trained long enough to be useful
There isn't enough data, and/or the data doesn't have enough to distinguish between left and right (or other). If they're hard to tell apart, it may be more difficult to get an accurate model.
You've found a bug! The data will help us determine if this is the case so that we can fix it.

0