Skip to content

Tracking lost with distance between individuals #3115

@ACarton-Leclercq

Description

@ACarton-Leclercq

Is there an existing issue for this?

  • I have searched the existing issues

Operating System

Windows 11

DeepLabCut version

3.0.0rc9

What engine are you using?

pytorch

DeepLabCut mode

multi animal

Device type

NVIDIA GeForce RTX 4070

Bug description 🐛

I trained dlcrnet-15 and a resnet50 models on >300 epochs with a training dataset of ~1500 frames (95/5) to track 2 identical animals. I enabled the keeping of identities because one of the animals always remains in close viscinity of the unique bodypart (cylinder).
Image

The models seem to accurately track the 2 animal although the mAP and mAR plateau at 70 - 75%, I found that a recurring error appears for all the models I benchmarked . When the mouse outside the cylinder (Expe) gets a bit further from the mouse inside (Stim) or from the cylinder (unique bodypart), the model loses it (see video bellow and poses plot)

Image
B1_F1_SFCDLC_Resnet50_DLC_DSISep17shuffle4_snapshot_080_el_id_p10_labeledshort.mp4

I purposefully added frames where the mice are close together to avoid identity switches and frames when they are distant from each other to avoid this issue but it persists.
I wonder if I set a parameter that biases the training somehow, please find attached my config.yaml file.

Steps To Reproduce

config.yaml

Relevant log output

Anything else?

No response

Code of Conduct

Metadata

Metadata

Assignees

Labels

howtousedlcissue regarding the use of DeepLabCut

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions