Skip to content
Merged
Changes from 1 commit
Commits
Show all changes
112 commits
Select commit Hold shift + click to select a range
4729ef3
Added inference code for incoming super models
yeshaokai Oct 14, 2022
ea9efc8
handled empty prediction in multiple scale prediction. Formatting
yeshaokai Oct 15, 2022
d638d70
Update deeplabcut/pose_estimation_tensorflow/predict_supermodel.py
MMathisLab Oct 20, 2022
636fbce
Update deeplabcut/pose_estimation_tensorflow/predict_supermodel.py
MMathisLab Oct 20, 2022
eb70f2f
Update deeplabcut/pose_estimation_tensorflow/predict_supermodel.py
yeshaokai Oct 21, 2022
020cfce
Update deeplabcut/pose_estimation_tensorflow/predict_supermodel.py
yeshaokai Oct 21, 2022
da2bb80
fixed DLCscorer in make_label_video for suffix
yeshaokai Oct 21, 2022
6bc0593
Added example document. Added top down inference
yeshaokai Oct 21, 2022
f8a5385
Fixed previous commit
yeshaokai Oct 21, 2022
45763fc
Made the scorer convetion include DLC_
yeshaokai Oct 31, 2022
329ae73
handled the case where one of topdown prediction gives empty prediction
yeshaokai Oct 31, 2022
ff2f6db
first docs started
MMathisLab Nov 6, 2022
f26f6fd
Update _toc.yml
MMathisLab Nov 6, 2022
28aa5cf
Merge pull request #1 from DeepLabCut/master
yeshaokai Nov 7, 2022
fe8b694
change scale_list nonoptional
yeshaokai Nov 7, 2022
e33b6c5
Added functional test script and api docs
yeshaokai Nov 7, 2022
227ad23
Fixed a formatting
yeshaokai Nov 7, 2022
bc57bd9
safer way to parse num_kpts
yeshaokai Nov 10, 2022
dc62f36
Made the superanimal inference simpler
yeshaokai Nov 11, 2022
e76c5af
Simplify the API and added more docs
yeshaokai Nov 11, 2022
7277182
changed the relative path in the rst file
yeshaokai Nov 11, 2022
1625057
Fixed circular import
yeshaokai Nov 11, 2022
136572a
Fixed known issue
yeshaokai Nov 15, 2022
dacbf37
Merge branch 'super_model_inference' of github.com:yeshaokai/DeepLabC…
yeshaokai Nov 15, 2022
7d7a023
Further getting rid of the dependency on config for inference
yeshaokai Nov 29, 2022
87ce73c
make_labeled_video takes superanimal_name now
yeshaokai Nov 29, 2022
9f17361
Update docs/ModelZoo.md
yeshaokai Nov 30, 2022
455c3f4
Merge branch 'DeepLabCut:main' into super_model_inference
yeshaokai Nov 30, 2022
c42e2e0
Cleanup and removal of bbox file
jeylau Dec 1, 2022
f88e460
Minor fixes
jeylau Dec 2, 2022
fb276b9
Run black and isort
jeylau Dec 2, 2022
0d55fb6
Remove unused variables
jeylau Dec 2, 2022
b116d61
Get rid of the additional VideoWriter
jeylau Dec 2, 2022
a8b6d7f
Fix test
jeylau Dec 2, 2022
c008b8b
Hide _video_inference from high-level API
jeylau Dec 2, 2022
a52709d
Add test_get_multi_scale_frames
jeylau Dec 2, 2022
794b875
Clean configs
jeylau Dec 7, 2022
500b90b
Accelerate pandas's code
jeylau Dec 7, 2022
7b978dd
Test projection back to original image size
jeylau Dec 7, 2022
0ef2224
Merge pull request #2014 from yeshaokai/super_model_inference
jeylau Dec 7, 2022
b57f638
Faster DataFrame creation
jeylau Dec 12, 2022
11c9214
Remove tools folder
jeylau Dec 14, 2022
69dd13a
Add dlclibrary for model download from zoo
jeylau Dec 14, 2022
a61aca8
also remove old weight download function
AlexEMG Dec 14, 2022
8de3260
Add dlclibrary to setup.py
jeylau Dec 15, 2022
3387f37
Merge remote-tracking branch 'official/add_dlclib_in' into develop
yeshaokai Dec 20, 2022
660a772
Added modelzoo folder
yeshaokai Nov 29, 2022
ed8867d
removed domain matcher for now
yeshaokai Nov 29, 2022
d77a9b3
fix last commit
yeshaokai Nov 29, 2022
c247499
Users define threshold and pcutoff for adaptation api
yeshaokai Nov 29, 2022
1d09dec
Added documentation. Only keep the without project way of using the api
yeshaokai Nov 29, 2022
c8a0eb6
Now video adaptation code uses video reader for training
yeshaokai Dec 7, 2022
b445057
reformatting
yeshaokai Dec 12, 2022
4697459
Update deeplabcut/modelzoo/apis/spatiotemporal_adapt.py
yeshaokai Dec 12, 2022
4030a9d
Update deeplabcut/modelzoo/apis/spatiotemporal_adapt.py
yeshaokai Dec 12, 2022
f135132
Update deeplabcut/modelzoo/apis/spatiotemporal_adapt.py
yeshaokai Dec 12, 2022
bec4bf8
Remove unused imports
jeylau Dec 13, 2022
3d08cfe
Remove duplicate code
jeylau Dec 13, 2022
8a7ce5e
Fixed unused threshold
yeshaokai Dec 13, 2022
69fb761
Avoid hardcoding supermodel names
jeylau Dec 13, 2022
9ceecf5
Add missing `vid` attribute
jeylau Dec 13, 2022
946c663
Delay import
jeylau Dec 13, 2022
5bd8c73
Add missing attribute
jeylau Dec 13, 2022
2a0d1cc
Add video adaptation to GUI
jeylau Dec 13, 2022
782c8a6
Update branch name to "main" in GitHub's CI workflow (#2089)
jeylau Dec 15, 2022
ca2d86a
inference api and adaptation api work with hugging face weights
yeshaokai Dec 20, 2022
5a20224
minor update
yeshaokai Dec 20, 2022
f525621
trying to avoid circular import
yeshaokai Dec 20, 2022
ddcd6e5
WIP fixing previous commit
yeshaokai Dec 20, 2022
de14948
fixed logic for getting image shape for video adaptation
yeshaokai Dec 20, 2022
f41fc04
smaller batch sizes in train configs
yeshaokai Dec 20, 2022
09e8b37
fix the path after enforcing abs path
yeshaokai Dec 21, 2022
4877e77
Added colab example
yeshaokai Dec 21, 2022
b4b3356
adaptation api takes kwargs
yeshaokai Dec 21, 2022
b30797f
updated docstring for inference code
yeshaokai Dec 22, 2022
7edc5c2
Update ModelZoo.md
MMathisLab Dec 23, 2022
d45da22
Add dlclibrary for model download from zoo (#2088)
jeylau Dec 22, 2022
6694719
Backwards comp
jeylau Dec 23, 2022
dc88466
Add some multi-animal defaults
jeylau Dec 23, 2022
6d26f4b
Add a missing parameter
jeylau Dec 23, 2022
d05e95c
Add empty paf graph
jeylau Dec 23, 2022
62e3179
Change dataset_type to single-animal
jeylau Dec 23, 2022
456b5e2
Merge branch 'develop' into data-and-api
jeylau Dec 23, 2022
f8ea42d
Merge pull request #2078 from yeshaokai/data-and-api
jeylau Dec 23, 2022
e3a5735
Update ModelZoo.md
MMathisLab Jan 3, 2023
60ef6b1
Merge branch 'main' into develop
jeylau Jan 9, 2023
19ee928
Minor fixes
jeylau Jan 9, 2023
c56b396
Video adaptation api (up to date) (#2116)
yeshaokai Jan 19, 2023
f8ba071
Fix imports
jeylau Jan 20, 2023
61d7942
Fix multiprocessing RuntimeError
jeylau Jan 20, 2023
5755f74
Fix model zoo GUI tab
jeylau Jan 20, 2023
15eec56
Fix typo
jeylau Jan 20, 2023
25e6ffd
Fix custom config path
jeylau Jan 20, 2023
a67631b
Test video adaptation on a shorter video
jeylau Jan 20, 2023
d68274d
Avoid empty folder creation if not adapting
jeylau Jan 20, 2023
a4a6318
Remove unused apply_filter flag
jeylau Jan 20, 2023
9c77988
Avoid multiprocessing when started with spawn
jeylau Jan 20, 2023
139caf9
Fix hardcoded paths
jeylau Jan 20, 2023
d1599e1
Option to pass in display and saveiters
jeylau Jan 20, 2023
5ad8a94
Merge branch 'main' into develop
jeylau Jan 20, 2023
f28425c
Append video analysis success
jeylau Jan 24, 2023
bd6fdee
Silence numpy RuntimeWarnings
jeylau Jan 24, 2023
0badf69
Add Colab example and form fields
jeylau Jan 24, 2023
9ea54ab
30x speedup of averaging over multiple scales
jeylau Jan 24, 2023
eed366e
Add Open in Colab badge
jeylau Jan 25, 2023
0eef655
Minor change
jeylau Jan 25, 2023
41ad473
Use newer API in modelzoo's GUI tab
jeylau Jan 25, 2023
e9ed866
Add trajectory plotting to superanimal inference
jeylau Jan 27, 2023
fe0d077
Update spatiotemporal_adapt.py
jeylau Jan 27, 2023
3b58aac
Rename variable
jeylau Jan 27, 2023
64979bc
Add tools directory back in
jeylau Mar 7, 2023
259db76
Merge branch 'main' into develop
jeylau Mar 7, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
change scale_list nonoptional
  • Loading branch information
yeshaokai committed Nov 7, 2022
commit fe8b694021fd4ebb25385d411768d272310a9458
7 changes: 3 additions & 4 deletions deeplabcut/pose_estimation_tensorflow/predict_supermodel.py
Original file line number Diff line number Diff line change
Expand Up @@ -138,16 +138,16 @@ def video_inference_topdown(
D = predict.predict_batched_peaks_and_costs(
test_cfg, cropped_frame, sess, inputs, outputs
)

if len(D) != 0:
# stripping the batch dimension
# stripping the batch dimension
preds.append(D[0])
else:
preds.append([])
# only do this when animal is detected
preds = _topdown_reverse_transformation(preds, _bbox, num_kpts)

PredicteData["frame" + str(counter).zfill(strwidth)] = preds

if counter>= nframes:
break
counter+=1
Expand Down Expand Up @@ -311,7 +311,7 @@ def get_nuances(
return ret


def get_multi_scale_frames(frame, scale_list=[]):
def get_multi_scale_frames(frame, scale_list):
augs = []
shapes = []
for scale in scale_list:
Expand Down Expand Up @@ -458,7 +458,6 @@ def video_inference(
_frame = cap.read_frame()
if _frame is not None:
frame = img_as_ubyte(_frame)

if invert_color:
frame = 255 - frame

Expand Down