CV4Animals: Computer Vision for Animal Behavior Tracking and Modeling

In conjunction with Computer Vision and Pattern Recognition 2021

12:00pm - 4:40pm Pacific Time, June 25

In Poster Session hosted by Gatherly, you can locate the paper using Paper ID.

Accepted Papers (Track I: Unpublished Work)

  • Paper ID 1: Optical Mouse: 3D Mouse Pose From Single-View Video, Bo Hu (Google); Shan Yang (Google); David A Ross (Google); Avneesh Sud (Google); Graham Ruby (Calico); Yi Liu (Calico); Bryan Seybold (Google)

  • Paper ID 2: SyDog: A Synthetic Dog Dataset for Improved 2D Pose Estimation, Moira C Shooter (University of Surrey); Charles Malleson (University of Surrey); Adrian Hilton (University of Surrey)

  • Paper ID 3: Evaluation of Semi-supervised Visual Object Tracking Methods For Fully Autonomous In-situ, Tagless Tracking of Marine Animals, Levi Cai (Woods Hole Oceanographic Institution and Massachusetts Institute of Technology); Yogesh Girdhar (WHOI / Samsung Research)

  • Paper ID 4: DynaDog+T: A Parametric Animal Model for Synthetic Canine Image Generation, Jake C Deane (University of Bath); Darren Cosker (University of Bath); Sinead Kearney (University of Bath); Kwang In Kim (UNIST)

  • Paper ID 5: Learning to Regress 3D Animal Shape and Pose from Images using a Single 3D Exemplar, Silvia Zuffi (IMATI-CNR); Nadine Rueegg (Max Planck Institute for Intelligent Systems); Angjoo Kanazawa (University of California Berkeley); Konrad Schindler (ETH Zurich); Michael J. Black (Max Planck Institute for Intelligent Systems)

  • Paper ID 6: Interpreting Expert Annotation Differences in Animal Behavior, Megan M Tjandrasuwita (Caltech); Jennifer J. Sun (Caltech); Ann Kennedy (Northwestern University); Swarat Chaudhuri (The University of Texas at Austin); Yisong Yue (Caltech)

  • Paper ID 7: Adaptive Algorithms for Bottom-up Animal Pose Estimation, Jessy Lauer (EPFL); Mu Zhou (University of Tsukuba); Shaokai Ye (EPFL); Mackenzie Mathis (EPFL); Alexander Mathis (EPFL)

  • Paper ID 8: hSMAL: Detailed Horse Shape and Pose Reconstruction for Motion Pattern Recognition, Ci Li (KTH Royal Institute of Technology); Nima Ghorbani (Max Planck Institute for Intelligent Systems Tübingen); Sofia Broomé (KTH Royal Institute of Technology); Maheen Rashid (Univrses AB); Michael J. Black (Max Planck Institute for Intelligent Systems); Elin Hernlund (Swedish University of Agricultural ScieDYnces); Hedvig Kjellström (KTH Royal Institute of Technology); Silvia Zuffi (IMATI-CNR)

  • Paper ID 9: Weakly Supervised Keypoint Discovery for Animals, Serim Ryou (California Institute of Technology); Pietro Perona (California Institute of Technology)

  • Paper ID 10: Towards Self-Supervision for Video Identification of Individual Holstein-Friesian Cattle: The Cows2021 Dataset, Jing Gao (University of Bristol); Tilo Burghardt (University of Bristol); William Andrew (Condense Reality); Andrew W Dowsey (University of Bristol); Neill Campbell

  • Paper ID 11: Image-to-Image Translation of Synthetic Samples for Rare Classes, Edoardo M Lanzini (Delft University of Technology); Sara M Beery (Caltech)

  • Paper ID 12: Can Poachers Find Animals from Public Camera Trap Images?, Sara M Beery (Caltech); Elizabeth Bondi (Harvard University)

  • Paper ID 13: Quantifying Bird Skeletons, Zhizhuo Zhou (University of Michigan); gemmechu mohammed (AAit); Brian Weeks (University of Michigan); David Fouhey (University of Michigan)

  • Paper ID 14: Spatio-Temporal Event Segmentation for Wildlife Extended Videos, Ramy A Mounir (University of South Florida); Roman Gula (Museum and Institute of Zoology of the Polish Academy of Sciences); Jörn Theuerkauf (Museum and Institute of Zoology of the Polish Academy of Sciences); Sudeep Sarkar (University of South Florida, Tampa)

  • Paper ID 15: Evaluation of Deep Lift Pose Models for 3D Rodent Pose Estimation based on Geometrically Triangulated Data, Indrani Sarkar (Otto Von Guericke University, Magdeburg); Indranil Maji (Otto Von Guericke University); Charitha Omprakash (Leibniz Institute for Neurobiology); Sebastian Stober (Otto von Guericke University); Sanja Mikulovic (Leibniz Institute for Neurobiology); Pavol Bauer (Leibniz Institute for Neurobiology)

  • Paper ID 16: SuperAnimal: Improving pre-training for Animal Pose Estimation, Shaokai Ye (EPFL); Maxime Vidal (EPFL); Steffen Schneider (EPFL); Tian Qiu (Albert Einstein College of Medicine); Alexander Mathis (EPFL); Mackenzie Mathis (EPFL)

  • Paper ID 17: Analysis of Visual Attention of a Harris’ Hawk in Flight using a Synthetic Reconstruction of its Visual Field, Sofia Minano (University of Oxford); Graham Taylor (University of Oxford, Department of Zoology)

  • Paper ID 18: Unsupervised Detection of Mouse Behavioural Anomalies using Two-stream Convolutional Autoencoders, Ezechukwu I Nwokedi (University of Lincoln); Rasneer Sonia Bains (MRC Harwell Institute); Luc Bidaut (University of Lincoln); Sara Wells (MRC Harwell Institute); Xujiong Ye (University of Lincoln); James M Brown (University of Lincoln)

  • Paper ID 19: Automated Audiovisual Behaviour Recognition in Wild Primates, Arsha Nagrani (Oxford); Max Bain (University of Oxford); Andrew Zisserman (University of Oxford)

  • Paper ID 20: Preliminary Detection of Rhino Middens for Understanding Rhino Behavior, Elizabeth Bondi (Harvard University); Catherine Ressijac (Harvard University); Peter Boucher (Harvard University)

  • Paper ID 21: Multi-Animal Pose Estimation with Transformer, Lucas Stoffl (EPFL); Maxime Vidal (EPFL); Alexander Mathis (EPFL)

  • Paper ID 22: Semi-supervised Sequence Modeling for Improved Behavioral Segmentation, Matthew Whiteway (Columbia University); Evan Schaffer (Columbia University); Anqi Wu (Columbia University); E. Kelly Buchanan (Columbia University); Omer Onder (Columbia University); Neeli Mishra (Columbia University); Liam Paninski (Columbia University)

  • Paper ID 23: Florida Wildlife Camera Trap Dataset, Crystal Gagne (University of Central Florida); Jyoti Kini (University of Central Florida); Daniel Smith (University of Central Florida); Mubarak Shah (University of Central Florida)

  • Paper ID 24: Vision-based Behavioral Recognition of Novelty Preference in Pigs, Aniket S Shirke (University of Illinois at Urbana-Champaign); Rebecca K. Golden (University of Illinois at Urbana-Champaign); Mrinal Gautam (University of Illinois Urbana Champaign); Angela Green-Miller (University of Illinois); Matthew Caesar (University of Illinois at Urbana-Champaign); Ryan N Dilger (University of Illinois)

  • Paper ID 25: Tracking Grow-Finish Pigs Across Large Pens Using Multiple Cameras, Aniket S Shirke (University of Illinois at Urbana-Champaign); Jiangong Li (University of illinois); Angela Green-Miller (University of Illinois); Tawni N Williams (University of Illinois at Urbana-Champaign); Xiaodan Hu (University of Illinois at Urbana-Champaign); Achleshwar Luthra (BITS Pilani); Narendra Ahuja (University of Illinois at Urbana-Champaign, USA); Matthew Caesar (University of Illinois at Urbana-Champaign)

  • Paper ID 26: Robust Tracking of Japanese Macaques from Videos in the Wild using Cascaded Networks, Riza Rae A Pineda (Nara Institute of Science and Technology); Takatomi Kubo (Nara Institute of Science and Technology); Kazushi Ikeda (Nara Institute of Science and Technology); Masaki Shimada (Teikyo University of Science)

  • Paper ID 27: The Animal ID Problem: Continual Curation, Chuck Stewart (Rensselaer Polytechnic Institute); Jason R Parham (Wild Me / Rensselaer Polytechnic Institute); Jason Holmberg (Wild Me); Tanya Berger-Wolf (Ohio State University)

  • Paper ID 28: Sim-to-Real Transfer for Object Detection and Localization on Animals, Syed Talal Wasim (Universite de Bordeaux); Syed N Hasany (University of Cassino); Kainat Abbasi (Habib University); Huda Feroz (Habib University); Anisa A Ahmed (Habib University); Mudasir H Shaikh (Habib University); Muhammad Farhan (Habib University)

  • Paper ID 29: Color in motion: Using 3D modeling and animation to study dynamic visual signals in a virtual environment, Audrey E Miller (Princeton University); Benedict Hogan (Princeton University); Mary Stoddard (Princeton University)

Accepted Papers (Track II: Published Work)

  • Paper ID 30: Referring to Objects in Videos using Spatio-Temporal Identifying Descriptions, Peratham Wiriyathammabhum, Abhinav Shrivastava, Vlad I. Morariu, Larry S. Davis

  • Paper ID 31: Spatio-temporal Reconstruction of Emergent Flash Synchronization in Firefly Swarms via Stereoscopic 360-degree Cameras, Raphaël Sarfati, Julie C. Hayes, Élie Sarfati and Orit Peleg

  • Paper ID 32: Automated Facial Recognition for Wildlife that Lack Unique Markings: A Deep Learning Approach for Brown Bears, Melanie Clapham, Ed Miller, Mary Nguyen, Chris T. Darimont

  • Paper ID 33: Movement Tracks for the Automatic Detection of Fish Behavior in Videos, Declan McIntosh, Tunai Porto Marques, Alexandra Branzan Albu, Rodney Rountree, Fabio De Leo

  • Paper ID 34: Anipose: A Toolkit for Robust Markerless 3D Pose Estimation, Pierre Karashchuk, Katie L. Rupp, Evyn S. Dickinson, Sarah Walling-Bell, Elischa Sanders, Eiman Azim, Bingni W. Brunton, John C. Tuthill

  • Paper ID 35: ZooBuilder: 2D and 3D Pose Estimation for Quadrupeds Using Synthetic Data, A. S. Fangbemi, Y. F. Lu, M. Y. Xu, X. W. Luo, A. Rolland, C. Raissi

  • Paper ID 36: Automatic Classification of Cichlid Behaviors Using 3D Convolutional Residual Networks, Lijiang Long, Zachary V. Johnson, Junyu Li, Tucker J. Lancaster, Vineeth Aljapur, Jeffrey T. Streelman, Patrick T. McGrath

  • Paper ID 37: 3D-ZeF: A 3D Zebrafish Tracking Benchmark Dataset, Malte Pedersen, Joakim Bruslund Haurum, Stefan Hein Bengtson, Thomas B. Moeslund

  • Paper ID 38: SiamBOMB: A Real-time AI-based System for Home-cage Animal Tracking, Segmentation and Behavioral Analysis, Xi Chen, Hao Zhai, Danqian Liu, Weifu Li, Chaoyue Ding, Qiwei Xie, Hua Han

  • Paper ID 39: Using Very-high-resolution Satellite Imagery and Deep Learning to Detect and Count African Elephants in Heterogeneous Landscapes, Isla Duporge, Olga Isupova, Steven Reece, David W. Macdonald, Tiejun Wang

  • Paper ID 40: Animal Pose Estimation from Video Data with a Hierarchical von Mises-Fisher-Gaussian Model, Libby Zhang, Timothy Dunn, Jesse Marshall, Bence Olveczky, Scott Linderman

  • Paper ID 41: Continuous Whole-body 3D Kinematic Recordings across the Rodent Behavioral Repertoire, Jesse D. Marshall, Diego E. Aldarondo, Timothy W. Dunn, William L. Wang, Gordon J. Berman, Bence P. Ölveczky

  • Paper ID 42: A Method for Detection of Small Moving Objects in UAV Videos, Vladan Stojnic, Vladimir Risojevíc, Mario Muštra, Vedran Jovanovi ́c, Janja Filipi, Nikola Kezi ́c, Zdenka Babi ́c

  • Paper ID 43: MonarchNet: Differentiating Monarch Butterflies from Those with Similar Phenotypes, Thomas Y. Chen

  • Paper ID 44: Tracking Individual Honeybees among Wildflower Clusters with Computer Vision-facilitated Pollinator Monitoring, Malika Nisal Ratnayake, Adrian G. Dyer, Alan Dorin

  • Paper ID 45: MacaquePose: A Novel “In the Wild” Macaque Monkey Pose Dataset for Markerless Motion Capture, Rollyn Labuguen, Jumpei Matsumoto, Salvador Blanco Negrete, Hiroshi Nishimaru, Hisao Nishijo, Masahiko Takada, Yasuhiro Go, Ken-ichi Inoue, Tomohiro Shibata

  • Paper ID 46: Extracting Identifying Contours for African Elephants and Humpback Whales using a Learned Appearance Model, Hendrik J. Weideman, Charles V. Stewart, Jason R. Parham, Jason Holmberg, Kiirsten Flynn, John Calambokidis, D. Barry Paul, Anka Bedetti, Michelle Henley, Jerenimo Lepirei, Frank G. Pope

  • Paper ID 47: LiftPose3D, a Deep Learning-based Approach for Transforming 2D to 3D Pose in Laboratory Animals, Adam Gosztolai, Semih G ̈unel, Victor Lobato R ́ıos, Marco Pietro Abrate, Daniel Morales, Helge Rhodin, Pascal Fua, Pavan Ramdya

  • Paper ID 48: Geometric Deep Learning Enables 3D Kinematic Profiling across Species and Environments, Timothy W. Dunn, Jesse D. Marshall, Kyle S. Severson, Diego E. Aldarondos, David G. C. Hildebrand, Selmaan N. Chettih, William L. Wang, Amanda J. Gellis, David E. Carlson, Dmitriy Aronovs, Winrich A. Freiwald, Fan Wang, Bence P. Ölveczky

  • Paper ID 49: Nonparametric Object and Parts Modeling with Lie Group Dynamics, David S. Hayden, Jason Pacheco, John W. Fisher III

  • Paper ID 50: A Three-dimensional Virtual Mouse Generates Synthetic Training Data for Behavioral Analysis, Luis A. Bolaños, Dongsheng Xiao, Nancy L. Ford, Jeff M. LeDue, Pankaj K. Gupta, Carlos Doebeli, Hao Hu, Helge Rhodin, Timothy H. Murphy

  • Paper ID 51: AcinoSet: A 3D Pose Estimation Dataset and Baseline Models for Cheetahs in the Wild, Daniel Joska, Liam Clark, Naoya Muramatsu, Ricardo Jericevich, Fred Nicolls, Alexander Mathis, Mackenzie W. Mathis, Amir Patel