AI Model BioCLIP 2 aims to Revolutionize Conservation Biology
Table of Contents
Tanya Berger-Wolf’s first computational biology project started as a bet with a colleague: that she could build an AI model capable of identifying individual zebras faster than a zoologist.
She won.
Now, the director of the Translational Data Analytics Institute and a professor at The Ohio State University, Berger-Wolf is taking on the whole animal kingdom with BioCLIP 2, a biology-based foundation model trained on the biggest, most diverse dataset of organisms to date. The model will be showcased at this year’s neurips AI research conference.
BioCLIP 2 goes beyond extracting details from images.it can distinguish species’ traits and determine inter-and intraspecies relationships. Such as, the model arranged Darwin’s finches by beak size, without teaching the concept of size, shown in the image below.
[Image of Scatter plot showing how BioCLIP 2 arranges Darwin’s finches by beak size from left to right.]
These capabilities will allow researchers to use the model as both a biological encyclopedia, a powerful scientific platform and an interactive research tool with inference capabilities to help address an ongoing issue in conservation biology: data deficiency for certain species.
“For iconic species like killer whales, we lack enough data to determine population size and for polar bears, the population is unknown,” saeid Berger-Wolf. “If we don’t have data for those species, what hope do the beetles and fungi have?”
AI models can enhance existing conservation efforts for threatened species and their habitats by filling this data-deficiency gap.
BioCLIP 2 is available under an open-source license on Hugging Face, where it was downloaded over 45,000 times last month. This paper builds on the first BioCLIP model, released over a year ago, which was also trained on NVIDIA GPUs and received the Best Student Paper award at the Computer Vision and Pattern Recognition (CVPR) conference.
The BioCLIP 2 paper will be presented at NeurIPS, taking place Nov. 30-Dec. 5 in Mexico City,and Dec. 2-7 in San Diego.
Building the World’s Biggest Biological flash card Deck
The project began with the compilation of a massive dataset, TREEOFLIFE-200M, which comprises 214 million images of organisms that span over 925,000 taxonomic classes – from monkeys to mealworms and
AI-Powered BioCLIP 2 Advances Wildlife Research with Detailed Species Identification and Digital Twin Technology
Researchers have developed BioCLIP 2, an enhanced artificial intelligence model capable of identifying over 1,800 plant and animal species with unprecedented accuracy. This advancement, detailed in a recent paper https://arxiv.org/abs/2505.23883, promises to revolutionize wildlife research and conservation efforts by enabling more efficient data collection and analysis, and paving the way for interactive digital twins of ecosystems.
bioclip 2: A Leap Forward in Species Identification
The original bioclip model, released in 2022, demonstrated the potential of foundation models for biodiversity research. BioCLIP 2 builds upon this foundation, considerably improving species identification accuracy. The model leverages a massive dataset of images and text descriptions to learn the visual characteristics of different species.
As the model trains, it becomes better at distinguishing between species, even those with subtle differences.The research team observed that variations within a species also begin to cluster, allowing for a more nuanced understanding of intra-species diversity.This is visually demonstrated through scatter plots showing improved separation of species as training progresses.
Accelerated Training with NVIDIA Technology
training such a complex model requires substantial computational power. the team, led by Dr. Tal Berger-Wolf, utilized a cluster of 64 NVIDIA Tensor Core GPUs to accelerate the training process. Individual Tensor Core GPUs were also employed for AI inference, the process of using the trained model to identify species in new images.
“Foundation models like BioCLIP would not be possible without NVIDIA accelerated computing,” stated Dr. Berger-Wolf.NVIDIA’s Tensor Cores are specifically designed to accelerate the matrix multiplications that are essential to deep learning, making them ideal for training and deploying large AI models.
Wildlife Digital Twins: Simulating Ecosystems for Conservation
The researchers are now focused on developing a wildlife-based interactive digital twin. This virtual environment will allow scientists to visualize and simulate ecological interactions between species and their environment.
The goal is to create a safe and controlled environment for studying complex relationships in the wild, minimizing disturbance to real-world ecosystems. “The digital twin allows us to visualize species interactions and put them in context,as well as to play the what-if scenarios and test our models without destroying the actual environment – creating as light a footprint as possible,” explained Dr. Berger-Wolf.
This digital twin will offer scientists the unique ability to explore ecosystems from the outlook of the species being studied, leading to more accurate and insightful ecological research.
Future Applications: Education and Public Engagement
Beyond scientific research,the technology has the potential for broader public engagement.The researchers envision deploying versions of the digital twin in interactive platforms, such as zoos, allowing visitors to experience the natural world from entirely new perspectives.
“I’m getting goosebumps just imagining that scenario of a kid coming into the zoo and being like, wow – this is what you would see if you were another zebra part of that herd, or if you were the little spider sitting on that scratching post,” Dr. Berger-Wolf said. This immersive experience could foster a deeper understanding and recognition for biodiversity and conservation.