AI-Powered Neural Control Offers Real-Time Insights into Animal Behavior
Researchers have developed an artificial intelligence system capable of detecting and immediately influencing the neural activity associated with complex social behaviors in animals. This breakthrough allows scientists to move beyond observation and directly test the causal links between brain activity and behavior, offering unprecedented opportunities to understand the neural basis of social interactions.
Linking Behavior to Neural Activity in Real-Time
The new system, dubbed YORU, identifies entire postures as single behaviors within a single video frame, achieving 90% to 98% accuracy across fruit flies, ants, and zebrafish. This speed is crucial for real-time intervention, as many social behaviors unfold rapidly. Traditional tracking methods, which analyze body parts frame by frame, often struggle with overlapping bodies and introduce delays, hindering accurate analysis.
YORU operates with a remarkably low latency of approximately 31 milliseconds – significantly faster than conventional pose trackers (which average around 47 milliseconds). This allows for the precise timing needed to influence neural activity during the behavior itself, rather than afterward.
Optogenetics and Targeted Neural Control
To control specific neurons, researchers utilized optogenetics, a technique that employs light to activate or silence genetically engineered light-sensitive neurons. When YORU detects a specific behavior, such as a fruit fly extending its wing in preparation for a courtship song, it triggers a light pulse that selectively silences the neurons responsible for that behavior. This allows researchers to observe the immediate impact of neural inhibition on the animal’s actions.
Unlike previous brain-control setups that illuminated entire arenas, YORU precisely targets individual animals within a group, minimizing disruption to surrounding individuals. During tests with two flies, the light remained focused on the intended target for 90.5% of the stimulation time.
Applications Beyond Behavior Control
The system’s capabilities extend beyond simply controlling behavior. By combining YORU with calcium imaging, which tracks neuron activity, researchers can correlate specific behaviors with corresponding patterns of neural activity in the brain. This allows for a deeper understanding of how the brain orchestrates complex actions.
Limitations and Future Directions
The current system has limitations. It may struggle to detect behaviors that unfold over multiple frames, and it doesn’t inherently track individual animal identities over time. Hardware limitations, such as projector and controller delays, can also introduce slight inaccuracies.
Future research will focus on improving the system’s ability to capture longer, more complex behaviors and reducing hardware-related delays. Researchers are also working to make the system more accessible to a wider range of biology labs by developing a user-friendly graphical interface. This will enable more widespread studies connecting brain circuits to social choices, while also prompting consideration of the ethical implications of such powerful technology.
By enabling real-time behavior detection and neural control, this system represents a significant step forward in our ability to unravel the complexities of the brain and understand the neural basis of social behavior.