{"id":41534,"date":"2023-09-26T08:05:39","date_gmt":"2023-09-26T15:05:39","guid":{"rendered":"https:\/\/vermont.salk.edu\/?post_type=disclosure&p=41534"},"modified":"2024-01-30T14:09:14","modified_gmt":"2024-01-30T22:09:14","slug":"unleashing-the-power-of-ai-to-track-animal-behavior","status":"publish","type":"disclosure","link":"https:\/\/www.salk.edu\/zh\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/","title":{"rendered":"\u91ca\u653e\u4eba\u5de5\u667a\u80fd\u7684\u529b\u91cf\uff0c\u8ffd\u8e2a\u52a8\u7269\u884c\u4e3a"},"content":{"rendered":"

LA JOLLA\u2014Movement offers a window into how the brain operates and controls the body. From clipboard-and-pen observation to modern artificial intelligence-based techniques, tracking human and animal movement has come a long way. Current cutting-edge methods utilize artificial intelligence to automatically track parts of the body as they move. However, training these models is still time-intensive and limited by the need for researchers to manually mark each body part hundreds to thousands of times. <\/p>\n

Now, Associate Professor Eiman Azim<\/a> and team have created GlowTrack, a non-invasive movement tracking method that uses fluorescent dye markers to train artificial intelligence. GlowTrack is robust, time-efficient, and high definition\u2014capable of tracking a single digit on a mouse\u2019s paw or hundreds of landmarks on a human hand.<\/p>\n

\"Human
Human hand marked with GlowTrack fluorescent tags.
Click here<\/a> for a high-resolution image.
Credit: Salk Institute<\/figcaption><\/figure>\n

The technique, published in Nature Communications<\/a><\/em>on September 26, 2023, has applications spanning from biology to robotics to medicine and beyond.<\/p>\n

\u201cOver the last several years, there has been a revolution in tracking behavior as powerful artificial intelligence tools have been brought into the laboratory,\u201d says Azim, senior author and holder of the William Scandling Developmental Chair. \u201cOur approach makes these tools more versatile, improving the ways we capture diverse movements in the laboratory. Better quantification of movement gives us better insight into how the brain controls behavior and could aid in the study of movement disorders like amyotrophic lateral sclerosis (ALS) and Parkinson\u2019s disease.\u201d<\/p>\n

Current methods to capture animal movement often require researchers to manually and repeatedly mark body parts on a computer screen\u2014a time-consuming process subject to human error and time constraints. Human annotation means that these methods can usually only be used in a narrow testing environment, since artificial intelligence models specialize to the limited amount of training data they receive. For example, if the light, orientation of the animal\u2019s body, camera angle, or any number of other factors were to change, the model would no longer recognize the tracked body part.<\/p>\n

To address these limitations, the researchers used fluorescent dye to label parts of the animal or human body. With these \u201cinvisible\u201d fluorescent dye markers, an enormous amount of visually diverse data can be created quickly and fed into the artificial intelligence models without the need for human annotation. Once fed this robust data, these models can be used to track movements across a much more diverse set of environments and at a resolution that would be far more difficult to achieve with manual human labeling.<\/p>\n

\"From
From left: Daniel Butler and Eiman Azim.
Click here<\/a> for a high-resolution image.
Credit: Salk Institute<\/figcaption><\/figure>\n

This opens the door for easier comparison of movement data between studies, as different laboratories can use the same models to track body movement across a variety of situations. According to Azim, comparison and reproducibility of experiments are essential in the process of scientific discovery.<\/p>\n

\u201cFluorescent dye markers were the perfect solution,\u201d says first author Daniel Butler, a Salk bioinformatics analyst. Like the invisible ink on a dollar bill that lights up only when you want it to, our fluorescent dye markers can be turned on and off in the blink of an eye, allowing us to generate a massive amount of training data.\u201d<\/p>\n

In the future, the team is excited to support diverse applications of GlowTrack and pair its capabilities with other tracking tools that reconstruct movements in three dimensions, and with analysis approaches that can probe these vast movement datasets for patterns.<\/p>\n

\u201cOur approach can benefit a host of fields that need more sensitive, reliable, and comprehensive tools to capture and quantify movement,\u201d says Azim. \u201cI am eager to see how other scientists and non-scientists adopt these methods, and what unique, unforeseen applications might arise.\u201d<\/p>\n

Other authors include Alexander Keim and Shantanu Ray of Salk.<\/p>\n

The work was supported by the UC San Diego CMG Training Program, a Jesse and Caryl Philips Foundation Award, the National Institutes of Health (R00NS088193, DP2NS105555, R01NS111479, RF1NS128898, and U19NS112959), the Searle Scholars Program, the Pew Charitable Trusts, and the McKnight Foundation.<\/p>","protected":false},"featured_media":42126,"template":"","faculty":[291],"disease-research":[448,332],"class_list":["post-41534","disclosure","type-disclosure","status-publish","has-post-thumbnail","hentry","faculty-eiman-azim","disease-research-artificial-intelligence","disease-research-computational-biology"],"acf":[],"yoast_head":"\nUnleashing the power of AI to track animal behavior - Salk Institute for Biological Studies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.salk.edu\/zh\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Unleashing the power of AI to track animal behavior - Salk Institute for Biological Studies\" \/>\n<meta property=\"og:description\" content=\"LA JOLLA\u2014Movement offers a window into how the brain operates and controls the body. From clipboard-and-pen observation to modern artificial intelligence-based techniques, tracking human and animal movement has come a long way. Current cutting-edge methods utilize artificial intelligence to automatically track parts of the body as they move. However, training these models is still time-intensive and limited by the need for researchers to manually mark each body part hundreds to thousands of times.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.salk.edu\/zh\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/\" \/>\n<meta property=\"og:site_name\" content=\"Salk Institute for Biological Studies\" \/>\n<meta property=\"article:modified_time\" content=\"2024-01-30T22:09:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-hr.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"615\" \/>\n\t<meta property=\"og:image:height\" content=\"578\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/\",\"name\":\"Unleashing the power of AI to track animal behavior - Salk Institute for Biological Studies\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/colorized-hand-hr.jpg\",\"datePublished\":\"2023-09-26T15:05:39+00:00\",\"dateModified\":\"2024-01-30T22:09:14+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/#breadcrumb\"},\"inLanguage\":\"zh-CN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/#primaryimage\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/colorized-hand-hr.jpg\",\"contentUrl\":\"https:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/07\\\/colorized-hand-hr.jpg\",\"width\":615,\"height\":578,\"caption\":\"Human hand marked with GlowTrack fluorescent tags.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/unleashing-the-power-of-ai-to-track-animal-behavior\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.salk.edu\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Unleashing the power of AI to track animal behavior\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#website\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/\",\"name\":\"Salk Institute for Biological Studies\",\"description\":\"The Power of Science\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.salk.edu\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"zh-CN\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#organization\",\"name\":\"Salk Institute for Biological Studies\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/salk_logo_696.jpg\",\"contentUrl\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/salk_logo_696.jpg\",\"width\":696,\"height\":696,\"caption\":\"Salk Institute for Biological Studies\"},\"image\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Unleashing the power of AI to track animal behavior - Salk Institute for Biological Studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.salk.edu\/zh\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/","og_locale":"zh_CN","og_type":"article","og_title":"Unleashing the power of AI to track animal behavior - Salk Institute for Biological Studies","og_description":"LA JOLLA\u2014Movement offers a window into how the brain operates and controls the body. From clipboard-and-pen observation to modern artificial intelligence-based techniques, tracking human and animal movement has come a long way. Current cutting-edge methods utilize artificial intelligence to automatically track parts of the body as they move. However, training these models is still time-intensive and limited by the need for researchers to manually mark each body part hundreds to thousands of times.","og_url":"https:\/\/www.salk.edu\/zh\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/","og_site_name":"Salk Institute for Biological Studies","article_modified_time":"2024-01-30T22:09:14+00:00","og_image":[{"width":615,"height":578,"url":"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-hr.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/","url":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/","name":"Unleashing the power of AI to track animal behavior - Salk Institute for Biological Studies","isPartOf":{"@id":"https:\/\/www.salk.edu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/#primaryimage"},"image":{"@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/#primaryimage"},"thumbnailUrl":"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-hr.jpg","datePublished":"2023-09-26T15:05:39+00:00","dateModified":"2024-01-30T22:09:14+00:00","breadcrumb":{"@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/#breadcrumb"},"inLanguage":"zh-CN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/"]}]},{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/#primaryimage","url":"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-hr.jpg","contentUrl":"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-hr.jpg","width":615,"height":578,"caption":"Human hand marked with GlowTrack fluorescent tags."},{"@type":"BreadcrumbList","@id":"https:\/\/www.salk.edu\/news-release\/unleashing-the-power-of-ai-to-track-animal-behavior\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.salk.edu\/"},{"@type":"ListItem","position":2,"name":"Unleashing the power of AI to track animal behavior"}]},{"@type":"WebSite","@id":"https:\/\/www.salk.edu\/#website","url":"https:\/\/www.salk.edu\/","name":"\u7d22\u5c14\u514b\u751f\u7269\u7814\u7a76\u6240","description":"The Power of Science","publisher":{"@id":"https:\/\/www.salk.edu\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.salk.edu\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"zh-CN"},{"@type":"Organization","@id":"https:\/\/www.salk.edu\/#organization","name":"\u7d22\u5c14\u514b\u751f\u7269\u7814\u7a76\u6240","url":"https:\/\/www.salk.edu\/","logo":{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.salk.edu\/#\/schema\/logo\/image\/","url":"http:\/\/www.salk.edu\/wp-content\/uploads\/2023\/03\/salk_logo_696.jpg","contentUrl":"http:\/\/www.salk.edu\/wp-content\/uploads\/2023\/03\/salk_logo_696.jpg","width":696,"height":696,"caption":"Salk Institute for Biological Studies"},"image":{"@id":"https:\/\/www.salk.edu\/#\/schema\/logo\/image\/"}}]}},"ACF":{"hero":"https:\/\/www.salk.edu\/wp-content\/uploads\/2023\/07\/colorized-hand-1920.jpg","line_1":"Unleashing the power of AI to track animal behavior","line_2":"Salk scientists create GlowTrack to track human and animal behavior with better resolution and more versatility","poster_quote":"","paper_url":"https:\/\/www.nature.com\/articles\/s41467-023-41565-3","journal_title":"Nature Communications","paper_author_list":"Daniel J. Butler, Alexander P. Keim, Shantanu Ray, Eiman Azim","doi":"https:\/\/doi.org\/10.1038\/s41467-023-41565-3","paper_title":"Large-scale capture of hidden fluorescent labels for training generalizable markerless motion capture models","subhead":"Salk scientists create GlowTrack to track human and animal behavior with better resolution and more versatility","home_photo":"","listing_photo":"","legacy_boilerplate":[],"hide_boilerplate":[],"disable_date":false,"listing_excerpt":"","descriptive_blurb":"","has_journal_cover":false,"og_image_override":false,"gallery":false},"_links":{"self":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/41534","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure"}],"about":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/types\/disclosure"}],"version-history":[{"count":6,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/41534\/revisions"}],"predecessor-version":[{"id":43030,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/41534\/revisions\/43030"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/media\/42126"}],"wp:attachment":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/media?parent=41534"}],"wp:term":[{"taxonomy":"faculty","embeddable":true,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/faculty?post=41534"},{"taxonomy":"disease-research","embeddable":true,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disease-research?post=41534"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}