{"id":29001,"date":"2020-12-16T10:36:24","date_gmt":"2020-12-16T18:36:24","guid":{"rendered":"https:\/\/vermont.salk.edu\/?post_type=disclosure&p=29001"},"modified":"2023-12-07T22:02:30","modified_gmt":"2023-12-08T06:02:30","slug":"teaching-artificial-intelligence-to-adapt","status":"publish","type":"disclosure","link":"https:\/\/www.salk.edu\/zh\/news-release\/teaching-artificial-intelligence-to-adapt\/","title":{"rendered":"Teaching artificial intelligence to adapt"},"content":{"rendered":"

LA JOLLA\u2014Getting computers to \u201cthink\u201d like humans is the holy grail of artificial intelligence, but human brains turn out to be tough acts to follow. The human brain is a master of applying previously learned knowledge to new situations and constantly refining what\u2019s been learned. This ability to be adaptive has been hard to replicate in machines.<\/p>\n

Now, Salk researchers have used a computational model of brain activity to simulate this process more accurately than ever before. The new model mimics how the brain\u2019s prefrontal cortex uses a phenomenon known as \u201cgating\u201d to control the flow of information between different areas of neurons. It not only sheds light on the human brain, but could also inform the design of new artificial intelligence programs.<\/p>\n

\"Terrence
From left: Terrence Sejnowski, Kay Tye and Ben Tsuda.<\/p>\n

Click here<\/a> for a high-resolution image.<\/p>\n

Credit: Salk Institute<\/figcaption><\/figure>\n

\u201cIf we can scale this model up to be used in more complex artificial intelligence systems, it might allow these systems to learn things faster or find new solutions to problems,\u201d says \u7279\u4f26\u65af\u00b7\u585e\u6d25\u8bfa\u7ef4\u5947<\/a>, head of Salk\u2019s Computational Neurobiology Laboratory and senior author of the new work, published on November 24, 2020, in Proceedings of the National Academy of Sciences<\/em><\/a>.<\/p>\n

The brains of humans and other mammals are known for their ability to quickly process stimuli\u2014sights and sounds, for instance\u2014and integrate any new information into things the brain already knows. This flexibility to apply knowledge to new situations and continuously learn over a lifetime has long been a goal of researchers designing machine learning programs or artificial brains. Historically, when a machine is taught to do one task, it\u2019s difficult for the machine to learn how to adapt that knowledge to a similar task; instead each related process has to be taught individually.<\/p>\n

In the current study, Sejnowski\u2019s group designed a new computational modeling framework to replicate how neurons in the prefrontal cortex\u2014the brain area responsible for decision-making and working memory\u2014behave during a cognitive test known as the Wisconsin Card Sorting Test. In this task, participants have to sort cards by color, symbol or number\u2014and constantly adapt their answers as the card-sorting rule changes. This test is used clinically to diagnose dementia and psychiatric illnesses but is also used by artificial intelligence researchers to gauge how well their computational models of the brain can replicate human behavior.<\/p>\n

Previous models of the prefrontal cortex performed poorly on this task. The Sejnowski team\u2019s framework, however, integrated how neurons control the flow of information throughout the entire prefrontal cortex via gating, delegating different pieces of information to different subregions of the network. Gating was thought to be important at a small scale\u2014in controlling the flow of information within small clusters of similar cells\u2014but the idea had never been integrated into models through the whole network.<\/p>\n

The new network not only performed as reliably as humans on the Wisconsin Card Sorting Task, but also mimicked the mistakes seen in some patients. When sections of the model were removed, the system showed the same errors seen in patients with prefrontal cortex damage, such as that caused by trauma or dementia.<\/p>\n

\u201cI think one of the most exciting parts of this is that, using this sort of modeling framework, we\u2019re getting a better idea of how the brain is organized,\u201d says Ben Tsuda, a Salk graduate student and first author of the new paper. \u201cThat has implications for both machine learning and gaining a better understanding of some of these diseases that affect the prefrontal cortex.\u201d<\/p>\n

If researchers have a better understanding of how regions of the prefrontal cortex work together, he adds, that will help guide interventions to treat brain injury. It could suggest areas to target with deep brain stimulation, for instance.<\/p>\n

\u201cWhen you think about the ways in which the brain still surpasses state-of-the-art deep learning networks, one of those ways is versatility and generalizability across tasks with different rules,” says study coauthor \u51ef\u6cf0<\/a>, a professor in Salk\u2019s Systems Neurobiology Laboratory and the Wylie Vale Chair. \u201cIn this new work, we show how gating of information can power our new and improved model of the prefrontal cortex.\u201d<\/p>\n

The team next wants to scale up the network to perform more complex tasks than the card-sorting test and determine whether the network-wide gating gives the artificial prefrontal cortex a better working memory in all situations. If the new approach works under broad learning scenarios, they suspect that it will lead to improved artificial intelligence systems that can be more adaptable to new situations.<\/p>\n

Hava Siegelmann of the University of Massachusetts Amherst was an additional author of the study. The work was supported by grants from the Kavli Institute for Brain and Mind at UC San Diego, the Office of Naval Research (N000141612829), the National Science Foundation (1735004) and DARPA (W911NF1820).<\/p>","protected":false},"featured_media":0,"template":"","faculty":[326,114],"disease-research":[448,124],"class_list":["post-29001","disclosure","type-disclosure","status-publish","hentry","faculty-kay-tye","faculty-terrence-sejnowski","disease-research-artificial-intelligence","disease-research-neuroscience-and-neurological-disorders"],"acf":[],"yoast_head":"\nTeaching artificial intelligence to adapt - Salk Institute for Biological Studies<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.salk.edu\/zh\/news-release\/teaching-artificial-intelligence-to-adapt\/\" \/>\n<meta property=\"og:locale\" content=\"zh_CN\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Teaching artificial intelligence to adapt - Salk Institute for Biological Studies\" \/>\n<meta property=\"og:description\" content=\"LA JOLLA\u2014Getting computers to \u201cthink\u201d like humans is the holy grail of artificial intelligence, but human brains turn out to be tough acts to follow. The human brain is a master of applying previously learned knowledge to new situations and constantly refining what\u2019s been learned. This ability to be adaptive has been hard to replicate in machines.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.salk.edu\/zh\/news-release\/teaching-artificial-intelligence-to-adapt\/\" \/>\n<meta property=\"og:site_name\" content=\"Salk Institute for Biological Studies\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-08T06:02:30+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/www.salk.edu\/wp-content\/uploads\/2020\/12\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/\",\"name\":\"Teaching artificial intelligence to adapt - Salk Institute for Biological Studies\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/#primaryimage\"},\"thumbnailUrl\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg\",\"datePublished\":\"2020-12-16T18:36:24+00:00\",\"dateModified\":\"2023-12-08T06:02:30+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/#breadcrumb\"},\"inLanguage\":\"zh-CN\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/#primaryimage\",\"url\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg\",\"contentUrl\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2020\\\/12\\\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/news-release\\\/teaching-artificial-intelligence-to-adapt\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/www.salk.edu\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Teaching artificial intelligence to adapt\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#website\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/\",\"name\":\"Salk Institute for Biological Studies\",\"description\":\"The Power of Science\",\"publisher\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/www.salk.edu\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"zh-CN\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#organization\",\"name\":\"Salk Institute for Biological Studies\",\"url\":\"https:\\\/\\\/www.salk.edu\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"zh-CN\",\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/salk_logo_696.jpg\",\"contentUrl\":\"http:\\\/\\\/www.salk.edu\\\/wp-content\\\/uploads\\\/2023\\\/03\\\/salk_logo_696.jpg\",\"width\":696,\"height\":696,\"caption\":\"Salk Institute for Biological Studies\"},\"image\":{\"@id\":\"https:\\\/\\\/www.salk.edu\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Teaching artificial intelligence to adapt - Salk Institute for Biological Studies","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.salk.edu\/zh\/news-release\/teaching-artificial-intelligence-to-adapt\/","og_locale":"zh_CN","og_type":"article","og_title":"Teaching artificial intelligence to adapt - Salk Institute for Biological Studies","og_description":"LA JOLLA\u2014Getting computers to \u201cthink\u201d like humans is the holy grail of artificial intelligence, but human brains turn out to be tough acts to follow. The human brain is a master of applying previously learned knowledge to new situations and constantly refining what\u2019s been learned. This ability to be adaptive has been hard to replicate in machines.","og_url":"https:\/\/www.salk.edu\/zh\/news-release\/teaching-artificial-intelligence-to-adapt\/","og_site_name":"Salk Institute for Biological Studies","article_modified_time":"2023-12-08T06:02:30+00:00","og_image":[{"url":"http:\/\/www.salk.edu\/wp-content\/uploads\/2020\/12\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/","url":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/","name":"Teaching artificial intelligence to adapt - Salk Institute for Biological Studies","isPartOf":{"@id":"https:\/\/www.salk.edu\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/#primaryimage"},"image":{"@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/#primaryimage"},"thumbnailUrl":"http:\/\/www.salk.edu\/wp-content\/uploads\/2020\/12\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg","datePublished":"2020-12-16T18:36:24+00:00","dateModified":"2023-12-08T06:02:30+00:00","breadcrumb":{"@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/#breadcrumb"},"inLanguage":"zh-CN","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/"]}]},{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/#primaryimage","url":"http:\/\/www.salk.edu\/wp-content\/uploads\/2020\/12\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg","contentUrl":"http:\/\/www.salk.edu\/wp-content\/uploads\/2020\/12\/Terry-Sejnowski-Kay-Tye-Ben-Tsuda-PR-458x188.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/www.salk.edu\/news-release\/teaching-artificial-intelligence-to-adapt\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.salk.edu\/"},{"@type":"ListItem","position":2,"name":"Teaching artificial intelligence to adapt"}]},{"@type":"WebSite","@id":"https:\/\/www.salk.edu\/#website","url":"https:\/\/www.salk.edu\/","name":"\u7d22\u5c14\u514b\u751f\u7269\u7814\u7a76\u6240","description":"The Power of Science","publisher":{"@id":"https:\/\/www.salk.edu\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.salk.edu\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"zh-CN"},{"@type":"Organization","@id":"https:\/\/www.salk.edu\/#organization","name":"\u7d22\u5c14\u514b\u751f\u7269\u7814\u7a76\u6240","url":"https:\/\/www.salk.edu\/","logo":{"@type":"ImageObject","inLanguage":"zh-CN","@id":"https:\/\/www.salk.edu\/#\/schema\/logo\/image\/","url":"http:\/\/www.salk.edu\/wp-content\/uploads\/2023\/03\/salk_logo_696.jpg","contentUrl":"http:\/\/www.salk.edu\/wp-content\/uploads\/2023\/03\/salk_logo_696.jpg","width":696,"height":696,"caption":"Salk Institute for Biological Studies"},"image":{"@id":"https:\/\/www.salk.edu\/#\/schema\/logo\/image\/"}}]}},"ACF":{"paper_url":"https:\/\/doi.org\/10.1073\/pnas.2009591117","journal_title":"Proceedings of the National Academy of Sciences","paper_author_list":"Ben Tsuda, Kay M. Tye, Hava T. Siegelmann and Terrence J. Sejnowski.","doi":"10.1073\/pnas.2009591117","paper_title":"A modeling framework for adaptive lifelong learning with transfer and savings through gating in the prefrontal cortex","subhead":"Salk\u2019s simulated system could help develop better artificial intelligence, treatments for brain disorders","home_photo":"","listing_photo":"","legacy_boilerplate":[],"hide_boilerplate":[],"disable_date":false,"listing_excerpt":"","descriptive_blurb":"","has_journal_cover":false,"og_image_override":false,"gallery":false},"_links":{"self":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/29001","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure"}],"about":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/types\/disclosure"}],"version-history":[{"count":3,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/29001\/revisions"}],"predecessor-version":[{"id":29005,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disclosure\/29001\/revisions\/29005"}],"wp:attachment":[{"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/media?parent=29001"}],"wp:term":[{"taxonomy":"faculty","embeddable":true,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/faculty?post=29001"},{"taxonomy":"disease-research","embeddable":true,"href":"https:\/\/www.salk.edu\/zh\/wp-json\/wp\/v2\/disease-research?post=29001"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}