{"id":56519,"date":"2024-04-02T02:51:46","date_gmt":"2024-04-02T06:51:46","guid":{"rendered":"https:\/\/euvolution.com\/open-source-convergence\/uncategorized\/layerwise-importance-sampled-adamw-lisa-a-machine-learning-optimization-algorithm-that-randomly-freezes-layers-of-llm-based-on-a-given-probability.php"},"modified":"2024-04-02T02:51:46","modified_gmt":"2024-04-02T06:51:46","slug":"layerwise-importance-sampled-adamw-lisa-a-machine-learning-optimization-algorithm-that-randomly-freezes-layers-of-llm-based-on-a-given-probability","status":"publish","type":"post","link":"https:\/\/euvolution.com\/open-source-convergence\/machine-learning\/layerwise-importance-sampled-adamw-lisa-a-machine-learning-optimization-algorithm-that-randomly-freezes-layers-of-llm-based-on-a-given-probability.php","title":{"rendered":"Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability&#8230;"},"content":{"rendered":"<p><a href=\"https:\/\/news.google.com\/rss\/articles\/CBMiuwFodHRwczovL3d3dy5tYXJrdGVjaHBvc3QuY29tLzIwMjQvMDMvMzEvbGF5ZXJ3aXNlLWltcG9ydGFuY2Utc2FtcGxlZC1hZGFtdy1saXNhLWEtbWFjaGluZS1sZWFybmluZy1vcHRpbWl6YXRpb24tYWxnb3JpdGhtLXRoYXQtcmFuZG9tbHktZnJlZXplcy1sYXllcnMtb2YtbGxtLWJhc2VkLW9uLWEtZ2l2ZW4tcHJvYmFiaWxpdHkv0gG_AWh0dHBzOi8vd3d3Lm1hcmt0ZWNocG9zdC5jb20vMjAyNC8wMy8zMS9sYXllcndpc2UtaW1wb3J0YW5jZS1zYW1wbGVkLWFkYW13LWxpc2EtYS1tYWNoaW5lLWxlYXJuaW5nLW9wdGltaXphdGlvbi1hbGdvcml0aG0tdGhhdC1yYW5kb21seS1mcmVlemVzLWxheWVycy1vZi1sbG0tYmFzZWQtb24tYS1naXZlbi1wcm9iYWJpbGl0eS8_YW1w?oc=5\" target=\"_blank\" rel=\"noopener\">Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability<\/a>\u00a0\u00a0MarkTechPost<br \/><!-- Auto Generated --><\/p>\n<p>Go here to see the original:<br \/>\n<a target=\"_blank\" href=\"https:\/\/news.google.com\/rss\/articles\/CBMiuwFodHRwczovL3d3dy5tYXJrdGVjaHBvc3QuY29tLzIwMjQvMDMvMzEvbGF5ZXJ3aXNlLWltcG9ydGFuY2Utc2FtcGxlZC1hZGFtdy1saXNhLWEtbWFjaGluZS1sZWFybmluZy1vcHRpbWl6YXRpb24tYWxnb3JpdGhtLXRoYXQtcmFuZG9tbHktZnJlZXplcy1sYXllcnMtb2YtbGxtLWJhc2VkLW9uLWEtZ2l2ZW4tcHJvYmFiaWxpdHkv0gG_AWh0dHBzOi8vd3d3Lm1hcmt0ZWNocG9zdC5jb20vMjAyNC8wMy8zMS9sYXllcndpc2UtaW1wb3J0YW5jZS1zYW1wbGVkLWFkYW13LWxpc2EtYS1tYWNoaW5lLWxlYXJuaW5nLW9wdGltaXphdGlvbi1hbGdvcml0aG0tdGhhdC1yYW5kb21seS1mcmVlemVzLWxheWVycy1vZi1sbG0tYmFzZWQtb24tYS1naXZlbi1wcm9iYWJpbGl0eS8_YW1w?oc=5\" title=\"Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability...\" rel=\"noopener\">Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability...<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p> Layerwise Importance Sampled AdamW (LISA): A Machine Learning Optimization Algorithm that Randomly Freezes Layers of LLM Based on a Given Probability \u00a0\u00a0MarkTechPost <\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[27373],"tags":[],"class_list":["post-56519","post","type-post","status-publish","format-standard","hentry","category-machine-learning"],"_links":{"self":[{"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/posts\/56519"}],"collection":[{"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/comments?post=56519"}],"version-history":[{"count":0,"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/posts\/56519\/revisions"}],"wp:attachment":[{"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/media?parent=56519"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/categories?post=56519"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/euvolution.com\/open-source-convergence\/wp-json\/wp\/v2\/tags?post=56519"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}