{"id":164,"date":"2024-05-05T09:10:00","date_gmt":"2024-05-05T00:10:00","guid":{"rendered":"http:\/\/localhost:8080\/achievement\/achievement-paper-2024-020\/"},"modified":"2026-04-29T21:09:26","modified_gmt":"2026-04-29T12:09:26","slug":"paper-wada-20240505","status":"publish","type":"achievement","link":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/achievement\/paper-wada-20240505\/","title":{"rendered":"Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">\u3072\u3068\u3053\u3068\u3067\u8a00\u3046\u3068<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u533b\u7642\u5206\u91ce\u306e\u6587\u7ae0\u30c7\u30fc\u30bf\u304c\u5c11\u306a\u3044\u5834\u5408\u3067\u3082\u3001\u5c02\u9580\u30b3\u30fc\u30d1\u30b9\u3092\u30aa\u30fc\u30d0\u30fc\u30b5\u30f3\u30d7\u30ea\u30f3\u30b0\u3057\u3066\u4e00\u822c\u30b3\u30fc\u30d1\u30b9\u3068\u30d0\u30e9\u30f3\u30b9\u3088\u304f\u4e8b\u524d\u5b66\u7fd2\u3055\u305b\u308b\u3053\u3068\u3067\u3001\u5b9f\u7528\u7684\u306a\u533b\u7642BERT\u3092\u69cb\u7bc9\u3067\u304d\u308b\u3053\u3068\u3092\u793a\u3057\u305f\u7814\u7a76\u3067\u3059\u3002<\/p>\n\n\n\n<h4 class=\"wp-block-heading\">Keywords<\/h4>\n\n\n\n<p class=\"wp-block-paragraph\">\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u3001AI\uff08\u6a5f\u68b0\u5b66\u7fd2\uff09\u3001\u533b\u5b66\u77e5\u8b58\u3001BERT\u3001\u533b\u7642\u30c6\u30ad\u30b9\u30c8\u30de\u30a4\u30cb\u30f3\u30b0<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u306a\u305c\u3053\u306e\u7814\u7a76\u3092\u3057\u305f\u306e\u304b<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">BERT\u306a\u3069\u306e\u8a00\u8a9e\u30e2\u30c7\u30eb\u306f\u3001\u5927\u91cf\u306e\u6587\u7ae0\u3067\u4e8b\u524d\u5b66\u7fd2\u3059\u308b\u3053\u3068\u3067\u3001\u533b\u7642\u6587\u66f8\u304b\u3089\u306e\u60c5\u5831\u62bd\u51fa\u3084\u5206\u985e\u306b\u5f79\u7acb\u3061\u307e\u3059\u3002\u3057\u304b\u3057\u3001\u82f1\u8a9e\u4ee5\u5916\u306e\u8a00\u8a9e\u3084\u7279\u5b9a\u306e\u533b\u7642\u9818\u57df\u3067\u306f\u3001\u9ad8\u54c1\u8cea\u3067\u5927\u898f\u6a21\u306a\u516c\u958b\u30b3\u30fc\u30d1\u30b9\u3092\u96c6\u3081\u308b\u3053\u3068\u304c\u96e3\u3057\u304f\u3001\u5341\u5206\u306a\u6027\u80fd\u3092\u6301\u3064\u533b\u7642\u5411\u3051\u30e2\u30c7\u30eb\u3092\u4f5c\u308a\u306b\u304f\u3044\u3068\u3044\u3046\u8ab2\u984c\u304c\u3042\u308a\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u3069\u3046\u8abf\u3079\u305f\u304b<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u7814\u7a76\u30c1\u30fc\u30e0\u306f\u3001\u5c0f\u898f\u6a21\u306a\u533b\u7642\u30fb\u751f\u7269\u533b\u5b66\u30b3\u30fc\u30d1\u30b9\u3092\u7e70\u308a\u8fd4\u3057\u4f7f\u3046\u300c\u30aa\u30fc\u30d0\u30fc\u30b5\u30f3\u30d7\u30ea\u30f3\u30b0\u300d\u306b\u3088\u308a\u3001\u4e00\u822c\u30b3\u30fc\u30d1\u30b9\u3068\u306e\u91cf\u7684\u306a\u504f\u308a\u3092\u88dc\u6b63\u3057\u306a\u304c\u3089\u540c\u6642\u306b\u4e8b\u524d\u5b66\u7fd2\u3059\u308b\u65b9\u6cd5\u3092\u63d0\u6848\u3057\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u3053\u306e\u65b9\u6cd5\u3092\u7528\u3044\u3066\u3001\u6b21\u306e3\u3064\u306e\u5b9f\u9a13\u3092\u884c\u3044\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>\u5c0f\u898f\u6a21\u306a\u82f1\u8a9e\u751f\u7269\u533b\u5b66\u30b3\u30fc\u30d1\u30b9\u304b\u3089\u82f1\u8a9eBiomedical BERT\u3092\u4f5c\u6210<\/li>\n\n\n\n<li>\u5c0f\u898f\u6a21\u306a\u65e5\u672c\u8a9e\u533b\u7642\u30b3\u30fc\u30d1\u30b9\u304b\u3089\u65e5\u672c\u8a9eMedical BERT\u3092\u4f5c\u6210<\/li>\n\n\n\n<li>PubMed\u6284\u9332\u5168\u4f53\u3092\u4f7f\u3044\u3001\u75be\u60a3\u95a2\u9023\u6284\u9332\u3092\u30d0\u30e9\u30f3\u30b9\u3088\u304f\u5f37\u8abf\u3057\u305f\u5f37\u5316\u7248Biomedical BERT\u3092\u4f5c\u6210<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">\u305d\u306e\u3046\u3048\u3067\u3001\u5f93\u6765\u306e\u4e8b\u524d\u5b66\u7fd2\u6cd5\u3084\u65e2\u5b58\u306eBERT\u30e2\u30c7\u30eb\u3068\u3001BLUE benchmark\u3084\u65e5\u672c\u8a9e\u533b\u7642\u30bf\u30b9\u30af\u3067\u6027\u80fd\u3092\u6bd4\u8f03\u3057\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u4f55\u304c\u308f\u304b\u3063\u305f\u304b<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u5c0f\u898f\u6a21\u306a\u533b\u7642\u30b3\u30fc\u30d1\u30b9\u3092\u4f7f\u3063\u305f\u5834\u5408\u3067\u3082\u3001\u63d0\u6848\u624b\u6cd5\u306b\u3088\u308b\u82f1\u8a9eBERT\u306fBLUE benchmark\u3067\u5b9f\u7528\u7684\u306a\u6027\u80fd\u3092\u793a\u3057\u3001\u540c\u3058\u30b3\u30fc\u30d1\u30b9\u30b5\u30a4\u30ba\u306e\u5f93\u6765\u6cd5\u3088\u308a\u9ad8\u3044\u30b9\u30b3\u30a2\u3092\u793a\u3057\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u65e5\u672c\u8a9e\u533b\u7642BERT\u3067\u3082\u3001\u63d0\u6848\u624b\u6cd5\u3067\u4f5c\u6210\u3057\u305f\u30e2\u30c7\u30eb\u306f\u3001\u533b\u7642\u6587\u66f8\u5206\u985e\u3084\u533b\u7642\u30c6\u30ad\u30b9\u30c8\u51e6\u7406\u30bf\u30b9\u30af\u306e\u591a\u304f\u3067\u5f93\u6765\u30e2\u30c7\u30eb\u3092\u4e0a\u56de\u308a\u307e\u3057\u305f\u3002\u3055\u3089\u306b\u3001PubMed\u6284\u9332\u3092\u4f7f\u3063\u305f\u5f37\u5316\u7248Biomedical BERT\u3067\u306f\u3001\u81e8\u5e8a\u30ce\u30fc\u30c8\u3092\u4f7f\u308f\u305a\u306b\u81e8\u5e8a\u30bf\u30b9\u30af\u3068\u751f\u7269\u533b\u5b66\u30bf\u30b9\u30af\u306e\u4e21\u65b9\u3067\u30b9\u30b3\u30a2\u6539\u5584\u304c\u78ba\u8a8d\u3055\u308c\u307e\u3057\u305f\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u306a\u305c\u5927\u4e8b\u306a\u306e\u304b<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u533b\u7642AI\u306e\u6027\u80fd\u306f\u3001\u5229\u7528\u3067\u304d\u308b\u533b\u7642\u30c6\u30ad\u30b9\u30c8\u30c7\u30fc\u30bf\u306e\u91cf\u3068\u8cea\u306b\u5927\u304d\u304f\u5de6\u53f3\u3055\u308c\u307e\u3059\u3002\u3053\u306e\u7814\u7a76\u306f\u3001\u30c7\u30fc\u30bf\u304c\u9650\u3089\u308c\u308b\u65e5\u672c\u8a9e\u533b\u7642\u5206\u91ce\u3084\u5c02\u9580\u9818\u57df\u3067\u3082\u3001\u30b3\u30fc\u30d1\u30b9\u8a2d\u8a08\u3068\u4e8b\u524d\u5b66\u7fd2\u65b9\u6cd5\u3092\u5de5\u592b\u3059\u308b\u3053\u3068\u3067\u3001\u9ad8\u6027\u80fd\u306a\u8a00\u8a9e\u30e2\u30c7\u30eb\u3092\u69cb\u7bc9\u3067\u304d\u308b\u53ef\u80fd\u6027\u3092\u793a\u3057\u3066\u3044\u307e\u3059\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u3053\u308c\u306f\u3001\u8a3a\u7642\u9332\u3001\u533b\u5b66\u6587\u732e\u3001\u533b\u7642\u6587\u66f8\u5206\u985e\u3001\u56fa\u6709\u8868\u73fe\u62bd\u51fa\u306a\u3069\u3001\u533b\u7642\u73fe\u5834\u306e\u81ea\u7136\u8a00\u8a9e\u51e6\u7406\u3092\u9032\u3081\u308b\u3046\u3048\u3067\u91cd\u8981\u306a\u77e5\u898b\u3067\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u6b21\u306b\u76ee\u6307\u3059\u3053\u3068<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">\u672c\u7814\u7a76\u3067\u306f\u3001\u65e5\u672c\u8a9e\u30bf\u30b9\u30af\u306e\u6570\u304c\u9650\u3089\u308c\u3066\u3044\u305f\u3053\u3068\u3001BERT\u4ee5\u5916\u306e\u30e2\u30c7\u30eb\u69cb\u9020\u3067\u306f\u691c\u8a3c\u3055\u308c\u3066\u3044\u306a\u3044\u3053\u3068\u3001\u30aa\u30fc\u30d0\u30fc\u30b5\u30f3\u30d7\u30ea\u30f3\u30b0\u6bd4\u7387\u304c\u4e3b\u306b1\u5bfe1\u3067\u691c\u8a0e\u3055\u308c\u305f\u3053\u3068\u304c\u9650\u754c\u3068\u3057\u3066\u6319\u3052\u3089\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u4eca\u5f8c\u306f\u3001\u3088\u308a\u591a\u69d8\u306a\u65e5\u672c\u8a9e\u533b\u7642\u30bf\u30b9\u30af\u3001\u9577\u3044\u81e8\u5e8a\u6587\u66f8\u3001BERT\u4ee5\u5916\u306e\u5927\u898f\u6a21\u8a00\u8a9e\u30e2\u30c7\u30eb\u3001PubMed\u3068MIMIC-III\u306e\u3088\u3046\u306a\u81e8\u5e8a\u30fb\u751f\u7269\u533b\u5b66\u30c7\u30fc\u30bf\u306e\u7d44\u307f\u5408\u308f\u305b\u306b\u5bfe\u3057\u3066\u3001\u6700\u9069\u306a\u4e8b\u524d\u5b66\u7fd2\u30d0\u30e9\u30f3\u30b9\u3092\u691c\u8a3c\u3059\u308b\u3053\u3068\u304c\u671f\u5f85\u3055\u308c\u307e\u3059\u3002<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">\u95a2\u9023\u8cc7\u6599<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\"><a href=\"https:\/\/hdl.handle.net\/11094\/101488\" target=\"_blank\" rel=\"noreferrer noopener\">\u5927\u962a\u5927\u5b66\u5b66\u8853\u60c5\u5831\u5eabOUKA<\/a><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u5c0f\u3055\u306a\u533b\u7642\u30b3\u30fc\u30d1\u30b9\u3067\u3082\u533b\u7642\u7528BERT\u3092\u9ad8\u6027\u80fd\u5316\u3059\u308b\u305f\u3081\u306e\u4e8b\u524d\u5b66\u7fd2\u6cd5\u306b\u95a2\u3059\u308b\u7814\u7a76<\/p>\n","protected":false},"featured_media":325,"template":"","achievement_type":[20],"achievement_keyword":[13,24],"fiscal_year":[32],"class_list":["post-164","achievement","type-achievement","status-publish","has-post-thumbnail","hentry","achievement_type-papers","achievement_keyword-ai","achievement_keyword-24","fiscal_year-32"],"_links":{"self":[{"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/achievement\/164","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/achievement"}],"about":[{"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/types\/achievement"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/media\/325"}],"wp:attachment":[{"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/media?parent=164"}],"wp:term":[{"taxonomy":"achievement_type","embeddable":true,"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/achievement_type?post=164"},{"taxonomy":"achievement_keyword","embeddable":true,"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/achievement_keyword?post=164"},{"taxonomy":"fiscal_year","embeddable":true,"href":"https:\/\/www.med.osaka-u.ac.jp\/pub\/hp-info\/wp-json\/wp\/v2\/fiscal_year?post=164"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}