\n \ud604\ub300 \uc0ac\ud68c\uc5d0\uc11c \uc815\ubcf4\uc758 \uc591\uc740 \uae30\ud558\uae09\uc218\uc801\uc73c\ub85c \uc99d\uac00\ud558\uace0 \uc788\uc73c\uba70, \uc774\ub294 \uc790\uc5f0\uc5b4 \ucc98\ub9ac(Natural Language Processing, NLP)\uc758 \uc911\uc694\uc131\uc744 \ub354\uc6b1 \ubd80\uac01\uc2dc\ud0a4\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc5b8\uc5b4\ub294 \uc778\uac04\uc758 \uc758\uc0ac\uc18c\ud1b5 \ub3c4\uad6c\ub85c\uc11c \ub9e4\uc6b0 \ubcf5\uc7a1\ud558\uace0 \ub2e4\uc591\ud55c \ub258\uc559\uc2a4\ub97c \ub0b4\ud3ec\ud558\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc774\uc5d0 \ub530\ub77c \uc790\uc5f0\uc5b4 \ucc98\ub9ac \ubd84\uc57c\ub294 \uc778\uacf5\uc9c0\ub2a5(AI) \uae30\uc220\uc758 \ud575\uc2ec \uc5f0\uad6c \ubd84\uc57c \uc911 \ud558\ub098\ub85c \uc790\ub9ac \uc7a1\uc558\uc2b5\ub2c8\ub2e4.\n<\/p>\n
\n \uc790\uc5f0\uc5b4 \ucc98\ub9ac\ub294 \ucef4\ud4e8\ud130\uac00 \uc778\uac04 \uc5b8\uc5b4\ub97c \uc774\ud574\ud558\uace0 \ud574\uc11d\ud560 \uc218 \uc788\ub3c4\ub85d \ud558\ub294 \uae30\uc220\ub85c \uc815\uc758\ub429\ub2c8\ub2e4. \uc774\ub294 \ud14d\uc2a4\ud2b8\uc640 \uc74c\uc131\uc744 \ud3ec\ud568\ud55c \ub2e4\uc591\ud55c \ud615\ud0dc\uc758 \uc5b8\uc5b4 \ub370\uc774\ud130\ub97c \ucc98\ub9ac\ud560 \uc218 \uc788\ub294 \ub2a5\ub825\uc744 \ud3ec\ud568\ud569\ub2c8\ub2e4. \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc758 \uc8fc\uc694 \uc791\uc5c5\uc740 \ub2e4\uc74c\uacfc \uac19\uc2b5\ub2c8\ub2e4:\n<\/p>\n
\n \uc774\ub7ec\ud55c \uc791\uc5c5\ub4e4\uc740 \uc790\uc5f0\uc5b4\uc758 \uad6c\uc870\uc640 \uc758\ubbf8\ub97c \uc774\ud574\ud558\uace0, \uc774\ub97c \ubc14\ud0d5\uc73c\ub85c \ub2e4\uc591\ud55c \uc5b8\uc5b4 \uae30\ubc18 \uc560\ud50c\ub9ac\ucf00\uc774\uc158\uc744 \uac1c\ubc1c\ud558\ub294 \ub370 \uae30\uc5ec\ud569\ub2c8\ub2e4.\n<\/p>\n
\n \ub525 \ub7ec\ub2dd\uc740 \ub2e4\uce35 \uc2e0\uacbd\ub9dd\uc744 \ud65c\uc6a9\ud558\uc5ec \ub370\uc774\ud130\uc5d0\uc11c \ud328\ud134\uc744 \uc790\ub3d9\uc73c\ub85c \ud559\uc2b5\ud558\ub294 \ubc29\ubc95\uc785\ub2c8\ub2e4. \uc804\ud1b5\uc801\uc778 \uae30\uacc4\ud559\uc2b5 \uae30\ubc95\ub4e4\uc740 \uc218\uc791\uc5c5\uc73c\ub85c \ud2b9\uc9d5(feature)\uc744 \ucd94\ucd9c\ud574\uc57c \ud588\uc9c0\ub9cc, \ub525 \ub7ec\ub2dd\uc740 \ub370\uc774\ud130\uc758 \ubcf5\uc7a1\ud55c \uad6c\uc870\ub97c \uc2a4\uc2a4\ub85c \ud559\uc2b5\ud560 \uc218 \uc788\ub294 \uac15\ub825\ud55c \ub2a5\ub825\uc744 \uc81c\uacf5\ud569\ub2c8\ub2e4. \uc774\ub294 \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc5d0 \ub9e4\uc6b0 \uc720\uc6a9\ud569\ub2c8\ub2e4.\n<\/p>\n
\n \uc790\uc5f0\uc5b4\ub294 \ube44\uad6c\uc870\uc801\uc774\uace0 \ubcf5\uc7a1\ud55c \ub370\uc774\ud130\ub97c \ud3ec\ud568\ud558\uace0 \uc788\uc73c\ubbc0\ub85c, \ub525 \ub7ec\ub2dd\uc758 \ud65c\uc6a9\uc740 \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc758 \uc815\ud655\ub3c4\uc640 \ud6a8\uc728\uc131\uc744 \uadf9\ub300\ud654\ud558\ub294 \ub370 \uc911\uc694\ud55c \uc5ed\ud560\uc744 \ud569\ub2c8\ub2e4. \uc608\ub97c \ub4e4\uc5b4, RNN(Recurrent Neural Network)\uc774\ub098 Transformer \ubaa8\ub378\uc740 \ubb38\ub9e5 \uc815\ubcf4\ub97c \ud559\uc2b5\ud558\uace0 \uc720\uc9c0\ud558\ub294 \ub370 \ub6f0\uc5b4\ub09c \uc131\ub2a5\uc744 \ubcf4\uc5ec\uc90d\ub2c8\ub2e4.\n<\/p>\n
\n \uc790\uc5f0\uc5b4 \ucc98\ub9ac \ud504\ub85c\uc81d\ud2b8\ub97c \uc2dc\uc791\ud558\uae30 \uc804\uc5d0 \uc801\uc808\ud55c \ud658\uacbd\uc744 \uc124\uc815\ud558\ub294 \uac83\uc774 \uc911\uc694\ud569\ub2c8\ub2e4. \uc77c\ubc18\uc801\uc73c\ub85c \ub2e4\uc74c\uacfc \uac19\uc740 \uc0ac\ud56d\uc744 \uace0\ub824\ud574\uc57c \ud569\ub2c8\ub2e4:\n<\/p>\n
\n \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc5d0 \uac00\uc7a5 \ub9ce\uc774 \uc0ac\uc6a9\ub418\ub294 \ud504\ub85c\uadf8\ub798\ubc0d \uc5b8\uc5b4\ub294 Python\uc785\ub2c8\ub2e4. Python\uc740 \ub2e4\uc591\ud55c \uc790\uc5f0\uc5b4 \ucc98\ub9ac \ub77c\uc774\ube0c\ub7ec\ub9ac\ub97c \uc81c\uacf5\ud558\uc5ec \uac1c\ubc1c\uc790\ub4e4\uc774 \uc27d\uac8c \uc791\uc5c5\ud560 \uc218 \uc788\ub3c4\ub85d \ud569\ub2c8\ub2e4. \uc8fc\uc694 \ub77c\uc774\ube0c\ub7ec\ub9ac\uc5d0\ub294 \ub2e4\uc74c\uacfc \uac19\uc740 \uac83\ub4e4\uc774 \uc788\uc2b5\ub2c8\ub2e4:\n<\/p>\n
\n Jupyter Notebook\uc740 Python \ud504\ub85c\uadf8\ub798\ubc0d\uacfc \ub370\uc774\ud130 \ubd84\uc11d\uc5d0 \ub9e4\uc6b0 \uc720\uc6a9\ud55c \ub3c4\uad6c\uc785\ub2c8\ub2e4. Anaconda\ub97c \uc774\uc6a9\ud574 \ud328\ud0a4\uc9c0\ub97c \uad00\ub9ac\ud558\uace0, Jupyter Notebook\uc5d0\uc11c \ubaa8\ub378\uc744 \uac1c\ubc1c\ud558\ub294 \uac83\uc774 \uc77c\ubc18\uc801\uc785\ub2c8\ub2e4. \ub610\ud55c, Google Colab\uacfc \uac19\uc740 \ud074\ub77c\uc6b0\ub4dc \uae30\ubc18 \ud50c\ub7ab\ud3fc\uc744 \ud65c\uc6a9\ud558\uba74 GPU\ub97c \ubb34\ub8cc\ub85c \uc0ac\uc6a9\ud560 \uc218 \uc788\uc5b4 \uc131\ub2a5\uc744 \ud06c\uac8c \ud5a5\uc0c1\uc2dc\ud0ac \uc218 \uc788\uc2b5\ub2c8\ub2e4.\n<\/p>\n
\n \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc5d0\uc11c\ub294 \ub370\uc774\ud130 \uc218\uc9d1\uacfc \uc804\ucc98\ub9ac\uac00 \ub9e4\uc6b0 \uc911\uc694\ud569\ub2c8\ub2e4. \ubaa8\ub378\uc758 \uc131\ub2a5\uc740 \uc8fc\uc5b4\uc9c4 \ub370\uc774\ud130\uc758 \ud488\uc9c8\uc5d0 \ud06c\uac8c \uc758\uc874\ud558\uae30 \ub54c\ubb38\uc785\ub2c8\ub2e4.\n<\/p>\n
\n \ub2e4\uc591\ud55c \uc18c\uc2a4\uc5d0\uc11c \ub370\uc774\ud130\ub97c \uc218\uc9d1\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \uc6f9 \uc2a4\ud06c\ub798\ud551, \uacf5\uac1c \ub370\uc774\ud130\uc14b(\uc608: Kaggle, UCI Machine Learning Repository) \ub4f1\uc744 \ud1b5\ud574 \uc6d0\ud558\ub294 \ub370\uc774\ud130\ub97c \ud655\ubcf4\ud560 \uc218 \uc788\uc2b5\ub2c8\ub2e4. \ub370\uc774\ud130\ub97c \uc218\uc9d1\ud560 \ub54c\ub294 \ub2e4\uc74c\uacfc \uac19\uc740 \uc0ac\ud56d\uc744 \uc720\uc758\ud574\uc57c \ud569\ub2c8\ub2e4:\n<\/p>\n
\n \uc218\uc9d1\ud55c \ub370\uc774\ud130\ub294 \uc77c\ubc18\uc801\uc73c\ub85c \uc804\ucc98\ub9ac\uac00 \ud544\uc694\ud569\ub2c8\ub2e4. \uc804\ucc98\ub9ac \ub2e8\uacc4\uc5d0\uc11c\ub294 \ub2e4\uc74c\uacfc \uac19\uc740 \uc791\uc5c5\uc744 \uc218\ud589\ud569\ub2c8\ub2e4:\n<\/p>\n
\n \uc774\uc81c \ub370\uc774\ud130\ub97c \uc900\ube44\ud588\uc73c\ubbc0\ub85c \ub525 \ub7ec\ub2dd \ubaa8\ub378\uc744 \uad6c\ucd95\ud560 \ucc28\ub840\uc785\ub2c8\ub2e4. \uc5ec\ub7ec \uac00\uc9c0 \ubaa8\ub378\uc774 \uc788\uc9c0\ub9cc, \uadf8 \uc911 Transformer \ubaa8\ub378\uc744 \uae30\ubcf8\uc73c\ub85c \uc124\uba85\ud558\uaca0\uc2b5\ub2c8\ub2e4. Transformer \ubaa8\ub378\uc740 \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc758 \ud601\uc2e0\uc73c\ub85c, \ub6f0\uc5b4\ub09c \uc131\ub2a5\uc744 \ubcf4\uc785\ub2c8\ub2e4. \ub2e4\uc74c\uc740 Transformer\uc758 \uc8fc\uc694 \uad6c\uc131 \uc694\uc18c\uc785\ub2c8\ub2e4:\n<\/p>\n
\n Transformer\ub294 \uc778\ucf54\ub354-\ub514\ucf54\ub354 \uad6c\uc870\ub97c \uac16\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc778\ucf54\ub354\ub294 \uc785\ub825 \uc2dc\ud000\uc2a4\ub97c \ubc1b\uc544 \uace0\ucc28\uc6d0 \ubca1\ud130\ub85c \ubcc0\ud658\ud558\uace0, \ub514\ucf54\ub354\ub294 \uc774 \ubca1\ud130\ub97c \ubc14\ud0d5\uc73c\ub85c \ucd9c\ub825\uc744 \uc0dd\uc131\ud569\ub2c8\ub2e4. \uc774 \uad6c\uc870\ub294 \uae30\uacc4 \ubc88\uc5ed\uacfc \uac19\uc740 \uc5ec\ub7ec \uc790\uc5f0\uc5b4 \ucc98\ub9ac \uc791\uc5c5\uc5d0 \ud6a8\uacfc\uc801\uc785\ub2c8\ub2e4.\n<\/p>\n
\n \uc5b4\ud150\uc158 \uba54\ucee4\ub2c8\uc998\uc740 \uc785\ub825 \uc2dc\ud000\uc2a4\uc758 \uc911\uc694\ud55c \ubd80\ubd84\uc5d0 \uc9d1\uc911\ud558\ub3c4\ub85d \ud558\ub294 \uae30\ubc95\uc785\ub2c8\ub2e4. \uc774\ub294 \ub1cc\uc758 \uc9d1\uc911\ub825\uc744 \ubaa8\ubc29\ud55c \uac83\uc73c\ub85c, \uae34 \ubb38\uc7a5\uc758 \uacbd\uc6b0\uc5d0\ub3c4 \ubb38\ub9e5\uc744 \uc81c\ub300\ub85c \uc774\ud574\ud558\ub294 \ub370 \ub3c4\uc6c0\uc744 \uc90d\ub2c8\ub2e4. \ud2b9\ud788, \n Transformer\ub294 \uc21c\uc11c\ub97c \uace0\ub824\ud558\uc9c0 \uc54a\uae30 \ub54c\ubb38\uc5d0, \uc785\ub825 \ub2e8\uc5b4\uc758 \uc704\uce58 \uc815\ubcf4\ub97c \ucd94\uac00\ud558\uae30 \uc704\ud574 Positional Encoding<\/strong>\uc744 \uc0ac\uc6a9\ud569\ub2c8\ub2e4. \uc774\ub807\uac8c \ud568\uc73c\ub85c\uc368 \ubaa8\ub378\uc740 \ubb38\uc7a5\uc758 \ub2e8\uc5b4 \uac04\uc758 \uc21c\uc11c\ub97c \ud559\uc2b5\ud560 \uc218 \uc788\uac8c \ub429\ub2c8\ub2e4.\n<\/p>\n \n \ubaa8\ub378\uc744 \uad6c\ucd95\ud55c \ud6c4\uc5d0\ub294 \ud559\uc2b5\uacfc \ud3c9\uac00\ub97c \uc9c4\ud589\ud574\uc57c \ud569\ub2c8\ub2e4. \uc774\ub54c \ub2e4\uc74c\uacfc \uac19\uc740 \ub2e8\uacc4\uac00 \ud3ec\ud568\ub429\ub2c8\ub2e4:\n<\/p>\n \n \ub370\uc774\ud130\ub97c \ud559\uc2b5 \ub370\uc774\ud130\uc640 \uac80\uc99d \ub370\uc774\ud130\ub85c \ub098\ub204\uc5b4 \ud559\uc2b5 \ub3d9\uc548 \ubaa8\ub378\uc744 \ud3c9\uac00\ud569\ub2c8\ub2e4. \ubcf4\ud1b5 80-20 \ube44\uc728\ub85c \ub098\ub204\ub294 \uac83\uc774 \uc77c\ubc18\uc801\uc785\ub2c8\ub2e4.\n<\/p>\n \n \ubaa8\ub378\uc744 \ud6c8\ub828\uc2dc\ud0a4\uae30 \uc704\ud574 \uc190\uc2e4 \ud568\uc218\ub97c \uc815\uc758\ud558\uace0, \uc635\ud2f0\ub9c8\uc774\uc800\ub97c \uc120\ud0dd\ud569\ub2c8\ub2e4. \uc190\uc2e4 \ud568\uc218\ub294 \ubaa8\ub378\uc758 \ucd9c\ub825\uacfc \uc2e4\uc81c \uac12 \uac04\uc758 \ucc28\uc774\ub97c \uce21\uc815\ud558\uba70, \uc635\ud2f0\ub9c8\uc774\uc800\ub294 \uc774 \uc190\uc2e4\uc744 \ucd5c\uc18c\ud654\ud558\uae30 \uc704\ud574 \uac00\uc911\uce58\ub97c \uc870\uc815\ud569\ub2c8\ub2e4.\n<\/p>\n \n \uac80\uc99d \ub370\uc774\ud130\ub97c \uc0ac\uc6a9\ud558\uc5ec \ubaa8\ub378\uc758 \uc131\ub2a5\uc744 \ud3c9\uac00\ud569\ub2c8\ub2e4. \uc77c\ubc18\uc801\uc73c\ub85c \uc815\ud655\ub3c4(Accuracy), \uc815\ubc00\ub3c4(Precision), \uc7ac\ud604\uc728(Recall), F1 \uc810\uc218 \ub4f1\uc758 \uc9c0\ud45c\ub97c \uc0ac\uc6a9\ud569\ub2c8\ub2e4. \uc774\ub4e4 \uc9c0\ud45c\ub97c \ubd84\uc11d\ud558\uc5ec \ubaa8\ub378\uc758 \uac15\uc810\uacfc \uc57d\uc810\uc744 \ud30c\uc545\ud569\ub2c8\ub2e4.\n<\/p>\n \n \uc790\uc5f0\uc5b4 \ucc98\ub9ac \uae30\uc220\uc740 \ub2e4\uc591\ud55c \ubd84\uc57c\uc5d0\uc11c \ud65c\uc6a9\ub418\uace0 \uc788\uc2b5\ub2c8\ub2e4. \ub2e4\uc74c\uc740 \uadf8 \uba87 \uac00\uc9c0 \uc0ac\ub840\uc785\ub2c8\ub2e4:\n<\/p>\n \n \ub525 \ub7ec\ub2dd\uc744 \uc774\uc6a9\ud55c \uc790\uc5f0\uc5b4 \ucc98\ub9ac\ub294 \uc815\ubcf4\uc758 \uc591\uc774 \uc99d\uac00\ud558\ub294 \ud604\ub300 \uc0ac\ud68c\uc5d0\uc11c \ub9e4\uc6b0 \uc911\uc694\ud55c \uc5ed\ud560\uc744 \ub9e1\uace0 \uc788\uc2b5\ub2c8\ub2e4. \uc774 \uac15\uc88c\uc5d0\uc11c\ub294 \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc758 \uae30\ubcf8 \uac1c\ub150\ubd80\ud130 \uc2dc\uc791\ud574 \ub525 \ub7ec\ub2dd \ubaa8\ub378 \uad6c\ucd95, \ud559\uc2b5, \ud3c9\uac00\uae4c\uc9c0\uc758 \uacfc\uc815\uc744 \uc0b4\ud3b4\ubcf4\uc558\uc2b5\ub2c8\ub2e4.\n<\/p>\n \n \uae4a\uc740 \uc774\ud574\ub97c \ubc14\ud0d5\uc73c\ub85c \uc9c0\uc18d\uc801\uc73c\ub85c \ubc1c\uc804\ud558\ub294 \uc790\uc5f0\uc5b4 \ucc98\ub9ac \uae30\uc220\uc744 \ud0d0\uad6c\ud558\uba74\uc11c, \uc0c8\ub85c\uc6b4 \uc751\uc6a9 \uac00\ub2a5\uc131\uc744 \ubaa8\uc0c9\ud574 \ub098\uac00\uae38 \ubc14\ub78d\ub2c8\ub2e4. \ud604\uc7ac\uc640 \ubbf8\ub798\uc758 \uc5b8\uc5b4 \ucc98\ub9ac \uae30\uc220\uc774 \uc6b0\ub9ac \uc0ac\ud68c\uc5d0 \ubbf8\uce60 \uae0d\uc815\uc801\uc778 \uc601\ud5a5\uc740 \ubb34\uad81\ubb34\uc9c4\ud569\ub2c8\ub2e4.\n<\/p>\nSelf-Attention<\/code> \uba54\ucee4\ub2c8\uc998\uc740 \ubaa8\ub4e0 \uc785\ub825 \ub2e8\uc5b4 \uac04\uc758 \uad00\uacc4\ub97c \uacc4\uc0b0\ud558\uc5ec \uc815\ubcf4\uc758 \uc804\ub2ec\uc744 \ucd5c\uc801\ud654\ud569\ub2c8\ub2e4.\n<\/p>\n6.3. Positional Encoding<\/h3>\n
7. \ubaa8\ub378 \ud559\uc2b5\uacfc \ud3c9\uac00<\/h2>\n
7.1. \ud559\uc2b5 \ub370\uc774\ud130\uc640 \uac80\uc99d \ub370\uc774\ud130 \ubd84\ub9ac<\/h3>\n
7.2. \ubaa8\ub378 \ud6c8\ub828<\/h3>\n
7.3. \uacb0\uacfc \ud3c9\uac00<\/h3>\n
8. \uc790\uc5f0\uc5b4 \ucc98\ub9ac\uc758 \uc751\uc6a9 \ubd84\uc57c<\/h2>\n
\n
9. \uacb0\ub860<\/h2>\n