{"id":10014,"date":"2019-07-02T06:20:52","date_gmt":"2019-07-01T21:20:52","guid":{"rendered":"https:\/\/www.suzukikenichi.com\/blog\/?p=10014"},"modified":"2019-07-02T06:16:57","modified_gmt":"2019-07-01T21:16:57","slug":"google-works-to-make-robots-exclusion-protocol-internet-standard","status":"publish","type":"post","link":"https:\/\/www.suzukikenichi.com\/blog\/google-works-to-make-robots-exclusion-protocol-internet-standard\/","title":{"rendered":"Google\u4e3b\u5c0e\u306e\u3082\u3068\u3001Robots Exclusion Protocol (REP) \u304c\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u306b"},"content":{"rendered":"

[\u30ec\u30d9\u30eb: \u4e0a\u7d1a]<\/p>\n

robots.txt \u306e\u4ed5\u69d8\u3092\u6a19\u6e96\u5316\u3059\u308b\u53d6\u308a\u7d44\u307f\u306b Google \u306f\u7740\u624b<\/a>\u3057\u307e\u3057\u305f\u3002<\/p>\n

\u80cc\u666f<\/h2>\n

\u80cc\u666f\u3092\u5b8c\u7d50\u306b\u8aac\u660e\u3057\u307e\u3059\u3002<\/p>\n

\u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u306e\u30af\u30ed\u30fc\u30e9\u2015\u2015Google \u3067\u8a00\u3048\u3070 Googlebot\u2015\u2015\u306e\u30af\u30ed\u30fc\u30eb\u3092\u5236\u5fa1\u3059\u308b\u305f\u3081\u306b robots.txt \u3092\u5229\u7528\u3067\u304d\u307e\u3059\u3002
robots.txt \u306e\u4ed5\u69d8\u3092 Robots Exclusion Protocol (REP)<\/mark><\/b> \u3068\u547c\u3073\u307e\u3059\u3002<\/p>\n

REP \u306f\u3082\u3068\u3082\u3068 Martijn Koster\uff08\u30de\u30fc\u30c6\u30a3\u30f3\u30fb\u30ab\u30b9\u30bf\u30fc\uff09<\/a>\u6c0f\u306b\u3088\u3063\u3066 1994 \u5e74\u306b\u8003\u6848\u3055\u308c\u305f\u4ed5\u7d44\u307f\u3067\u3059\u3002
\u30af\u30ed\u30fc\u30e9\u304c\u30af\u30ed\u30fc\u30eb\u3059\u308b\u3068\u304d\u306b\u3001\u904e\u5ea6\u306a\u8ca0\u8377\u3092\u30b5\u30fc\u30d0\u30fc\u306b\u304b\u3051\u308b\u3053\u3068\u3092\u9632\u3050\u3053\u3068\u304c\u76ee\u7684\u3067\u3057\u305f\u3002
\u3061\u306a\u307f\u306b\u3001Koster \u6c0f\u81ea\u8eab\u304c\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8\u3092\u7ba1\u7406\u3059\u308b\u30a6\u30a7\u30d6\u30de\u30b9\u30bf\u30fc\u3067\u3057\u305f\u3002<\/p>\n

\u4ed5\u69d8\u306e\u516c\u958b\u4ee5\u6765 25 \u5e74\u3001REP \u306f\u5e45\u5e83\u304f\u4f7f\u308f\u308c\u308b\u3088\u3046\u306b\u306a\u308a\u4e8b\u5b9f\u4e0a\u306e\u6a19\u6e96\u306b\u306a\u308a\u307e\u3057\u305f\u3002
\u73fe\u5728\u30015 \u5104\u306e\u30b5\u30a4\u30c8\u304c\u4f7f\u7528\u3057\u3066\u3044\u308b\u3068\u306e\u3053\u3068\u3067\u3059\u3002<\/p>\n

\u3057\u304b\u3057\u3001\u4e8b\u5b9f\u4e0a\u306e\u6a19\u6e96\u3067\u306f\u3042\u308b\u3082\u306e\u306e\u6b63\u5f0f\u306a\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96<\/a>\u3067\u306f\u3042\u308a\u307e\u305b\u3093\u3067\u3057\u305f\u3002<\/p>\n

\u305d\u306e\u305f\u3081\u3001\u5229\u7528\u8005\u306b\u3088\u3063\u3066\u4f7f\u3044\u65b9\u3084\u89e3\u91c8\u306e\u4ed5\u65b9\u304c\u5fae\u5999\u306b\u7570\u306a\u3063\u3066\u304f\u308b\u3053\u3068\u304c\u3042\u308a\u307e\u3059\u3002
\u305f\u3068\u3048\u3070\u3001Disallow:<\/mark><\/b> \u306e\u30b3\u30ed\u30f3\u3092\u4ed8\u3051\u5fd8\u308c\u305f\u308a\u3001Dis Allow \u3068\u7db4\u3063\u3066\u3057\u307e\u3063\u305f\u308a\u3057\u305f\u5834\u5408\u306e\u51e6\u7406\u3067\u3059\u3002<\/p>\n

\u305d\u3053\u3067\u3001robots.txt \u3092\u4f7f\u7528\u3059\u308b\u3059\u3079\u3066\u306e\u4eba\uff08robots.txt \u306b\u5f93\u3046\u30af\u30ed\u30fc\u30e9\u306e\u958b\u767a\u8005\u3001robots.txt \u3092\u4f7f\u7528\u3059\u308b\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8\u7ba1\u7406\u8005\uff09\u306e\u305f\u3081\u306e\u7d71\u4e00\u3055\u308c\u305f\u4ed5\u69d8\u3092\u4f5c\u6210\u3059\u308b\u3053\u3068\u306b Google \u306f\u53d6\u308a\u7d44\u307f\u59cb\u3081\u305f\u306e\u3067\u3059\u3002<\/p>\n

Google \u304c\u4e3b\u5c0e\u3057\u305f\u3068\u306f\u3068\u306f\u3044\u3048\u3001\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u3067\u3059\u3002
REP \u8003\u6848\u8005\u306e Koster \u6c0f\u3084\u307b\u304b\u306e\u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u4f01\u696d\u3068\u30a6\u30a7\u30d6\u30de\u30b9\u30bf\u30fc\u305f\u3061\u3068\u5171\u540c\u3067\u53d6\u308a\u7d44\u3093\u3067\u3044\u307e\u3059\u3002
\u3082\u3063\u3068\u3044\u3048\u3070\u3001\u3042\u3089\u3086\u308b\u4eba\uff08\u3042\u306a\u305f\u3082\uff01\uff09\u304c\u6700\u7d42\u7684\u306a\u7b56\u5b9a\u3078\u306e\u30d7\u30ed\u30bb\u30b9\u306b\u95a2\u4e0e\u3067\u304d\u307e\u3059\u3002<\/p>\n

Google \u304c\u4f5c\u6210\u3057\u305f\u63d0\u6848\u6587\u66f8<\/a> (RFC: Request For Comments) \u306f\u73fe\u5728 Draft Standard\uff08\u6a19\u6e96\u5316\u3078\u306e\u8349\u7a3f\uff09 \u306e\u6bb5\u968e\u3067\u3059\u3002
\u3053\u306e\u3042\u3068 standard\uff08\u6a19\u6e96\uff09\u306e\u6bb5\u968e\u3092\u7d4c\u3066\u6700\u7d42\u7684\u306b\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u306b\u306a\u308a\u307e\u3059\u3002<\/p>\n

\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96 \u306b\u306a\u3063\u305f REP \u306b\u5f93\u3048\u3070\u3001\u958b\u767a\u8005\u30fb\u30b5\u30a4\u30c8\u7ba1\u7406\u8005\u306f\u7d71\u4e00\u3055\u308c\u305f\u5171\u901a\u306e\u4ed5\u69d8\u3067 robots.txt \u3092\u5229\u7528\u3067\u304d\u307e\u3059\u3002<\/p>\n

\u30b5\u30a4\u30c8\u7ba1\u7406\u8005\u306b\u4e0e\u3048\u308b\u5f71\u97ff<\/h2>\n

\u3055\u3066\u3001\u50d5\u305f\u3061\u30b5\u30a4\u30c8\u7ba1\u7406\u8005\u306b\u306f\u3069\u3093\u306a\u5f71\u97ff\u304c\u3042\u308b\u306e\u3067\u3057\u3087\u3046\u304b\uff1f
\u4eca\u4f7f\u3063\u3066\u3044\u308b robots.txt \u306b\u4f55\u304b\u5909\u66f4\u3092\u52a0\u3048\u308b\u5fc5\u8981\u304c\u3042\u308b\u306e\u3067\u3057\u3087\u3046\u304b\uff1f<\/p>\n

\u901a\u5e38\u306f\u3001\u4f55\u3082\u3059\u308b\u5fc5\u8981\u306f\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n

\u3069\u3061\u3089\u304b\u3068\u3044\u3046\u3068\u3001REP \u306e\u6a19\u6e96\u5316\u306f\u3001REP \u3092\u5229\u7528\u3059\u308b\u30af\u30ed\u30fc\u30e9\u306e\u958b\u767a\u8005\u306b\u3068\u3063\u3066\u5927\u304d\u306a\u5909\u9769\u306e\u610f\u5473\u5408\u3044\u304c\u5f37\u3044\u3067\u3059\u3002<\/p>\n

\u30a6\u30a7\u30d6\u30b5\u30a4\u30c8\u3092\u95b2\u89a7\u3059\u308b\u3068\u304d\u306e HTTP \u30d7\u30ed\u30c8\u30b3\u30eb\u3082\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u3067\u3059\u3002
\u3051\u308c\u3069 HTTP \u306e\u4ed5\u69d8\u3092\u307b\u3068\u3093\u3069\u77e5\u3057\u3089\u306a\u304f\u3066\u3082\u3001\u30a6\u30a7\u30d6\u30de\u30b9\u30bf\u30fc\u3068\u3057\u3066\u50d5\u305f\u3061\u306f\u30b5\u30a4\u30c8\u3092\u516c\u958b\u3067\u304d\u308b\u3057\u3001\u30e6\u30fc\u30b6\u30fc\u3068\u3057\u3066\u95b2\u89a7\u3067\u304d\u307e\u3059\u3088\u306d\u3002
\u3067\u3082\u3001\u30a6\u30a7\u30d6\u30b5\u30fc\u30d0\u30fc\u3084\u30d6\u30e9\u30a6\u30b6\u3092\u958b\u767a\u3059\u308b\u30a8\u30f3\u30b8\u30cb\u30a2\u306f HTTP \u306e\u4ed5\u69d8\u3092\u77e5\u3063\u3066\u3044\u308b\u5fc5\u8981\u304c\u3042\u308a\u307e\u3059\u3002
\n\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u3092\u96e2\u308c\u305f\u4f8b\u3067\u8a00\u3048\u3070\u3001\u30a8\u30f3\u30b8\u30f3\u306e\u4ed5\u7d44\u307f\u3092\u77e5\u3089\u306a\u304f\u3066\u3082\u81ea\u52d5\u8eca\u3092\u904b\u8ee2\u3067\u304d\u307e\u3059\u3088\u306d\u3002
\u3067\u3082\u3001\u81ea\u52d5\u8eca\u30e1\u30fc\u30ab\u30fc\u306e\u30a8\u30f3\u30b8\u30cb\u30a2\u3084\u81ea\u52d5\u8eca\u4fee\u7406\u5de5\u5834\u306e\u6574\u5099\u54e1\u306f\u30a8\u30f3\u30b8\u30f3\u306e\u4ed5\u7d44\u307f\u306b\u719f\u77e5\u3057\u3066\u3044\u306a\u3051\u308c\u3070\u306a\u308a\u307e\u305b\u3093\u3002<\/p>\n

\u540c\u3058\u3053\u3068\u3067\u3059\u3002
REP \u304c\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u306b\u306a\u308b\u3053\u3068\u3092\u50d5\u305f\u3061\u306f\u3053\u3068\u3055\u3089\u610f\u8b58\u3059\u308b\u5fc5\u8981\u306f\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n

\u305d\u308c\u3067\u3082\u7d30\u304b\u306a\u3053\u3068\u3092\u8a00\u3048\u3070\u3001REP \u306e\u6a19\u6e96\u5316\u306b\u4f34\u3044\u3001Google \u306e robots.txt \u306e\u30c9\u30ad\u30e5\u30e1\u30f3\u30c8\u306b\u306f\u66f4\u65b0<\/a>\u304c\u5165\u308a\u307e\u3057\u305f\u3002<\/p>\n

\u3053\u308c\u306f\u3001\u5225\u8a18\u4e8b\u3067\u5f8c\u65e5\u8aac\u660e\u3057\u305f\u3044\u3068\u601d\u3044\u307e\u3059\u3002<\/p>\n

\u3068\u3044\u3046\u3053\u3068\u3067\u3001REP \u306e\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u5316\u306f\u3001\u691c\u7d22\u30a8\u30f3\u30b8\u30f3\u4f01\u696d\uff08\u30af\u30ed\u30fc\u30e9\u958b\u767a\u8005\uff09\u306b\u306f\u5927\u304d\u306a\u30cb\u30e5\u30fc\u30b9\u3067\u3059\u3002
\u305d\u308c\u3067\u3082\u50d5\u305f\u3061\u306b\u306f\u3001\u307b\u307c\u5f71\u97ff\u306f\u3042\u308a\u307e\u305b\u3093\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"

robots.txt \u306e\u4ed5\u69d8\u3092\u6a19\u6e96\u5316\u3059\u308b\u53d6\u308a\u7d44\u307f\u306b Google \u306f\u7740\u624b\u3057\u305f\u300225 \u5e74\u524d\u306b\u8003\u6848\u3055\u308c\u305f Robots Exclusion Protocol (REP) \u306f\u4e8b\u5b9f\u4e0a\u306e\u6a19\u6e96\u3067\u306f\u3042\u3063\u305f\u304c\u7d71\u4e00\u3055\u308c\u305f\u30a4\u30f3\u30bf\u30fc\u30cd\u30c3\u30c8\u6a19\u6e96\u3067\u306f\u306a\u304b\u3063\u305f\u3002<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,8],"tags":[62,406],"class_list":{"0":"post-10014","1":"post","2":"type-post","3":"status-publish","4":"format-standard","6":"category-google-seo","7":"category-net-marketing","8":"tag-robotstxt","9":"tag-robots-exclusion-protocol"},"_links":{"self":[{"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/posts\/10014","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/comments?post=10014"}],"version-history":[{"count":0,"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/posts\/10014\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/media?parent=10014"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/categories?post=10014"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.suzukikenichi.com\/blog\/wp-json\/wp\/v2\/tags?post=10014"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}