设置了sitemap.json设置了指定页面禁止爬虫,监控平台就出现了大量报错,报错内容如下:
webviewScriptError
Failed to execute 'removeChild' on 'Node': The node to be removed is not a child of this node.
Error: Failed to execute 'removeChild' on 'Node': The node to be removed is not a child of this node.
at g (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:225507
at http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:225537
at E (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:226216
at m.insertChildToElement (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:227395
at a (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:224043
at n.m.replaceChild (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:229276
at b (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:1261736
at p (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:1262600
at b (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:1261977
at e.value (http://100.109.145.229:18569/wxacrawler/public/vendor/WAWebview.3217bd6f100b5b7b115a.js:1:1270333
场景值都是1129,可以确认是微信爬虫的问题。