Blocking Mozilla Tabstack
help wanted
There is also Mozilla Tabstack, which is "Web browsing for AI systems". As such they would qualify as an AI crawler to be put into this list.
According to their own website, they respect the `robots.txt` as `Mozilla-Tabstack`: https://docs.tabstack.ai/trust/controlling-access
1 条评论