ITADN
首页
AIGC
博客文章
GIT库
资源下载
C龙虾
程序订做
联系我们
ai-robots-txt/ai.robots.txt
/
Issues
Blocking CCBot
#211
Closed
wumpus
创建于 2026-01-22
W
wumpus
commented
The Common Crawl Foundation has an open-access repository, and we're the kind of organization which should be a member of COAR. Why is CCBot in the robots.txt in this repo?
关闭于 2026-01-22
2 条评论