# robots.txt — 星辰实业有限公司 # 说明:开放主流搜索引擎抓取,禁止抓取后台与资源目录 # ---------- 百度蜘蛛 ---------- User-agent: Baiduspider Allow: / Disallow: /assets/ Disallow: /*?q= Crawl-delay: 1 User-agent: Baiduspider-image Allow: / User-agent: Baiduspider-render Allow: / # ---------- 搜狗蜘蛛 ---------- User-agent: Sogou web spider Allow: / Disallow: /assets/ Crawl-delay: 1 User-agent: Sogou inst spider Allow: / Disallow: /assets/ User-agent: Sogou Orion spider Allow: / # ---------- 其他主流搜索引擎 ---------- User-agent: Googlebot Allow: / Disallow: /assets/ User-agent: 360Spider Allow: / Disallow: /assets/ User-agent: YisouSpider Allow: / Disallow: /assets/ User-agent: Bytespider Allow: / Disallow: /assets/ User-agent: Bingbot Allow: / Disallow: /assets/ # ---------- 默认规则 ---------- User-agent: * Allow: / Disallow: /assets/ # ---------- 站点地图 ---------- Sitemap: https://www.example.com/sitemap.xml