إنشاء ملف robots.txt وإرساله | مجموعة خدمات بحث Google  |  المستندات  |  Google for Developers

PHOTO EMBED

Wed Nov 13 2024 23:18:38 GMT+0000 (Coordinated Universal Time)

Saved by @jamile46 

# Example 1: Block only Googlebot
User-agent: Googlebot
Disallow: /

# Example 2: Block Googlebot and Adsbot
User-agent: Googlebot
User-agent: AdsBot-Google
Disallow: /

# Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)
User-agent: *
Disallow: /
content_copyCOPY

https://developers.google.com/search/docs/crawling-indexing/robots/create-robots-txt?hl