User-agent: * #Allow only below mentioned paths Allow: /suninternational/* #Disallow everything else Disallow: /libs/ Disallow: /crx/ Disallow: /crx/de/ Disallow: /system/ Disallow: /bin/ Disallow: /etc/ Disallow: /apps/ Disallow: /home/ Disallow: /editor.html/ Disallow: /cf# Disallow: /aem/ Disallow: /content/usergenerated/ Disallow: /*?wcmmode=* Disallow: /*?debug=* Disallow: /*.query.json* Disallow: /*.query.* Disallow: /*.json$ Disallow: /*.zip$ Disallow: /*.tar$ Disallow: /*.bak$ #Crawl all sitemaps mentioned below Sitemap: https://www.suninternational.com/content/suninternational/sitemap.xml