Web crawlers and robots on Magento stores: controlling search engine and AI bots, meta robots tags, crawl budget and bot traffic.
Adds attributes to products, categories, and CMS pages to control robots meta (noindex, nofollow, noarchive). When a flag is enabled, that directive is forced to "no" for the entity; otherwise the store’s design setting is used.