do_robotstxt WordPress Action Hook
The do_robotstxt hook allows you to add custom content to your site's robots.txt file. This can be useful if you want to add directives for specific robots, or exclude certain parts of your site from being crawled.
do_action( 'do_robotstxt' ) #
Fires when displaying the robots.txt file.