Google Does Not Remove URLs Excluded By Robots.txt Until URLs Are Individually Reprocessed

Google's John Mueller posted a clarification on how and when Google processes the removal requests, or exclusion requests, you make in your robots.txt. The action is not taken when Google discovers the change in your robots.txt, but rather after first the robots.txt is processed and then the specific URLs that are impacted are individually reprocessed by Google Search.

Accounts Tweeting
Other Articles by Tweeters
First Shared
March 21, 2023 @ 9:11 PM PST
Loading Tweets
Currently no tweets or quote tweets to display.