.Google's Gary Illyes uncovers Googlebot accumulates web links as opposed to "following" all of them, negating main documents.Googlebot accumulates links rather than following all of them in real-time.Gary Illyes discussed this relevant information in Google's 'Look Off The Record' podcast.Google.com's documentation contradicts the genuine crawler actions.