Googlebot Website Traffic Affect SEO
Yes more than that so so Robots.txt is very effective at being able to sort of tell much how to do a certain thing But in this scenario, like how do you tell that like, it’s Googlebot visiting your site? Yes question Yes So as we are basically using a browser in two steps one of the crawling and one is the the actual rendering At both of these moments we do give you the user agent header But basically there’s the string, it’s literally the string googlebot in there, that’s so right straightforward Yes, and you can actually use that to help with your SPA Performance as well. So okay as you can detect on the server side Oh, this is a googlebot user agent requesting you might consider sending us a pre-rendered static HTML Version and you can do the same thing for the others like all the other search engines and and social media Bots have a specific string saying that they are a robot Okay, so you can then basically go like oh in this case I’m not I’m not giving you the real deal that the single page app.
I’m giving you this HTML that we pre-rendered for you That’s called dynamic rendering we have ducks on that as well. The one thing that still doesn’t quite make sense to me is Does the Googlebot kind of have different contexts like Does it sometimes pretend that it’s sort like I I think of it as this little mythical creature that’s pretending to do certain things so like does it pretend to be on a mobile and then desktop like Are they different sort of I guess like user agents? Even though it still says Googlebot and can you differentiate between them you’re asking great questions because yes, we have different user agents So I’m not sure if you heard about more by first indexing being rolled out and happening I’ve heard that like it’s going to affect like how you’re ranked.
Potentially That’s two different things that get conflated so often. So mobile- first indexing is about us discovering your content using a mobile user agent and a mobile viewport. So we are using mobile user agents and and the user agent string says so if it says something about Android and the name And then you’re like aha. So this is the mobile Googlebot you have documentation on there There’s literally a Help Center article that lists all these things So we try to index mobile content to make sure that we have something nice to serve for people who are on mobile But we’re not pretending like random user-agents or anything that we stick to the user agent strings that we have documented as well And that’s more my first indexing where we try to get your mobile content into the index rather than the desktop content, huh? And then there’s mobile readiness or mobile friendliness If your page is mobile-friendly it makes sure that everything is within viewport and you have large enough tap targets and all these kind of lovely things and that just Is a quality indicator we call these signals we have over 200 of them That’s a lot So Googlebot collects all these signals and then stuffs them as metadata into the index And then when ranked we’re like, okay, so this user’s on mobile So maybe this thing that has a really good mobile friendliness Signal attached to it might be a better one and the thing where they have to like pinch zoom all the way out to be Able to read anything and then can’t actually deal with the different links because they’re too close to each other so that’s one of the many it’s not the signal it’s one of the many signals is one of the over 200 signals to to deal with I Had no idea.
They were 200 right? That’s like me I know that you’re not allowed to like share what they all out because like there has to be a certain mystique around it because I guess like a lot of SEOs abused that in the past. Yeah, yeah Unfortunately that is a game that is still being played and people are doing like weird stuff to try to game us And the interesting thing with this is with the 200 signals. It’s really hard to say which one gets you would like weights And they keep moving and they keep changing So it’s I love when people are like no let’s do this and then look my my rank changes like yeah for this one query But you lost on all the other queries because you did like really weird and funky stuff for that. So just Build good content for the users and then you’ll be fine I feel like that it feels like less effort as well and like constantly trying to yeah Yeah, but it’s not an easy answer, right? You’ll pay me to make you more successful on on Search engines and I come to you and say like so who are your users and what do they need and how could you express? That so that they know that it’s what they need That’s a hard one because that means I basically bring the ball back to you and you have to think about stuff and figure out strategically whereas if I’m like, okay, I’m just gonna you know Get you get you links, or do some funky tricks here and then you’ll be ranking number one.