Quote:
Originally Posted by TheSquealer
I did contradict myself... but i did say unless you are indexing the entire web, there is no way to know. For most of the life of SEO, people had to rely on what was provided by search engines which was never much. Are these tools secret? Why not just post the links? I haven't been too worried about it in recent years but I would be interested to see them.
|
Majestic & Ahrefs
They both index the entire web. There is usually a 5% tolerance when it comes to results, meaning one may deviate from the other by around 5% on average. Used together you get a pretty complete and accurate picture.
Quote:
Originally Posted by TheSquealer
Being that Google announced they had passed 3 trillion pages indexed in 2008, i really can't imagine anyone trying to index the web as a "tool" as it would require unreal computing power and storage and couldn't possibly pay for itself by selling the tool or providing access.
|
Availability of scalable powerful computing and network resources is better now than it was in 2008. It's possible to index the entire web quite cheaply (relatively) using off the shelf compute resources offered by Amazon and other providers, feed that data to micro services which are scalable and cheap then you can analyse that data for pennies.