You can learn a lot more about what Google really thinks by reading what their new hires say. They are not yet skilled in the arts of public relations & make major gaffs like this one:

Instead of being able to SEO the entire Internet, businesses can now only affect the search results for a tiny percentage of users. That's a good thing because SEO can't scale, and SEO isn't good for users or the Internet at large.

If you look at the Google experience from the standpoint of customers, it's pretty good. Users get relevant search results and ads. Advertisers get their content on top of everything else. It's a good compromise between advertising and usability, and it works really well. It's a bug that you could rank highly in Google without buying ads, and Google is trying to fix the bug. Manipulating Google results shouldn't be something you feel entitled to be able to do. If you want to rank highly in Google, be relevant for the user currently searching. Engage him in social media or email, provide relevant information about what you're selling, and, generally, be a "good match" for what the user wants. - Googley Jon Rockway

Would love to hear someone more senior confirm this as the official Google company position, however they are too skilled at public relations to make that blunder (at least outside of foreign AdWords ads that tell you to "forget SEO").

Ahrefs is the newest entry into the link research tool space. They use their own bot and their own index (which they state is based on information from a trillion website connections).

They claim their index is updated every 30 minutes and the fresh data is available to their users within 30 minutes of the actual index refresh.

Ahrefs also has a ranking database of roughly 45 million keywords from 9 different countries (US GB FR RU DE ES IT AU BR). The tools within their membership are:

• Site Explorer
• SERPs Analysis
• Reports
• Labs/Tools

Their pricing is very straight-forward and only increases or decreases based on volume of data you have access to. You can check out the easy to understand pricing on their pricing page (and they offer SEO Book readers a 50% discount on the first month).

Site Explorer

Ahref's Site Explorer functions in a similar way to Majestic's Site Explorer and SeoMoz's Site Explorer. You can choose a specific URL, the domain without subdomains, or domain with all its subdomains:

If we look at the Site Explorer results, you'll see an overview of the last 45 days or so from Ahref's crawl history:

On the left you can see some interesting stats like the total number of backlinks, different referring IP's and subnets (class c blocks and such), unique domains, and the types of backlinks the site has (text, image, redirects, and so on).

In addition to the overview report, you have other research options to chose from:

• New Links
• Lost Links (great opportunity for you to swoop in and alert the linker + sell them on linking to you and your resources)
• Anchor Text Profile
• Pages Crawled on the Site
• Referring Domain Breakdown
• SERP Positions (organic ranking report)
• Raw Export of the Data (up to your limits based on your pricing plan)

New Links

In the New Link tab you can go back to a previous month, or work inside the current month, and find newly discovered links by the day. Here is what that looks like:

Click on whatever day you want and you'll get a list of linking urls, the target link page, and the anchor text used for the link:

This report can help you reverse engineer, down to the day, a link building campaign that your competitor is running (always good to be out in front of a big link push by a competitor) and can also help you evaluate your own link campaign or even help you spot a link growth issue that may have resulted in some kind of penalty or over-optimization filter.

Now keep in mind that, based on their stated crawling guidelines, the stronger links from stronger sites tend to get crawled more frequently so the spammiest of the spammy link approaches might not get picked up on. For that level of deep research a historical report from Majestic SEO and a link status checker, like Advanced Link Manager, is likely a better bet.

You can export this report to Excel or .CSV format.

Lost Links

The Lost Links tab has the same interface as the New Links report does. For your own domain you might want to consider tracking your own links in something like Raven or Buzzstream but this tool does report dropped links down to the day. Combine that with their crawling preferences (better links = quicker attention) and you can spot drops of substance quickly.

You can use this report to find links that a competitor has lost, off of which you can contact the webmaster and see if you can't promote your site or similar content to earn the link your competitor was previously getting.

You can export this report to Excel or .CSV format.

Anchor Text

The anchor text report is exactly what you expect it to be. It lists the anchor texts of external links, the number of occurrences, as well as an expandable dropdown menu to see the pages being linked from and the pages being linked to on the site you are researching.

You can export to Excel or .CSV and choose to export everything, up to your limit, or just the current page.

Crawled Pages

This report will show you all the pages crawled by Ahrefs with the following stats:

• Page URL and Title
• Crawl Date
• Page Size
• Internal Links
• External Links

I would likely use this report (on competitors) for checking some of their more popular internally linked-to pages as well as checking out how they structure their site. You can also jump right to a site explorer report for any of the URL's listed on that report as well as check the SERP positions for any of them.

Referring Domains

One thing I like about Ahrefs is that it's straight and to the point. It's very easy to get in, get your data, and get out. Each report does pretty much what you expect it to. This report shows the referring domains + number links coming from that domain. You can access the links from each domain by clicking the Expand button next to the referring domain:

SERP Positioning

Similar to SemRush, Ahref's provides estimated ranking data for keyword sets on both Google and Bing/Yahoo in multiple countries (US, UK, AU, DE, FR, ES, IT, BR, RU). The tool shows the:

• Position
• Keyword
• CPC
• Estimated cost
• Ranking url
• Global search volume
• Advertiser competition
• Last date checked
• Rating (estimated visitors per month based on assumed traffic distribution)

The other cool thing about this report is that it will tell you the change from the last time they checked the ranking.

SERPs Analysis

This is similar to the SERP positioning report. Essentially, you enter a URL and you get the Google + Bing & Yahoo ranking data with those same metrics as stated above:

• Position
• Keyword
• CPC
• Estimated cost
• Ranking url
• Global search volume
• Advertiser competition
• Last date checked
• Rating (estimated visitors per month based on assumed traffic distribution)

In addition to that, you also have the following reports:

• Daily Stats
• History of Changes
• Ads Analysis

Daily Stats

This report shows you, on a daily basis, the following data points:

• New Keywords
• Lost Keywords
• Total Keywords that moved up
• Total Keywords that moved down
• Total Positions up
• Total Positions down
• Rating Change (estimated percentage of traffic gained or lost)
• Cost Change (rating change * CPC)

There are graphical charts for:

• Search Engine Traffic (shown above)
• Keyword Trend (total keywords ranking)
• Traffic Cost
• Bar Graph for New and Lost Keywords
• Estimated Traffic Changes
• Estimated Traffic Cost Changes

History of Changes

This report breaks down the keyword changes by day and how much the specific keyword moved up/down (and the corresponding page that is ranking).

You can look at a daily report, a 7 day report, 30 days, or a custom range.

Ads Analysis

Ahrefs also incorporates Google (and Bing/Yahoo but I had a hard time getting figures for Bing/Yahoo) PPC data. You can pull in the ranking of the ad, the ad text, volume & CPC data, as well as last updated date & competition levels.

You can look at just the keyword/ranking data or choose from their other 2 reports; keywords/ranking + ad text (Table + Ads) or just the PPC ad text itself (Ads Preview).

Reports

You can create reports for your own domain for free or a any other site as a part of your subscription. Each domain counts as a separate report, so you can enter as many as you are entitled to in this interface but they do count against your monthly allowance.

The report overview looks like this:

Each tab represents a data point you can review. In any tab you can choose to export the visible page or the entire report.

There are quite a few filtering options here, as you can see below:

Your filtering options, report-wide, are:

• URLs from - you can include or exclude based on user-defined data (exclude by word(s), domain extension, and so on)
• Backlinks Type - you can choose to show, specifically, different backlink types (nofollow, image, frame, redirect, form, deleted)
• Pages - show links only to a specific page
• Subdomain - show links only to a specific subdomain
• Countries - show links from specific countries
• Anchors - show or exclude specific anchor text links
• Referring Domains - show links from a specific domain, or set of domains only
• IP - show links from a specific IP or range of IP's only
• Subnets - show backlinks only from specific subnets
• TLD - show links from specific TLD's only
• Date - show links based on specific crawl period

The cool thing here is that you can layer on the filters as you wish. The following screenshot shows all filters selected and available:

The reporting is really quite powerful and provides numerous ways to quickly filter out junk links so you can focus on the good stuff.

Labs

There are 3 additional tools in their Labs section.

• Ahrefs Top - Top 1 million domains by number of backlinks, completely searchable
• Domain Comparison - compare up to 5 domains for different link metrics (see below)
• Batch Domains - (see below) dump in a bunch of URLs and get a total count of backlinks, referring domains, and IP's. Unsure of the limit here but I did about 25 with no problem.

Here is a screenshot of the domain comparison feature:

The Batch Domains feature looks like this (and is completely exportable!):

Ahrefs is Worth a Spin

I was impressed with the speed of this tool, the exportability of the data, and the report filtering capabilities. It hardly hurts to have another link database to pull from, especially one that is updated every 30 minutes.

The tool is quite easy to use and it does pretty much what you expect it to. If you are into link research you should give this tool a try. The database appears to be a fairly good size for a new database and the ability to slice and dice that data from right within the web interface is a solid feature. If you do try it out, let us know what you think! We are also adding their link data to SEO for Firefox & the SEO Toolbar today.

Sharing is caring!

Please share :)

Embed code is here.

Sharing is caring!

Please share :)

Embed code is here.

Google announced they rolled out their anti-overly-aggressive-ads algorithm. They didn't give a specific % on how much of the above the fold content can be ads, but suggest using their browser preview tool. Using that tool on Google.com's search results would of course score it as a spam site, but for some small AdSense webmasters that avoided Panda, Google may have drew first blood.

Much Quicker Updates

With a limited number of recoveries nearly a year after Panda, the first bite might seem like a big concern, however the "too many ads" algorithm updates far more frequently than Panda does:

If you decide to update your page layout, the page layout algorithm will automatically reflect the changes as we re-crawl and process enough pages from your site to assess the changes. How long that takes will depend on several factors, including the number of pages on your site and how efficiently Googlebot can crawl the content. On a typical website, it can take several weeks for Googlebot to crawl and process enough pages to reflect layout changes on the site.

And for those who got hit by Panda then tried to make up for those lower ad revenues with more AdSense ad units, they probably just got served round #2 of Panda Express. ;)

Is it Screen Layout, or Something Else?

In the past Google suggested to a nuked AdWords advertiser that more of his above-the-fold real estate should be content than ads.

However Google has such a rich data set with AdSense that I don't think they would just look at layout. If I were them I would factor in all sorts of metrics like

• AdSense CTR
• average page views per visitor
• repeat visits & brand searches
• bounce rate
• clickstream data from Chrome & the Google toolbar (so even if you are using other ad networks, they can still sample the data)

Some sites are primarily driven off of mobile views while other sites might be seen on large monitors. When Google sees every page load & measures the CTRs, tacking actual user response is better than guestimating it.

They could come up with some pretty good metrics from those & then for any high traffic/high earning site they could manually review them to see if they deserve to get hit or not & adjust + refine the "algorithm" until those edge cases disappeared. Google's lack of credible competition in contextual & display ads means they can negotiate pretty tough terms with publishers that they feel are not adding enough value to the ecosystem.

It's Not Just Algorithms Cleaning Up AdSense

In addition to these sorts of algorithms, over the past year they have manually hit networks of sites with the doorway pages label & disabled ad serving on sites or entire accounts where they felt there was a bit too much arbitrage. One of our SEO Book members pointed me to this thread where a lot of Pakistani AdSense accounts got torched last October & another sent me a sample termination email from Google similar to this one:

Notice that in the above:

• There was no claim of click fraud, copyright issues, or anything like that.
• There was no claim of advertiser complaints.
• Google offers no customer support phone number, no "you might want to work on this" advice, doesn't list which of the sites in the account they felt could be improved, and RETROACTIVELY nuked past "earnings" ... depending on where it is in the schedule that can amount to anywhere from 30 to 50+ days (I remember Teeceo mentioned how they waited until the day before the AdSense payday to smoke his stuff way back in the day to have maximum impact!)

On Google's latest quarterly earnings call they highlighted how year on year Google's revenues were up 25% but the network revenues only grew at 15%. They also explained the slower network revenue growth as being associated with improved search quality & algorithm updates like Panda.

Left unsaid in such a statement was that until those algorithms rolled out, Google admitted they funded spam. ;) The whole AdSense & content farm problem was created through incentive structures with unintended consequences.

Is the Garbage Disappearing, or Just Moving to a New Landfill?

If you track what is going on with the Google+ over-promotion (long overdue post coming on that front shortly!) or how Google is still pre-paying Demand Media to upload video "content" to Youtube, Google still may be funding the same model, but doing so while gaining a tighter control of relevancy so they can better sort good stuff from crap (when you host content & track user response you have all the metrics in the world to determine how relatively good you think it is). If they over-promote these sites then in the short run they create the same skewed business model problem.

Sure hosting the user experience makes it easier to sort the wheat from the chaff, but the other big risk here is the impact on the rest of the publishing ecosystem. There will be lots of thin spam from popular people on Google+ (anyone launched a celebrity-focused Pay-Per-Plus site yet?) & in-depth editorial content might not be economically feasible in certain categories where there literally is no organic SERP above the fold.

I will complement them on their efforts to clean up some of the worst offenses (from the prior generation of "bad incentives"). If you were hit by it, Panda was every bit as big/brutal as the famous Florida update. If this update is anything near as significant as the Panda update (in how it impacts smaller independent webmasters) then it is going to force more of them/us to move up the value chain.

That may mean pain in the short run, but (for those who take it as a wake up call to develop brand & organic non-search traffic streams) far more rewards in the longrun for those who remain after the herd is thinned.

Working for "The Company"

Larry Page's view on working for the company:

My grandfather was an autoworker, and I have a weapon he manufactured to protect himself from the company that he would carry to work. It's a big iron pipe with a hunk of lead on the head. I think about how far we've come as companies from those days, where workers had to protect themselves from the company.

I think for many SEOs the idea of starting over is painful, but the best SEOs often enjoy the forced evolution & the game of it all. They don't roll over & play dead or forget SEO. And if Google didn't put hard resets in every once in a while, then the big hedge funds would be mopping up the SERPs and cleaning our clocks with the help of Helicopter Ben.

Areas For Improvement

Of course this could be taken as a positive post toward Google (and it mostly is), but I don't want to come across as a fanboi, so I thought I should do a shout out to a couple things they still need to fix in order to be consistent:

• If Google is going to tell people that thick deep content is needed to gain sustainable exposure then they shouldn't be ranking thin + pages in the SERPs just because it is a Google product. Even people who have *always* given Google the benefit of the doubt (full on fanbois) found the Google+ placement in the SERPs distasteful.
• Google's AdSense is still sending out some of those automated "you are leaving money on the table" styled emails reminding publishers to use 3 ad units. If such behavior may lead to a smoke job, then the recommendation shouldn't be offered in the first place. Right below the "use 3 ad units" there needs to be a "proceed with caution" styled link (in red) that links to the recent "too many ads" post.
• Old case studies that are no longer in line with best practices in the current market should have some sort of notice/notification added to them so new webmasters don't get the wrong idea.
• Some of the AdSense heatmaps are roadmaps to penalization. These should have been fixed before yesterday's announcement, but if they are still up there next week then Google is willfully & intentionally trying to destroy any small business owner that follows that "best practice" advice.
  

Your Feedback Needed

Since this update impacted far fewer sites than the Panda update, there are fewer sample/example sites. Did any of your websites get hit? If so, how would you describe ...

• your ad layout
• your ad CTR
• you mode of monetization (AdSense, other, both)
• the level of impact on your site from the update

This is an interesting play:

BBVA, Spain’s second-largest bank by assets, is teaming up with Google to use its search engine results to provide advanced forecasts of hotel and tourism demand in the country, part of a plan to market real-time economic indicators to its clients.

The bank and internet group will announce on Monday a scheme called the “BBVA-Google tourism activity in Spain indicator”. The first pilot project has focused on measuring advance demand for hotel stays and tourism interest in Spain by using search engine data.

Private investors get to see that search data before anyone else does. If you have a retirement plan invested in stocks, then you are at an asymmetrical information disadvantage because Google is providing an in-depth look at that search data to competing investors who can trade on the information before it is public.

Is search traffic a big deal? Is there enough signal there to matter? Yes. And yes.

I read an investment report earlier today about a company where the hedge fund's rating & valuation was largely based on / justified by the SEO strategy of the underlying company & their current Google rankings...the report even had keyword ranking charts in it!

Was Google paid for giving BBVA access to the above data? Or was it thrown in as a freebie in exchange for getting over 100,000 BBVA workers to switch to the cloud & go Google on the enterprise software front?

If Google has over 90% search marketshare in many EU countries & is willing to leverage proprietary search data to win contracts in other fields, how does anyone compete against that data bundling?

Further, think of all the damage hedge funds & huge banks have done to societies the globe over this past decade & now Google is directly helping the bad guys.

That is Google's approach to their proprietary information: if you invest in their ecosystem and use their analytics tools you can't get your own analytics data (as they have to protect "user privacy"), but they will gladly sell that same data off to someone else.

If there is no public outrage at this "test" then the data units will start getting more granular. Rather than measuring categories Google may sell data on a per-site or per-company basis. Looking at how Google has consistently disintermediated "partners" everywhere else, if Google is feeling bold they may suggest that selling the data to others also permits Google to trade on the data as well.

What's far scarier than an angry search engineer looking at your large paid link buy or a rogue Google "contractor" hacking up your site? A Google hedge fund with a substantial short position on your stock. :D

Recall that Eric Schmidt has stated:

"One day we had a conversation where we figured we could just try and predict the stock market..." Eric Schmidt continues, "and then we decided it was illegal. So we stopped doing that."

Based on Mr. Schmidt's above comment, is it reasonable that Google now profits off leveraging their data for securities analysis? What made the above clearly illegal & what is going on now above board? What's the difference between them? Perhaps a "contractor" layer?

At the same time Google runs sweeping ad campaigns reminding people how Google protects them online, while hosting banking data in the cloud & making themselves a juicier hacking target.

Google warns publishers against using paywalls because it is a poor user experience while wiping out competing lead aggreagtors with new guidelines that are likely impossible to comply with. Sites like Highbeam Research get smoked by algorithms like Panda & the Google works with the folks who already have the legislature in their pocket to get them more data. The lesson here from Google is to provide a clean front end user experience and then sell the data back out the other end.

Everything is fine. Keep shopping (on Google.com + your Android phone)...Google will ensure the data is monetized to its full potential.

Wow...this is pretty...um...transparent.

According to this post, Google was caught scraping Mocality, calling the listed businesses, soliciting that they move to Google "Get Your Business Online", disparaged the directory they were scraping in the client call, and then lied about having the permission of the directory they were scraping to try to con businesses into working with Google.

A few select quotes:

There are absolutely no costs, and this will be agreed on before it’s put on… No one will come and tell you like Mocality used to do, someone tells you it’s free and then they come to ask for money. You know that Google doesn’t fool around here.
...
Mocality used to charge people and many of the people who used to be in Mocality we have taken them and transferred them here. Didn’t we also find you on Mocality?
...
Ai…they used to…but some people didn’t used to pay. They [Mocality] used to go and ask people to pay them around Ksh. 20,000 and people refused. It was things like that.)

Google's business model *is* buying or building things that are free and then later pulling back features and/or sneaking costs in on them. Whether it be clubbing Android carriers with compatibility, saying search ads are evil then placing them everywhere, Google Maps API terms changes, terms changes on the Google AdWords API, Google hotel place listings with endless price ads, or keyword (not provided) in web analytics while trying to force you to register in Google Webmaster Tools to get any keyword data at all!

As if that wasn't bad enough, when the fake business asked Google if Mocality was ok with this, this was the exchange:

My question is does Mocality know that you’re getting their con…our contacts from their directory?
~~~
Yah. They know. They know that very well. They have agreed with Google when they were on that thing.

I have long stated that the difference between spam and quality content is who is spamming. With the recent widely criticized over-promotion of Google+ in the search results and this sort of scrape, lie & disintermediate the source Google's true character is shining through.

Facebook & Twitter are smart not to leave the barn door open for Google.

All information wants to be free and wrapped in Google's ads. Or so the saying goes. But until they can be trusted it won't be. They have done A LOT of brand damage to themselves in the past couple months.

Update: Google was mortified that they got caught doing this:

We were mortified to learn that a team of people working on a Google project improperly used Mocality’s data and misrepresented our relationship with Mocality to encourage customers to create new websites. We’ve already unreservedly apologised to Mocality. We’re still investigating exactly how this happened, and as soon as we have all the facts, we’ll be taking the appropriate action with the people involved.