Announcing Fresh Web Explorer

Fresh Web Explorer (FWE) functions a lot like Open Site Explorer, so the interface will be familiar to OSE users. However, the data is extremely recent, and rather than just show you links, we grab full text content of articles, blog posts, forum threads, user comments, and other web content. FWE doesn't just show you links, but all term, brand, or phrase mentions as well. 

 

FWE is powered by our Freshscape Index, which is a 30 day index of 4.3 million feeds (and counting). There's a new Freshscape index every eight hours, sortable by one week, two weeks, or 30 days of mentions. You can also sort your data by Feed Authority, our new metric created specifically for Fresh Web Explorer:

 

 

Feed Authority directly measures the importance of any feed on a scale of 1-100. It is a machine learning model that predicts the number of subscribers for a given feed and distinguishes among the many different feeds on any site. For example, it wil assign a lower score to a comment feed associated with a six-month-old blog post than the main feed associated with the blog. In this way, it is analogous to Page Authority, but applied to feeds. We currently use features extracted from crawling the feed (number of posts, post frequency, etc.) as well as Mozscape metrics to compute the score. Our data scientists are working to improve this metric, so expect to see some of the scores change as they refine the algorithm and introduce additional features.

 

Warning: We're going to get even more nerdy about Feed Authority for a quick second. The chart below shows the distribution of Feed Authority across the Freshscape index:

Approximately 25% of the index has a Feed Authority less than 2.0, with the other 75% having higher values. The feeds with low scores are mostly stale (no longer updated), have very few or no links, or have malformed XML. A similar graph for all feeds on the internet would have the opposite shape, with 75%+ of feeds having Feed Authority less than 2.0 (we confirmed this with a random sample of feeds from our Mozscape index). We minimized the number of low-quality feeds in our index by carefully building it from a set of high-quality blog directories and a curated list of feeds.

 

Bringing it back to using FWE, there are a number of operators you can use to customize your search:

 

 

In particular, you may find yourself making extensive use of the 'Match phrase exactly' operator, by using double quotes around your search term or phrase. This cues Fresh Web Explorer to only return results where your phrase of terms appears on a page exactly as you searched for them in FWE, rather than returning results where the terms may appear anywhere on the page and in any order. When searching on non-branded or very popular terms, using this operator may surface a more precise set of results from FWE.

 

If you're inclined to mix and match this data with other sources, FWE provides you with the ability to export up to 10,000 mentions in the Freshscape index, in .csv format:

 

 

This export allows you to sort a large number of mentions by date found, Feed Authority, domain, HTML title, and URL. One of the additional fields available in the export that's not in the FWE web interface: the feed source where FWE found the page containing the mention. This can provide useful insight into why a Feed Authority score might be low, even though the page mentioning your search is located on a strong domain.

 

We've put together a video walkthrough and a detailed FAQ to get you started as well as answer additional questions.

 

Fresh link and mention data have become critically important to online marketers. If you're engaged in link building and outreach, having the ability to quickly sort recent mentions by source and date can make a world of difference in quick outreach to build audience for your content or brand. If you're in the SEO trenches, you're probably all too familiar with how freshness plays a role in Google and Bing search results. If you've watched the meteoric rise of sites like Buzzfeed, Business Insider, or Huffington Post, the formula to their success is pretty clear: Match content to the most recent user intent you can surface, then build links and social mentions to that content like crazy.

 

To get started, you can use FWE to engage in several high-ROI activities:

• Find recent mentions in FWE where you aren't being linked to – On news publications and high-volume blogs, the quicker you ask the writer for a link, the better chance you have of actually getting it. It's much harder to convince them it's worth the effort a month later. An effective technique that increases your chances even more is to add something new to the content that increases its value or changes the narrative of the story. 
• Competitor analysis –  Where are your competitors being mentioned? Are there feeds that highlight their content frequently? FWE is a good tool to build up your outreach list.
• Content Strategy – FWE allows you to check on or keep track of a set of terms over time, and helps you get a sense for what type of content gets a lot of mentions, shares, and links. For instance, a term like "World Cup 2014"  is already drawing significant interest as we get closer to the 2014 event in Brazil. Sites like Bleacher Report and Goal are already starting to stake out their claim in the SERPs.

FWE can help you make strategic decisions on how to create and focus both new and legacy content on this type of quickly evolving user search intent. Our engineers have put in a lot of work to make the Freshscape index, and we will be using it to power additional features in the near future.

Ready to give it a spin?