URL Profiler

Discovery Mosti

 URL profiler is a data collecting tool at a very good price for the features included. When it comes to domain names there is a lot of research required to determine whether it is powerful or not. Now there are loads of tools that will analyse domains and provide you with different metrics. What URL profiler does is group all of these tools together for you to get a great insight as to how good the domain actually is.   The tool is quite straightforward to use. Below is a screenshot of what you will see once you first open up URL Profiler. This is essentially the dashboard.  

Now before I go into each of the tools and what kind of features you can use here you first need to head to the settings at the top. In here you will see loads of different things you can change and filter such as the number of connections that you run at one time (How fast the tool will run). You can also change what kind of data you want URL profiler to find data like social accounts etc. All of these settings are personal preference but the one that is most important is the Proxies tab. 

 

You will need to use proxies to allow URL Profiler to carry out scraping massive amounts of URLs without getting your IP address banned. The amount of proxies you need all depends on the number of connections that you what to run at the same time. If you don't add any private proxies then URL profiler will use public ones. However, these will often timeout and you won't be able to scrape larger lists of URLs. I would also suggest getting at the very least 10 proxies to allow yourself to carry out some worthwhile searches. Along the right-hand side, you'll see the different features that you can use the proxies for. Be sure to check all of these options as they won't be used otherwise. You can also allow proxies to retry a number of times if they fail. I wouldn't set this number too high as typically when a proxy fails, it's because google suspects it to be running automation. Once you've added your proxies its time to add your accounts to the software. 

If you click on the accounts tab at the top you will a dropdown containing all of the tools that require you to input credentials for it to work correctly. There are a few tools here that you don't necessarily need and some that I definitely recommend you buy to use with this tool. 

Majestic - This is a backlink checking tool that gives you a good end depth analysis as to how good a website backlink profile is (Trust flow/Citation Flow) Having URL profiler allows you to use the tool for 500 requests per day for free. This is great if you only plan on carrying out searches on low volumes of URLs. If however, you are going to be using URL profiler for larger scrapes then I highly suggest getting yourself a majestic subscription. The data this tool provides is so useful in helping you know if a domain is powerful or not. 

MozScape - Mozscape is a tool that gives you metrics such as domain authority (DA) for any site out there. Again just like Majestic you can get up to 500 searches with URL profiler a day, anything after this requires a Moz API key. I would suggest to everyone that they go ahead and sign up to Moz and get an API as it's completely free. 

Ahrefs - This an all in one marketing tool that allows you to carry out competitor research. The difference here is Ahrefs is actually a paid tool that URL profiler doesn't have any free searches for. So you will need to pay for this one if you do plan on using it. You can get an Ahrefs account starting at $99

Google - URL profiler can be integrated with Googles PageSpeed and Google Safe Browsing. These are both free to set up, all you need to do is follow the steps to get an API key for each of the tools in Google's developer console. URL Profiler has a step by step guide that you can find beside where you enter the API key. 

MY Addr - This tool is used to let you collect Whois and Alexa data. They have a free account that you can set up and once that is done you will then have an active API key. All you need to enter is your username and password for the account and it will tell you if the account API is Valid or not. 

Copyscape - This is a copyright checking tool, you can see if any of the information on a webpage is found anywhere else on the internet. To use this with URL Profiler you do need a premium subscription to generate yourself the API key. For the content analysis, this tool is very useful to help you understand if the pages that you are scanning are of any value. 

uClassify - uClassify is another content analysis tool that can take a look at a few different aspects of a page's content including things like language, topics and mood of the writing. To use this tool you first need to sign up for a free account on their website. Once you've done that you need to add the read API key into URL Profiler. You will then have up to 5000 free searches per day with this tool. 

SEMRush - This is an all in one marketing tool pretty similar to Ahrefs. Again you need to have a paid account before you can access the API key, with subscriptions starting at $99.95

Both SEMRush and Ahrefs have their pros and cons but having at least one of these tools to integrate with URL Profiler will make your analysis a lot more beneficial. Okay now you have set up the all of the accounts you are going to use, It's time to start using URL Profiler. 

 

In this example, I am going to scrape a few URL's on the coca cola website. The dashboard is split into a few different sections. First of all we're going to take a look at the right-hand side which contains your URL List. These are the target URLs that you be collecting the information on. 

 

Right clicking on the URL list will show you the different options you have to add the URLs, this can be done by either copying and pasting in your list or you can import them from a file. You can also import sitemaps in here as well, allowing you to effectively scrape every URL on a website. Once you have your list together you can then take a look at the next section which is domain level data

There are a whole load of metrics you can search for here, some of which will only be available if you filled in the credentials in the accounts section earlier. As you can see there are lots of metrics available here to scrape for. At this stage, it all comes down to the stats that you personally value, so you can select whatever you like here. Next up is the URL Level Data

These are all metrics related to the individual URL's you scrape instead of the whole domain name. For example, you can check to see the page authority (PA) using a tool like Moz or you can check to see if the search bots have access to the page etc. After this are all of the Google-related tools that you can use. The likes of Google search console and google page speed can be looked at from here if you add your API keys from google. The final two areas you can gather data on is the content analysis and link analysis.  

The first is will take a look at the content within the page to check how well written it is and if it's unique etc. The next is link analysis. What you do here is enter a URL and URL Profiler will take a look at the links on the domain, and will give them a score based on how quality the links are. Once you've made your way through all of these settings it's time to start your scrape. Clicking on the "run profiler" button on the bottom right-hand side, from here you then choose what to name your file and where you'd like to save it. 

 

You can now leave your scan to run, the number of URLs and allowed concurrent connections will factor into how fast your scan will be. After the results are complete, clicking on the "open file" button will show you all the stats. 

Summary

URL Profiler is a great tool for gathering loads of metrics from lots of different sources and tools out there on any URL. One thing you do need to consider however is while this integrates with some of the industries biggest tools, you do need a subscription with a lot of those tools along with URL profiler to make use of them. If you already pay for many of these tools and need one place to gather all of the data, then a tool like this is perfect for you. URL profiler does offer you a 14 day free trial so I would definitely suggest giving this tool a try if you analyse domains in any capacity.

Post a Comment

If you have any doubts, Please let me know

Previous Post Next Post