SEMrush Free Website Stats Scraper: 1,060 Runs by 124 Users (2026)

Each record returns 11 output fields including authority score, estimated monthly visits, and referring domain counts. This scraper accesses the SEMrush public website overview without requiring a login, cookies, or an official API key. You can expect high-level metrics for any domain, such as organic search traffic and backlink deltas, for $2.00 per 1,000 results on Apify's free plan. Residential proxies are used to navigate verification gates automatically for domains requiring a browser fallback. This is designed for marketing teams and SEO practitioners who need bulk domain authority data but do not require granular keyword rankings or paid search history.

Try it before you read further. Apify's free plan includes $5.00 of usage every month with no credit card, enough for up to 2,500 results at $0.002 each before platform usage. Open SEMrush Free Website Stats Scraper on Apify and run the prefilled example.

How reliable is SEMrush Free Website Stats Scraper in production?

Across the last 30 days of public runs on the Apify platform, SEMrush Free Website Stats Scraper recorded 175 runs with the following outcomes.

Outcome	Runs	Share
Succeeded	137	78.3%
Failed	0	0.0%
Aborted by the user	30	17.1%
Timed out	8	4.6%
Total	175	100.0%

Practitioners should expect about 5 in a hundred runs to fail or time out based on recent performance. To maintain a high success rate, use smaller domain batches and ensure the execution timeout is set long enough to allow for the browser fallback on unindexed domains.

What does it cost to run SEMrush Free Website Stats Scraper?

Each result costs $0.002 on Apify's free plan, which is $2.00 per 1,000 results. Starting a run is charged separately at $0.005 per GB of Actor memory. Apify also bills the platform usage each run consumes, at the rates of your Apify plan, on top of these charges.

Apify plan	Per result	Per 1,000 results
FREE	$0.002	$2.00
BRONZE	$0.00167	$1.67
SILVER	$0.00133	$1.33
GOLD	$0.001	$1.00
PLATINUM	$0.001	$1.00
DIAMOND	$0.001	$1.00

Worked example: collecting 10,000 results costs $20.00 in result charges before run-start fees and platform usage. With 4.6% of runs failing or timing out in the last 30 days, budget for re-running a portion of those batches rather than assuming every run completes.

The number of entries in the domains list is the primary driver of your bill as it determines the total result count. To verify if the metrics meet your requirements, run a single domain lookup on Apify's free plan which provides enough usage for 2,500 results.

How do you run SEMrush Free Website Stats Scraper from the API?

The schema marks 1 of its 4 controls as required: domains. Nothing in the payload below is illustrative. Those are the schema's prefilled defaults for SEMrush Free Website Stats Scraper, so the request works once your token is in place.

Call the synchronous endpoint to start a run and receive dataset items in one request:

curl -X POST "https://api.apify.com/v2/acts/crawlerbros~semrush-scraper/run-sync-get-dataset-items?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"domains":["wikipedia.org"],"mode":"full","enableBrowserFallback":true,"proxyConfiguration":{"useApifyProxy":true,"apifyProxyGroups":["RESIDENTIAL"],"apifyProxyCountry":"US"}}'

The same run from Python, using the official client:

from apify_client import ApifyClient

client = ApifyClient("<YOUR_APIFY_TOKEN>")

run_input = {
  "domains": [
    "wikipedia.org"
  ],
  "mode": "full",
  "enableBrowserFallback": True,
  "proxyConfiguration": {
    "useApifyProxy": True,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ],
    "apifyProxyCountry": "US"
  }
}

run = client.actor("crawlerbros~semrush-scraper").call(run_input=run_input)

for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

And from Node.js:

import { ApifyClient } from 'apify-client'

const client = new ApifyClient({ token: '<YOUR_APIFY_TOKEN>' })

const input = {
  "domains": [
    "wikipedia.org"
  ],
  "mode": "full",
  "enableBrowserFallback": true,
  "proxyConfiguration": {
    "useApifyProxy": true,
    "apifyProxyGroups": [
      "RESIDENTIAL"
    ],
    "apifyProxyCountry": "US"
  }
}

const run = await client.actor('crawlerbros~semrush-scraper').call(input)
const { items } = await client.dataset(run.defaultDatasetId).listItems()
console.log(items)

Because the call is synchronous, your client waits for the whole run. Keep it for exploration. For scheduled work, start the run without waiting and collect the dataset afterwards, so network trouble costs you a retry rather than the results.

Which SEMrush Free Website Stats Scraper inputs matter, and which can you skip?

The domains array is the primary control where you provide the target websites for lookup. Use the mode selector to choose between a full report or limited fields like authority_only or traffic_only to streamline your dataset.

domains (array): List of domains to look up (e.g. 'wikipedia.org', 'github.com').
mode (string): Output scope. Default: "full".
enableBrowserFallback (boolean): Use Patchright anti-detect Chrome when the public overview URL returns no metrics. Default: true.
proxyConfiguration (object): Apify Proxy Residential is required. SEMrush gates its free checker with reCAPTCHA v3, which rejects datacenter IPs. Default: {"useApifyProxy":true,"apifyProxyGroups":["RESIDENTIAL"],"apifyProxyCountry":"US"}.

Fixed-choice controls: mode accepts full, authority_only (Authority only), backlinks_only (Backlinks only), traffic_only (Traffic only).

What does SEMrush Free Website Stats Scraper return?

The returned records are ideal for benchmarking site authority and traffic volume across large domain lists. Note that these records do not contain keyword-level details, competitor ranking tables, or PPC ad copy.

type - "semrush_website_stats"
domain - the normalized domain (e.g. custify.com)
authorityScore - 0-100 SEMrush Authority Score
visits + visitsText - estimated monthly visits
organicSearchTraffic + organicSearchTrafficText - organic search visits
referringDomains + referringDomainsText + referringDomainsChange - referring domain count + delta
backlinks + backlinksText + backlinksChange - backlink count + delta
asOf - data month (e.g. July 2026)
sourceUrl - SEMrush URL the data was scraped from
scrapedAt - UTC ISO timestamp
notFound + reason - present only when SEMrush has no data for the domain

These are the documented fields. Optional ones can be empty on a given record, so measure how often each field your deliverable depends on is populated across a real sample before automating the handoff.

How do you build the workflow end to end?

Open SEMrush Free Website Stats Scraper and work through these in order. Each step ends with something to check, so a bad configuration surfaces on a small run rather than a scheduled one.

Run a single test with a known domain in the domains array and mode set to full to confirm connectivity.
Ensure proxyConfiguration is set to residential because datacenter IPs will be rejected by reCAPTCHA v3.
Execute the run and check the dataset for the semrush_website_stats type.
Examine the authorityScore to ensure it falls within the expected 0 to 100 range.
Monitor the reason field if notFound is true to distinguish between missing data and scraping blocks.
Scale up by adding multiple domains to the domains array while keeping enableBrowserFallback enabled.
Verify that each record includes an asOf timestamp to confirm the data month for your reporting.

How do you apply it? Three worked playbooks

These are SEMrush Free Website Stats Scraper's own documented use cases, each worked through as an operating pattern rather than a description.

Use case 1: SEO agencies

Outcome: Pull authority score and backlink counts for client reporting

Configure: Set domains to your client URL list, mode to full, and enableBrowserFallback to true.

Working method: Initiate a batch run for the primary client domain and a set of local competitors to establish baseline metrics. Compare the authorityScore and referringDomains across the set to identify authority gaps. Check that each result includes a sourceUrl for verification.

Deliverable: A CSV report containing authorityScore, backlinks, and referringDomains for a portfolio of clients.

Stop condition: The record returns notFound true for a high-authority domain that is known to have SEMrush data.

Use case 2: Sales intelligence

Outcome: Estimate competitor website traffic before outreach

Configure: Set domains to your prospect list and mode to traffic_only.

Working method: Process your lead list through the domains array to extract visits and organicSearchTraffic. Filter the results for domains showing organicSearchTraffic above your qualification threshold. Use these figures to prioritize high-intent outreach targets.

Deliverable: A filtered prospect list enriched with estimated monthly visits and organic search traffic volume.

Stop condition: The success rate in the run console drops below 70 percent, indicating potential proxy rotation issues.

Use case 3: Lead enrichment

Outcome: Append website traffic data to company profiles

Configure: Set domains to your CRM domain export, mode to authority_only, and enableBrowserFallback to true.

Working method: Input a batch of normalized company domains into the Actor. Map the returned authorityScore and referringDomains back to your internal company records. Identify accounts with increasing authority score by comparing current results against previous monthly exports.

Deliverable: An updated CRM dataset containing the authorityScore and referringDomains for every company profile.

Stop condition: Results consistently arrive with empty metrics for valid top-level domains.

What breaks, and how do you design around it?

Over the last 30 days, 0.0% of public runs failed and 4.6% timed out. Build retries and alerting around those rates rather than assuming every run completes.

When a domain is not readily indexed, the tool invokes a browser fallback that can increase the duration per domain to over 60 seconds. Plan for longer runtimes when processing thousands of domains that may require this intensive anti-bot navigation.

When should you not use SEMrush Free Website Stats Scraper?

Do not use this Actor if you require historical keyword volume, individual backlink URLs, or competitive ad spend analysis, as these require a paid SEMrush subscription. For users who specifically need Ahrefs-specific metrics like Domain Rating, Ahrefs Free Website Stats Scraper is the appropriate alternative. If your goal is to find personnel contact details rather than SEO metrics, Website Contact Finder or Contact Info Scraper Pro should be used instead.

What should you check before trusting the output?

authorityScore is missing from the record while mode is set to full or authority_only.
visits and organicSearchTraffic fields are both null despite the domain being active.
The notFound boolean is true but the reason field is missing.
scrapedAt fails to return a valid ISO 8601 timestamp.
The asOf field returns a date from more than two months prior to the current run.

None of this proves a record is correct. It gives a scheduled SEMrush Free Website Stats Scraper run defined points where it should stop instead of quietly passing bad data downstream.

Frequently asked questions

What is the cost for 1,000 results on the free plan?

On the free plan, 1,000 results cost $2.00 in result charges. Apify's free plan includes $5.00 of monthly usage with no credit card required, which is sufficient to cover up to 2,500 results of this Actor before factoring in platform usage.

How reliable is this scraper for automated tracking?

The data shows a 78.3% success rate over the last 30 days, with about 5 in a hundred runs failing or timing out. This indicates that while the tool is effective, users should implement retries for the small percentage of runs that do not complete.

Why are residential proxies necessary for this Actor?

SEMrush uses reCAPTCHA v3 to gate its free website stats. Datacenter IPs are frequently identified as bots and blocked, whereas residential proxies provide the higher trust scores required to retrieve metrics without a login.

Does this Actor provide keyword rankings?

No. This Actor is limited to the public website overview metrics provided by SEMrush. It returns 11 output fields including authority score and traffic estimates, but it does not include granular keyword ranking or PPC data.

Can I use this without a SEMrush account?

Yes. This Actor scrapes the public-facing free tools on SEMrush. It does not require you to provide a SEMrush account, cookies, or an API key to extract website authority and traffic statistics.

Where to go next

When you are ready to run it, open SEMrush Free Website Stats Scraper on Apify; the free plan covers up to 2,500 results a month.

Start with the SEMrush Free Website Stats Scraper Actor page for the current input schema, pricing tier, and run history.

Readers running SEMrush Free Website Stats Scraper commonly pair it with:

Ahrefs Free Website Stats Scraper: Scrape Ahrefs public website stats (Domain Rating, backlinks, global rank, organic traffic) from ahrefs.com/websites/.
SocialBlade Stats Scraper: Scrape public SocialBlade creator stats for YouTube, TikTok, Instagram, Twitch, and Facebook.
Website Contact Finder: Crawl any website and extract emails, phone numbers, and social media profiles.
Contact Info Scraper Pro: Crawl any website and extract emails, phones, and social media profiles.

Related guides:

Resources

Actor documentation, input schema, and pricing: verified against the published Actor on 2026-09-23.
Actor last updated by its maintainers on 2026-07-08.
Run outcome figures cover the 30 day public window ending 2026-09-23.
SEMrush Free Website Stats Scraper on Apify