You've launched a new website, typed your business name into Google, and... nothing. Or your old site shows up but the new pages don't. Or you appear for your business name but never for the thing you actually sell.
These are three different problems with different fixes, and most of them have nothing to do with "doing more SEO". This guide walks through how to work out which one you have, then the nine most common causes and how to fix each one.
First: is your site indexed at all?
Before changing anything, find out whether Google has your pages in its index. There are two ways to check.
The quick check. Search Google for site:yourdomain.com.au (no space after the colon). Google's own SEO Starter Guide suggests exactly this. If you see a list of your pages, you're indexed and the problem is ranking, not indexing. If you see nothing, Google either hasn't found the site or has chosen (or been told) not to index it.
The proper check. Set up Google Search Console. It's free, and it's the only place Google tells you directly what it thinks of your site. Add your site as a domain property (you verify it by adding a TXT record to your DNS, which covers every subdomain and both http and https), then use:
- URL Inspection: paste any page address and Google tells you whether it's indexed, when it was last crawled and why not if it isn't.
- Page indexing report: a list of every URL Google knows about, grouped by the reason it is or isn't indexed.
Keep in mind Google itself says "Don't expect every URL on your site to be indexed". What you want is your important pages (home, services, contact, key articles) indexed, not every tag page and duplicate.
The 9 most common causes
| # | Cause | Where you'll see it | Typical fix |
|---|---|---|---|
| 1 | Site is new and Google hasn't found it | No results for site: search |
Search Console, sitemap, links |
| 2 | A noindex tag left on |
"Excluded by 'noindex' tag" | Remove the tag or setting |
| 3 | robots.txt blocking crawlers | "Blocked by robots.txt" | Fix robots.txt |
| 4 | Password, staging or unpublished site | URL Inspection can't fetch the page | Publish properly, remove the lock |
| 5 | Canonical or duplicate problems | "Duplicate without user-selected canonical" | Pick one version, redirect the rest |
| 6 | Google crawled it and chose not to index | "Crawled - currently not indexed" | Make the page more useful and distinct |
| 7 | Indexed, but not ranking for what you search | Pages appear for site: only |
Content that matches real searches |
| 8 | No (or a weak) Google Business Profile | Missing from the map results | Create and complete your profile |
| 9 | Manual action or hacked site | Manual actions / Security issues reports | Clean up, then request a review |
1. It's new and Google hasn't found it yet
Google mostly finds pages by following links from pages it already knows about. A brand-new domain with no links pointing to it can sit unnoticed for a while. Google says crawling can take "anywhere from a few days to a few weeks", and there's no guarantee any given site will be indexed.
Fix: verify the site in Search Console, submit your XML sitemap (most platforms generate one at /sitemap.xml), and use URL Inspection's "Request indexing" button on your home page and main service pages. Don't keep hammering the button: Google notes that requesting a recrawl of the same URL multiple times won't make it any faster, and there's a daily quota. Then get a few genuine links: your Google Business Profile, industry directories, suppliers, your local chamber of commerce and your social profiles.
2. A noindex tag was left on
This is one of the most common causes after a launch. Sites are usually built on a staging address with indexing switched off so the half-finished version doesn't show up in Google. Then the site goes live and nobody flips the switch back.
A noindex instruction looks like this in the page's HTML:
<meta name="robots" content="noindex">
or as an HTTP response header:
X-Robots-Tag: noindex
In WordPress it's usually the Settings → Reading → "Discourage search engines from indexing this site" checkbox. Many website builders have a similar "hide from search engines" toggle in their SEO settings.
Fix: remove it, then request indexing. You can check a page yourself from a terminal:
# Look for a noindex header
curl -sI https://yourdomain.com.au/ | grep -i x-robots-tag
# Look for a robots meta tag in the HTML
curl -s https://yourdomain.com.au/ | grep -io '<meta[^>]*name="robots"[^>]*>'
If either prints something containing noindex, that's your culprit.
3. robots.txt is blocking Google
Your robots.txt file tells crawlers which paths they may fetch. A staging leftover like this blocks everything:
User-agent: *
Disallow: /
There's a subtlety here. Blocking a page in robots.txt stops Google crawling it, but it isn't a reliable way to keep a page out of the index: Google can still list a URL it learned about elsewhere, just without a proper description. And if a page is blocked by robots.txt, Google never sees a noindex tag on it. So don't use both together.
Fix: a normal small-business robots.txt can be as simple as:
User-agent: *
Disallow:
Sitemap: https://yourdomain.com.au/sitemap.xml
4. The site is password-protected, on staging, or not published
Google can't index what it can't load. Common versions of this: the site is still behind a "coming soon" page or a password, you're looking at the builder's preview link rather than the live domain, the domain isn't connected to the hosting yet, or the site builder plan that allows publishing has lapsed.
Fix: open your domain in a private browser window on your phone, using mobile data. If you don't see the real site, Google doesn't either. URL Inspection's "Test live URL" will also show you exactly what Googlebot gets back.
5. Duplicate versions and canonical mix-ups
To Google, http://yourdomain.com.au, https://yourdomain.com.au and https://www.yourdomain.com.au can be three different sites. If all three load without redirecting, Google picks one as the "canonical" and may ignore the others, sometimes not the one you'd choose. A worse version: a <link rel="canonical"> tag that still points at the old staging domain, which tells Google the real page lives somewhere else.
Fix: pick one version (usually https:// with or without www), permanently redirect (301) the others to it, make sure every page's canonical tag points to that version, and list only those URLs in your sitemap.
6. Google crawled it and chose not to index it
"Crawled - currently not indexed" in the Page indexing report means Google fetched the page and decided it wasn't worth adding for now. Google describes it as a common message for many sites, and it isn't always a problem, but if it's hitting your main service pages, it usually means they're thin or near-identical: three sentences of copy, a stock photo, or ten suburb pages with the suburb name swapped.
Fix: make each important page clearly useful and different. Say what you do, where, for whom, what it costs (or what affects the price), how the process works, and answer the questions customers actually ask you. Then request indexing again.
7. You're indexed, just not ranking for what you search
If site: shows your pages but you can't find yourself for "electrician Gosford", the site is indexed and the issue is relevance and competition. Google ranks pages that best match the words people type, and a homepage that says "Quality solutions for all your needs" doesn't match anything.
Fix: use the Performance report in Search Console to see what you do show up for, then give each core service its own page that uses the plain words customers use, including your area. Page speed matters too, mainly for keeping visitors once they arrive; our Core Web Vitals guide covers that.
8. You're missing from the map results
The map pack at the top of local searches comes from Google Business Profiles, not from your website alone. Google says local results are based mainly on relevance, distance and prominence, and that "There's no way to request or pay for a better local ranking on Google."
Fix: create and verify a Business Profile, choose accurate categories, fill in every field (hours, service areas, services, photos), link it to your website, and ask happy customers for reviews and reply to them.
9. A manual action or a hacked site
Less common, but serious. If Google finds spam on your site, or your site has been hacked and is serving spam pages or redirects, your pages can be demoted or dropped. Search Console has a Manual actions report and a Security issues report; if both say "No issues detected", you can rule this out.
Fix: clean the site properly (update or rebuild, change every password, remove the injected content), then request a review from the report.
A quick checklist
- Search
site:yourdomain.com.au. - Verify the site in Google Search Console as a domain property.
- Inspect your home page with URL Inspection.
- Check for
noindexand robots.txt blocks. - Confirm only one version of the domain loads; the others redirect.
- Submit your sitemap.
- Make sure each main service has its own useful page.
- Set up and complete your Google Business Profile.
- Give it a few weeks before judging the results.
When it's worth getting help
Most of the fixes above are a settings change or an afternoon of writing. If your site is fighting you on every one of them (a builder that won't let you edit the robots settings, pages you can't change, five versions of the domain), it might be time to rebuild rather than patch. Our website packages include SEO foundations as standard, and the Business Website (from $6,500) also includes Google Business setup. If you're not sure where your money is best spent, our website cost guide breaks down the options.
If your site isn't showing up and you'd like someone to look under the bonnet, get in touch and we'll tell you what's going on.