Fraud Blocker

6 Common Signs Your Website is Experiencing Technical SEO Issues

May 2, 2024
6 Common Signs Your Website is Experiencing Technical SEO Issues

Table of Contents

Often having close ties to website development and the server setup and configuration that hosts your website. Technical SEO is the optimisation of what is “under the hood” of your website, from hosting and site speed to XML sitemaps, meta tags and more.

With many of these elements not being visible on the front end of your website, when technical issues occur more often than not (unless actively monitoring), they remain undiscovered until you notice an issue as a result of this technical SEO error, such as a drop in traffic, a page not loading or a spike in users landing on a 404 page.
So, what are some of the common signs that your website is suffering from a technical SEO issue?
Common Signs Your site has technical SEO issues: Which are the most likely culprits, and How to Fix Them

Website Security Issues

An insecure website can drastically impact user trust and credibility. A study from HubSpot reveals that 82% of visitors would leave a website that is not secure. This highlights the critical nature of security in maintaining visitor engagement and trust. Moreover, Google has openly prioritised secure websites in search results, and websites that remain on HTTP see not only a reduction in user trust but also a potential drop in organic traffic due to lower search rankings.

From an SEO standpoint, an insecure website is a liability. It can lead to increased bounce rates as users leave after encountering security warnings, reducing the average session duration and negatively impacting the site’s search engine performance.

You need to use HTTPS, an encryption protocol, to encrypt communications. The protocol is called Transport Layer Security (TLS), although formerly it was known as Secure Sockets Layer (SSL). This protocol secures communications by using what’s known as an asymmetric public key infrastructure. This type of security system uses two different keys to encrypt communications between two parties:

Common Signs of Website Security Issues

What are the common signs to look out for if you suspect your website might be serving content via an unsecured route?

Browser Security Prompt When Landing On a Page

Modern browsers alert users if they’re about to access an insecure or compromised website. If a user reports this about any page on your website, it is a sign that you are encountering security issues.

 

Google Search Console Alerts

Google search console malware warning

Google Search Console provides notifications if Google detects any security issues with your site. You can check the notifications in your Google Search Console dashboard.

Unusual Site Activity

This can include unexpected changes in site content, new unfamiliar ads, or pop-ups that can indicate a breach or injection of malicious code.

If you suspect there has been a breach on your website, speak with your hosting provider, security software provider or webmaster. They can conduct a malware scan of your website to locate and remove any malicious code.

How to Resolve Insecure Content Issues on Your Website.

SSL/TLS certificates

Make sure your website has an active SSL certificate. Implement secure certificates to enable HTTPS, thus securing user connections to your site. An SSL certificate is valid for one year, so always check to make sure your certificate has not expired.
Speak with your webmaster or hosting provider regarding your HTTPS

Check SSL Certificate Validity

SSL certificates have a specific validity period. If your certificate has expired, you’ll need to renew it immediately. You can check the expiry date using tools like SSL Labs’ SSL Test or directly through your browser by clicking on the padlock icon in the address bar.

Ensure that the certificate is issued for the correct domain name. Sometimes, issues arise if the certificate is issued for www.example.com but not for example.com, or vice versa.

Ensure Correct Certificate Installation

The SSL certificate must be properly installed on your server. Errors often occur if the certificate is not correctly associated with the website. Consult your hosting provider’s documentation or support for guidance on proper installation, or use tools like “SSL Checker” to verify if your SSL certificate is installed correctly.

Resolve Mixed Content Issues

If your website has an active SSL that has no installation issues, then you might need to resolve mixed content issues. This happens when a webpage with a secure HTTPS connection attempts to load resources (like images, videos, stylesheets, or scripts) over an insecure HTTP connection. Browsers can block these resources or display security warnings.

Use relative URLs (like /path/image.jpg) or ensure all URLs on your site use HTTPS. Tools such as “Why No Padlock?” can help identify and fix mixed content issues.

An excellent plugin to enforce HTTPS on your website:

Easy HTTPS Redirection (SSL)

Other Reasons Your Website Might Not Be Secure

  • Running out-of-date plugins, themes and software
  • Using poorly maintained plugins and scripts
  • Insecure hosting
  • Lack of security monitoring

Signs Your Website Has Duplicate Content Issues.

Duplicate content refers to content that has already been published elsewhere. If you notice that your content is not being chosen over other web pages, a common cause could be that similar content has already been indexed.

Common Signs of Duplicate Content

What are the common signs that your website is suffering due to duplicate content?

Search Engines Choose to Index Another Page Rather Than Your Newly Published Content

This means Google has crawled your page and determined that there is nearly identical content already indexed that they will serve instead.
Duplicate content is determined by matching substantial blocks of content within a web page or against pages already in the index.

Search engines (not just Google) may penalise sites with large quantities of duplicate content as it can appear as an attempt to manipulate search rankings. However, genuine mistakes can be easily rectified.

Pages Missing in Search Results

Some of your pages might not appear in search results, especially if they are similar to other content on your website.

New Content Not Showing on Google

If your new content is similar to a page already indexed, then it will not be displayed to users; instead, the page Google deems as the original content will be served.

Products Not Receiving Organic Traffic

An eCommerce website can have many listings of similar products with minor variations for each item. If each of these is on a separate URL, Google will likely determine which one will be indexed and which will not be listed on Google.

How to fix Duplicate Content

First and foremost, if you are publishing content, you should use a plagiarism checker that can scan indexed pages online against your content to locate if there are any possible matches.

If it comes back as one of your pages being a high % match, then you need to either create original content or choose to serve one of the pages by adding a canonical tag to the page you wish not to be indexed. The canonical tag will tell Google that this is not the page on which you want to be indexed and, instead, crawl the other page.

How to View the duplicate Page in Google Search Console:

How to find pages that have been marked as duplicate content by google

How to Add a Canonical Tag in Your HTML

Identify the Canonical URL: First, determine the preferred URL (canonical URL) for the content that may appear on multiple URLs. This is the URL you want search engines to treat as the authoritative version.

Edit the HTML Header: Open the HTML code of the webpage where you want to insert the canonical tag. You need to place the tag within the <head> section of the HTML document.

Add the Canonical Tag: Insert the following line into the <head> section of your HTML document, replacing “https://www.example.com/page-url” with the canonical URL of your page:

<link rel=”canonical” href=”https://www.example.com/page-url” />

canonical html example

How to add a canonical tag WordPress using Yoast

Ensure Yoast SEO is Installed and Activated: Before you begin, make sure that the Yoast SEO plugin is installed and activated on your WordPress site. If it’s not, you can install it by going to your WordPress dashboard, navigating to “Plugins”> “Add New”, and searching for “Yoast SEO”. Install and activate the plugin.

Open the Post or Page Editor:Go to the post or page where you want to set or change the canonical URL. You can do this by navigating to “Posts” or “Pages” on your WordPress dashboard and then selecting the post or page to edit.

Scroll to the Yoast SEO meta box:Below the main content area in the editor, you will find the Yoast SEO meta box. Depending on your WordPress setup, this section might appear at the bottom of the page or in a sidebar panel.

Navigate to the Advanced Settings:Click on the “Yoast SEO” icon, and then click on the “Advanced” tab within the Yoast SEO meta box. A gear icon might represent this tab.

Set the Canonical URL:In the “Advanced” tab, find the field labeled “Canonical URL.” Enter the full URL that you want search engines to consider the canonical source for this page. Make sure you include the full URL, starting with “https://” or “http://.”

Save or Update Your Post/Page:After you’ve entered the desired canonical URL, make sure to click “Update” or “Publish” at the top of the page to save your changes.

How to Add a Canonical Tag in WordPress Using RankMath

Ensure Rank Math SEO is Installed and Activated: Before you start, ensure the Rank Math SEO plugin is installed and activated on your WordPress site. If it’s not installed, you can add it by navigating to:

“Plugins”> “Add New” in your WordPress dashboard, searching for “Rank Math SEO”, and then installing and activating it.

Open the Post or Page Editor: Go to the WordPress dashboard, click “Posts” or “Pages”, and select the post or page where you want to set or edit the canonical URL.

Find the Rank Math SEO Metabox: Scroll down below the main content area of the editor, where you will find the Rank Math SEO metabox. Alternatively, it might appear in a sidebar depending on your screen layout or settings.

Navigate to the Advanced Tab: In the Rank Math SEO meta box, click on the “Advanced” tab. This tab may be represented by a gear icon or simply labelled as “Advanced”.

Set the Canonical URL: Within the “Advanced” tab, you’ll find a section for the canonical URL. Enter the full URL you wish search engines to consider as the authoritative (canonical) source for this content. Ensure that the URL starts with “https://” or “http://” and is correctly formatted.

Save or Update Your Changes: After entering the desired canonical URL, click “Update” or “Publish” at the top of the editor to save your changes.

Other Reasons Google is Not Indexing Your Content

  • You need to allow more time for Google to crawl and index the page.
  • Your website has crawl errors
  • The page has been marked as “noindex”

Signs Your Website Has Metadata Issues

Is Google showing the wrong metadata for your website? This is a common sign that all is not well with the metadata on your web pages. Meta descriptions, titles, and tags are crucial elements of your website as they offer a short description and summary of what your website and each page contains.

If your metadata is incorrect, irrelevant, or missing from your web pages, search engines will often rewrite it to make it appropriate.

Common Signs Of Issues with Your Meta Descriptions, Tags or Titles

What are the common signs to look out for that your website is experiencing issues with its metadata

Poor Snippets in SERPs

The descriptions in search results may not accurately or enticingly summarise the page content.

Low Click-through Rates

Fewer people clicking to your website from search engine results pages could indicate missing, incorrect or poorly written titles and descriptions.

Incorrect Summary Displaying on The Search Engine Results Page

If you see meta titles and descriptions that do not match your pages in search results, then this is a sign that you need to check your metadata for each page.

How to fix Meta Title, Tag and Description Issues

How to resolve your metadata issues on your website

Check and Update Your HTML Source Code

You should only have one description meta tag in the HTML source code of your website. If there are multiple tags or none at all, the description shown in search engines may not be the one you prefer.

The tag should be formatted like this:

<meta name=”description” content=”Preferred description goes here”/>
metadata html code example

You might need help from your website developer to implement this.

Update Your Meta details Using Yoast:

Ensure Yoast SEO is Installed and Activated: Make sure that Yoast SEO is installed and activated on your WordPress site. If not, you can install it by going to:

“Plugins”> “Add New” in your WordPress dashboard, searching for “Yoast SEO,” and then installing and activating it.

Open the Post or Page Editor: Navigate to “Posts” or “Pages” from your WordPress dashboard and click on the post or page you want to edit. This will open the WordPress editor for that specific piece of content.

Locate the Yoast SEO meta box: Scroll down to find the Yoast SEO meta box beneath the post or page editor. Alternatively, if you’re using the Gutenberg editor, you’ll find the Yoast SEO panel on the right-hand sidebar.

Edit the SEO Title and Meta Description: Within the Yoast SEO meta box or panel, click on the “Google preview” section (this might just be an icon that looks like a magnifying glass or labelled as “SEO”). This expands the snippet editor.

SEO Title: Click on the title in the Google preview. Yoast provides variables such as %%title%% for the post title, %%sitename%% for your site’s name, etc., that you can use or enter a custom title directly.

Meta Description: Click on the meta description area in the Google preview. A text box will open where you can type or edit the meta description. Try to create an engaging and concise summary that includes relevant keywords to improve the post’s SEO.

Save Your Changes:
After updating the SEO title and meta description, click “Update” or “Publish” to save these changes to your post or page.

edit meta data in yoast

Update Your Meta Details Using RankMath

Ensure Rank Math is Installed and Activated: Verify that the Rank Math SEO plugin is installed and activated on your WordPress site. If not already installed, you can add it by going to “Plugins”> “Add New” in your WordPress dashboard, searching for “Rank Math SEO,” and then installing and activating it.

Open the Post or Page Editor: Navigate to “Posts” or “Pages” from your WordPress dashboard and select the post or page you wish to edit. This will open the WordPress editor for that specific content.

Access Rank Math SEO Metabox: Scroll down to the Rank Math SEO metabox located beneath the main content editor area. In the Gutenberg editor, you might find the Rank Math SEO panel as a sidebar.

Edit SEO Title and Meta Description: Click the “Edit Snippet” button in the RankMath meta box or panel. This opens the snippet editor, where you can modify the SEO title and meta description.

SEO Title: You can edit the SEO title directly in the snippet editor. Rank Math allows variables like %title% for the post title, %sitename% for your site’s name, etc., or you can enter a custom title.

Meta Description: Click in the meta description field and type or edit your description. It’s best to craft a concise and engaging description that incorporates your target keywords to improve the post’s SEO effectiveness.

Save Your Changes:
Make sure to update or publish your changes by clicking the “Update” or “Publish” button at the top of the editor.

Other Reasons Google is Showing Incorrect Metadata for Your Website

  • Google has not yet crawled your latest meta content updates.
  • Google has crawled the content you added, deemed the quality insufficient, and decided to rewrite it.

 

Signs of Crawl Errors On Your Website

Why is Google Not Crawling My Webpage? Web crawlers (bots or spiders) typically discover your web pages by following links on your website. If a page you have requested is not being discovered, this may be a sign that you are experiencing a crawl error on your website.

Common Signs Your Website Has Crawl Errors

What are the common signs to look out for that your website is suffering from crawl errors?

The page is Not Being Crawled or Indexed

You have submitted new content that has been published for weeks, yet it just does not seem to get any attention from search engines.

If a page has no links pointing to it, the chance of it being discovered decreases. This is what is known as an “orphaned page.”

Whilst most websites will now have .xml sitemaps for the spiders to crawl, as you can see in Google Search Console, one of the examinations is to check if any internal links are pointing to the page:

Example of an orphaned website that has no internal links

If there are no internal links, this will indicate to search engines that this page is not important and less likely to be indexed.

 

An Important Page has Suddenly Disappeared From Search Engines

This may be a result of some updates being carried out and unknowingly removing all links to the page, meaning it has become an orphaned page.

Google Search Console Notifications

These errors are often reported in Google Search Console. Check your notifications by going to:

Search console error notifications

Missing Content in Search

Important content doesn’t appear in search results, indicating crawling issues.

Clicking a Link Results in a 404

If when clicking one of your internal links or a link from the search engine results page onto your website results in a 404 page, this is a sign that there is a crawl issue on your website and must be addressed promptly.

404 page not found

How to fix Crawl Errors

Some possible solutions if you are experiencing crawl errors on your website. 

Conduct a Technical Audit to Locate any Crawl Issues

Firstly, a manual audit of each page should be carried out to ensure all published pages are as expected and there are no visible errors; if it is not viable to do this manually, then I would recommend using a crawling tool such as Screaming Frog.

If you do not have the knowledge or time to do this, then it might be time to call in the SEO professionals.

Screaming frog

Check Your Website Menus

Pages located in the main menu, sub-menus and footer of the website are considered to be the primary pages of the website, So if the page in question that is not displaying in search results is a vitally important page for your website, then consider locating it in these areas.

How to Update Your WordPress Menu

Access the WordPress Dashboard: Log into your WordPress admin panel by entering your username and password.

Navigate to the Menus Screen: Go to “Appearance” on the left-hand sidebar in your WordPress dashboard, and then click on “Menus.” This will take you to the menu editor screen.

Select or Create a Menu: If you already have menus created, you can select the menu you want to edit from the dropdown list and click “Select” to start editing it. If you want to create a new menu, click on “Create a new menu,” enter a name for your new menu in the space provided, and click “Create Menu.”

Add Menu Items: On the left side of the menu editor, you’ll see boxes that contain pages, posts, custom links, and categories that you can add to your menu. Select the items you want to add by checking the box next to each item and then click the “Add to Menu” button.

Custom Links: You can use this to add a custom URL link to your menu, such as a link to an external site. Simply provide the URL and the link text.

Categories: If you want to add a blog category page, select it from the categories box and add it to your menu.

Organise Menu Items: Once the items are added, you can drag and drop them to arrange the order and structure. To create a dropdown menu, drag an item underneath and slightly to the right of another item, and it will become a sub-item of the parent item.

Configure Menu Settings: Below the menu structure, there are settings that allow you to choose where this menu appears on your site. These are theme-specific locations like a primary menu, footer menu, etc. Check the locations you want this menu to appear in.

Save Your Menu: Once you are satisfied with your menu’s structure and settings, click the “Save Menu” button to apply the changes.

Wordpress Menu structure

Add Appropriate Internal Links to the Page

As mentioned earlier, if there are no internal links to a page, this is considered an unimportant page. Adding some appropriate internal links will help increase the authority of this page within your website’s hierarchy.

How to add Internal Links in WordPress:
Manually Adding Links in Your Content

The simplest and most direct method is to manually insert links within your content when editing posts or pages:

When writing or editing content, use the WordPress editor to highlight the text you want to turn into a link.

Click the link button (which looks like a chain link) in the toolbar.
Enter the URL of the target page or search for the page/post within your site to link to it.

Consider link relevance, Make sure that the links are contextually relevant to the content of both the source and the target pages.

demonstration of how to add a link to text in wordpress

Using Plugins for Enhanced Link Management

Several WordPress plugins can help automate or simplify the process of adding internal links:

Link Whisper

A smart plugin that suggests internal links based on the content you are editing. It uses AI to recommend relevant links, saving you time and improving your site’s link structure.

Yoast

Yoast also offers internal linking suggestions as you write content. It helps you link to related posts that are important for your site’s SEO.

Internal Link Juicer

This plugin automatically converts specific keywords into links throughout your site. You can set up keywords for important posts and ensure they get linked throughout your content.

Other Reasons a Page Has Not Been Discovered by Search Engines

  • It’s a new page: If the web page is new, you will need to allow time for search engines to discover the newly published page.
  • It has been discovered by search engines but has been deemed not worthy of indexing.
  • Poor Site Navigation: Difficulty in navigating your website could indicate issues with internal links.

 

Signs Your Website Has Mobile Responsive Issues

In today’s world, one vital factor determining a website’s success is its performance on mobile. If your website has responsive issues, you could be missing out on potential business and ranking below other websites as a result.

You would likely need help from a website developer who can work on your website’s code to resolve mobile layout issues.

Making sure your website is responsive for mobile is one of the key elements any SEO professional will check when reviewing the technical side of your website.

Common Signs of Website Responsive Issues

What are the common signs to look out for when your website has issues on mobile?

Low Engagement Rate (High Bounce Rate)

If your website or a particular page has a low engagement rate, and visitors leave your site quickly without any interaction when visiting from mobile, this could suggest poor mobile performance. You can check this data in your Google Analytics (GA4) account.

GA4 engagement and event count

Poor User Experience on Mobile

Users complain about how your site functions on mobile devices. If your website is a little dated or maybe some recent work has not been tested on mobile, users may report issues when viewing it on mobile.

Website Slow to Load on Mobile

If pages take a long time to load on mobile, this must be addressed.
Attention spans of audiences are growing shorter and shorter; content needs to be fully loaded quickly; otherwise, your potential client will click back and go to the next available weblink.

You can test this by going to Page Speed Insights

How to Fix Mobile Responsive Issues

Some of the ways you can resolve your responsive issues

Serve Properly sized images

Depending on the content management system you are using, the code of your website, and the image plugins you have installed, the images you add to your website might not always adapt for users viewing on different screens.

If you notice images not appearing correctly when you have smaller screens, there are multiple ways to fix this.

In WordPress

You can use a plugin such as Adaptive Image Sizes to control the sizes of images on different screen sizes.

Update Your Code

Update your image code to serve “responsive images”, meaning adjusting the width and height to fit any screen (mobile, tablet, or desktop). All the images will be optimised and served to the right screen; not only will this resolve display issues, but it will also mean less bandwidth consumption and faster browser execution. (Which is coming up next).

You’ll need to generate multiple versions of each image and specify which one to use in your HTML or CSS using viewport dimensions, media queries, etc. Your website developer may need to assist with this.

Optimise Your Website for Speed and Performance.

The quicker the load time of your website the less visitors have to spend waiting, optimising your website so that all of your pages load quickly is a vital task if you are experiencing low engagement rate for visitors on mobile.

Optimise your Images

Images usually take the longest time to load on a website since image files are typically larger in size than HTML and CSS files. However, it is possible to reduce the load time of images through image optimisation, which involves decreasing their resolution and dimensions, as well as compressing the image files themselves.

(h6) Plugins to Help Optimise Your Images
Limit the number of HTTP requests

Each time you visit a webpage in your browser, the browser will send multiple HTTP requests for different assets, such as images, scripts, and CSS files. Some pages may require dozens of such requests, which may cause delays due to the transfer of files to and from the server where your website is hosted.

To minimise the load time for a webpage, it is recommended to reduce the number of assets that need to be loaded.

A speed test can help identify which HTTP requests are taking the most time.   

Page Speed Insights

example of JavaScript files being loaded on a test in page speed insights

Best Plugins to Increase Page Load Speed (reducing HTTP requests)

WP Rocket
Nitropack
Wp-Optimise

Defer / Delay Scripts

The more scripts and code trying to be loaded at one time the more resource that is being used meaning the slower the page is going to load. If there are scripts  that can be delayed, then delaying these scripts will help with the page load speed.

The simplest way to defer loading of JavaScript is to use the defer attribute in the <script> tag. This attribute tells the browser to execute the script only after the HTML document has been fully parsed.

<script src=”path/to/your-script.js” defer></script>

Alternatively, you can use the async attribute, which does not wait for the HTML document to be fully parsed before loading, but it will execute the script asynchronously as soon as it is downloaded.

<script src=”path/to/your-script.js” async></script>

I would recommend speaking with your webmaster to action this. 

Bring in The Professionals

Optimising a website is not a straightforward task and there is no one size fits all solution for this as many factors can impact the speed of your website which may not be the case on other websites.

Various reasons such as, You could have a heavy site on a slow server or you could be adding too many JavaScript heavy elements to a web page or your website is simply outdated with old code libraries that are no longer supported.

It will vary from website to website. Hiring an optimisation specialist will help you pinpoint the cause of your slow page load speeds and help you to assemble a strategy.

Other reasons why Your Website is Not Performing Well on Mobile

  • Poor Server quality
  • Too many elements are being loaded.
  • DOM is too big
  • Too many scripts and files are being loaded.

 

Signs Your Website Has Indexing Issues

If you have recently searched for your business name or relevant keywords related to your products or services and noticed that your website is not showing up in search results, then you are not alone.

This is a common issue that many businesses face, but it should be addressed promptly. However, before making any changes, you need to determine the root cause of why your website is not appearing in search results.

Common Signs of Indexing Issues

What are some of the common signs that your website is experiencing indexing issues?

Your Site is Not Showing at all on Google

Google pulls its results from an index of all the pages it’s crawled online. If your site isn’t in this index, Google will not display your content in their results. You can check if this is the issue by searching the site using the “site:” operator. For instance, if I wanted to make sure my website (webbh.co.uk) was indexed in the Google search, I would type:

site:webbh.co.uk

using google to search for a website

Individual Web Pages Are Missing From Google

If you notice that some of your important pages are not appearing in the Google search results, or you are unsure if they are even listed on the search engine, you can check by using the site: operator entering the full page URL. For example:

site:webbh.co.uk/seo-services/

using google to search for a specific URL and if it is indexed

How to fix Common Website Indexing Issues

What are some of the solutions to resolve common web page indexing issues?

Remove “noindex” meta tag

If your website has been marked as “noindex” search engines will not crawl and index your website, meaning you will never be listed on search engines. This can quite often happen by mistake or someone forgets to remove it before publishing content.

Remove “noindex” from your HTML header code

If the index is set using a meta tag in the HTML, it would typically look like this:

To remove the noindex directive, you have two options:
Simply delete or comment out the entire meta tag from the HTML of your page.
You can also modify the content attribute of the meta tag to allow indexing or remove restrictions explicitly.

Before: <meta name=”robots” content=”noindex”>

After:  <meta name=”robots” content=”index, follow”>

This index follow directive tells search engines that they can index this page and follow the links on this page.

Using Noindex, Nofollow HTML Metatags How to Tell Google Not to Index a Page in Search-2

Remove the “noindex” command from your WordPress Dashboard

Log into Your WordPress Dashboard:
Start by logging into the admin area of your WordPress site.

Go to Settings:
Navigate to the “Settings” menu on the left-hand sidebar of your WordPress dashboard.

Select ‘Reading’:
Click on the “Reading” sub-menu under “Settings.”

Find the Search Engine Visibility Option:
Scroll down to the “Search Engine Visibility” section. You will see a checkbox next to “Discourage search engines from indexing this site.”

Change the Setting:
If the checkbox is marked, uncheck it. This action will allow search engines to index your site.

Save Changes:
Click the “Save Changes” button at the bottom of the page to apply the new setting.

wordpress discourage search engines from indexing this site

Using RankMath to Remove “Noindex”

Log into Your WordPress Dashboard.

Navigate to the Post or Page: Open the post or page you want to edit.

Find the Rank Math SEO Metabox: Scroll down to the Rank Math SEO section.

Go to the “Advanced” Tab: Click on the “Advanced” tab within the Rank Math panel.

Set Robots Meta to “Index”: Ensure the ‘Robots Meta’ dropdown for ‘Index’ is set to “Index”. Make sure that the “No Index” option is not selected.

Save Your Changes: Click “Update” on the post or page.

rankmath page noindex setting

 
Using Yoast SEO to Remove “Noindex”

Log into Your WordPress Dashboard.

Navigate to the Post or Page: Go to “Posts” or “Pages” from your WordPress dashboard and click on the post or page you wish to edit.

Scroll to the Yoast SEO Metabox: Below the post editor, find the Yoast SEO section.

Switch to the “Advanced” Tab: In the Yoast SEO meta box, click on the “Advanced” tab (gear icon).

Change ‘Allow search engines to show this Post in search results?’: You will see an option that says, “Allow search engines to show this Post in search results?”. Set this to “Yes”.

Update or Publish Your Post: Save the changes by clicking “Update” or “Publish”.

Update Your Robots.txt Instructions

If your website is not being crawled because of instructions set on your robots.txt, you will need to update the commands here to allow crawling.

You need to access the root directory of your website, where your site’s main files are stored. This is typically done through FTP (File Transfer Protocol) using tools like FileZilla, or via the file manager provided by your web hosting service in the control panel (e.g., cPanel).

Ensure that there are no entries that might block search engines. For example, entries like Disallow: / would prevent all web crawlers from accessing any part of your site. Modify such entries to more specific directories or pages you wish to keep private or clear the Disallow entry to allow access.

Add the following content to specify that all robots are allowed to access all parts of your site.
User-agent: *
Disallow:

This code tells web crawlers that they can visit all sections of your website as the Disallow directive is empty.

 

 The Website Or Page Is New

If your website or page is new, then the chances are you might not be experiencing crawl errors. Instead, you just need to allow time for Google to crawl it.

 

Other Reasons Your Pages are Not Being Indexed

  • Broken or outdated sitemaps
  • Incorrectly configured URL parameters
  • Connectivity issues, meaning crawlers cannot reach the server
  • Incorrect use of rel=canonical tags
  • Very slow load speed
  • Selecting the incorrect privacy settings in your CMS (easily done in WordPress)
  • The site may be indexed under a different domain
  • If the site is brand new, Google just might not have got around to it yet
Posted in Technical SEO
Related Posts
Write a comment