Sitemaps

Overview

The Sitemaps module allows you to generate, manage, and monitor XML sitemaps for your website. Sitemaps are essential files that help search engines like Google and Bing discover and index all pages on your website. This module automates the creation and maintenance of these files, ensuring search engines always have an up-to-date map of your site's content.

This module is fully integrated with the Blog Management System and Centralized SEO System, providing automated sitemap generation for blog posts, SEO-optimized sitemap features, and intelligent content prioritization based on SEO analysis scores. The system automatically includes blog content with proper metadata and integrates with SEO automation workflows.

XML sitemaps list all important URLs on your website along with metadata like last modification date and update frequency. By providing this information to search engines, you improve your site's crawlability and can potentially boost your search engine rankings.

Accessing Sitemaps

Navigation Path: Dashboard > SEO > Sitemaps

Required Permission: sitemaps.view

Key Features

• Automatic Generation: Create sitemaps automatically from your website content
• Multiple Sitemap Types: Generate different sitemaps (pages, posts, categories, etc.)
• Blog Integration: Automated sitemap generation for blog posts with SEO metadata
• SEO-Optimized Features: Priority calculation based on SEO analysis scores
• Statistics Dashboard: View total URLs, file sizes, and last generation time
• Content Analysis: Analyze sitemap structure and URL distribution
• Cache Management: Clear sitemap cache to force regeneration
• Download Capability: Download sitemap files for manual submission
• Search Engine Integration: Quick links to submit sitemaps to Google and Bing
• Automated Blog Updates: Automatic sitemap regeneration when blog posts are published
• SEO Score Integration: URL prioritization based on centralized SEO system scores

Main Interface

Statistics Dashboard

The main sitemaps page displays four key statistics cards:

• Total URLs: The total number of URLs included across all sitemaps
• File Size: Combined size of all sitemap files in kilobytes
• Last Generated: How long ago the sitemaps were last generated
• Sitemap Files: Number of individual sitemap files created

These statistics help you monitor your sitemap health and ensure all content is being included.

Quick Actions Section

The Quick Actions area provides tools for generating specific types of sitemaps:

• Generate Specific Sitemap: Create individual sitemaps by type (pages, posts, etc.)
• Generate All Sitemaps: Regenerate all sitemap files at once
• Clear Cache: Remove cached sitemap data to force fresh generation

Sitemap Files List

Below the statistics, you'll find a table listing all generated sitemap files with:

• File Name: Name of the sitemap file (e.g., sitemap.xml, sitemap-pages.xml)
• URLs: Number of URLs contained in that sitemap
• Size: File size in kilobytes
• Last Modified: When the file was last updated
• Actions: View, download, or delete the sitemap file

Common Tasks

Task 1: Generate All Sitemaps

To create or update all sitemap files:

1. Navigate to Dashboard > SEO > Sitemaps
2. Click the "Generate All Sitemaps" button in the top-right corner
3. Wait for the generation process to complete (usually a few seconds)
4. A success message will appear confirming generation
5. The statistics will update to reflect the new sitemap data

What Happens:

• All sitemap types are regenerated from current content
• Old sitemap files are replaced with new versions
• Statistics are updated with current data
• Cache is automatically cleared

Task 2: Generate a Specific Sitemap

To generate only one type of sitemap:

1. Navigate to Dashboard > SEO > Sitemaps
2. Scroll to the "Quick Actions" section
3. In the "Generate Specific Sitemap" dropdown, select the sitemap type (e.g., "Pages", "Posts")
4. Click the "Generate" button
5. Wait for confirmation that the sitemap was generated

When to Use:

• After adding or updating content of a specific type
• When you only need to refresh one sitemap
• To save time instead of regenerating all sitemaps

Task 3: View Sitemap Content

To inspect the contents of a sitemap file:

1. Navigate to Dashboard > SEO > Sitemaps
2. Find the sitemap file in the list
3. Click the "View" button (eye icon) next to the file
4. Review the sitemap details page showing:
   • File information (name, size, last modified)
   • XML source code with syntax highlighting
   • Content analysis (URL count, sub-sitemaps, special features)
   • Actions (download, back to list)

Features on View Page:

• Line Numbers: Toggle line numbers on/off for easier reference
• Format XML: Auto-format the XML for better readability
• Copy to Clipboard: Copy the entire XML content
• Download: Save the file to your computer

Task 4: Download a Sitemap

To download a sitemap file:

1. Navigate to Dashboard > SEO > Sitemaps
2. Find the sitemap in the list
3. Click the "Download" button (download icon)
4. The file will download to your computer

Use Cases:

• Manual submission to search engines
• Backup before regenerating
• Sharing with SEO consultants
• Offline analysis

Task 5: Submit Sitemap to Search Engines

To notify search engines about your sitemap:

1. Navigate to Dashboard > SEO > Sitemaps
2. Click "View" on your main sitemap.xml file
3. Scroll to the "External Tools" section
4. Click "Google Search Console" or "Bing Webmaster Tools"
5. Log in to the respective service
6. Submit your sitemap URL (typically https://yoursite.com/sitemap.xml)

Important Notes:

• You only need to submit once; search engines will check for updates automatically
• Submit the main sitemap.xml file, not individual sub-sitemaps
• Verify your site ownership in the webmaster tools first

Task 6: Clear Sitemap Cache

To force fresh sitemap generation:

1. Navigate to Dashboard > SEO > Sitemaps
2. Click the "Clear Cache" button in the top-right corner
3. Wait for confirmation that cache was cleared
4. Optionally, regenerate sitemaps immediately after clearing cache

When to Use:

• Sitemaps aren't reflecting recent content changes
• After making configuration changes
• When troubleshooting sitemap issues
• Before important content launches

Task 7: Delete a Sitemap File

To remove a specific sitemap file:

1. Navigate to Dashboard > SEO > Sitemaps
2. Find the sitemap file in the list
3. Click the "Delete" button (trash icon)
4. Confirm the deletion in the popup dialog
5. The file will be removed from the server

Warning: Only delete sitemap files if you're certain they're no longer needed. Deleting the main sitemap.xml can impact SEO.

Task 8: Generate Blog-Specific Sitemaps

To create sitemaps specifically for blog content:

1. Navigate to Dashboard > SEO > Sitemaps
2. In the "Generate Specific Sitemap" dropdown, select:
   • "Blog Posts" for all published blog posts
   • "Blog Categories" for blog category pages
   • "Blog Tags" for blog tag pages
3. Click the "Generate" button
4. Wait for confirmation that the sitemap was generated

Blog Sitemap Features:

• Automatically includes SEO metadata from blog posts
• Calculates priority based on SEO analysis scores
• Includes featured images as image sitemap entries
• Updates automatically when blog content is published

Task 9: Configure SEO-Optimized Sitemap Settings

To optimize sitemaps using SEO system data:

1. Navigate to Dashboard > Settings > SEO > Sitemaps
2. Configure SEO integration options:
   • Use SEO Scores for Priority: Enable priority calculation from SEO analysis
   • Minimum SEO Score: Set threshold for including content (default: 30)
   • High Priority Threshold: SEO score for high priority (default: 70)
   • Include Image Sitemaps: Enable image sitemap generation for blog posts
3. Set blog-specific options:
   • Auto-regenerate on Publish: Automatically update sitemaps when blog posts are published
   • Include Draft Previews: Include scheduled posts in sitemaps (not recommended)
   • Category Priority Boost: Increase priority for category pages
4. Click "Save Settings"
5. Regenerate sitemaps to apply new settings

Task 10: Monitor Blog Content in Sitemaps

To verify blog content is properly included:

1. Navigate to Dashboard > SEO > Sitemaps
2. Click "View" on the blog posts sitemap
3. Review the sitemap content for:
   • All published blog posts are included
   • Priority values reflect SEO scores
   • Last modification dates are accurate
   • Image URLs are included (if enabled)
4. Check the SEO Dashboard for any blog posts with sitemap issues
5. Use the Blog Management interface to verify post publication status

Troubleshooting Blog Sitemaps:

• If blog posts are missing, check publication status
• If priorities seem incorrect, verify SEO analysis has been run
• If images are missing, check featured image settings
• If updates aren't reflected, clear sitemap cache and regenerate

Settings and Options

Sitemap Types

The system can generate different types of sitemaps:

• Main Sitemap (sitemap.xml): Index file that references all other sitemaps
• Pages Sitemap: Contains all static pages
• Blog Posts Sitemap: Contains published blog posts with SEO metadata
• Blog Categories Sitemap: Contains blog category pages with SEO optimization
• Blog Tags Sitemap: Contains blog tag pages for content organization
• Custom Sitemaps: Additional sitemaps based on your content types

Blog-Specific Sitemap Features

Blog Posts Sitemap Enhancement:

• Automatic inclusion of published blog posts
• SEO score-based priority calculation
• Featured image URLs included as image sitemaps
• Category and tag associations
• Publication and modification date tracking
• Automatic updates when posts are published/updated

SEO Integration Features:

• Priority values calculated from SEO analysis scores
• High-performing content gets higher priority (0.8-1.0)
• Medium-performing content gets standard priority (0.5-0.7)
• Low-performing content gets lower priority (0.1-0.4)
• Automatic exclusion of content with very low SEO scores (if configured)

Sitemap Metadata

Each URL in a sitemap includes:

• Location (loc): The full URL of the page
• Last Modified (lastmod): When the page was last updated
• Change Frequency (changefreq): How often the page typically changes
• Priority (priority): Relative importance (0.0 to 1.0)

File Size Limits

• Individual sitemap files are limited to 50,000 URLs
• Maximum file size is 50MB (uncompressed)
• Large sites automatically split into multiple sitemap files
• A sitemap index file references all sub-sitemaps

Permissions

The following permissions control access to sitemap management:

• sitemaps.view: View the sitemaps page and statistics
• sitemaps.generate: Generate new sitemaps
• sitemaps.delete: Delete sitemap files
• sitemaps.clear-cache: Clear sitemap cache

Users need the appropriate permissions to perform each action. Contact your administrator if you need additional access.

Tips and Best Practices

Generation Frequency

• Regenerate sitemaps after publishing new content
• Set up automatic generation if your site updates frequently
• Don't regenerate more than once per hour to avoid server load

Search Engine Submission

• Submit your sitemap to Google Search Console and Bing Webmaster Tools
• Only submit the main sitemap.xml file
• Monitor crawl statistics in webmaster tools

Content Organization

• Ensure all important pages are included in sitemaps
• Use priority values to indicate your most important pages
• Exclude admin pages, duplicate content, and low-value pages

Performance

• Clear cache before regenerating if changes aren't appearing
• Monitor file sizes to ensure they stay under limits
• Use sitemap indexes for sites with many pages

Monitoring

• Check statistics regularly to ensure URL counts are correct
• Verify last generation time to confirm automatic updates are working
• Review sitemap content periodically to catch any issues

Troubleshooting

Problem: Sitemap is Empty or Missing URLs

Possible Causes:

• Content hasn't been published yet
• Permissions prevent certain content from being included
• Cache is stale

Solutions:

1. Verify content is published and publicly accessible
2. Clear sitemap cache using the "Clear Cache" button
3. Regenerate all sitemaps
4. Check that content types are configured to be included in sitemaps
5. Review audit logs for any errors during generation

Problem: Sitemap Not Updating with New Content

Possible Causes:

• Cache is preventing updates
• Automatic generation is not configured
• Generation failed silently

Solutions:

1. Clear the sitemap cache
2. Manually regenerate sitemaps
3. Check server logs for generation errors
4. Verify cron jobs are running if automatic generation is enabled
5. Ensure sufficient disk space and permissions

Problem: Search Engines Not Crawling Sitemap

Possible Causes:

• Sitemap not submitted to search engines
• Sitemap URL is incorrect
• robots.txt is blocking access
• Server errors preventing access

Solutions:

1. Verify sitemap is accessible at /sitemap.xml in a browser
2. Check robots.txt file doesn't block sitemap access
3. Submit sitemap URL to Google Search Console and Bing Webmaster Tools
4. Add sitemap location to robots.txt: Sitemap: https://yoursite.com/sitemap.xml
5. Check webmaster tools for crawl errors

Problem: Sitemap File Too Large

Possible Causes:

• Too many URLs in a single sitemap
• Site has grown beyond single sitemap capacity

Solutions:

1. The system should automatically split large sitemaps
2. Regenerate sitemaps to trigger automatic splitting
3. Verify sitemap index file is created
4. Consider excluding low-value pages from sitemaps
5. Contact administrator if automatic splitting isn't working

Problem: Permission Denied Errors

Possible Causes:

• User lacks required permissions
• File system permissions are incorrect

Solutions:

1. Verify you have sitemaps.generate permission
2. Contact administrator to request necessary permissions
3. Check that web server has write access to sitemap directory
4. Review audit logs to see who has sitemap permissions

Problem: Sitemap Contains Wrong URLs

Possible Causes:

• Base URL is configured incorrectly
• Content is miscategorized
• Cache contains old data

Solutions:

1. Verify site URL in general settings
2. Clear sitemap cache
3. Regenerate all sitemaps
4. Check content categorization and publication status
5. Review sitemap generation configuration

Problem: Blog Posts Not Appearing in Sitemaps

Possible Causes:

• Blog posts are in draft status
• SEO score below minimum threshold
• Blog sitemap generation disabled
• Cache not updated after publishing

Solutions:

1. Verify blog posts are published (not draft or scheduled)
2. Check SEO score meets minimum threshold in sitemap settings
3. Enable blog post inclusion in sitemap configuration
4. Clear sitemap cache and regenerate blog sitemaps
5. Check blog post SEO analysis has been completed
6. Verify blog post URLs are accessible and not blocked

Problem: SEO Priorities Not Reflecting in Sitemaps

Possible Causes:

• SEO score integration disabled
• SEO analysis not completed for content
• Priority calculation settings incorrect
• Cache containing old priority data

Solutions:

1. Enable "Use SEO Scores for Priority" in sitemap settings
2. Run SEO analysis on blog posts via SEO Dashboard
3. Verify priority threshold settings are appropriate
4. Clear sitemap cache to remove old priority data
5. Regenerate sitemaps after SEO analysis completion
6. Check SEO analysis results in centralized SEO system

Problem: Image Sitemaps Not Generated for Blog Posts

Possible Causes:

• Image sitemap generation disabled
• Blog posts missing featured images
• Image URLs not accessible
• Image sitemap cache issues

Solutions:

1. Enable "Include Image Sitemaps" in sitemap settings
2. Verify blog posts have featured images set
3. Check that image URLs are publicly accessible
4. Clear image cache and regenerate sitemaps
5. Verify image file permissions and server configuration
6. Check media library for broken image links

Problem: Automatic Sitemap Updates Not Working

Possible Causes:

• Auto-regeneration disabled in settings
• Queue workers not running for background jobs
• Blog publishing hooks not triggering sitemap updates
• Insufficient permissions for automatic generation

Solutions:

1. Enable "Auto-regenerate on Publish" in sitemap settings
2. Verify queue workers are running: php artisan queue:work
3. Check Laravel logs for sitemap generation errors
4. Test manual sitemap generation to verify functionality
5. Verify user permissions for automatic sitemap generation
6. Check blog publishing workflow triggers sitemap updates

Related Modules

Content Management

• Pages: Pages are automatically included in sitemaps
• General Settings: Configure base URL used in sitemaps

Blog Management System

• Blog Posts: Blog posts automatically included in sitemaps
• Blog Categories: Category pages included in category sitemaps
• Blog Tags: Tag pages included in tag sitemaps
• Blog Media Integration: Featured images included in image sitemaps

Centralized SEO System

• SEO Dashboard: Monitor sitemap performance and SEO integration
• SEO Technical: Advanced sitemap configuration and technical SEO
• SEO Analytics: Track sitemap effectiveness and crawl statistics
• SEO Automation: Automated sitemap generation workflows
• Blog SEO Integration: SEO analysis integration with sitemap generation

System Administration

• Audit Logs: Track sitemap generation and modifications
• Permissions: Manage who can generate sitemaps