These are other entries in our FAQ database:

• How can I exclude unwanted files (images, etc) from the sitemap file?
  
• "The XML page cannot be displayed" / "Error loading stylesheet" error message
  
• The GSiteCrawler generates several files - which one do I upload for Google Sitemaps?
  

Questions, ideas, problems, wishes? Be informed whenever something new comes up (or any important problems are fixed.)

Google Group

How can I reduce the size of my GSiteCrawler database?

The MS-Access database files used by the default installation of the GSiteCrawler can reach a maximal size of 1GB. Once they reach that size, the program cannot access the database properly and corruption can occur. It is vital that the size of the database is reduced before you continue working with the program.

In order to first reduce the size of your database file, the GSiteCrawler includes a small tool to compress the database and remove unnecessary spare space. You can start this tool through the menu items "File" / "Compress database" (or start it manually: it's called "DbCompress" and located in the same folder as the GSiteCrawler). It is usually enough to just click on "Start" and let it work (it will take some time if your database is close to 1GB in size).

If your database has reached 1GB and the GSiteCrawler does not start any more, you can manually start DbCompress, click on the down-arrow next to the start-button and choose "Regenerate". This can usually save a database file that has reached the maximum size.

In order to keep this from happening in the future, you can do one of the following:

1. Use separate database files for separate domains. You can create new database files with the menu item "File" / "Choose database" / "New database". If you have a large number of domains, it often also makes sense to separate them into logical groups by using separate database files.
2. Use the SQL-Server version of the GSiteCrawler. This will require a separate update-installation and possibly other downloads (see the appropriate FAQ entry). If you have a Microsoft SQL-Server in your local network, you can use that - the maximum database sizes are much higher (4GB or more, depending on the version). If you do not have access to a Microsoft SQL Server, you can use the free MSDE database engine instead (maximum 2GB database files).