magento re-indexing takes too much time

magento re-indexing takes too much time

October 17, 2026 · Illustrated author avatarBy Stefan Bogdanescu
magento re-indexing takes too much time

Optimizing Magento Indexing for Large Product Catalogs

Are you facing challenges with Magento indexing in your e-commerce store? If you have a large product catalog—say, around 75,000 products—and you’re adding new items through data import profiles, you might be experiencing slow re-indexing times and even MySQL connection errors. This is a common issue for Magento stores with extensive product databases.

Understanding the Problem

Magento’s indexing system is designed to keep search results relevant by regularly updating its database tables based on changes in your catalog. However, when dealing with large datasets, this process can become resource-intensive and time-consuming.

The default Magento setup isn’t optimized for high-volume indexing, which leads to several issues:

  1. Resource Overload: Each re-index operation triggers multiple queries and processes simultaneously, overwhelming the server’s resources.
  2. MySQL Connection Limits: Most servers have a limit on concurrent MySQL connections. If you exceed this limit while re-indexing, you’ll encounter errors like “Too many connections.”
  3. Slow Performance: The default indexing modes are designed for smaller stores, so they don’t scale well with large catalogs.

Optimizing Magento Indexing

To resolve these issues and improve the performance of your store, consider implementing the following optimization strategies:

1. Use the Update on Save (UOS) indexers

Many common indexes can be updated in real-time as products are saved, eliminating the need for periodic re-indexing. This approach significantly reduces the load on your server.

php bin/magento indexer:update byscheduled

To enable UOS for specific indexers:

  1. Log in to your Magento admin panel.
  2. Navigate to System > Configuration > Catalog.
  3. Find the “Index Management” section under the ‘Catalog’ tab.
  4. Set the value of “Update on Save” to “Yes” for the indexes you want to enable (e.g., catalog_product_flat, cataloginventory_stock).
  5. Click “Save Config”.

2. Optimize MySQL settings

Ensure your MySQL server is properly configured and optimized:

  • Increase the max_connections setting in your MySQL configuration file.
  • Adjust the innodb_buffer_pool_size to a value that’s about 70%-80% of your available RAM.
  • Consider using InnoDB as your primary storage engine for better performance.

3. Implement a staging environment

If you’re adding large numbers of products through data import profiles, consider doing so in a staging environment first. This allows you to re-index and test the changes before pushing them live to your production store.

4. Leverage Magento’s indexer modes

Magento offers three indexing modes: update on save, manual update, and scheduled update by cron job. For very large catalogs, it’s beneficial to use a combination of these modes:

  1. Enable UOS for indexes that require real-time updates.
  2. Run manual re-indexing during slow periods (e.g., late at night).
  3. Schedule the remaining indexers to run daily or weekly, depending on your store’s specific needs.

Conclusion

Optimizing Magento indexing in a large e-commerce store requires a strategic approach and careful resource management. By enabling Update on Save for relevant indexes, configuring MySQL settings appropriately, and leveraging Magento’s built-in indexer modes, you can significantly improve the performance of your re-indexing processes.

At Laravel Company, we specialize in helping e-commerce businesses optimize their Magento stores for maximum efficiency. Contact us today to learn more about our Magento optimization services and how we can help you overcome challenges with indexing, performance, and scalability.

Catalog Indexing Database Performance

Our network