Growing database load
Millions of datasheets and media files meant the original database design had to be revisited rather than simply given more hardware.
Case study · Product content syndication · Since 2002
Brands need quality product information to reach the channels that sell for them. Icecat publishes and syndicates that content to tens of thousands of channels worldwide — and Bintime has been the engineering team behind it since 2002.
About the client
Icecat NV publishes and syndicates product information to tens of thousands of sales and marketing channels worldwide, for online and offline use. It ranked 47th in the Main Software 2021 edition with a score of 80%.
In cooperation with 300+ sponsoring brands and online channel partners, Icecat offers Open Icecat — the only worldwide unique open catalogue — with product datasheets in 60+ languages, standardised in formats built for implementing, categorising, filtering, searching and comparing products. Alongside the free Open Icecat, the fee-based Full Icecat covers 30k+ brands with more than six million described products.
Its integration partners include Aliexpress, Amazon, Google Shopping, Shopify and Magento.

Business challenge
From the concept onwards, Icecat’s aim was an innovative product with complex functionality that would be user-friendly and fail-safe. Those three requirements pull against each other, and over twenty years the volume of data pulled hardest.
Millions of datasheets and media files meant the original database design had to be revisited rather than simply given more hardware.
Datasheets have to arrive in formats that channels can implement, categorise, filter, search and compare — the same content, many shapes.
A catalogue that tens of thousands of channels depend on cannot be experimented with carelessly. New features had to ship without putting delivery at risk.
Approach
The team adopted an agile approach, converting Icecat’s requirements and ideas into platform features cost- and time-efficiently, and reducing their time to market. That is the working relationship: the client innovates commercially, the team turns it into shipped functionality.
To manage the increasing database loads of millions of datasheets and media files, the developers optimised the team to be T-shaped, adapted the existing database architecture and implemented new technologies where the original ones had reached their limits.
Engagement modelAn 18-person dedicated development team, T-shaped by design, working with Icecat continuously since 2002.
Agile against a commercial roadmap. Requirements and ideas converted into features, with time to market as the measure.
A T-shaped team. Engineers who move across the stack, so growth in one area does not create a queue behind one specialist.
Database architecture adapted, not replaced. MySQL kept where it fits, with Cassandra, ClickHouse, Elastic and MongoDB added where the load demanded a different shape.
Content delivery as a product. XML, JSON, CSV and Icecat LIVE, so integrating the catalogue is a channel’s choice rather than a project.
Review functionality against revenue. Constant reviews of what the functionality earns keep a twenty-year platform from accumulating features nobody uses.
Value delivered
On Icecat’s way to becoming an IPO-listed enterprise and a market leader in product content distribution, Bintime has supported it throughout. Today that shows up as:
Including L’Oréal, HP, Asus and Xerox — brands paying to have their product content in the open catalogue because it reaches their channels.
Localisation is not an add-on here: it is the reason a channel in one market can use content prepared for another.
More than six million described products in the fee-based catalogue, alongside the free Open Icecat.
Seamless integration with key marketplaces such as Amazon, Aliexpress and Lazada, with content downloadable in XML, JSON, CSV and Icecat LIVE.
Expanding cooperation
Bintime supports Icecat in keeping the platform stable while continuing to innovate. Constant reviews of functionality against the revenue it produces are how those two goals are held together.
The traditional PIM market is crowded, but PIM plus syndication still offers room — and that is where Icecat positions itself, with a freemium model built on an open catalogue and expectations of continued fast growth.
Acquisitions have left Icecat with several PIM tools — Cedemo, Icecat, Iceshop, Syndy — so the next step is simplification: developing one PIM. Fewer platforms mean an ecosystem that is easier to maintain and operate. In parallel, the team is building a new generation of connectors to Amazon in answer to brands’ demand.
FAQ
Publishing standardised product datasheets to the channels that sell the products — in formats a channel can implement, categorise, filter, search and compare without rework.
Open Icecat is the free, brand-sponsored open catalogue with datasheets in 60+ languages. Full Icecat is fee-based, covering 30k+ brands and more than six million products.
By adapting the database architecture and adding technologies suited to each load — Cassandra, ClickHouse, Elastic and MongoDB alongside MySQL — instead of scaling one database indefinitely.
Integration partners include Aliexpress, Amazon, Google Shopping, Shopify and Magento, with content available in XML, JSON, CSV and Icecat LIVE.
Consolidating the PIM tools acquired over the years into one platform, and building a new generation of connectors to Amazon.
Only if it keeps changing shape. Here that meant a T-shaped team, an architecture revisited as volumes grew, and functionality reviewed against what it earns.
Start a conversation
Tell us where your product data lives and where it needs to go. We come back with an architecture direction, a team shape and the first ninety days.
We will get back to you within 24 hours with next steps.