Content Delivery Network Purging – How it Works

Shalom Carmel Chief Information Officer at GlobalDots
4 Min read

Instant purging is key to any CDN as it allows businesses to remove stale, outdated and unwanted content from the edge as quickly as possible. This feature is important to publishers as well as other parts of the web industry that updates info fast (such as social networks, news portals, trading platforms).

Illustration of cloud computing with devices connected to a cloud.
Image source

​When talking about purging, a ​not a one-size-fits-all approach does not exist. Some CDNs do it in seconds or minutes (referred to in the industry as “instant”), while others can take hours or longer. CDNs that take fewer time tend to adopt an asynchoronous approach and are backed by newer hardware and optimized scripting, as opposed to those that take longer because of their outdated systems or bloated networks.

How One AI-Driven Media Platform Cut EBS Costs for AWS ASGs by 48%

How One AI-Driven Media Platform Cut EBS Costs for AWS ASGs by 48%

There are hundreds of instances of digital media sites releasing stories, then needing to purge them due to story updates, misinformation from sources, and editorial mistakes. Depending on the reach of the website and importance of the piece, each second a false piece remains live could equate to a high-percentage loss of reputation. Purging is directly connected to the decreasing of customer experience. ​Another benefit or example is that after deploying new code, developers don’t have to wait forever to see the change on the production website.

A digital illustration representing a global network with a globe and multiple computer screens connected by arrows.
Image source

Purging is shown to be most important in industries such as: publishing, advertising, gaming and software related industries.

The difference between Purging and Invalidation

Today, files are cleared from the cache in one of the following ways:

  • Purging (asynchronous)
  • Invalidation​

Purging today is done asynchronously, but that wasn’t always the case. While the purging requests would be submitted at the same time, they would have stand in the queue, waiting for the execution. One request had to be completed before the other one could start. The picture below shows how the requests are queued in both cases.

Illustration comparing synchronous and asynchronous purge requests in a CDN architecture.
Image source

Purging: Secure but not always instant

Purging occurs when the CDN looks for the file on all edges and deletes it from the disk. Depending on the CDN you’re using, this can be a slower process, but it’s always more secure. The speed of ​the purge depends on ​hardware type, network size, and the amount of CDN customers requesting purges at the same time. Outdated hardware or network congestion always impacts purging to take longer time.

Diagram illustrating a cloud network structure with devices and servers.
Image source

​Some news agencies have SLAs in place that require all content be completely removed from all physical disks, due to security reasons. ​Invalidation can be performed instantaneously – often regardless of the CDN provider you have – and uses much less resources, mainly because ​the CDN only checks the header information and doesn’t require disk cycles for deletion. There is a downside though, content is still locally cached on servers and requires disk space on the edge. If the content is a large media file, that space could be used for more popular objects.

Invalidation: Faster (instant) but doesn’t meet SLAs

When invalidating content we make the Last-Modified  header on the content to change. More about cache validators can be found here.  This forces the validation of the origin server and based on response it will use the resource either from edge (nothing has changed) or get the latest version from the origin. In this case ​CDN only checks the header information and doesn’t require disk cycles for deletion. This may require extra storage capacity on the edge.

Purging methods used by different CDNs

We’ll take a quick look how different new generation CDNs handle purging methods:

Server speed and resources we have today, made fast content removal from a CDN possible. Disk usage is still a factor, but the purging experience has greatly improved and will without a doubt continue to grow and be optimized.

In any case, instant purging is one of the critical features of modern CDNs, improving on the speed in which the stale information is cleared from edge servers and increasing the validity of information provided on CDNs customers websites. Depending on the use case customers can decide on the strategies and implementation tactics .

Latest Articles

How Optimizing Kafka Can Save Costs of the Whole System

Kafka is no longer exclusively the domain of high-velocity Big Data use cases. Today, it is utilized on by workloads and companies of all sizes, supporting asynchronous communication between even small groups of microservices.  But this expanded usage has led to problems with cost creep that threaten many companies’ bottom lines. And due to the […]

29th September, 2024
Migrating Volumez RedHat VMs into Amazon Linux 2 for higher effective discounts rate of Saving Plan

A cloud data infrastructure company relied on extensive use of multiple instance types to test its products. But this made it difficult to optimize costs – a fact which had begun to impact their ability to scale the business.   The GlobalDots team helped the company identify and implement a new infrastructure configuration that both saved […]

19th September, 2024
How Yuki Achieved SOC 2 Compliance 6x Faster

Overview A fast-growing Snowflake optimization platform was missing out on customers because they didn’t have the right data security compliance. Through multiple consultations and extensive vendor-testing, the GlobalDots team selected a solution to provide both tech and human support, helping the company achieve SOC 2 compliance within just 3 months – and win new customers […]

16th September, 2024
Agile Content partners with GlobalDots to revolutionize CDN management ahead of IBC 2024

New partnership between Agile Content and GlobalDots promises to introduce automated multi-CDN solutions, optimizing content delivery and easing provider management for broadcasters worldwide. Amsterdam, Netherlands, September 9th, 2024 – Agile Content, a leading provider of digital TV and video distribution solutions, proudly announces its strategic partnership with GlobalDots, a global leader in cloud performance optimization and […]

Miguel Fersen Director for Iberia and LATAM, GlobalDots
12th September, 2024

Unlock Your Cloud Potential

Schedule a call with our experts. Discover new technology and get recommendations to improve your performance.

    GlobalDots' industry expertise proactively addressed structural inefficiencies that would have otherwise hindered our success. Their laser focus is why I would recommend them as a partner to other companies

    Marco Kaiser
    Marco Kaiser

    CTO

    Legal Services

    GlobalDots has helped us to scale up our innovative capabilities, and in significantly improving our service provided to our clients

    Antonio Ostuni
    Antonio Ostuni

    CIO

    IT Services

    It's common for 3rd parties to work with a limited number of vendors - GlobalDots and its multi-vendor approach is different. Thanks to GlobalDots vendors umbrella, the hybrid-cloud migration was exceedingly smooth

    Motti Shpirer
    Motti Shpirer

    VP of Infrastructure & Technology

    Advertising Services