Managing large Debian repositories with Pulp (and less than 50GiB of RAM)

Quirin Pamp

B.4.039 - Monday 4th February 2019 - 17:00 → 17:25

Pulp is a platform for software repository management.
The pulp_deb plugin adds Apt-repository support for Debian packages.
Until recently, the pulp_deb implementation did not scale well for large repositories.
Synchronizing a full Debian or Ubuntu release (typically containing around 50,000 Packages) would routinely take hours before falling victim to the OOM-killer.
This talk discusses the changes we employed to fix this lamentable state of affairs.
It concludes with lessons learned for the development of pulp_deb 3.

Speaker Info

Quirin Pamp

Quirin Pamp is a software engineer with ATIX AG in Munich, Germany.
In this capacity he contributes to open-source projects in and around the Foreman/Katello ecosystem.
Unrelated interests include logic and cycling.