GitLab Backups for Bitcoin Core repository

The recent update to the site generation process marks a significant enhancement over the previous methodology. Previously, the system relied on a Hugo-based approach, which required loading all issues and pull requests (PRs) into memory simultaneously. This method proved inefficient, especially for larger repositories such as bitcoin/bitcoin, which could not be processed on systems with only 16GB of RAM due to the substantial memory demands.

In response to these challenges, the site has transitioned to a Python script that optimizes the generation process through a two-step procedure. Initially, the script builds an index of all issues and PRs, thereby establishing a structured framework. Subsequently, it processes each issue and PR individually, significantly reducing the memory footprint by avoiding the need to load all data at once. This streamlined approach not only enhances performance but also allows the process to be executed on platforms like GitHub Actions. The generated HTML can then be hosted directly on GitHub Pages, providing a more scalable and efficient solution.

This change is envisioned as an alternative to the existing mirror, potentially offering a more robust and adaptable infrastructure for handling large-scale data without overwhelming system resources. For further details on Hugo, the previously used platform, you can visit Hugo.