Problem: I currently have a repository that I am attempting to sync to a remote for the PyPI repository. I have the remote configured with the --includes blank (i.e. to sync the entire PyPI repo, aside from some specified in the --excludes). Still using on_demand downloading. However, when I sync the repository to the remote, the sync never completes. I left one sync attempt running for over two weeks and the sync still had not completed. I am a bit confused as to why this takes so long, as it should only be syncing the metadata for the PyPI repo (if I understand correctly). Is it normal for this to take this long?
Edit: I have also noticed that the sync always ends up consistently maxing out a single CPU core. I believe that might be why the sync always slows down and never completes, but I am confused as to why the sync uses up so much CPU (and just on a single CPU core).
Expected outcome: A sync of the PyPI repository metadata should complete in a reasonable amount of time (less than a week) and not max out CPU.
Pulpcore version: 3.20.0
Pulp plugins installed and their versions: python 3.7.2
Operating system - distribution and version: Ubuntu 22.04
Other relevant data: