RPM packages are missing in pulp repository

Support
#1

Problem:
Hi,
In the source the packages are present but somehow the pulp repository is not picking.
Yum install not able to find mysql packages for me.
[root@admin ~]# yum list | grep mysql-community-common
[root@admin ~]#
Expected outcome:
Should be to install packages
Pulpcore version:
pulpcore==3.31.0
Pulp plugins installed and their versions:
pulp-rpm==3.22.3
pulp-certguard==1.6.5
pulp-certguard-client==1.6.5
pulp-cli==0.21.2
Operating system - distribution and version:
RHEL 8.8

Please let me know if you need any other information.
Thank You!

#2

Can you paste which commands you have executed?

#3

Hi @dralley
We are reposync-ing the packages into some directory and there we are using createrepo command to create local metadata repository, which is acting as our pulp remote.
Now commands I ran to create repo, remote, sync, publish and distribute are:

pulp rpm repository create --name “${REPO_NAME}”

pulp rpm remote create --name “${REMOTE_NAME}” --url “file://${REPO_DIR}/” --policy ‘immediate’

pulp rpm repository sync --name “${REPO_NAME}” --remote “${REMOTE_NAME}”

pulp rpm publication create --repository “${REPO_NAME}”

Also, we are creating the content guard and patching the distribution

http --check-status --ignore-stdin POST http://localhost:24817/pulp/api/v3/distributions/rpm/rpm/ name="${DIST_NAME}" base_path="${REPO_NAME}" content_guard=${CERTGUARD} publication=${PUBLICATION_HREF}

Appreciate your help!

#4

Just some debug work from my side:
Scenario 1:
I created a remote without mysql packages, synced with repo and created other pulp required stuff. And tried to search from client using yum list | grep mysql-community-common. Didn’t found anything, works as expected.

Scenario 2:
reposync the mysql packages to same directory. And then again, I created a remote with mysql packages, synced with repo and created other pulp required stuff. Now I can see few mysql-community packages but not all which are present in directory.

[root@admin ~]# yum list | grep mysql-community
mysql-community-client-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-client-plugins.x86_64 8.0.35-1.el8 boomi
mysql-community-client-plugins-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-debugsource.x86_64 8.0.35-1.el8 boomi
mysql-community-icu-data-files.x86_64 8.0.35-1.el8 boomi
mysql-community-libs-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-server-debug.x86_64 8.0.35-1.el8 boomi
mysql-community-server-debug-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-server-debuginfo.x86_64 8.0.23-1.el8 boomi
mysql-community-test-debuginfo.x86_64 8.0.23-1.el8 boomi

#5

this is the output of createrepo command

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/SecurityCenter-5.19.0-el7.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/falcon-sensor-7.02.0-15705.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/ossec-hids-3.5.0-10635.el8.art.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/ossec-hids-3.7.0-24342.el8.art.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/ossec-hids-server-3.5.0-10635.el8.art.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/ossec-hids-server-3.7.0-24342.el8.art.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/percona-toolkit-3.3.0-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/splunk-9.0.4-de405f4a7979-linux-2.6-x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/splunkforwarder-9.0.4-de405f4a7979-linux-2.6-x86_64.rpm

14:56:34: Dir to scan: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/repodata

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-client-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-client-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-client-plugins-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-client-plugins-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-common-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-debugsource-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-devel-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-icu-data-files-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-libs-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-libs-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-server-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-server-debug-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-server-debug-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-server-debuginfo-8.0.23-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-test-8.0.35-1.el8.x86_64.rpm

14:56:34: Adding pkg: /usr/local/lib/pulp/mirror-data/rhel8/boomi-repo-x86_64/mysql-community-test-debuginfo-8.0.23-1.el8.x86_64.rpm
#6

Hey @tushar ,

I was able to reproduce what you’ve described with a small fixture repo in the sense that yum list doesn’t contain all items processed originally by createrepo_c.

Nevertheless, yum list doesn’t show all .rpm packages available in the system because of the concept of modules. In my fixture setup, this was the cause of this difference.

With that said, I have two things to ask:

  1. I’m not 100% confident that this is necessarily your case, but to be sure you can run the command below and share if those missing packages aren’t actually “hidden”:
REPOID=<your-repoid> # as defined in the .repo file associated pulp distribution
yum --repoid ${REPOID} module list mysql
  1. If still not solved, it would be helpful to have access to the original repository you synced from (if that’s not private) or some similar public one (which contains this set of mysql-community packages and behaves similarly).

Hope this can help!

2 Likes
#7

@tushar, if you are able to do so, then it would be great if you could send us the repository URL if it’s a public repo, or if it’s not public, then perhaps the repository metadata from the original repo - that is, the repodata/ directory (not including any of the packages).

That would help with figuring out what if anything is going wrong when it gets pulled into Pulp.

1 Like