Rhel7 repo has broken packages in it

Problem:

I started with the official redhat 7 repo ( https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os) and created a distribution. The distribution shows packages that cannot be downloaded.

Expected outcome:

Be able to download any package in the distribution

Pulpcore version:

3.13.0

Pulp plugins installed and their versions:

rpm - 3.12.0

Operating system - distribution and version:

Red Hat Enterprise Linux Server release 7.9 (Maipo)

Other relevant data:

Broken download

curl -v -O https://<repo_server>/pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* About to connect() to <repo_server> port 443 (#0)
*   Trying 10.1.2.46...
* Connected to <repo_server> (10.1.2.46) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* SSL connection using TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
* Server certificate:
* 	subject: CN=<repo_server>
* 	start date: Jun 16 13:23:50 2021 GMT
* 	expire date: Sep 18 13:23:50 2023 GMT
* 	common name: <repo_server>
* 	issuer: CN=<repo_server>,O=Pulp,C=US
> GET /pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm HTTP/1.1
> User-Agent: curl/7.29.0
> Host: <repo_server>
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.16.1
< Date: Tue, 18 Apr 2023 23:58:04 GMT
< Content-Type: audio/x-pn-realaudio-plugin
< Content-Length: 75952
< Connection: keep-alive
< Accept-Ranges: bytes
< Etag: "2f6f596cb806e3c10b8bd0f334d7b850:1659684846.907411"
< Last-Modified: Tue, 14 Apr 2020 13:51:20 GMT
< X-Cache: TCP_MEM_HIT from a23-205-102-15.deploy.akamaitechnologies.com (AkamaiGHost/11.0.3-47547230) (-)
< x-rh-edge-request-id: 42632061
< x-rh-edge-reference-id: 0.f66cd17.1681861943.42632061
< x-rh-edge-cache-status: Hit from child
< x-origin: rcmnew
< EJ-HOST: authorizer-prod-iad2-33-4fhjd
< X-Akamai-Request-ID: 42632061
< Strict-Transport-Security: max-age=15768000
<
{ [data not shown]
* transfer closed with 60190 bytes remaining to read
20 75952   20 15762    0     0  37411      0  0:00:02 --:--:--  0:00:02 37439
* Closing connection 0
curl: (18) transfer closed with 60190 bytes remaining to read

Working Download

curl -v -O https://<repo_server>/pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* About to connect() to <repo_server> port 443 (#0)
*   Trying 10.1.2.46...
* Connected to <repo_server> (10.1.2.46) port 443 (#0)
* Initializing NSS with certpath: sql:/etc/pki/nssdb
*   CAfile: /etc/pki/tls/certs/ca-bundle.crt
  CApath: none
* SSL connection using TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384
* Server certificate:
* 	subject: CN=<repo_server>
* 	start date: Jun 16 13:23:50 2021 GMT
* 	expire date: Sep 18 13:23:50 2023 GMT
* 	common name: <repo_server>
* 	issuer: CN=<repo_server>,O=Pulp,C=US
> GET /pulp/content/ci-rhel7-q2-w16-2023/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm HTTP/1.1
> User-Agent: curl/7.29.0
> Host: <repo_server>
> Accept: */*
>
< HTTP/1.1 200 OK
< Server: nginx/1.16.1
< Date: Tue, 18 Apr 2023 23:58:34 GMT
< Content-Type: application/octet-stream
< Content-Length: 75544
< Connection: keep-alive
< Last-Modified: Thu, 18 Nov 2021 18:09:31 GMT
< Accept-Ranges: bytes
< Strict-Transport-Security: max-age=15768000
<
{ [data not shown]
100 75544  100 75544    0     0   333k      0 --:--:-- --:--:-- --:--:--  333k
* Connection #0 to host <repo_server> left intact

Here are the exerts from a repo sync for the same packages

reposync --gpgcheck -l --downloadcomps --download-metadata --repoid=ci-rhel7-q2-w16-2023 --download_path=/data/redhat7

(8828/33666): hunspell-devel-1.3.2-13.el7.x86_64.rpm
hunspell-devel-1.3.2-16.el7.x8 FAILED

This is the sync job

HTTP 200 OK
Allow: GET, PATCH, DELETE, HEAD, OPTIONS
Content-Type: application/json
Vary: Accept

{
“pulp_href”: “/pulp/api/v3/tasks/fc23cd4a-0749-494a-be8f-8f34d9484575/”,
“pulp_created”: “2023-04-18T21:20:06.502423Z”,
“state”: “completed”,
“name”: “pulp_rpm.app.tasks.synchronizing.synchronize”,
“logging_cid”: “9e7302e0ca7d4b40a1c683b0030211eb”,
“started_at”: “2023-04-18T21:20:09.472214Z”,
“finished_at”: “2023-04-18T21:30:25.746569Z”,
“error”: null,
“worker”: “/pulp/api/v3/workers/290c893b-a3da-4572-a57c-e76646adec4d/”,
“parent_task”: null,
“child_tasks”: [],
“task_group”: null,
“progress_reports”: [
{
“message”: “Parsed Packages”,
“code”: “sync.parsing.packages”,
“state”: “completed”,
“total”: 33666,
“done”: 33666,
“suffix”: null
},
{
“message”: “Parsed Comps”,
“code”: “sync.parsing.comps”,
“state”: “completed”,
“total”: 91,
“done”: 91,
“suffix”: null
},
{
“message”: “Parsed Advisories”,
“code”: “sync.parsing.advisories”,
“state”: “completed”,
“total”: 5123,
“done”: 5123,
“suffix”: null
},
{
“message”: “Downloading Metadata Files”,
“code”: “sync.downloading.metadata”,
“state”: “completed”,
“total”: null,
“done”: 6,
“suffix”: null
},
{
“message”: “Downloading Artifacts”,
“code”: “sync.downloading.artifacts”,
“state”: “completed”,
“total”: null,
“done”: 21,
“suffix”: null
},
{
“message”: “Associating Content”,
“code”: “associating.content”,
“state”: “completed”,
“total”: null,
“done”: 2788,
“suffix”: null
},
{
“message”: “Un-Associating Content”,
“code”: “unassociating.content”,
“state”: “completed”,
“total”: null,
“done”: 2964,
“suffix”: null
}
],
“created_resources”: [
“/pulp/api/v3/repositories/rpm/rpm/a4c96de2-3f01-49f7-b737-a7b972589184/versions/12/”
],
“reserved_resources_record”: [
“/pulp/api/v3/repositories/rpm/rpm/a4c96de2-3f01-49f7-b737-a7b972589184/”,
“/pulp/api/v3/remotes/rpm/rpm/1d94bc40-0d4e-41c3-961e-56980f4585ff/”
]
}

Hi there bjmammen!

First - that is a really, really old version of pulpcore and pulp_rpm. core/3.13 was released almost two years ago; there have been many, many, MANY improvements since then. You will def want to upgrade when you get a chance!

There may have been a transient failure. I just created a RHEL7 remote and repo, sync’d them, and was able to get that RPM:

pulp rpm remote create \
    --name rhel_7_x86_64_server \
    --url https://cdn.redhat.com/content/dist/rhel/server/7/7Server/x86_64/os \
    --policy on_demand \
    --client-cert=@${BASE}pulp_startup/CDN_cert/cdn_11012023.pem \
    --client-key=@${BASE}pulp_startup/CDN_cert/cdn_11012023.pem \
    --ca-cert=@${BASE}pulp_startup/CDN_cert/redhat-uep.pem
pulp rpm repository create \
    --name rhel_7_x86_64_server \
    --remote rhel_7_x86_64_server
pulp rpm repository sync \
    --name rhel_7_x86_64_server
pulp rpm publication create \
    --repository rpm:rpm:rhel_7_x86_64_server
pulp rpm distribution create \
    --repository rpm:rpm:rhel_7_x86_64_server

curl -v -O http://localhost:5001/pulp/content/default/rhel_7_x86_64_server/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm
*   Trying 127.0.0.1:5001...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* Connected to localhost (127.0.0.1) port 5001 (#0)
> GET /pulp/content/default/rhel_7_x86_64_server/Packages/h/hunspell-devel-1.3.2-16.el7.x86_64.rpm HTTP/1.1
> Host: localhost:5001
> User-Agent: curl/7.85.0
> Accept: */*
> 
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Server: nginx/1.14.1
< Date: Wed, 19 Apr 2023 13:21:27 GMT
< Content-Type: audio/x-pn-realaudio-plugin
< Transfer-Encoding: chunked
< Connection: keep-alive
< Accept-Ranges: bytes
< Etag: "2f6f596cb806e3c10b8bd0f334d7b850:1659684846.907411"
< Last-Modified: Tue, 14 Apr 2020 13:51:20 GMT
< X-Cache: TCP_HIT from a104-114-72-141.deploy.akamaitechnologies.com (AkamaiGHost/11.0.3-47547230) (-)
< x-rh-edge-request-id: 22ac45a1
< x-rh-edge-reference-id: 0.8d487268.1681910487.22ac45a1
< x-rh-edge-cache-status: Hit from child
< x-origin: rcmnew
< EJ-HOST: authorizer-prod-w2-32-79lxs
< X-Akamai-Request-ID: 22ac45a1
< 
{ [11733 bytes data]
100 75952    0 75952    0     0   187k      0 --:--:-- --:--:-- --:--:--  187k
* Connection #0 to host localhost left intact

curl -v -O http://localhost:5001/pulp/content/default/rhel_7_x86_64_server/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm
*   Trying 127.0.0.1:5001...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0* Connected to localhost (127.0.0.1) port 5001 (#0)
> GET /pulp/content/default/rhel_7_x86_64_server/Packages/h/hunspell-devel-1.3.2-13.el7.x86_64.rpm HTTP/1.1
> Host: localhost:5001
> User-Agent: curl/7.85.0
> Accept: */*
> 
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Server: nginx/1.14.1
< Date: Wed, 19 Apr 2023 13:25:24 GMT
< Content-Type: audio/x-pn-realaudio-plugin
< Transfer-Encoding: chunked
< Connection: keep-alive
< Accept-Ranges: bytes
< Etag: "84b404a79e3963d155e6c0f37ff23304:1656574411.094828"
< Last-Modified: Wed, 16 Apr 2014 00:15:32 GMT
< X-Cache: TCP_HIT from a23-44-237-197.deploy.akamaitechnologies.com (AkamaiGHost/11.0.3-47547230) (-)
< x-rh-edge-request-id: 18afb054
< x-rh-edge-reference-id: 0.c5ed2c17.1681910724.18afb054
< x-rh-edge-cache-status: Hit from child
< x-origin: rcmnew
< EJ-HOST: authorizer-prod-e1-36-j6c8d
< X-Akamai-Request-ID: 18afb054
< 
{ [11734 bytes data]
100 75544    0 75544    0     0   207k      0 --:--:-- --:--:-- --:--:--  208k
* Connection #0 to host localhost left intact
3 Likes

Thank you. My issues was solved by updating to the latest version.

1 Like

Outstanding! Whatever it was, glad we fixed it, and glad you’re on the latest Stuff! Thanks for reporting back :slight_smile: