apt-mirror in all versions (including disco and last from github) doesn't mirror Commands-* files

seems that even using more recent apt-mirror perl script doesn't solve the problem, Commands files aren't mirrored.
any idea ?

tested on a fresh disco server install, apt-mirroring ubuntu disco :
# ll mirror/archive.ubuntu.com/ubuntu/dists/disco/main/
total 24
drwxrwxr-x 6 root root 4096 Apr 22 02:47 ./
drwxrwxr-x 6 root root 4096 Apr 22 02:44 ../
drwxrwxr-x 2 root root 4096 Apr 22 02:44 binary-amd64/
drwxrwxr-x 2 root root 4096 Apr 22 02:47 dep11/
drwxrwxr-x 2 root root 4096 Apr 22 02:45 i18n/
drwxrwxr-x 2 root root 4096 Apr 22 02:44 source/
# find . | grep Commands
-> nothing

so the bug is not specific to old apt-mirror.
by the way, apt-mirror provided with disco has a mirror.list that mirrors artful by default. should also be fixed ...

Status changed to 'Confirmed' because the bug affects multiple users.

Might be worth updating the bug title and tags to indicate that this is not Xenial-specific, and also happens to the apt-mirror package in Disco.

I created an issue in the github from apt-mirror. Don't know whether it is still in maintenance!

https://github.com/apt-mirror/apt-mirror/issues/118

I have tested the version of apt-mirror from ppa:slashd/test and can confirm that with the updates Eric added it now works on bionic.

If other impacted users want to try the test package before moving forward with the SRU:

sudo add-apt-repository ppa:slashd/test
sudo apt-get update
sudo apt-get install apt-mirror ### version 0.5.4-1ubuntu0.18.04.1+testpkg20200428b2

- Eric

I would definitely appreciate more feedbacks if possible.

That would definitely bring more confidence in the patchset (at SRU perpsective) if more impacted folks test it pre-SRU.

- Eric

I just left a comment in the apt-mirror upstream bug[0] seeking for volunteers to test.

[0] - https://github.com/apt-mirror/apt-mirror/issues/118

- Eric

Eric, I think we may end up needing this commit as well:

https://github.com/josbraden/apt-mirror/commit/8c06384dd5a7c4c3c27ac4f5d37824cedb8634c6

E: Failed to fetch http://X.X.X.X/ubuntu/dists/focal-updates/universe/dep11/icons-64x64@2.tar 404 Not Found [IP: X.X.X.X 80]
E: Some index files failed to download. They have been ignored, or old ones used instead.

Hi,

I testing your repository for Ubuntu 20.04 LTS.

My apt-mirror server running on Ubuntu 18.04 LTS upgraded since Ubuntu 14.04 LTS.

I have repository for Ubuntu 14.04, Ubuntu 18.04 and now Ubuntu 20.04 (and I using too for Debian 10).

I must use "slashd/test" with Focal and I have no more issue with cnf index, but when I run apt-mirror, I have some warning with indexes :

<pre>
Processing indexes: [SSSSSSSSSSSSSUse of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 936, <STREAM> line 1.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 936, <STREAM> line 2.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 936, <STREAM> line 3.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 936, <STREAM> line 4.
Use of uninitialized value $lines{"Files:"} in split at /usr/bin/apt-mirror line 936, <STREAM> line 5.
SPPPPPPPPPPPPPPPPPPPPPPPPPPPP]
</pre>

However, the download continue and I have my update.

Maybe it's nothing, but i prefer tell you my error.

Sorry for my bad English.

Regards,
Jerome.

Status changed to 'Confirmed' because the bug affects multiple users.

I tested the ppa:slashd/test apt-mirror 0.5.4-1ubuntu0.18.04.1+testpkg20200428b2 package on my Bionic 18.04.4 LTS mirror host, and it successfully got all applicable cnf directories for the 20.04 focal release. It looks good for me!

This is quite ridiculous, would it not be possible to apply the fix toe apt-mirror already?

I'd rather not use a modified third party apt-mirror tool if it can be helped.

@Eric

We are in discussion atm trying to resolve the maintainer transition upstream.
As soon as the maintainer aspect is figured out, hopefully the code will be merge in the official project and not only the fork.

And then I'll be happy to update the Ubuntu apt-mirror package in the Ubuntu archive.

Hope that answer your concern here.

- Eric

FWIW, I'm having this problem, too, specifically with the icons files, as noted in comment #12, on my mirror running on Ubuntu 18.04. Oddly, some installations using my mirror are fine with this, whereas others complain. Applying the patch linked in comment #12 fixed it for me.

I had this problem running apt-mirror on bionic, upgrading to the PPA version fixed it

Had this problem with apt-mirror on Xenial with Focal clients. Using apt-mirror 0.5.4-1ubuntu0.18.04.1+testpkg20200428b2 from ppa:slashd/test solved the problem for me. Thanks for the work on this.

I'm running in this issue too. When will the fix be releases for 18.04? In the PPP there are no packages anymore.

The Eoan Ermine has reached end of life, so this bug will not be fixed for that release

Just ran into this issue on with a Focal host mirroring Focal repositories with Focal clients. Some searching led me to https://github.com/Stifler6996/apt-mirror which I can confirm works (i.e. fixes cnf, icons, and compression-related problems).

I don't know the politics behind how maintainers get chosen but I'm happy to help however I can.

Any progress on this?

Trying to mirror into a secure environment through a proxy which allows me to hit ubuntu.com repo servers.

I'm in a bind because the workaround here is to use some random code from github which I'm not allowed to bring into the secure environment. Therefore my plans of using Ubuntu in the secure environment are dashed.

I feel like this deserves some more attention as the fix is in existence and security vetting of a perl script shouldn't be too onerous. Please let me know if I can help.

The Groovy Gorilla has reached end of life, so this bug will not be fixed for that release

This is broken in Ubuntu server 22.04 distribution.

E: Failed to fetch .........../ubuntu/dists/jammy/main/cnf/Commands-amd64 404 Not Found [NoSuchKey] The specified key does not exist.
E: Failed to fetch .........../ubuntu/dists/jammy-updates/main/cnf/Commands-amd64 404 Not Found [NoSuchKey] The specified key does not exist.
E: Failed to fetch .........../ubuntu/dists/jammy-backports/main/cnf/Commands-amd64 404 Not Found [NoSuchKey] The specified key does not exist.
E: Failed to fetch .........../ubuntu/dists/jammy-security/main/cnf/Commands-amd64 404 Not Found [NoSuchKey] The specified key does not exist.

Hiya, a fix was introduced in Debian and in Ubuntu Kinetic via 0.5.4-2. \o/

This bug was fixed in the package apt-mirror - 0.5.4-2

---------------
apt-mirror (0.5.4-2) unstable; urgency=medium

  [ Jelmer Vernooij ]
  * Migrate repository from alioth to salsa.

  [ Benjamin Drung ]
  * Update Homepage URL to github.io
  * Switch to debhelper 13
  * Support for xz translations (Closes: #932112, #932379)
  * Download 'cnf' Files (LP: #1825755)
  * Bump Standards-Version to 4.6.1
  * Set Rules-Requires-Root: no

 -- Benjamin Drung <email address hidden> Fri, 07 Oct 2022 13:04:08 +0200

Status changed to 'Confirmed' because the bug affects multiple users.