slackpkg+ 1.8

zerouno · 02-14-2020, 01:08 AM

Also run
bash -x slackpkg update >slackpkg.txt 2>&1
And attach that file

chrisretusn · 02-14-2020, 06:53 AM

slackpkg - version 2.84.0_beta5 / slackpkg+ 1.7.0d1

The 'slackpkg update' seems to working okay here. Here is my output on already updated data. Of note, the only repository that is not local is slackpkgplus. When I first did the upgrade, the output was not right, however it all looks good now after I reverted back to the 1.7.0 to get before look, then back to 1.7.0d1 to get the after, now I can't reproduce it. Must have been a cobweb that got cleaned out.

Code:

# slackpkg update

Updating the package lists...
        Downloading...
force to download ChangeLog
                ChangeLogs
'//home/slackware/slackware64-current/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/ChangeLog.txt'
'/home/non-slack/slackbuilds/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/nonslack.txt'
    File: slackpkgplus         -> ChangeLog.txt        .. Cached.
cp: cannot stat '/home/non-slack/multilib/current/ChangeLog.txt': No such file or directory
'/home/non-slack/multilib/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/multilib.txt'
cp: cannot stat '/home/non-slack/ktown/current/testing/x86_64/ChangeLog.txt': No such file or directory
cp: cannot stat '/home/non-slack/ktown/current/testing/ChangeLog.txt': No such file or directory
cp: cannot stat '/home/non-slack/ktown/current/ChangeLog.txt': No such file or directory
'/home/non-slack/ktown/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/ktown.txt'
'/home/non-slack/alienbob_restricted/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/restricted.txt'
'/home/non-slack/alienbob/ChangeLog.txt' -> '/tmp/slackpkg.WRemgi/alienbob.txt'
'/home/non-slack/slackbuilds/CHECKSUMS.md5' -> '/tmp/slackpkg.WRemgi/CHECKSUMS.md5-nonslack'
    File: slackpkgplus         -> CHECKSUMS.md5        .. Cached.
'/home/non-slack/multilib/current/CHECKSUMS.md5' -> '/tmp/slackpkg.WRemgi/CHECKSUMS.md5-multilib'
'/home/non-slack/ktown/current/testing/x86_64/CHECKSUMS.md5' -> '/tmp/slackpkg.WRemgi/CHECKSUMS.md5-ktown'
'/home/non-slack/alienbob_restricted/CHECKSUMS.md5' -> '/tmp/slackpkg.WRemgi/CHECKSUMS.md5-restricted'
'/home/non-slack/alienbob/CHECKSUMS.md5' -> '/tmp/slackpkg.WRemgi/CHECKSUMS.md5-alienbob'
Files //var/lib/slackpkg/CHECKSUMS.md5.asc and /tmp/slackpkg.WRemgi/CHECKSUMS.md5.asc differ
        Downloading...
                Done.

                No changes in ChangeLog.txt between your last update and now.
                Do you really want to download all other files (y/N)? n

zerouno · 02-14-2020, 07:36 AM

To clean cache
rm /var/lib/slackpkg/cache/*

Latest update from git remove the copy warnings (but denydias has a 'sed' bug that I can't reproduce for now)

chrisretusn · 02-14-2020, 08:20 AM

slackpkg - version 2.84.0_beta5 / slackpkg+ 1.7.0d1

Quote:

- Added SBo support. This does not replace sbopkg. It just search in
SlackBuilds.org and report the url to download to build and install
packages yourself.

Works as advertised. Neat feature. Suggestion, add a SBOOFF variable to turn on SBOURL. Typing 'SBOOFF=on slackpkg search ffmpeg' it a bit easier to remember than 'SBOURL=https://www.slackbuilds.org/slackbuilds/14.2/ slackpkg search ffmpeg'.
Here is my output searching ffmpeg.

Code:

# slackpkg search ffmpeg

Looking for ffmpeg in package list. Please wait... DONE

The list below shows all packages with name matching "ffmpeg".

[ Status              ] [ Repository  ] [ Package                                      ]
  installed               alienbob        ffmpeg3-compat-3.4.6-x86_64-1alien          
  installed               ktown           ffmpegthumbs-19.12.2-x86_64-1alien          
  installed               nonslack        ffmpeg-compat32-4.2.1-x86_64-1aliencompat32 
  installed               restricted      ffmpeg-4.2.1-x86_64-1alien                  
  installed               slackware64     ffmpegthumbnailer-2.2.2-x86_64-1            
  uninstalled             alienbob        gst-plugins-ffmpeg0-0.10.13-x86_64-2alien   
  uninstalled(masked)     extra           ffmpeg-4.2.2-x86_64-1_alsa                  
  uninstalled(masked)     multilib        ffmpeg-compat32-4.2.2-x86_64-1compat32      
  uninstalled(masked)     slackware64     ffmpeg-4.2.2-x86_64-1                       

You can search specific files using "slackpkg file-search file".


Also found in SBo:

[ package ]                             [ url ]
  alsa-plugin-ffmpeg-1.1.1                https://www.slackbuilds.org/slackbuilds/14.2/audio/alsa-plugin-ffmpeg.tar.gz
  audacious-ffmpeg-3.7.2                  https://www.slackbuilds.org/slackbuilds/14.2/audio/audacious-ffmpeg.tar.gz
  ffmpegthumbnailer-2.2.0                 https://www.slackbuilds.org/slackbuilds/14.2/desktop/ffmpegthumbnailer.tar.gz
  ffmpeg-3.2.4                            https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg.tar.gz
  ffmpeg2theora-0.30                      https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg2theora.tar.gz
  ffmpeg4-4.1                             https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg4.tar.gz
  gst0-ffmpeg-0.10.13                     https://www.slackbuilds.org/slackbuilds/14.2/multimedia/gst0-ffmpeg.tar.gz
  opera-developer-ffmpeg-codecs-0.41.3    https://www.slackbuilds.org/slackbuilds/14.2/multimedia/opera-developer-ffmpeg-codecs.tar.gz
  opera-ffmpeg-codecs-0.41.3              https://www.slackbuilds.org/slackbuilds/14.2/multimedia/opera-ffmpeg-codecs.tar.gz

Quote:

- Smaller output for 'slackpkg search'

Nice! Posting this mostly so others can see. I couldn't tell the difference, so reverted back to see.

Code:

Before:
[ Status           ] [ Repository               ] [ Package                                  ]
   installed               alienbob                     ffmpeg3-compat-3.4.6-x86_64-1alien        
   installed               ktown                        ffmpegthumbs-19.12.2-x86_64-1alien        
   installed               nonslack                     ffmpeg-compat32-4.2.1-x86_64-1aliencompat32  
   installed               restricted                   ffmpeg-4.2.1-x86_64-1alien                
   installed               slackware64                  ffmpegthumbnailer-2.2.2-x86_64-1          
  uninstalled              alienbob                     gst-plugins-ffmpeg0-0.10.13-x86_64-2alien  
  uninstalled(masked)      extra                        ffmpeg-4.2.2-x86_64-1_alsa                
  uninstalled(masked)      multilib                     ffmpeg-compat32-4.2.2-x86_64-1compat32    
  uninstalled(masked)      slackware64                  ffmpeg-4.2.2-x86_64-1                     

After:
[ Status              ] [ Repository  ] [ Package                                      ]
  installed               alienbob        ffmpeg3-compat-3.4.6-x86_64-1alien          
  installed               ktown           ffmpegthumbs-19.12.2-x86_64-1alien          
  installed               nonslack        ffmpeg-compat32-4.2.1-x86_64-1aliencompat32 
  installed               restricted      ffmpeg-4.2.1-x86_64-1alien                  
  installed               slackware64     ffmpegthumbnailer-2.2.2-x86_64-1            
  uninstalled             alienbob        gst-plugins-ffmpeg0-0.10.13-x86_64-2alien   
  uninstalled(masked)     extra           ffmpeg-4.2.2-x86_64-1_alsa                  
  uninstalled(masked)     multilib        ffmpeg-compat32-4.2.2-x86_64-1compat32      
  uninstalled(masked)     slackware64     ffmpeg-4.2.2-x86_64-1

Quote:

- 'slackpkg search' did not honor the '+' symbol

Verified works.

Quote:

- 'slackpkg check-updates' did not work unless you set VERBOSE=3

Verified now works with all verbosity levels.

Quote:

Fix setupmultilib script

I've never actually used this. Did everything manually.

Quote:

slackpkg+ did not work properly when run as a package group instead single packages.

Not really sure what you mean by package group.

One reason I choose 'ffmpeg' for my example was because there is a missing version in the list. This existed before upgrading to slackpkg+ 1.7.0d1. This is what I get using 'slackpkg search ffmpeg-4':

Code:

[ Status           ] [ Repository               ] [ Package                                  ]
   installed               restricted                   ffmpeg-4.2.1-x86_64-1alien                
  uninstalled(masked)      extra                        ffmpeg-4.2.2-x86_64-1_alsa                
  uninstalled(masked)      slackware64                  ffmpeg-4.2.2-x86_64-1

This what I think I should see: (I'm guessing this is because of the same tag.)

Code:

[ Status           ] [ Repository               ] [ Package                                  ]
   installed               restricted                   ffmpeg-4.2.1-x86_64-1alien                
  uninstalled(masked)      alienbob                     ffmpeg-4.2.1-x86_64-1alien
  uninstalled(masked)      extra                        ffmpeg-4.2.2-x86_64-1_alsa                
  uninstalled(masked)      slackware64                  ffmpeg-4.2.2-x86_64-1

Chuck56 · 02-14-2020, 08:28 AM

Quote:

Originally Posted by zerouno

Replace /usr/libexec/slackpkg/functions.d/slackpkgplus.sh with that release:
https://raw.githubusercontent.com/zu...lackpkgplus.sh

Code:

Looking for packages to upgrade. Please wait...   8%

I installed the dev version & replaced slackpkgplus.sh with the updated code. The install-new & upgrade-all progress percent is awesome! Same sed issue here on update as denydias reported.

Reverting back to original dev slackpkgplus.sh for now. Thanks for your efforts zerouno!

zerouno · 02-14-2020, 08:35 AM

Can you run bash -x slackpkg update with the git slackpkgplus.sh release? Currently I'm not able to replicate the problem.

Chuck56 · 02-14-2020, 08:45 AM

see attached...

I ran "bash -x slackpkg update >slackpkg.txt 2>&1" from your earlier post. Hope that helps!

zerouno · 02-14-2020, 08:59 AM

Thanks.
can run the same with original (no git)

There is an inconsistence on a unmodified piece of code

Chuck56 · 02-14-2020, 09:11 AM

same command, no git...

chrisretusn · 02-14-2020, 09:21 AM

Just tried with latest slackpkgplus.sh, those "cp: cannot stat" line are gone.

TERSE is really neat, even with VERBOSE=1 (tried with VERBOSE=0 too.) I kind of like it non-terse, but I plan to leave it enabled for awhile in the spirit of testing. ;-)

I kind of liked the spinning progress system. I can get used to the new system though.

denydias · 02-14-2020, 11:26 AM

Quote:

Originally Posted by zerouno

Also run
bash -x slackpkg update >slackpkg.txt 2>&1
And attach that file

Changed to VERBOSE=3, then ran:

using master:

Code:

$ time bash -x slackpkg update 2>&1 | tee slackpkgplus-master.txt
...
real    2m10,248s
user    0m18,154s
sys     0m5,240s

using slackpkg+-1.7.0d1:

Code:

$ time bash -x slackpkg update 2>&1 | tee slackpkgplus-1.7.0d1.txt
...
real    1m4,839s
user    0m16,937s
sys     0m3,676s

Output files here (LQ don't let me attach files due to ridiculous captcha thing).

I wish it helps.

zerouno · 02-14-2020, 02:40 PM

Are you sure that git slackpkgplus md5 is:

# md5sum /usr/libexec/slackpkg/functions.d/slackpkgplus.sh
5ab845db4868679e55ad1dc396622348 /usr/libexec/slackpkg/functions.d/slackpkgplus.sh

In row 444 (open with vim)

Code:

      curl --max-time 10 --location --head $SRCURL 2>/dev/null|tac|sed '/^HTTP/q'|tac|grep -v -i -e ^Date: -e ^Set-Cookie: -e ^Expires: -e ^X-Varnish:|sed 's/^M//' > $TMPDIR/cache.head

note the
sed 's/^M//'
(^M is a single character)
This should be the same both in git and no git release.

in slackpkg output:

nogit (row 451):

Code:

+ curl --max-time 10 --location --head http://guest7/slackware64-current/ChangeLog.txt
+ tac
+ sed '/^HTTP/q'
+ tac
+ grep -v -i -e '^Date:' -e '^Set-Cookie:' -e '^Expires:' -e '^X-Varnish:'
+ sed $'s/\r//'
+ echo 'Url: http://guest7/slackware64-current/ChangeLog.txt'

\r is a translation of ascii ^M

git (row 458):

Code:

+ curl --max-time 10 --location --head http://guest7/slackware64-current/ChangeLog.txt
+ tac
+ sed '/^HTTP/q'
+ tac
+ sed 's/
//'
+ grep -v -i -e '^Date:' -e '^Set-Cookie:' -e '^Expires:' -e '^X-Varnish:'
sed: -e expression #1, char 2: unterminated `s' command
+ echo 'Url: http://guest7/slackware64-current/ChangeLog.txt'

the newline after s/ is the translation of the use of ^M

If I run on my machine I obtains

Code:

+ sed $'s/\r//'

in both with and without git release.

try to replace

Code:

      curl --max-time 10 --location --head $SRCURL 2>/dev/null|tac|sed '/^HTTP/q'|tac|grep -v -i -e ^Date: -e ^Set-Cookie: -e ^Expires: -e ^X-Varnish:|sed 's/^M//' > $TMPDIR/cache.head

with

Code:

      curl --max-time 10 --location --head $SRCURL 2>/dev/null|tac|sed '/^HTTP/q'|tac|grep -v -i -e ^Date: -e ^Set-Cookie: -e ^Expires: -e ^X-Varnish:|sed $'s/\r//' > $TMPDIR/cache.head

(see sed)

rworkman · 02-14-2020, 04:25 PM

I was referring to the replacement of the spinnythingy :-)

denydias · 02-14-2020, 04:32 PM

Quote:

Originally Posted by zerouno

Are you sure that git slackpkgplus md5 is:

# md5sum /usr/libexec/slackpkg/functions.d/slackpkgplus.sh
5ab845db4868679e55ad1dc396622348 /usr/libexec/slackpkg/functions.d/slackpkgplus.sh

Nope... mine was:

Code:

$ md5sum /usr/libexec/slackpkg/functions.d/slackpkgplus.sh.new
a8d5531ee51f016a11a5eacc73d8e2c5  /usr/libexec/slackpkg/functions.d/slackpkgplus.sh.new

I've copy/paste it. I got it straight with wget:

Code:

$ wget https://raw.githubusercontent.com/zuno/slackpkgplus/master/src/slackpkgplus.sh
$ md5sum /usr/libexec/slackpkg/functions.d/slackpkgplus.sh
5ab845db4868679e55ad1dc396622348  /usr/libexec/slackpkg/functions.d/slackpkgplus.sh

sed errors are gone:

Code:

$ slackpkg update

Updating the package lists...
        Downloading...
force to download ChangeLog
                ChangeLogs
    File: slackware            -> ChangeLog.txt        .. Cached.
    File: slackpkgplus         -> ChangeLog.txt        .. Cached.
    File: alienbob             -> ChangeLog.txt        .. Cached.
    File: ponce                -> ChangeLog.txt        .. Downloading... 
    File: slackonly            -> ChangeLog.txt        .. Cached.
    File: restricted           -> ChangeLog.txt        .. Cached.
    File: slackpkgplus         -> CHECKSUMS.md5        .. Cached.
    File: alienbob             -> CHECKSUMS.md5        .. Cached.
    File: ponce                -> CHECKSUMS.md5        .. Downloading... 
    File: slackonly            -> CHECKSUMS.md5        .. Cached.
    File: restricted           -> CHECKSUMS.md5        .. Cached.
'/media/nas/mirrors/alienbob/ktown/latest/CHECKSUMS.md5' -> '/tmp/slackpkg.d3tggb/CHECKSUMS.md5-ktown'
Files //var/lib/slackpkg/CHECKSUMS.md5.asc and /tmp/slackpkg.d3tggb/CHECKSUMS.md5.asc differ
        Downloading...
                Done.

                No changes in ChangeLog.txt between your last update and now.
                Do you really want to download all other files (y/N)? y

                List of all files
    File: patches              -> MANIFEST.bz2         .. Cached.
    File: slackware64          -> MANIFEST.bz2         .. Cached.
    File: extra                -> MANIFEST.bz2         .. Cached.
    File: pasture              -> MANIFEST.bz2         .. Cached.
    File: testing              -> MANIFEST.bz2         .. Cached.
    File: slackpkgplus         -> MANIFEST.bz2         .. Cached.
    File: alienbob             -> MANIFEST.bz2         .. Cached.
    File: ponce                -> MANIFEST.bz2         .. Downloading...
    File: slackonly            -> MANIFEST.bz2         .. Cached.
    File: restricted           -> MANIFEST.bz2         .. Cached.
'/media/nas/mirrors/alienbob/ktown/latest/MANIFEST.bz2' -> '/tmp/slackpkg.d3tggb/SLACKPKGPLUS_ktown-MANIFEST.bz2'
                Checksums
    File: slackware            -> CHECKSUMS.md5        .. Cached.
    File: slackware            -> CHECKSUMS.md5.asc    .. Cached.
    File: slackpkgplus         -> CHECKSUMS.md5.asc    .. Cached.
    File: alienbob             -> CHECKSUMS.md5.asc    .. Cached.
    File: ponce                -> CHECKSUMS.md5.asc    .. Downloading...
    File: slackonly            -> CHECKSUMS.md5.asc    .. Cached.
    File: restricted           -> CHECKSUMS.md5.asc    .. Cached.
'/media/nas/mirrors/alienbob/ktown/latest/CHECKSUMS.md5.asc' -> '/tmp/slackpkg.d3tggb/CHECKSUMS.md5-ktown.asc'
                Package List
    File: slackware            -> FILELIST.TXT         .. Cached.
    File: SBo                  -> SLACKBUILDS.TXT.gz   .. Downloading...
                Package descriptions
    File: patches              -> PACKAGES.TXT         .. Cached.
    File: slackware64          -> PACKAGES.TXT         .. Cached.
    File: extra                -> PACKAGES.TXT         .. Cached.
    File: pasture              -> PACKAGES.TXT         .. Cached.
    File: testing              -> PACKAGES.TXT         .. Cached.
    File: slackpkgplus         -> PACKAGES.TXT         .. Cached.
    File: alienbob             -> PACKAGES.TXT         .. Cached.
    File: ponce                -> PACKAGES.TXT         .. Downloading...
    File: slackonly            -> PACKAGES.TXT         .. Cached.
    File: restricted           -> PACKAGES.TXT         .. Cached.
'/media/nas/mirrors/alienbob/ktown/latest/PACKAGES.TXT' -> '/tmp/slackpkg.d3tggb/SLACKPKGPLUS_ktown-PACKAGES.TXT'
        Formatting lists to slackpkg style...
                Package List: using CHECKSUMS.md5 as source
                Package descriptions

Now I have a question about SBOURL. Default one is https://www.slackbuilds.org/slackbuilds/14.2/. Is there a way so it can use ponce's -current SBo fork? It's url is git://github.com/Ponce/slackbuilds.git@current.

denydias · 02-14-2020, 04:47 PM

Another suggestion... following @chrisretusn's ffmpeg example:

Code:

$ slackpkg search ffmpeg

Looking for ffmpeg in package list. Please wait... DONE

The list below shows all packages with name matching "ffmpeg".

[ Status              ] [ Repository  ] [ Package                                                    ]
  installed               alienbob        ffmpeg3-compat-3.4.6-x86_64-1alien
  installed               ktown           ffmpegthumbs-19.12.2-x86_64-1alien
  installed               restricted      ffmpeg-4.2.1-x86_64-1alien
  installed               slackware64     ffmpegthumbnailer-2.2.2-x86_64-1
  uninstalled             alienbob        gst-plugins-ffmpeg0-0.10.13-x86_64-2alien
  uninstalled             ponce           gst0-ffmpeg-0.10.13-x86_64-1ponce
  uninstalled             slackonly       alsa-plugin-ffmpeg-1.1.1-x86_64-3_slonly
  uninstalled             slackonly       ffmpeg2theora-0.30-x86_64-6_slonly
  uninstalled             slackonly       ffmpegyag-0.7.6-x86_64-1_slonly
  uninstalled             slackonly       opera-developer-ffmpeg-codecs-60.0.3107.4-x86_64-1_slonly
  uninstalled             slackonly       opera-ffmpeg-codecs-60.0.3112.90-x86_64-1_slonly
  uninstalled             slackonly       vivaldi-codecs-ffmpeg-extra-60.0.3112.78-x86_64-1_slonly
  uninstalled(masked)     extra           ffmpeg-4.2.2-x86_64-1_alsa
  uninstalled(masked)     ponce           ffmpeg-4.2.2-x86_64-1ponce
  uninstalled(masked)     slackonly       ffmpeg-3.2.4-x86_64-6_slonly
  uninstalled(masked)     slackonly       ffmpegthumbnailer-2.2.0-x86_64-4_slonly
  uninstalled(masked)     slackonly       gst0-ffmpeg-0.10.13-x86_64-2_slonly
  uninstalled(masked)     slackware64     ffmpeg-4.2.2-x86_64-1

You can search specific files using "slackpkg file-search file".


Also found in SBo:

[ package ]                             [ url ]
  alsa-plugin-ffmpeg-1.1.1                https://www.slackbuilds.org/slackbuilds/14.2/audio/alsa-plugin-ffmpeg.tar.gz
  audacious-ffmpeg-3.7.2                  https://www.slackbuilds.org/slackbuilds/14.2/audio/audacious-ffmpeg.tar.gz
  ffmpegthumbnailer-2.2.0                 https://www.slackbuilds.org/slackbuilds/14.2/desktop/ffmpegthumbnailer.tar.gz
  ffmpeg-3.2.4                            https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg.tar.gz
  ffmpeg2theora-0.30                      https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg2theora.tar.gz
  ffmpeg4-4.1                             https://www.slackbuilds.org/slackbuilds/14.2/multimedia/ffmpeg4.tar.gz
  gst0-ffmpeg-0.10.13                     https://www.slackbuilds.org/slackbuilds/14.2/multimedia/gst0-ffmpeg.tar.gz
  opera-developer-ffmpeg-codecs-0.41.3    https://www.slackbuilds.org/slackbuilds/14.2/multimedia/opera-developer-ffmpeg-codecs.tar.gz
  opera-ffmpeg-codecs-0.41.3              https://www.slackbuilds.org/slackbuilds/14.2/multimedia/opera-ffmpeg-codecs.tar.gz

I understand that the (masked) label refers to packages that are not candidates to be installed as an upgrade because repository priorities forbid them to do so.

In my case, I have "PKGS_PRIORITY=( restricted ktown )" in place, so even though slackware64's ffmpeg is newer (4.2.2) than the one I've currently installed (4.2.1), the prior will not be installed as the later is the one "masking" it.

The word "masked" explains very little of this, as well as the place where it's applied to. Is there a better wording for this? Or maybe:

Code:

[ Status              ] [ Repository  ] [ Package                                                    ]
  installed(masking)      restricted      ffmpeg-4.2.1-x86_64-1alien
...
  uninstalled(masked)     extra           ffmpeg-4.2.2-x86_64-1_alsa
  uninstalled(masked)     ponce           ffmpeg-4.2.2-x86_64-1ponce
  uninstalled(masked)     slackware64     ffmpeg-4.2.2-x86_64-1