LinuxQuestions.org
Help answer threads with 0 replies.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware
User Name
Password
Slackware This Forum is for the discussion of Slackware Linux.

Notices


Reply
  Search this Thread
Old 12-18-2023, 12:52 PM   #6016
linux91
Member
 
Registered: Feb 2004
Location: Williamson, New York, USA
Distribution: (Minix), SLS, Slackware 0.99-15, Current, Qubes-OS
Posts: 111

Rep: Reputation: 43

Quote:
Originally Posted by rogan View Post
Don't know if it is of any help, but I'm running a custom 6.6.7 using lvm, on Slack 15.0.
This might point to udev changes on current ?
I'm attempting to locate where my system is hanging up during boot. Trying to eliminate potential reasons.
Thanks.
 
Old 12-18-2023, 12:59 PM   #6017
linux91
Member
 
Registered: Feb 2004
Location: Williamson, New York, USA
Distribution: (Minix), SLS, Slackware 0.99-15, Current, Qubes-OS
Posts: 111

Rep: Reputation: 43
Quote:
Originally Posted by drumz View Post
Yes. Why do you ask?

Code:
# uname -r
6.6.7-etr
Code:
# lsblk
NAME              MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINTS
nvme1n1           259:0    0   7.3T  0 disk  
...
nvme2n1           259:2    0   7.3T  0 disk  
...
nvme0n1           259:3    0   1.8T  0 disk  
...
nvme3n1           259:10   0     7T  0 disk  
...
Code:
# cat /etc/slackware-version 
Slackware 15.0
Edit: I read that as "LVM and/or LUKS" but I think you meant "LUKS on top of LVM". In that case, no. I don't use LVM. Only LUKS.
Correct LUKS on top of LVM.
I'm attempting to locate where my system is hanging up during boot. Trying to eliminate potential reasons.
Thanks.
The info you, @rogan, and @ctrlaltca have supplied indicate it doesn't seem to be the LVM or LKS systems.
I am directing current efforts to looking at whether the video dev or module as a possible culprit.
My previous post describes the challenge:
https://www.linuxquestions.org/quest...ml#post6470302

Thanks

Last edited by linux91; 12-18-2023 at 01:16 PM. Reason: Trimmed quoted text to streamline reply.
 
Old 12-18-2023, 01:00 PM   #6018
linux91
Member
 
Registered: Feb 2004
Location: Williamson, New York, USA
Distribution: (Minix), SLS, Slackware 0.99-15, Current, Qubes-OS
Posts: 111

Rep: Reputation: 43
Quote:
Originally Posted by ctrlaltca View Post
Yes, LVM over LUKS working fine here.
I would post my /proc/version and lsblk but cloudflare won't let me.
This is the third time i try to post this comment. Fsck cloudflare.
This is very helpful, Thanks.

My current take is that the hangup occurs when executing the command:
/sbin/udevadm trigger --type=devices --action=add
during startup or simply executing the command at the CLI.
This is a very broad swag but it's where I'm starting.

I configured the system to dual boot kernel-6.1.66 (last working kernel) and the latest kernel. This allows me to test new kernels to see if it is addressed upstream while in the meantime I will continue to compare the later kernels with kernel-6.1.66, ex. diffing the output of lsmod, lsdev, udevadm monitor, etc. for each kernel; running the udevadm trigger command above.
I will also diff the kernel config files to see if something was enabled or disabled.

Last edited by linux91; 12-18-2023 at 01:34 PM. Reason: Clarification
 
Old 12-18-2023, 04:39 PM   #6019
drumz
Member
 
Registered: Apr 2005
Location: Oklahoma, USA
Distribution: Slackware
Posts: 906

Rep: Reputation: 697Reputation: 697Reputation: 697Reputation: 697Reputation: 697Reputation: 697
Quote:
Originally Posted by linux91 View Post
This is very helpful, Thanks.

My current take is that the hangup occurs when executing the command:
/sbin/udevadm trigger --type=devices --action=add
during startup or simply executing the command at the CLI.
This is a very broad swag but it's where I'm starting.

I configured the system to dual boot kernel-6.1.66 (last working kernel) and the latest kernel. This allows me to test new kernels to see if it is addressed upstream while in the meantime I will continue to compare the later kernels with kernel-6.1.66, ex. diffing the output of lsmod, lsdev, udevadm monitor, etc. for each kernel; running the udevadm trigger command above.
I will also diff the kernel config files to see if something was enabled or disabled.
You could adding debug echo statements to the startup scripts to help narrow down the problem area. I did that at work while trying to pin down a problem with Ubuntu not booting. Found the line that failed but still couldn't solve the problem...
 
Old 12-18-2023, 08:35 PM   #6020
Aeterna
Senior Member
 
Registered: Aug 2017
Location: Terra Mater
Distribution: VM Host: Slackware-current, VM Guests: Artix, Venom, antiX, Gentoo, FreeBSD, OpenBSD, OpenIndiana
Posts: 1,011

Rep: Reputation: Disabled
Quote:
Originally Posted by marav View Post
Linux 6.7 Introduces "make hardening.config" To Help Build A Hardened Kernel

Code:
The hardening updates for the Linux 6.7 kernel bring a new hardening configuration 
profile to help in building a security hardened kernel with some sane defaults.
https://www.phoronix.com/news/Linux-6.7-Hardening
Well I have found what executing
Quote:
make hardening.config
will generate:

https://github.com/torvalds/linux/bl...rdening.config
of course run it on top of existing .config
pretty much safe for everybody. I am running hardened kernel for long time (there options are mostly in 5.x and all in 6.x). These settings are really reasonable hardening options.

Recently I compiled Slackware generic 6.6.3. ~4850 modules.... So compiling may not be very enticing. But it really is worth to keep system as safe as possible.

Last edited by Aeterna; 12-18-2023 at 08:37 PM.
 
Old 12-18-2023, 10:33 PM   #6021
linux91
Member
 
Registered: Feb 2004
Location: Williamson, New York, USA
Distribution: (Minix), SLS, Slackware 0.99-15, Current, Qubes-OS
Posts: 111

Rep: Reputation: 43
Quote:
Originally Posted by drumz View Post
You could adding debug echo statements to the startup scripts to help narrow down the problem area. I did that at work while trying to pin down a problem with Ubuntu not booting. Found the line that failed but still couldn't solve the problem...
I'll look into that, Thanks.
Apparently many things have changed in the kernel-6.6.7 config since kernel-6.1.66. This looks like it will take some time to figure out.
 
Old 12-19-2023, 05:40 AM   #6022
rogan
Member
 
Registered: Aug 2004
Distribution: Slackware
Posts: 216

Rep: Reputation: 117Reputation: 117
I have encountered a kernel bug on 6.6.7 possibly related to yours.
It manifests as commands taking "forever" to complete, for instance
depmod on a newly created /lib/modules/5.15.143 took about ten minutes,
and btrfs send had to be stopped, as I gave up waiting.
All works normally with a similarly configured 5.15.143.
I suspect some interaction with atomic file read/write and the all-new
scheduler they introduced, but there may be other reasons, who knows...
I'll try to nail this down.
 
1 members found this post helpful.
Old 12-19-2023, 06:32 AM   #6023
Petri Kaukasoina
Senior Member
 
Registered: Mar 2007
Posts: 1,851

Rep: Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520
Quote:
Originally Posted by rogan View Post
I suspect some interaction with atomic file read/write and the all-new
scheduler they introduced, but there may be other reasons, who knows...
What scheduler do you mean? I have recently noticed intermittent delays of maybe ten seconds running commands like 'ls' in a directory containing few files. I use bfq I/O scheduler as before (it's a HDD).
 
1 members found this post helpful.
Old 12-19-2023, 06:58 AM   #6024
rogan
Member
 
Registered: Aug 2004
Distribution: Slackware
Posts: 216

Rep: Reputation: 117Reputation: 117
As usual I'm a bit too vague, sorry.

The scheduler I refer to is the new EEVDF scheduler which replaced
the old CFQ that distributes cpu time between processes.

Yes I suspect this one because commands sometimes just don't get any
cpu time it seems.
 
1 members found this post helpful.
Old 12-19-2023, 07:51 AM   #6025
cwizardone
LQ Veteran
 
Registered: Feb 2007
Distribution: Slackware64-current with "True Multilib" and KDE4Town.
Posts: 9,152

Original Poster
Rep: Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323Reputation: 7323
A second release candidate for the 5.10.205 kernel update,

5.10.205-rc2, with 60 patches, https://lkml.iu.edu/hypermail/linux/...2.2/02747.html
 
1 members found this post helpful.
Old 12-19-2023, 08:25 AM   #6026
Petri Kaukasoina
Senior Member
 
Registered: Mar 2007
Posts: 1,851

Rep: Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520Reputation: 1520
Quote:
Originally Posted by rogan View Post
The scheduler I refer to is the new EEVDF scheduler which replaced
the old CFQ that distributes cpu time between processes.

Yes I suspect this one because commands sometimes just don't get any
cpu time it seems.
OK, my 10 sec pause reading a directory not in cache can't be it because according to my notes I had seen it in 6.6.1 and then I had tried 6.1.62 and saw it there, too. First time it appeared somewhat earlier than that but I don't remember when. I guess I should try 5.15.
 
1 members found this post helpful.
Old 12-19-2023, 08:44 AM   #6027
rogan
Member
 
Registered: Aug 2004
Distribution: Slackware
Posts: 216

Rep: Reputation: 117Reputation: 117
Ok Thanks for the info. Thankfully the problem here is 100% replicable so
I'm going to do a few subsystem exclusion exercises and see what happens.
 
Old 12-19-2023, 08:48 AM   #6028
Aeterna
Senior Member
 
Registered: Aug 2017
Location: Terra Mater
Distribution: VM Host: Slackware-current, VM Guests: Artix, Venom, antiX, Gentoo, FreeBSD, OpenBSD, OpenIndiana
Posts: 1,011

Rep: Reputation: Disabled
What about running top alongside to confirm cpu spikes?
You can always try lqx or zen kernels with alternative cpu schedulers https://github.com/zen-kernel/zen-kernel/releases. This also would confirm or exclude cpu scheduler as a culprit.

Last edited by Aeterna; 12-19-2023 at 08:57 AM.
 
1 members found this post helpful.
Old 12-19-2023, 11:05 AM   #6029
Didier Spaier
LQ Addict
 
Registered: Nov 2008
Location: Paris, France
Distribution: Slint64-15.0
Posts: 11,065

Rep: Reputation: Disabled
Or just run this, possibly through an alias in ~/bash_aliases or such:
Code:
ps -e --width 70 -o pcpu,pid,user,args --sort=-pcpu | head -5
 
1 members found this post helpful.
Old 12-19-2023, 03:30 PM   #6030
rogan
Member
 
Registered: Aug 2004
Distribution: Slackware
Posts: 216

Rep: Reputation: 117Reputation: 117
I've tried quite a few different kernel configurations,
excluding options that I think might have anything to
do with our problems. So far no luck...
This bug is probably deep, whatever it is.
Random hangs from scanning (reading writing) processes,
no btrfs send /receive, no matter what.
In the case of btrfs send/receive: after a normal start,
cpu usage drops to zero, as does io, then the process just
sits there doing nothing until killed.
Example: 16G btrfs send from a hdd to nvme which receives:
6.6.7:
send: cpu time about 3 sec user 22 sec system. Killed after 14 minutes:
receive: cpu time about 3 sek user 53 sec system. --- | | ---
5.15.143:
send: cpu time about 5 sec user 39 sec system 4 min 40 sec real.
receive: cpu time about 5 sec user 1 min 28 sec system --- | | ---

It's still early days for the 6.6 series. This is going to get fixed.

Aeterna: I might try the zen when I get the time. Thanks for the tip.
Didier: I usually use iostat, top and time because it's simple and often enough.

Last edited by rogan; 12-19-2023 at 03:45 PM.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off



Similar Threads
Thread Thread Starter Forum Replies Last Post
Linux.conf.au: Latest Linux kernel release due early March DragonSlayer48DX Linux - News 0 01-18-2010 10:43 PM
No video on latest kernel release Tralce Linux - Kernel 3 11-30-2006 07:48 AM
What is the latest Redhat release TILEMANN Linux - Software 5 11-20-2006 10:48 PM
LXer: News: OpenVZ To Release Support, Patches for Latest Kernel LXer Syndicated Linux News 0 11-01-2006 10:54 PM
latest debian release? doralsoral Linux - Software 5 12-25-2004 12:40 PM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Slackware

All times are GMT -5. The time now is 03:00 AM.

Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration