LinuxQuestions.org
Review your favorite Linux distribution.
Home Forums Tutorials Articles Register
Go Back   LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Ubuntu
Reload this Page [SOLVED] INFO: task gnome-shell:5523 blocked for more than 120 seconds
User Name
Password
Ubuntu This forum is for the discussion of Ubuntu Linux.

Notices


Reply
  Search this Thread
Old 03-27-2018, 09:24 AM   #1
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Rep: Reputation: 21
INFO: task gnome-shell:5523 blocked for more than 120 seconds

I've noticed that my system will suddenly seem to 'lock-up'. I'd be
unable to switch windows and even the clock would freeze. This happens very intermittently and I can't seem to find a way to duplicate it. This is on a 16.04.4 LTS release. Kernel info is

Code:
uname -a
Linux localhost 4.13.0-37-generic #42~16.04.1-Ubuntu SMP Wed Mar 7
16:03:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
This is the kern.log output from 23 March I'd included the same from 24 March however it made the post too long. It hasn't happened since the 24th so far

Code:
Mar 23 15:09:42 localhost kernel: [456627.787010] INFO: task fetchmail:1195 blocked for more than 120 seconds.
Mar 23 15:09:42 localhost kernel: [456627.787016]       Not tainted 4.13.0-37-generic #42~16.04.1-Ubuntu
Mar 23 15:09:42 localhost kernel: [456627.787018] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 23 15:09:42 localhost kernel: [456627.787020] fetchmail       D    0  1195      1 0x00000000
Mar 23 15:09:42 localhost kernel: [456627.787022] Call Trace:
Mar 23 15:09:42 localhost kernel: [456627.787032]  __schedule+0x3d6/0x8b0
Mar 23 15:09:42 localhost kernel: [456627.787036]  ? scsi_init_io+0x4b/0x1c0
Mar 23 15:09:42 localhost kernel: [456627.787038]  ? bit_wait+0x60/0x60
Mar 23 15:09:42 localhost kernel: [456627.787039]  schedule+0x36/0x80
Mar 23 15:09:42 localhost kernel: [456627.787044]  io_schedule+0x16/0x40
Mar 23 15:09:42 localhost kernel: [456627.787045]  bit_wait_io+0x11/0x60
Mar 23 15:09:42 localhost kernel: [456627.787046]  __wait_on_bit_lock+0x88/0xd0
Mar 23 15:09:42 localhost kernel: [456627.787048]  out_of_line_wait_on_bit_lock+0x8e/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787050]  ? bit_waitqueue+0x40/0x40
Mar 23 15:09:42 localhost kernel: [456627.787053]  bh_uptodate_or_lock+0x6d/0x70
Mar 23 15:09:42 localhost kernel: [456627.787056]  __read_extent_tree_block+0x5d/0x1f0
Mar 23 15:09:42 localhost kernel: [456627.787058]  ext4_find_extent+0x13b/0x2f0
Mar 23 15:09:42 localhost kernel: [456627.787059]  ext4_ext_map_blocks+0x7a/0x14d0
Mar 23 15:09:42 localhost kernel: [456627.787063]  ? mempool_alloc_slab+0x15/0x20
Mar 23 15:09:42 localhost kernel: [456627.787064]  ? mempool_alloc+0x73/0x180
Mar 23 15:09:42 localhost kernel: [456627.787068]  ? cfq_dispatch_insert+0xbe/0x160
Mar 23 15:09:42 localhost kernel: [456627.787071]  ? alloc_request_size+0x30/0x70
Mar 23 15:09:42 localhost kernel: [456627.787074]  ? kernfs_path_from_node_locked+0x389/0x490
Mar 23 15:09:42 localhost kernel: [456627.787077]  ext4_map_blocks+0x406/0x5d0
Mar 23 15:09:42 localhost kernel: [456627.787079]  ext4_getblk+0x51/0x190
Mar 23 15:09:42 localhost kernel: [456627.787080]  ext4_bread+0x22/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787082]  __ext4_read_dirblock+0x34/0x2b0
Mar 23 15:09:42 localhost kernel: [456627.787083]  dx_probe+0x4b/0x470
Mar 23 15:09:42 localhost kernel: [456627.787085]  ext4_dx_find_entry+0x55/0x180
Mar 23 15:09:42 localhost kernel: [456627.787087]  ext4_find_entry+0x43a/0x4d0
Mar 23 15:09:42 localhost kernel: [456627.787089]  ? d_alloc_parallel+0xc1/0x4b0
Mar 23 15:09:42 localhost kernel: [456627.787091]  ? dequeue_entity+0xed/0x4c0
Mar 23 15:09:42 localhost kernel: [456627.787093]  ext4_lookup+0x7c/0x270
Mar 23 15:09:42 localhost kernel: [456627.787095]  lookup_slow+0xab/0x170
Mar 23 15:09:42 localhost kernel: [456627.787097]  walk_component+0x1c5/0x360
Mar 23 15:09:42 localhost kernel: [456627.787098]  link_path_walk+0x19f/0x5e0
Mar 23 15:09:42 localhost kernel: [456627.787100]  ? path_init+0x1d9/0x310
Mar 23 15:09:42 localhost kernel: [456627.787101]  path_openat+0xf7/0x13f0
Mar 23 15:09:42 localhost kernel: [456627.787103]  ? page_add_file_rmap+0x133/0x170
Mar 23 15:09:42 localhost kernel: [456627.787105]  ? filemap_map_pages+0x350/0x360
Mar 23 15:09:42 localhost kernel: [456627.787107]  do_filp_open+0x99/0x110
Mar 23 15:09:42 localhost kernel: [456627.787110]  ? __check_object_size+0xfc/0x1a0
Mar 23 15:09:42 localhost kernel: [456627.787113]  ? __alloc_fd+0x46/0x170
Mar 23 15:09:42 localhost kernel: [456627.787115]  do_sys_open+0x12d/0x290
Mar 23 15:09:42 localhost kernel: [456627.787116]  ? do_sys_open+0x12d/0x290
Mar 23 15:09:42 localhost kernel: [456627.787118]  ? entry_SYSCALL_64_after_hwframe+0xaa/0x139
Mar 23 15:09:42 localhost kernel: [456627.787119]  ? entry_SYSCALL_64_after_hwframe+0xa3/0x139
Mar 23 15:09:42 localhost kernel: [456627.787121]  ? entry_SYSCALL_64_after_hwframe+0x9c/0x139
Mar 23 15:09:42 localhost kernel: [456627.787123]  SyS_open+0x1e/0x20
Mar 23 15:09:42 localhost kernel: [456627.787124]  entry_SYSCALL_64_fastpath+0x24/0xab
Mar 23 15:09:42 localhost kernel: [456627.787126] RIP: 0033:0x7efe3a6dd040
Mar 23 15:09:42 localhost kernel: [456627.787127] RSP: 002b:00007ffd87410f48 EFLAGS: 00000246 ORIG_RAX: 0000000000000002
Mar 23 15:09:42 localhost kernel: [456627.787129] RAX: ffffffffffffffda RBX: 00000000efcdab89 RCX: 00007efe3a6dd040
Mar 23 15:09:42 localhost kernel: [456627.787130] RDX: 00000000000001b6 RSI: 0000000000000000 RDI: 00007efe3ab8586b
Mar 23 15:09:42 localhost kernel: [456627.787131] RBP: 00000000c3d2e1f0 R08: 0000000000000008 R09: 0000000000000001
Mar 23 15:09:42 localhost kernel: [456627.787132] R10: 0000000000000000 R11: 0000000000000246 R12: 00007ffd87411000
Mar 23 15:09:42 localhost kernel: [456627.787133] R13: 00007ffd8741100a R14: 00007ffd87410f28 R15: 0000000002209df0
Mar 23 15:09:42 localhost kernel: [456627.787233] INFO: task ionice:32535 blocked for more than 120 seconds.
Mar 23 15:09:42 localhost kernel: [456627.787235]       Not tainted 4.13.0-37-generic #42~16.04.1-Ubuntu
Mar 23 15:09:42 localhost kernel: [456627.787236] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 23 15:09:42 localhost kernel: [456627.787237] ionice          D    0 32535   3839 0x00000000
Mar 23 15:09:42 localhost kernel: [456627.787239] Call Trace:
Mar 23 15:09:42 localhost kernel: [456627.787241]  __schedule+0x3d6/0x8b0
Mar 23 15:09:42 localhost kernel: [456627.787243]  ? bit_wait+0x60/0x60
Mar 23 15:09:42 localhost kernel: [456627.787244]  schedule+0x36/0x80
Mar 23 15:09:42 localhost kernel: [456627.787245]  io_schedule+0x16/0x40
Mar 23 15:09:42 localhost kernel: [456627.787247]  bit_wait_io+0x11/0x60
Mar 23 15:09:42 localhost kernel: [456627.787248]  __wait_on_bit+0x63/0x90
Mar 23 15:09:42 localhost kernel: [456627.787250]  ? submit_bio+0x73/0x150
Mar 23 15:09:42 localhost kernel: [456627.787251]  out_of_line_wait_on_bit+0x8e/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787252]  ? bit_waitqueue+0x40/0x40
Mar 23 15:09:42 localhost kernel: [456627.787254]  bh_submit_read+0x7b/0x90
Mar 23 15:09:42 localhost kernel: [456627.787255]  __read_extent_tree_block+0x18f/0x1f0
Mar 23 15:09:42 localhost kernel: [456627.787257]  ? ext4_find_extent+0x13b/0x2f0
Mar 23 15:09:42 localhost kernel: [456627.787258]  ext4_find_extent+0x13b/0x2f0
Mar 23 15:09:42 localhost kernel: [456627.787260]  ext4_ext_map_blocks+0x7a/0x14d0
Mar 23 15:09:42 localhost kernel: [456627.787262]  ? cfq_del_cfqq_rr+0xe8/0x1a0
Mar 23 15:09:42 localhost kernel: [456627.787264]  ext4_map_blocks+0x406/0x5d0
Mar 23 15:09:42 localhost kernel: [456627.787267]  ? ktime_get+0x3e/0xa0
Mar 23 15:09:42 localhost kernel: [456627.787268]  ext4_getblk+0x51/0x190
Mar 23 15:09:42 localhost kernel: [456627.787270]  ext4_bread+0x22/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787271]  __ext4_read_dirblock+0x34/0x2b0
Mar 23 15:09:42 localhost kernel: [456627.787272]  dx_probe+0x4b/0x470
Mar 23 15:09:42 localhost kernel: [456627.787274]  ext4_dx_find_entry+0x55/0x180
Mar 23 15:09:42 localhost kernel: [456627.787275]  ext4_find_entry+0x43a/0x4d0
Mar 23 15:09:42 localhost kernel: [456627.787277]  ? d_alloc_parallel+0xc1/0x4b0
Mar 23 15:09:42 localhost kernel: [456627.787279]  ext4_lookup+0x7c/0x270
Mar 23 15:09:42 localhost kernel: [456627.787280]  lookup_slow+0xab/0x170
Mar 23 15:09:42 localhost kernel: [456627.787282]  walk_component+0x1c5/0x360
Mar 23 15:09:42 localhost kernel: [456627.787283]  link_path_walk+0x19f/0x5e0
Mar 23 15:09:42 localhost kernel: [456627.787285]  ? path_init+0x1d9/0x310
Mar 23 15:09:42 localhost kernel: [456627.787286]  path_openat+0xf7/0x13f0
Mar 23 15:09:42 localhost kernel: [456627.787289]  ? list_lru_add+0x58/0x120
Mar 23 15:09:42 localhost kernel: [456627.787291]  ? page_add_file_rmap+0x58/0x170
Mar 23 15:09:42 localhost kernel: [456627.787292]  do_filp_open+0x99/0x110
Mar 23 15:09:42 localhost kernel: [456627.787296]  ? __kmalloc+0x1c3/0x200
Mar 23 15:09:42 localhost kernel: [456627.787298]  ? security_prepare_creds+0x79/0x90
Mar 23 15:09:42 localhost kernel: [456627.787301]  do_open_execat+0x78/0x1e0
Mar 23 15:09:42 localhost kernel: [456627.787303]  ? do_open_execat+0x78/0x1e0
Mar 23 15:09:42 localhost kernel: [456627.787304]  do_execveat_common.isra.35+0x21a/0x750
Mar 23 15:09:42 localhost kernel: [456627.787306]  SyS_execve+0x31/0x40
Mar 23 15:09:42 localhost kernel: [456627.787309]  do_syscall_64+0x67/0x120
Mar 23 15:09:42 localhost kernel: [456627.787311]  entry_SYSCALL64_slow_path+0x25/0x25
Mar 23 15:09:42 localhost kernel: [456627.787312] RIP: 0033:0x7f8c20b0f777
Mar 23 15:09:42 localhost kernel: [456627.787313] RSP: 002b:00007ffd7156ca98 EFLAGS: 00000206 ORIG_RAX: 000000000000003b
Mar 23 15:09:42 localhost kernel: [456627.787314] RAX: ffffffffffffffda RBX: 00007ffd7156cc58 RCX: 00007f8c20b0f777
Mar 23 15:09:42 localhost kernel: [456627.787315] RDX: 00007ffd7156cc68 RSI: 00007ffd7156cc58 RDI: 00007ffd7156e8b4
Mar 23 15:09:42 localhost kernel: [456627.787316] RBP: 00007ffd7156cb00 R08: 0000000000000000 R09: 0000000000000003
Mar 23 15:09:42 localhost kernel: [456627.787317] R10: 00000000000005b3 R11: 0000000000000206 R12: 00007ffd7156cc68
Mar 23 15:09:42 localhost kernel: [456627.787318] R13: 0000000000000000 R14: 00007ffd7156e8b4 R15: 0000000000000000
Mar 23 15:09:42 localhost kernel: [456627.787320] INFO: task chrome-gnome-sh:32545 blocked for more than 120 seconds.
Mar 23 15:09:42 localhost kernel: [456627.787322]       Not tainted 4.13.0-37-generic #42~16.04.1-Ubuntu
Mar 23 15:09:42 localhost kernel: [456627.787323] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Mar 23 15:09:42 localhost kernel: [456627.787324] chrome-gnome-sh D    0 32545  23464 0x00000000
Mar 23 15:09:42 localhost kernel: [456627.787326] Call Trace:
Mar 23 15:09:42 localhost kernel: [456627.787327]  __schedule+0x3d6/0x8b0
Mar 23 15:09:42 localhost kernel: [456627.787329]  ? bit_wait+0x60/0x60
Mar 23 15:09:42 localhost kernel: [456627.787330]  schedule+0x36/0x80
Mar 23 15:09:42 localhost kernel: [456627.787332]  io_schedule+0x16/0x40
Mar 23 15:09:42 localhost kernel: [456627.787333]  bit_wait_io+0x11/0x60
Mar 23 15:09:42 localhost kernel: [456627.787334]  __wait_on_bit_lock+0x88/0xd0
Mar 23 15:09:42 localhost kernel: [456627.787336]  out_of_line_wait_on_bit_lock+0x8e/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787337]  ? bit_waitqueue+0x40/0x40
Mar 23 15:09:42 localhost kernel: [456627.787338]  bh_uptodate_or_lock+0x6d/0x70
Mar 23 15:09:42 localhost kernel: [456627.787340]  __read_extent_tree_block+0x5d/0x1f0
Mar 23 15:09:42 localhost kernel: [456627.787341]  ext4_find_extent+0x13b/0x2f0
Mar 23 15:09:42 localhost kernel: [456627.787343]  ext4_ext_map_blocks+0x7a/0x14d0
Mar 23 15:09:42 localhost kernel: [456627.787345]  ? call_timer_fn+0x140/0x140
Mar 23 15:09:42 localhost kernel: [456627.787347]  ext4_map_blocks+0x406/0x5d0
Mar 23 15:09:42 localhost kernel: [456627.787349]  ? wait_iff_congested+0xaf/0x160
Mar 23 15:09:42 localhost kernel: [456627.787350]  ext4_getblk+0x51/0x190
Mar 23 15:09:42 localhost kernel: [456627.787353]  ? shrink_inactive_list+0x518/0x5b0
Mar 23 15:09:42 localhost kernel: [456627.787354]  ext4_bread+0x22/0xb0
Mar 23 15:09:42 localhost kernel: [456627.787356]  ? inactive_list_is_low+0x115/0x220
Mar 23 15:09:42 localhost kernel: [456627.787357]  __ext4_read_dirblock+0x34/0x2b0
Mar 23 15:09:42 localhost kernel: [456627.787358]  dx_probe+0x4b/0x470
Mar 23 15:09:42 localhost kernel: [456627.787360]  ext4_dx_find_entry+0x55/0x180
Mar 23 15:09:42 localhost kernel: [456627.787361]  ext4_find_entry+0x43a/0x4d0
Mar 23 15:09:42 localhost kernel: [456627.787363]  ? d_alloc_parallel+0xc1/0x4b0
Mar 23 15:09:42 localhost kernel: [456627.787365]  ext4_lookup+0x7c/0x270
Mar 23 15:09:42 localhost kernel: [456627.787366]  lookup_slow+0xab/0x170
Mar 23 15:09:42 localhost kernel: [456627.787368]  walk_component+0x1c5/0x360
Mar 23 15:09:42 localhost kernel: [456627.787369]  ? path_init+0x1d9/0x310
Mar 23 15:09:42 localhost kernel: [456627.787370]  path_lookupat+0x76/0x230
Mar 23 15:09:42 localhost kernel: [456627.787373]  ? find_next_bit+0xb/0x10
Mar 23 15:09:42 localhost kernel: [456627.787375]  ? cpumask_any_but+0x2b/0x40
Mar 23 15:09:42 localhost kernel: [456627.787377]  filename_lookup+0xb8/0x1a0
Mar 23 15:09:42 localhost kernel: [456627.787379]  ? __check_object_size+0xfc/0x1a0
Mar 23 15:09:42 localhost kernel: [456627.787382]  ? strncpy_from_user+0x4d/0x170
Mar 23 15:09:42 localhost kernel: [456627.787384]  user_path_at_empty+0x36/0x40
Mar 23 15:09:42 localhost kernel: [456627.787385]  ? user_path_at_empty+0x36/0x40
Mar 23 15:09:42 localhost kernel: [456627.787387]  vfs_statx+0x77/0xe0
Mar 23 15:09:42 localhost kernel: [456627.787388]  ? entry_SYSCALL_64_after_hwframe+0x11a/0x139
Mar 23 15:09:42 localhost kernel: [456627.787390]  SYSC_newstat+0x3d/0x70
Mar 23 15:09:42 localhost kernel: [456627.787391]  ? entry_SYSCALL_64_after_hwframe+0xdb/0x139
Mar 23 15:09:42 localhost kernel: [456627.787393]  ? entry_SYSCALL_64_after_hwframe+0xd4/0x139
Mar 23 15:09:42 localhost kernel: [456627.787394]  ? entry_SYSCALL_64_after_hwframe+0xcd/0x139
Mar 23 15:09:42 localhost kernel: [456627.787395]  ? entry_SYSCALL_64_after_hwframe+0xc6/0x139
Mar 23 15:09:42 localhost kernel: [456627.787397]  ? entry_SYSCALL_64_after_hwframe+0xbf/0x139
Mar 23 15:09:42 localhost kernel: [456627.787398]  ? entry_SYSCALL_64_after_hwframe+0xb8/0x139
Mar 23 15:09:42 localhost kernel: [456627.787399]  ? entry_SYSCALL_64_after_hwframe+0xb1/0x139
Mar 23 15:09:42 localhost kernel: [456627.787401]  ? entry_SYSCALL_64_after_hwframe+0xaa/0x139
Mar 23 15:09:42 localhost kernel: [456627.787402]  ? entry_SYSCALL_64_after_hwframe+0xa3/0x139
Mar 23 15:09:42 localhost kernel: [456627.787403]  ? entry_SYSCALL_64_after_hwframe+0x9c/0x139
Mar 23 15:09:42 localhost kernel: [456627.787405]  ? entry_SYSCALL_64_after_hwframe+0x95/0x139
Mar 23 15:09:42 localhost kernel: [456627.787406]  ? entry_SYSCALL_64_after_hwframe+0x8e/0x139
Mar 23 15:09:42 localhost kernel: [456627.787407]  ? entry_SYSCALL_64_after_hwframe+0x87/0x139
Mar 23 15:09:42 localhost kernel: [456627.787409]  ? entry_SYSCALL_64_after_hwframe+0x80/0x139
Mar 23 15:09:42 localhost kernel: [456627.787410]  ? entry_SYSCALL_64_after_hwframe+0x79/0x139
Mar 23 15:09:42 localhost kernel: [456627.787411]  ? entry_SYSCALL_64_after_hwframe+0x72/0x139
Mar 23 15:09:42 localhost kernel: [456627.787413]  ? entry_SYSCALL_64_after_hwframe+0x6b/0x139
Mar 23 15:09:42 localhost kernel: [456627.787414]  SyS_newstat+0xe/0x10
Mar 23 15:09:42 localhost kernel: [456627.787416]  entry_SYSCALL_64_fastpath+0x24/0xab
Mar 23 15:09:42 localhost kernel: [456627.787417] RIP: 0033:0x7ff5f2c43be5
Mar 23 15:09:42 localhost kernel: [456627.787418] RSP: 002b:00007ffd11f18ce8 EFLAGS: 00000246 ORIG_RAX: 0000000000000004
Mar 23 15:09:43 localhost kernel: [456627.787419] RAX: ffffffffffffffda RBX: 0000000000000006 RCX: 00007ff5f2c43be5
Mar 23 15:09:43 localhost kernel: [456627.787420] RDX: 00007ffd11f18d30 RSI: 00007ffd11f18d30 RDI: 00007ff5f328b130
Mar 23 15:09:43 localhost kernel: [456627.787421] RBP: 000000000000000c R08: 0000000000f8ffd0 R09: 00007ffd11f18a00
Mar 23 15:09:43 localhost kernel: [456627.787422] R10: 0000000000000148 R11: 0000000000000246 R12: 00000000009bb8e0
Mar 23 15:09:43 localhost kernel: [456627.787423] R13: 00007ff5f3288ea0 R14: 0000000000f40630 R15: 00007ff5f3288ea0
Mar 23 17:32:24 localhost kernel: [465187.707975] gdbus: page allocation stalls for 15060ms, order:0, mode:0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=(null)
Mar 23 17:32:24 localhost kernel: [465187.707981] gdbus cpuset=/ mems_allowed=0
Mar 23 17:32:24 localhost kernel: [465187.707985] CPU: 0 PID: 3489 Comm: gdbus Not tainted 4.13.0-37-generic #42~16.04.1-Ubuntu
Mar 23 17:32:24 localhost kernel: [465187.707986] Hardware name: Dell Inc. OptiPlex 780                 /0C27VV, BIOS A15 08/06/2013
Mar 23 17:32:24 localhost kernel: [465187.707987] Call Trace:
Mar 23 17:32:24 localhost kernel: [465187.707995]  dump_stack+0x63/0x8b
Mar 23 17:32:24 localhost kernel: [465187.707998]  warn_alloc+0x114/0x1c0
Mar 23 17:32:24 localhost kernel: [465187.708001]  __alloc_pages_slowpath+0x954/0xe10
Mar 23 17:32:24 localhost kernel: [465187.708004]  ? update_curr+0x78/0x1c0
Mar 23 17:32:24 localhost kernel: [465187.708007]  ? __blk_run_queue+0x43/0x70
Mar 23 17:32:24 localhost kernel: [465187.708008]  __alloc_pages_nodemask+0x263/0x280
Mar 23 17:32:24 localhost kernel: [465187.708011]  alloc_pages_vma+0x88/0x1e0
Mar 23 17:32:24 localhost kernel: [465187.708014]  __read_swap_cache_async+0x13c/0x1b0
Mar 23 17:32:24 localhost kernel: [465187.708016]  read_swap_cache_async+0x2b/0x60
Mar 23 17:32:24 localhost kernel: [465187.708017]  swapin_readahead+0x13c/0x220
Mar 23 17:32:24 localhost kernel: [465187.708020]  do_swap_page+0x2c5/0x700
Mar 23 17:32:24 localhost kernel: [465187.708021]  ? do_swap_page+0x2c5/0x700
Mar 23 17:32:24 localhost kernel: [465187.708023]  __handle_mm_fault+0x776/0x1080
Mar 23 17:32:24 localhost kernel: [465187.708025]  handle_mm_fault+0xcc/0x1c0
Mar 23 17:32:24 localhost kernel: [465187.708027]  __do_page_fault+0x258/0x4f0
Mar 23 17:32:24 localhost kernel: [465187.708028]  do_page_fault+0x22/0x30
Mar 23 17:32:24 localhost kernel: [465187.708031]  ? page_fault+0x36/0x60
Mar 23 17:32:24 localhost kernel: [465187.708032]  page_fault+0x4c/0x60
Mar 23 17:32:24 localhost kernel: [465187.708034] RIP: 0033:0x7f2e773c6035
Mar 23 17:32:24 localhost kernel: [465187.708035] RSP: 002b:00007f2e7569ecc0 EFLAGS: 00010202
Mar 23 17:32:24 localhost kernel: [465187.708037] RAX: 0000000001692ee0 RBX: 0000000000000020 RCX: 0000000000000000
Mar 23 17:32:24 localhost kernel: [465187.708038] RDX: 00000000015de2c0 RSI: 0000000001692ee0 RDI: 0000000000000020
Mar 23 17:32:24 localhost kernel: [465187.708039] RBP: 00007f2e68002e10 R08: 0000000000000006 R09: 00007f2e7766e8e0
Mar 23 17:32:24 localhost kernel: [465187.708039] R10: 00000000015de2c0 R11: 0000000000000000 R12: 00000000015ec1e0
Mar 23 17:32:24 localhost kernel: [465187.708040] R13: 0000000000000000 R14: 00007f2e68002e10 R15: 00007f2e7793a8b0
Mar 23 17:32:24 localhost kernel: [465187.708042] Mem-Info:
Mar 23 17:32:24 localhost kernel: [465187.708046] active_anon:720034 inactive_anon:144010 isolated_anon:257
Mar 23 17:32:24 localhost kernel: [465187.708046]  active_file:22655 inactive_file:17775 isolated_file:0
Mar 23 17:32:24 localhost kernel: [465187.708046]  unevictable:8 dirty:72 writeback:165 unstable:0
Mar 23 17:32:24 localhost kernel: [465187.708046]  slab_reclaimable:12937 slab_unreclaimable:14457
Mar 23 17:32:24 localhost kernel: [465187.708046]  mapped:88024 shmem:117237 pagetables:16920 bounce:0
Mar 23 17:32:24 localhost kernel: [465187.708046]  free:20899 free_pcp:0 free_cma:0
Mar 23 17:32:24 localhost kernel: [465187.708049] Node 0 active_anon:2880136kB inactive_anon:576040kB active_file:90620kB inactive_file:71100kB unevictable:32kB isolated(anon):1028kB isolated(file):0kB mapped:352096kB dirty:288kB writeback:660kB shmem:468948kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
Mar 23 17:32:24 localhost kernel: [465187.708050] Node 0 DMA free:15364kB min:276kB low:344kB high:412kB active_anon:472kB inactive_anon:20kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15908kB mlocked:0kB kernel_stack:0kB pagetables:12kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 23 17:32:24 localhost kernel: [465187.708053] lowmem_reserve[]: 0 3417 3774 3774 3774
Mar 23 17:32:24 localhost kernel: [465187.708056] Node 0 DMA32 free:62260kB min:60944kB low:76180kB high:91416kB active_anon:2637992kB inactive_anon:522584kB active_file:79636kB inactive_file:62384kB unevictable:32kB writepending:892kB present:3614716kB managed:3549148kB mlocked:32kB kernel_stack:11744kB pagetables:63548kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 23 17:32:24 localhost kernel: [465187.708060] lowmem_reserve[]: 0 0 356 356 356
Mar 23 17:32:24 localhost kernel: [465187.708063] Node 0 Normal free:5972kB min:6360kB low:7948kB high:9536kB active_anon:241572kB inactive_anon:53548kB active_file:11112kB inactive_file:7716kB unevictable:0kB writepending:156kB present:458752kB managed:369812kB mlocked:0kB kernel_stack:1680kB pagetables:4120kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
Mar 23 17:32:24 localhost kernel: [465187.708066] lowmem_reserve[]: 0 0 0 0 0
Mar 23 17:32:24 localhost kernel: [465187.708069] Node 0 DMA: 15*4kB (ME) 7*8kB (M) 3*16kB (UM) 1*32kB (U) 1*64kB (U) 2*128kB (UE) 2*256kB (UE) 2*512kB (ME) 3*1024kB (UME) 1*2048kB (E) 2*4096kB (M) = 15364kB
Mar 23 17:32:24 localhost kernel: [465187.708081] Node 0 DMA32: 896*4kB (UME) 1157*8kB (UME) 1460*16kB (UME) 491*32kB (UME) 149*64kB (UME) 5*128kB (E) 3*256kB (E) 0*512kB 0*1024kB 0*2048kB 0*4096kB = 62856kB
Mar 23 17:32:24 localhost kernel: [465187.708091] Node 0 Normal: 281*4kB (UME) 106*8kB (UMEH) 73*16kB (UMEH) 39*32kB (UEH) 6*64kB (UH) 3*128kB (H) 3*256kB (H) 1*512kB (H) 0*1024kB 0*2048kB 0*4096kB = 6436kB
Mar 23 17:32:24 localhost kernel: [465187.708103] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Mar 23 17:32:24 localhost kernel: [465187.708104] 171368 total pagecache pages
Mar 23 17:32:24 localhost kernel: [465187.708106] 13700 pages in swap cache
Mar 23 17:32:24 localhost kernel: [465187.708107] Swap cache stats: add 6856505, delete 6842809, find 31295974/32789986
Mar 23 17:32:24 localhost kernel: [465187.708107] Free swap  = 1741644kB
Mar 23 17:32:24 localhost kernel: [465187.708108] Total swap = 4089852kB
Mar 23 17:32:24 localhost kernel: [465187.708108] 1022365 pages RAM
Mar 23 17:32:24 localhost kernel: [465187.708109] 0 pages HighMem/MovableOnly
Mar 23 17:32:24 localhost kernel: [465187.708109] 38648 pages reserved
Mar 23 17:32:24 localhost kernel: [465187.708110] 0 pages cma reserved
Mar 23 17:32:24 localhost kernel: [465187.708110] 0 pages hwpoisoned
Upon a post I found on Google I also ran 'iostat -mx'

Code:
sudo iostat -mx
Linux 4.13.0-37-generic (localhost)     03/25/2018  _x86_64_    (2 CPU)
 
avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           8.28    0.04    1.75    5.42    0.00   84.51
 
Device: rrqm/s   wrqm/s     r/s     w/s    rMB/s    wMB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda      10.64    16.17   15.03    6.52     0.31     0.18    46.40     2.66  123.51   22.58  356.31   3.95   8.51
sdb      3.78     0.44    2.67    0.33     0.03     0.02    32.48     0.24   80.91    4.82  689.02   3.19   0.96
SDA is my hard drive and SDB is a 1TB USB drive I use for backups.

Any information as to how I could troubleshoot this would be appreciated.
 
Old 03-28-2018, 08:11 PM   #2
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,153

Rep: Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125
If sdb is a backup drive, why is it active ?. Do you only get the lockup if doing backups ?.
Something(s) is chewing up all your memory, and causing half your swap to be used as well. I'm guessing swap is on sda as well as everything else, so the swap I/O is competing with everything else I/O.
Let me pin the tail on the donkey - java ?.

All wild guesses in the dark mind ...
Have a look at top and see if kswapd is in state "D", or is showing high (any) %CPU - both/either is bad news.
 
1 members found this post helpful.
Old 03-29-2018, 04:12 PM   #3
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
I guess it's always active if it's plugged in, or do you mean something else. The lockups occur very randomly. My backup is done at 2:30am so I wouldn't notice however I do have hourly syslog snippets sent to me via logcheck and if they're larger than normal I do look through them. Yes, everything, swap included is on sda. Not sure what you mean by kswapd being in "D" but here's the output of top:

Code:
top -b -n5 -p39
top - 16:06:44 up  3:57,  1 user,  load average: 0.04, 0.22, 0.29
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  6.8 us,  1.4 sy,  0.0 ni, 87.2 id,  4.5 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   162216 free,  2687164 used,  1085480 buff/cache
KiB Swap:  4089852 total,  3580880 free,   508972 used.   620644 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
   39 root      20   0       0      0      0 S   0.0  0.0   0:04.55 kswapd0

top - 16:06:47 up  3:57,  1 user,  load average: 0.04, 0.22, 0.29
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.2 us,  1.0 sy,  0.0 ni, 97.8 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   161664 free,  2687716 used,  1085480 buff/cache
KiB Swap:  4089852 total,  3580880 free,   508972 used.   620092 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
   39 root      20   0       0      0      0 S   0.0  0.0   0:04.55 kswapd0

top - 16:06:50 up  3:57,  1 user,  load average: 0.04, 0.22, 0.29
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.3 us,  1.0 sy,  0.0 ni, 97.0 id,  0.7 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   161720 free,  2687652 used,  1085488 buff/cache
KiB Swap:  4089852 total,  3580880 free,   508972 used.   620156 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
   39 root      20   0       0      0      0 S   0.0  0.0   0:04.55 kswapd0

top - 16:06:53 up  3:57,  1 user,  load average: 0.04, 0.22, 0.28
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  2.0 us,  1.2 sy,  0.0 ni, 96.7 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   161292 free,  2687976 used,  1085592 buff/cache
KiB Swap:  4089852 total,  3580880 free,   508972 used.   619728 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
   39 root      20   0       0      0      0 S   0.0  0.0   0:04.55 kswapd0

top - 16:06:56 up  3:57,  1 user,  load average: 0.04, 0.22, 0.28
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.0 us,  0.8 sy,  0.0 ni, 97.5 id,  0.7 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   162960 free,  2687980 used,  1083920 buff/cache
KiB Swap:  4089852 total,  3580880 free,   508972 used.   621396 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
   39 root      20   0       0      0      0 S   0.0  0.0   0:04.55 kswapd0
and you mentioned java:

Code:
top -b -n5 -p3098
top - 16:05:31 up  3:56,  1 user,  load average: 0.16, 0.29, 0.32
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  6.8 us,  1.4 sy,  0.0 ni, 87.1 id,  4.5 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   159788 free,  2680084 used,  1094988 buff/cache
KiB Swap:  4089852 total,  3579856 free,   509996 used.   620996 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 3098 chris     20   0 2837128 124360   6596 S   0.0  3.2   0:20.99 java

top - 16:05:34 up  3:56,  1 user,  load average: 0.15, 0.29, 0.32
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.5 us,  1.2 sy,  0.0 ni, 97.3 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   159484 free,  2680388 used,  1094988 buff/cache
KiB Swap:  4089852 total,  3579856 free,   509996 used.   620692 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 3098 chris     20   0 2837128 124360   6596 S   0.0  3.2   0:20.99 java

top - 16:05:37 up  3:56,  1 user,  load average: 0.15, 0.29, 0.32
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.7 us,  0.8 sy,  0.0 ni, 96.0 id,  1.5 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   161152 free,  2680360 used,  1093348 buff/cache
KiB Swap:  4089852 total,  3579856 free,   509996 used.   622360 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 3098 chris     20   0 2837128 124360   6596 S   0.0  3.2   0:20.99 java

top - 16:05:40 up  3:56,  1 user,  load average: 0.14, 0.28, 0.31
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.7 us,  0.7 sy,  0.0 ni, 97.5 id,  0.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   161444 free,  2679960 used,  1093456 buff/cache
KiB Swap:  4089852 total,  3579856 free,   509996 used.   622660 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 3098 chris     20   0 2837128 124360   6596 S   0.0  3.2   0:20.99 java

top - 16:05:43 up  3:56,  1 user,  load average: 0.13, 0.28, 0.31
Tasks:   1 total,   0 running,   1 sleeping,   0 stopped,   0 zombie
%Cpu(s):  1.3 us,  1.0 sy,  0.0 ni, 96.5 id,  1.2 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem :  3934860 total,   160904 free,  2680492 used,  1093464 buff/cache
KiB Swap:  4089852 total,  3579856 free,   509996 used.   622120 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 3098 chris     20   0 2837128 124360   6596 S   0.0  3.2   0:20.99 java
on a side note I had to restart this morning due to the intel-microcode update.
 
Old 03-29-2018, 06:21 PM   #4
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,153

Rep: Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125
The only meaningful data are leading up to, and during, a lockup event. Sysstat should help there.
For kswapd, look under heading for state - you're showing "S" for sleep (which is good) - if you see "D" it is being blocked on disk I/O. That is very bad. Same goes if it is spinning trying to find free pages for whatever is continually requesting memory.
Keep an eye out for things "growing" - as I said, java is always a good bet.

As for the backup drive, I'd be wanting to know what is doing I/O at all. Presuming it really is (only) a backup drive, and not just an extra disk for using anytime.
 
1 members found this post helpful.
Old 03-29-2018, 07:43 PM   #5
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
Thanks, that's what I thought I should look at, state, but wanted to make sure. Not much I can do about java is there? As for the backup drive you nailed it. I do have other files such as my music collection stored on it so you can say it's more than just a backup though rsync does backup to it nightly. I'll do some reading up on Sysstat, sa2 and sar.

Thank very much for your help and advice.
 
Old 03-29-2018, 08:27 PM   #6
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,153

Rep: Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125
Just re-read and noticed USB - slow writing to USB is not just a function of USB itself, but the way the kernel buffers up dirty pages for write-out. You might like to try this to reduce the effect - just set it back to zero to reset, or reboot. See if the lockout go away with this set.
Code:
sudo su -c "echo 10000000 > /proc/sys/vm/dirty_bytes"
 
1 members found this post helpful.
Old 03-29-2018, 09:15 PM   #7
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
Ran it as you posted, syslog shows

Code:
Mar 29 20:54:27 localhost systemd[1]: Created slice User Slice of root.
Mar 29 20:54:28 localhost systemd[1]: Starting User Manager for UID 0...
Mar 29 20:54:28 localhost systemd[1]: Started Session c2 of user root.
Mar 29 20:54:31 localhost systemd[2049]: Starting D-Bus User Message Bus Socket.
Mar 29 20:54:31 localhost systemd[2049]: Reached target Paths.
Mar 29 20:54:31 localhost systemd[2049]: Reached target Timers.
Mar 29 20:54:31 localhost systemd[2049]: Listening on D-Bus User Message Bus Socket.
Mar 29 20:54:31 localhost systemd[2049]: Reached target Sockets.
Mar 29 20:54:31 localhost systemd[2049]: Reached target Basic System.
Mar 29 20:54:31 localhost systemd[2049]: Reached target Default.
Mar 29 20:54:31 localhost systemd[2049]: Startup finished in 1.779s.
Mar 29 20:54:31 localhost systemd[1]: Started User Manager for UID 0.
Mar 29 20:54:37 localhost systemd[1]: Stopping User Manager for UID 0...
Mar 29 20:54:37 localhost systemd[2049]: Stopped target Default.
Mar 29 20:54:37 localhost systemd[2049]: Stopped target Basic System.
Mar 29 20:54:37 localhost systemd[2049]: Stopped target Sockets.
Mar 29 20:54:37 localhost systemd[2049]: Stopped target Paths.
Mar 29 20:54:38 localhost systemd[2049]: Closed D-Bus User Message Bus Socket.
Mar 29 20:54:38 localhost systemd[2049]: Reached target Shutdown.
Mar 29 20:54:38 localhost systemd[2049]: Starting Exit the Session...
Mar 29 20:54:38 localhost systemd[2049]: Stopped target Timers.
Mar 29 20:54:38 localhost systemd[2049]: Received SIGRTMIN+24 from PID 2144 (kill).
Mar 29 20:54:38 localhost systemd[1]: Stopped User Manager for UID 0.
Mar 29 20:54:38 localhost systemd[1]: Removed slice User Slice of root.
If this works can I setup a cronjob that will run the command as you wrote it on boot?
 
Old 03-29-2018, 10:02 PM   #8
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,153

Rep: Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125
It's just a standard sysctl - depends on how Ubuntu do it now with systemd. I'd be guessing /etc/sysctl.conf still.
Code:
vm.dirty_bytes = 10000000
Then "sudo sysctl -p" or a reboot will make it permanent.
 
1 members found this post helpful.
Old 03-30-2018, 08:06 AM   #9
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
Hmm, the command

Code:
vm.dirty_bytes = 10000000
sudo su vm.dirty_bytes = 10000000
[sudo] password for chris: 
No passwd entry for user 'vm.dirty_bytes'
I do have a /etc/systemd/system.conf

Code:
#  This file is part of systemd.
#
#  systemd is free software; you can redistribute it and/or modify it
#  under the terms of the GNU Lesser General Public License as published by
#  the Free Software Foundation; either version 2.1 of the License, or
#  (at your option) any later version.
#
# Entries in this file show the compile time defaults.
# You can change settings by editing this file.
# Defaults can be restored by simply deleting this file.
#
# See systemd-system.conf(5) for details.

[Manager]
#LogLevel=info
#LogTarget=journal-or-kmsg
#LogColor=yes
#LogLocation=no
#DumpCore=yes
#ShowStatus=yes
#CrashChangeVT=no
#CrashShell=no
#CrashReboot=no
#CPUAffinity=1 2
#JoinControllers=cpu,cpuacct net_cls,net_prio
#RuntimeWatchdogSec=0
#ShutdownWatchdogSec=10min
#CapabilityBoundingSet=
#SystemCallArchitectures=
#TimerSlackNSec=
#DefaultTimerAccuracySec=1min
#DefaultStandardOutput=journal
#DefaultStandardError=inherit
#DefaultTimeoutStartSec=90s
#DefaultTimeoutStopSec=90s
#DefaultRestartSec=100ms
#DefaultStartLimitInterval=10s
#DefaultStartLimitBurst=5
#DefaultEnvironment=
#DefaultCPUAccounting=no
#DefaultBlockIOAccounting=no
#DefaultMemoryAccounting=no
#DefaultTasksAccounting=no
#DefaultTasksMax=
#DefaultLimitCPU=
#DefaultLimitFSIZE=
#DefaultLimitDATA=
#DefaultLimitSTACK=
#DefaultLimitCORE=
#DefaultLimitRSS=
#DefaultLimitNOFILE=
#DefaultLimitAS=
#DefaultLimitNPROC=
#DefaultLimitMEMLOCK=
#DefaultLimitLOCKS=
#DefaultLimitSIGPENDING=
#DefaultLimitMSGQUEUE=
#DefaultLimitNICE=
#DefaultLimitRTPRIO=
#DefaultLimitRTTIME=
Although I'm not sure if the above configuration file has anything at all to do with this.
 
Old 03-30-2018, 06:05 PM   #10
syg00
LQ Veteran
 
Registered: Aug 2003
Location: Australia
Distribution: Lots ...
Posts: 21,153

Rep: Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125Reputation: 4125
Quote:
Originally Posted by myself
I'd be guessing /etc/sysctl.conf still.
That was a line to be added to the relevant file. It used to be sysctl.conf, but under systemd the function has moved. Ubuntu may still be supporting its use for backward compatibility, I don't know. You'd need to investigate that.

/etc/systemd/system.conf is not relevant in this context.
 
1 members found this post helpful.
Old 03-30-2018, 08:55 PM   #11
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
Doing a lot of Googling this evening after your last reply I finally found that if I run

Code:
sysctl -a | grep dirty
sysctl: permission denied on key 'fs.protected_hardlinks'
sysctl: permission denied on key 'fs.protected_symlinks'
sysctl: permission denied on key 'kernel.cad_pid'
sysctl: permission denied on key 'kernel.unprivileged_userns_apparmor_policy'
sysctl: permission denied on key 'kernel.usermodehelper.bset'
sysctl: permission denied on key 'kernel.usermodehelper.inheritable'
sysctl: permission denied on key 'net.core.bpf_jit_harden'
sysctl: permission denied on key 'net.core.bpf_jit_kallsyms'
sysctl: permission denied on key 'net.ipv4.tcp_fastopen_key'
sysctl: permission denied on key 'net.ipv6.conf.all.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.default.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.eth0.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.lo.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.virbr0.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.virbr0-nic.stable_secret'
sysctl: permission denied on key 'vm.mmap_rnd_bits'
sysctl: permission denied on key 'vm.mmap_rnd_compat_bits'
sysctl: permission denied on key 'vm.stat_refresh'
vm.dirty_background_bytes = 0
vm.dirty_background_ratio = 10
vm.dirty_bytes = 10000000
vm.dirty_expire_centisecs = 3000
vm.dirty_ratio = 0
vm.dirty_writeback_centisecs = 500
vm.dirtytime_expire_seconds = 43200
Now whether the vm.dirty_bytes was always set to that I really don't know but I doubt it. I imagine that running

Code:
sudo su -c "echo 10000000 > /proc/sys/vm/dirty_bytes"
as you suggested made the change. Just now I ran sudo sysctl -p and notice that the time stamp for

Code:
Mar 30 20:41 dirty_bytes
cat dirty_bytes
10000000
So far since I made this change yesterday I've seen none of the lock-ups.
 
Old 03-30-2018, 09:19 PM   #12
Toadman
Member
 
Registered: Aug 2002
Location: Copperas Cove, Texas
Distribution: Ubuntu 20.04 LTS
Posts: 304

Original Poster
Rep: Reputation: 21
Doing a lot of Googling this evening after your last reply I finally found that if I run

Code:
sysctl -a | grep dirty
sysctl: permission denied on key 'fs.protected_hardlinks'
sysctl: permission denied on key 'fs.protected_symlinks'
sysctl: permission denied on key 'kernel.cad_pid'
sysctl: permission denied on key 'kernel.unprivileged_userns_apparmor_policy'
sysctl: permission denied on key 'kernel.usermodehelper.bset'
sysctl: permission denied on key 'kernel.usermodehelper.inheritable'
sysctl: permission denied on key 'net.core.bpf_jit_harden'
sysctl: permission denied on key 'net.core.bpf_jit_kallsyms'
sysctl: permission denied on key 'net.ipv4.tcp_fastopen_key'
sysctl: permission denied on key 'net.ipv6.conf.all.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.default.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.eth0.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.lo.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.virbr0.stable_secret'
sysctl: permission denied on key 'net.ipv6.conf.virbr0-nic.stable_secret'
sysctl: permission denied on key 'vm.mmap_rnd_bits'
sysctl: permission denied on key 'vm.mmap_rnd_compat_bits'
sysctl: permission denied on key 'vm.stat_refresh'
vm.dirty_background_bytes = 0
vm.dirty_background_ratio = 10
vm.dirty_bytes = 10000000
vm.dirty_expire_centisecs = 3000
vm.dirty_ratio = 0
vm.dirty_writeback_centisecs = 500
vm.dirtytime_expire_seconds = 43200
Now whether the vm.dirty_bytes was always set to that I really don't know but I doubt it. I imagine that running

Code:
sudo su -c "echo 10000000 > /proc/sys/vm/dirty_bytes"
as you suggested made the change. Just now I ran sudo sysctl -p and notice that the time stamp for

Code:
Mar 30 20:41 dirty_bytes
cat dirty_bytes
10000000
So far since I made this change yesterday I've seen none of the lock-ups.
Last edited by Toadman; 03-30-2018 at 09:21 PM.
 
  


Reply



Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts
BB code is On
Smilies are On
[IMG] code is Off
HTML code is Off


Similar Threads
Thread Thread Starter Forum Replies Last Post
What solution for "info: task shutdown:4947 blocked for more than 120 seconds." ahm_anw83 Linux - Enterprise 1 09-12-2015 07:42 AM
INFO : task events/2:69 blocked for more than 120 seconds ttinvent Linux - Server 5 12-29-2014 03:12 AM
Task blocked for more than 120 seconds errors and crashes Red Squirrel Linux - Server 17 04-01-2014 01:12 PM
kernel: INFO: task gzip:28803 blocked for more than 120 seconds nallanisai Red Hat 3 01-16-2013 06:48 AM
Task blocked for more than 120 seconds errors and crashes sanjay87 Linux - Server 3 06-19-2012 01:51 AM

LinuxQuestions.org > Forums > Linux Forums > Linux - Distributions > Ubuntu

All times are GMT -5. The time now is 03:02 PM.

Contact Us - Advertising Info - Rules - Privacy - LQ Merchandise - Donations - Contributing Member - LQ Sitemap -
Main Menu
Advertisement
My LQ
Write for LQ
LinuxQuestions.org is looking for people interested in writing Editorials, Articles, Reviews, and more. If you'd like to contribute content, let us know.
Main Menu
Syndicate
RSS1  Latest Threads
RSS1  LQ News
Twitter: @linuxquestions
Open Source Consulting | Domain Registration