Running on Debian Buster with Kernel 5.2.11, DRBD, Xen 4.11.2-pre. No problems on the other Node with Intel Core i3 550.Did stress test on the NUC without xen on mem and cpu without any messages. Messages starts when VM is on the node.Doesn't matter if this is hvm or pv.... Also changed Kernel >4.19... Message comes every few minutes and the node run into load over 14 in a few hours...
Sep 3 08:01:09 dmw02 kernel: [42937.912115] ------------[ cut here ]------------
Sep 3 08:01:09 dmw02 kernel: [42937.912137] WARNING: CPU: 1 PID: 4058 at arch/x86/mm/tlb.c:148 leave_mm.cold.15+0xc/0x13
Sep 3 08:01:09 dmw02 kernel: [42937.912139] Modules linked in: xen_netback(E) loop(E) xen_blkback(E) gfs2(E) drbd(E) lru_cache(E) nf_tables(E) nfnetlink(E) dlm(E) bridge(E) stp(E) llc(E) intel_rapl(E) crct10dif_pclmul(E) xen_gntdev(E) xen_evtchn(E) xenfs(E) crc32_pclmul(E) xen_privcmd(E) ipmi_devintf(E) ipmi_msghandler(E) ghash_clmulni_intel(E) cdc_ether(E) usbnet(E) r8152(E) mii(E) aesni_intel(E) aes_x86_64(E) crypto_simd(E) cryptd(E) glue_helper(E) wdat_wdt(E) watchdog(E) intel_rapl_perf(E) snd_pcm(E) snd_timer(E) snd(E) soundcore(E) serio_raw(E) wmi_bmof(E) pcspkr(E) spi_pxa2xx_platform(E) dw_dmac(E) dw_dmac_core(E) i915(E) idma64(E) joydev(E) drm_kms_helper(E) evdev(E) mei_me(E) drm(E) sg(E) mei(E) i2c_algo_bit(E) tpm_crb(E) tpm_tis(E) tpm_tis_core(E) tpm(E) rng_core(E) button(E) binfmt_misc(E) dm_mod(E) configfs(E) ip_tables(E) x_tables(E) autofs4(E) ext4(E) crc16(E) mbcache(E) jbd2(E) raid456(E) async_raid6_recov(E) async_memcpy(E) async_pq(E) async_xor(E) async_tx(E) xor(E) raid6_pq(E) libcrc32c(E)
Sep 3 08:01:09 dmw02 kernel: [42937.912198] crc32c_generic(E) hid_generic(E) raid1(E) usbhid(E) hid(E) raid0(E) multipath(E) linear(E) raid10(E) md_mod(E) sd_mod(E) i2c_designware_platform(E) i2c_designware_core(E) crc32c_intel(E) psmouse(E) ahci(E) xhci_pci(E) libahci(E) i2c_i801(E) lpc_ich(E) xhci_hcd(E) r8169(E) libata(E) realtek(E) libphy(E) intel_lpss_pci(E) intel_lpss(E) mfd_core(E) usbcore(E) scsi_mod(E) fan(E) wmi(E) video(E)
Sep 3 08:01:09 dmw02 kernel: [42937.912228] CPU: 1 PID: 4058 Comm: kworker/1:3 Tainted: G W E 5.2.11 #1
Sep 3 08:01:09 dmw02 kernel: [42937.912229] Hardware name: Intel(R) Client Systems NUC6CAYH/NUC6CAYB, BIOS AYAPLCEL.86A.0063.2019.0621.1450 06/21/2019
Sep 3 08:01:09 dmw02 kernel: [42937.912236] Workqueue: events netstamp_clear
Sep 3 08:01:09 dmw02 kernel: [42937.912240] RIP: e030:leave_mm.cold.15+0xc/0x13
Sep 3 08:01:09 dmw02 kernel: [42937.912243] Code: fa ff 66 90 be 02 00 00 00 48 c7 c7 40 89 c0 81 e8 04 f9 ff ff e8 8f eb fa ff 66 90 eb 94 48 c7 c7 58 ab e5 81 e8 dd 76 07 00 <0f> 0b e9 cc f8 ff ff 48 c7 c7 58 ab e5 81 e8 ca 76 07 00 0f 0b e9
Sep 3 08:01:09 dmw02 kernel: [42937.912245] RSP: e02b:ffffc90040258e88 EFLAGS: 00010046
Sep 3 08:01:09 dmw02 kernel: [42937.912247] RAX: 0000000000000024 RBX: ffff88803a6d3fc0 RCX: 0000000000000000
Sep 3 08:01:09 dmw02 kernel: [42937.912249] RDX: 0000000000000000 RSI: ffff888041e97688 RDI: ffff888041e97688
Sep 3 08:01:09 dmw02 kernel: [42937.912250] RBP: ffffffff8101a1b0 R08: 00000000000018a3 R09: 0000000000000004
Sep 3 08:01:09 dmw02 kernel: [42937.912251] R10: 0000000000000000 R11: 0000000000000001 R12: ffff88803a6d3fc0
Sep 3 08:01:09 dmw02 kernel: [42937.912253] R13: 0000000000000000 R14: ffffffff81e5ab58 R15: ffff888041ea857c
Sep 3 08:01:09 dmw02 kernel: [42937.912274] FS: 00007f0a90105740(0000) GS:ffff888041e80000(0000) knlGS:0000000000000000
Sep 3 08:01:09 dmw02 kernel: [42937.912276] CS: 10000e030 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 3 08:01:09 dmw02 kernel: [42937.912278] CR2: 00007f0a902dd9f0 CR3: 00000000024dc000 CR4: 0000000000040660
Sep 3 08:01:09 dmw02 kernel: [42937.912283] Call Trace:
Sep 3 08:01:09 dmw02 kernel: [42937.912288] <IRQ>
Sep 3 08:01:09 dmw02 kernel: [42937.912292] drop_mm_ref_this_cpu+0x53/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912300] flush_smp_call_function_queue+0x48/0x100
Sep 3 08:01:09 dmw02 kernel: [42937.912305] xen_call_function_single_interrupt+0xf/0x30
Sep 3 08:01:09 dmw02 kernel: [42937.912310] __handle_irq_event_percpu+0x46/0x190
Sep 3 08:01:09 dmw02 kernel: [42937.912314] handle_irq_event_percpu+0x30/0x80
Sep 3 08:01:09 dmw02 kernel: [42937.912317] handle_percpu_irq+0x40/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912320] generic_handle_irq+0x27/0x30
Sep 3 08:01:09 dmw02 kernel: [42937.912326] __evtchn_fifo_handle_events+0x17d/0x190
Sep 3 08:01:09 dmw02 kernel: [42937.912330] __xen_evtchn_do_upcall+0x42/0x80
Sep 3 08:01:09 dmw02 kernel: [42937.912334] xen_evtchn_do_upcall+0x27/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912338] xen_do_hypervisor_callback+0x29/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912340] </IRQ>
Sep 3 08:01:09 dmw02 kernel: [42937.912343] RIP: e030:smp_call_function_many+0x1f8/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912346] Code: c7 e8 6c 0e 63 00 3b 05 aa 0f 00 01 0f 83 8c fe ff ff 48 63 d0 48 8b 0b 48 03 0c d5 60 ba f0 81 8b 51 18 83 e2 01 74 0a f3 90 <8b> 51 18 83 e2 01 75 f6 eb c8 48 c7 c2 c0 03 12 82 4c 89 fe 89 df
Sep 3 08:01:09 dmw02 kernel: [42937.912347] RSP: e02b:ffffc90040dfbd70 EFLAGS: 00000202
Sep 3 08:01:09 dmw02 kernel: [42937.912349] RAX: 0000000000000002 RBX: ffff888041eaafc0 RCX: ffff888041f2f4c0
Sep 3 08:01:09 dmw02 kernel: [42937.912351] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff888041eaafc8
Sep 3 08:01:09 dmw02 kernel: [42937.912352] RBP: ffff888041eaafc8 R08: 0000000000000000 R09: ffff88804144fbf0
Sep 3 08:01:09 dmw02 kernel: [42937.912353] R10: 0000000000000000 R11: ffffffff8204eda8 R12: ffffffff8102f7c0
Sep 3 08:01:09 dmw02 kernel: [42937.912354] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000200
Sep 3 08:01:09 dmw02 kernel: [42937.912358] ? poke_int3_handler+0x40/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912363] ? dev_queue_xmit_nit+0xf3/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912365] ? poke_int3_handler+0x40/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912368] ? dev_queue_xmit_nit+0xf4/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912370] on_each_cpu+0x28/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912373] ? dev_queue_xmit_nit+0xf3/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912375] text_poke_bp+0xb5/0xdc
Sep 3 08:01:09 dmw02 kernel: [42937.912380] __jump_label_transform+0x108/0x110
Sep 3 08:01:09 dmw02 kernel: [42937.912383] arch_jump_label_transform+0x24/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912388] __jump_label_update+0x75/0xe0
Sep 3 08:01:09 dmw02 kernel: [42937.912392] static_key_enable_cpuslocked+0x57/0x90
Sep 3 08:01:09 dmw02 kernel: [42937.912395] static_key_enable+0x16/0x20
Sep 3 08:01:09 dmw02 kernel: [42937.912398] process_one_work+0x1a7/0x3b0
Sep 3 08:01:09 dmw02 kernel: [42937.912401] worker_thread+0x30/0x390
Sep 3 08:01:09 dmw02 kernel: [42937.912404] ? create_worker+0x1a0/0x1a0
Sep 3 08:01:09 dmw02 kernel: [42937.912406] kthread+0x112/0x130
Sep 3 08:01:09 dmw02 kernel: [42937.912409] ? __kthread_parkme+0x70/0x70
Sep 3 08:01:09 dmw02 kernel: [42937.912411] ret_from_fork+0x35/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912416] ---[ end trace 0d2295a5a1956628 ]---
Sep 3 08:01:09 dmw02 kernel: [42937.912115] ------------[ cut here ]------------
Sep 3 08:01:09 dmw02 kernel: [42937.912137] WARNING: CPU: 1 PID: 4058 at arch/x86/mm/tlb.c:148 leave_mm.cold.15+0xc/0x13
Sep 3 08:01:09 dmw02 kernel: [42937.912139] Modules linked in: xen_netback(E) loop(E) xen_blkback(E) gfs2(E) drbd(E) lru_cache(E) nf_tables(E) nfnetlink(E) dlm(E) bridge(E) stp(E) llc(E) intel_rapl(E) crct10dif_pclmul(E) xen_gntdev(E) xen_evtchn(E) xenfs(E) crc32_pclmul(E) xen_privcmd(E) ipmi_devintf(E) ipmi_msghandler(E) ghash_clmulni_intel(E) cdc_ether(E) usbnet(E) r8152(E) mii(E) aesni_intel(E) aes_x86_64(E) crypto_simd(E) cryptd(E) glue_helper(E) wdat_wdt(E) watchdog(E) intel_rapl_perf(E) snd_pcm(E) snd_timer(E) snd(E) soundcore(E) serio_raw(E) wmi_bmof(E) pcspkr(E) spi_pxa2xx_platform(E) dw_dmac(E) dw_dmac_core(E) i915(E) idma64(E) joydev(E) drm_kms_helper(E) evdev(E) mei_me(E) drm(E) sg(E) mei(E) i2c_algo_bit(E) tpm_crb(E) tpm_tis(E) tpm_tis_core(E) tpm(E) rng_core(E) button(E) binfmt_misc(E) dm_mod(E) configfs(E) ip_tables(E) x_tables(E) autofs4(E) ext4(E) crc16(E) mbcache(E) jbd2(E) raid456(E) async_raid6_recov(E) async_memcpy(E) async_pq(E) async_xor(E) async_tx(E) xor(E) raid6_pq(E) libcrc32c(E)
Sep 3 08:01:09 dmw02 kernel: [42937.912198] crc32c_generic(E) hid_generic(E) raid1(E) usbhid(E) hid(E) raid0(E) multipath(E) linear(E) raid10(E) md_mod(E) sd_mod(E) i2c_designware_platform(E) i2c_designware_core(E) crc32c_intel(E) psmouse(E) ahci(E) xhci_pci(E) libahci(E) i2c_i801(E) lpc_ich(E) xhci_hcd(E) r8169(E) libata(E) realtek(E) libphy(E) intel_lpss_pci(E) intel_lpss(E) mfd_core(E) usbcore(E) scsi_mod(E) fan(E) wmi(E) video(E)
Sep 3 08:01:09 dmw02 kernel: [42937.912228] CPU: 1 PID: 4058 Comm: kworker/1:3 Tainted: G W E 5.2.11 #1
Sep 3 08:01:09 dmw02 kernel: [42937.912229] Hardware name: Intel(R) Client Systems NUC6CAYH/NUC6CAYB, BIOS AYAPLCEL.86A.0063.2019.0621.1450 06/21/2019
Sep 3 08:01:09 dmw02 kernel: [42937.912236] Workqueue: events netstamp_clear
Sep 3 08:01:09 dmw02 kernel: [42937.912240] RIP: e030:leave_mm.cold.15+0xc/0x13
Sep 3 08:01:09 dmw02 kernel: [42937.912243] Code: fa ff 66 90 be 02 00 00 00 48 c7 c7 40 89 c0 81 e8 04 f9 ff ff e8 8f eb fa ff 66 90 eb 94 48 c7 c7 58 ab e5 81 e8 dd 76 07 00 <0f> 0b e9 cc f8 ff ff 48 c7 c7 58 ab e5 81 e8 ca 76 07 00 0f 0b e9
Sep 3 08:01:09 dmw02 kernel: [42937.912245] RSP: e02b:ffffc90040258e88 EFLAGS: 00010046
Sep 3 08:01:09 dmw02 kernel: [42937.912247] RAX: 0000000000000024 RBX: ffff88803a6d3fc0 RCX: 0000000000000000
Sep 3 08:01:09 dmw02 kernel: [42937.912249] RDX: 0000000000000000 RSI: ffff888041e97688 RDI: ffff888041e97688
Sep 3 08:01:09 dmw02 kernel: [42937.912250] RBP: ffffffff8101a1b0 R08: 00000000000018a3 R09: 0000000000000004
Sep 3 08:01:09 dmw02 kernel: [42937.912251] R10: 0000000000000000 R11: 0000000000000001 R12: ffff88803a6d3fc0
Sep 3 08:01:09 dmw02 kernel: [42937.912253] R13: 0000000000000000 R14: ffffffff81e5ab58 R15: ffff888041ea857c
Sep 3 08:01:09 dmw02 kernel: [42937.912274] FS: 00007f0a90105740(0000) GS:ffff888041e80000(0000) knlGS:0000000000000000
Sep 3 08:01:09 dmw02 kernel: [42937.912276] CS: 10000e030 DS: 0000 ES: 0000 CR0: 0000000080050033
Sep 3 08:01:09 dmw02 kernel: [42937.912278] CR2: 00007f0a902dd9f0 CR3: 00000000024dc000 CR4: 0000000000040660
Sep 3 08:01:09 dmw02 kernel: [42937.912283] Call Trace:
Sep 3 08:01:09 dmw02 kernel: [42937.912288] <IRQ>
Sep 3 08:01:09 dmw02 kernel: [42937.912292] drop_mm_ref_this_cpu+0x53/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912300] flush_smp_call_function_queue+0x48/0x100
Sep 3 08:01:09 dmw02 kernel: [42937.912305] xen_call_function_single_interrupt+0xf/0x30
Sep 3 08:01:09 dmw02 kernel: [42937.912310] __handle_irq_event_percpu+0x46/0x190
Sep 3 08:01:09 dmw02 kernel: [42937.912314] handle_irq_event_percpu+0x30/0x80
Sep 3 08:01:09 dmw02 kernel: [42937.912317] handle_percpu_irq+0x40/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912320] generic_handle_irq+0x27/0x30
Sep 3 08:01:09 dmw02 kernel: [42937.912326] __evtchn_fifo_handle_events+0x17d/0x190
Sep 3 08:01:09 dmw02 kernel: [42937.912330] __xen_evtchn_do_upcall+0x42/0x80
Sep 3 08:01:09 dmw02 kernel: [42937.912334] xen_evtchn_do_upcall+0x27/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912338] xen_do_hypervisor_callback+0x29/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912340] </IRQ>
Sep 3 08:01:09 dmw02 kernel: [42937.912343] RIP: e030:smp_call_function_many+0x1f8/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912346] Code: c7 e8 6c 0e 63 00 3b 05 aa 0f 00 01 0f 83 8c fe ff ff 48 63 d0 48 8b 0b 48 03 0c d5 60 ba f0 81 8b 51 18 83 e2 01 74 0a f3 90 <8b> 51 18 83 e2 01 75 f6 eb c8 48 c7 c2 c0 03 12 82 4c 89 fe 89 df
Sep 3 08:01:09 dmw02 kernel: [42937.912347] RSP: e02b:ffffc90040dfbd70 EFLAGS: 00000202
Sep 3 08:01:09 dmw02 kernel: [42937.912349] RAX: 0000000000000002 RBX: ffff888041eaafc0 RCX: ffff888041f2f4c0
Sep 3 08:01:09 dmw02 kernel: [42937.912351] RDX: 0000000000000001 RSI: 0000000000000000 RDI: ffff888041eaafc8
Sep 3 08:01:09 dmw02 kernel: [42937.912352] RBP: ffff888041eaafc8 R08: 0000000000000000 R09: ffff88804144fbf0
Sep 3 08:01:09 dmw02 kernel: [42937.912353] R10: 0000000000000000 R11: ffffffff8204eda8 R12: ffffffff8102f7c0
Sep 3 08:01:09 dmw02 kernel: [42937.912354] R13: 0000000000000000 R14: 0000000000000001 R15: 0000000000000200
Sep 3 08:01:09 dmw02 kernel: [42937.912358] ? poke_int3_handler+0x40/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912363] ? dev_queue_xmit_nit+0xf3/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912365] ? poke_int3_handler+0x40/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912368] ? dev_queue_xmit_nit+0xf4/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912370] on_each_cpu+0x28/0x60
Sep 3 08:01:09 dmw02 kernel: [42937.912373] ? dev_queue_xmit_nit+0xf3/0x250
Sep 3 08:01:09 dmw02 kernel: [42937.912375] text_poke_bp+0xb5/0xdc
Sep 3 08:01:09 dmw02 kernel: [42937.912380] __jump_label_transform+0x108/0x110
Sep 3 08:01:09 dmw02 kernel: [42937.912383] arch_jump_label_transform+0x24/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912388] __jump_label_update+0x75/0xe0
Sep 3 08:01:09 dmw02 kernel: [42937.912392] static_key_enable_cpuslocked+0x57/0x90
Sep 3 08:01:09 dmw02 kernel: [42937.912395] static_key_enable+0x16/0x20
Sep 3 08:01:09 dmw02 kernel: [42937.912398] process_one_work+0x1a7/0x3b0
Sep 3 08:01:09 dmw02 kernel: [42937.912401] worker_thread+0x30/0x390
Sep 3 08:01:09 dmw02 kernel: [42937.912404] ? create_worker+0x1a0/0x1a0
Sep 3 08:01:09 dmw02 kernel: [42937.912406] kthread+0x112/0x130
Sep 3 08:01:09 dmw02 kernel: [42937.912409] ? __kthread_parkme+0x70/0x70
Sep 3 08:01:09 dmw02 kernel: [42937.912411] ret_from_fork+0x35/0x40
Sep 3 08:01:09 dmw02 kernel: [42937.912416] ---[ end trace 0d2295a5a1956628 ]---