Mailing List Archive

On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:

> Morning,
>
> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>
> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
> secondary and after a reboot was greeted with a
>
> drbdadm status
> r0 role:Secondary
> disk:Diskless
>
> Looking at /proc/drbd I noticed it still had the previous version listed
>
> cat /proc/drbd
> version: 9.1.13 (api:2/proto:86-121)
> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
> mockbuild@, 2023-01-30 18:33:50
> Transports (api:18):
>
> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and
> now back and working with /proc/drbd showing the correct version.
>
> cat /proc/drbd
> version: 9.1.14 (api:2/proto:86-121)
> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
> 2023-04-08 19:54:28
> Transports (api:18): tcp (9.1.14)
>
> Did I miss a step on the upgrade, should I have brought drbd down first
> (it was set to secondary) or intitally booted into an earlier kernel first
> before the upgrade?
>
> Best Regards,
> Nigel
>

You installed the kmod package built for el9 on your el8 system. Please try
installing kmod-drbd90 for el8.

Akemi

Akemi,

Sorry syntax in email, did a copy and paste of the new update package name from the release email rather than from installed system package names. Actual system installed files are correct though, so the original problem does unfortunately still exist.

$dnf list --installed | grep drbd
drbd90-utils.x86_64 9.23.1-1.el8.elrepo @elrepo
kmod-drbd90.x86_64 9.1.14-1.el8_7.elrepo @elrepo

Best Regards,
Nigel



On 14 April 2023 10:28:42 IST, Akemi Yagi <toracat@elrepo.org> wrote:
>On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>
>> Morning,
>>
>> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>>
>> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
>> secondary and after a reboot was greeted with a
>>
>> drbdadm status
>> r0 role:Secondary
>> disk:Diskless
>>
>> Looking at /proc/drbd I noticed it still had the previous version listed
>>
>> cat /proc/drbd
>> version: 9.1.13 (api:2/proto:86-121)
>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
>> mockbuild@, 2023-01-30 18:33:50
>> Transports (api:18):
>>
>> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and
>> now back and working with /proc/drbd showing the correct version.
>>
>> cat /proc/drbd
>> version: 9.1.14 (api:2/proto:86-121)
>> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
>> 2023-04-08 19:54:28
>> Transports (api:18): tcp (9.1.14)
>>
>> Did I miss a step on the upgrade, should I have brought drbd down first
>> (it was set to secondary) or intitally booted into an earlier kernel first
>> before the upgrade?
>>
>> Best Regards,
>> Nigel
>>
>
>You installed the kmod package built for el9 on your el8 system. Please try
>installing kmod-drbd90 for el8.
>
>Akemi

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Hi Nigel,

Can you show the output from:

$ find /lib/modules -name drbd.ko

Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens? Do
you still see version: 9.1.13?

Akemi

On Fri, Apr 14, 2023 at 4:53?AM Nigel Phillips <nigel@ntalk.ie> wrote:

> Akemi,
>
> Sorry syntax in email, did a copy and paste of the new update package name
> from the release email rather than from installed system package names.
> Actual system installed files are correct though, so the original problem
> does unfortunately still exist.
>
> $dnf list --installed | grep drbd
> drbd90-utils.x86_64
> 9.23.1-1.el8.elrepo @elrepo
> kmod-drbd90.x86_64
> 9.1.14-1.el8_7.elrepo @elrepo
>
> Best Regards,
> Nigel
>
>
>
> On 14 April 2023 10:28:42 IST, Akemi Yagi <toracat@elrepo.org> wrote:
>>
>> On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>
>>> Morning,
>>>
>>> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>>>
>>> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
>>> secondary and after a reboot was greeted with a
>>>
>>> drbdadm status
>>> r0 role:Secondary
>>> disk:Diskless
>>>
>>> Looking at /proc/drbd I noticed it still had the previous version listed
>>>
>>> cat /proc/drbd
>>> version: 9.1.13 (api:2/proto:86-121)
>>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
>>> mockbuild@, 2023-01-30 18:33:50
>>> Transports (api:18):
>>>
>>> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and
>>> now back and working with /proc/drbd showing the correct version.
>>>
>>> cat /proc/drbd
>>> version: 9.1.14 (api:2/proto:86-121)
>>> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
>>> 2023-04-08 19:54:28
>>> Transports (api:18): tcp (9.1.14)
>>>
>>> Did I miss a step on the upgrade, should I have brought drbd down first
>>> (it was set to secondary) or intitally booted into an earlier kernel first
>>> before the upgrade?
>>>
>>> Best Regards,
>>> Nigel
>>>
>>
>> You installed the kmod package built for el9 on your el8 system. Please
>> try installing kmod-drbd90 for el8.
>>
>> Akemi
>>
> --
> Sent from my Android device with K-9 Mail. Please excuse my brevity.
>

Akemi,

Current values, reboot to new kernel, then values again in steps below. And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd

$ uname -r
4.18.0-425.13.1.el8_7.x86_64

$ drbdadm status
r0 role:Secondary
disk:UpToDate
vmstorage1-telecity role:Primary
peer-disk:UpToDate

$ find /lib/modules -name drbd.ko
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko

$ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"

$shutdown -r now

$uname -r
4.18.0-425.19.2.el8_7.x86_64

$drbdadm status
r0 role:Secondary
disk:Diskless

$ find /lib/modules -name drbd.ko
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko

$ cat /proc/drbd
version: 9.1.13 (api:2/proto:86-121)
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50
Transports (api:18):

Also some symbol errors from dmesg with newer kernel

[Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from drbdsetup [2088])
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_find_path_by_addr
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_find_path_by_addr (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_get_listener
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_get_listener (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_stream_send_timed_out
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_stream_send_timed_out (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_register_transport_class
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_register_transport_class (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_should_abort_listening
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_should_abort_listening (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_put_listener
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_put_listener (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_path_event
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_path_event (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_free_pages
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_free_pages (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_unregister_transport_class
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_unregister_transport_class (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_alloc_pages
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_alloc_pages (err -22)



Nigel




Nigel Phillips | IT Consultant

Tel: (+353) 86 6057580
Skype: live:nigel_2260

www.ntalk.ie | nigel@ntalk.ie


From: "Akemi Yagi" <toracat@elrepo.org>
To: "Nigel Phillips" <nigel@ntalk.ie>
Cc: "drbd-user" <drbd-user@lists.linbit.com>
Sent: Friday, 14 April, 2023 16:05:30
Subject: Re: [DRBD-user] 9.1.14 upgrade issue

Hi Nigel,

Can you show the output from:

$ find /lib/modules -name drbd.ko

Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens? Do you still see version: 9.1.13?

Akemi

On Fri, Apr 14, 2023 at 4:53 AM Nigel Phillips < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] > wrote:



Akemi,

Sorry syntax in email, did a copy and paste of the new update package name from the release email rather than from installed system package names. Actual system installed files are correct though, so the original problem does unfortunately still exist.

$dnf list --installed | grep drbd
drbd90-utils.x86_64 9.23.1-1.el8.elrepo @elrepo
kmod-drbd90.x86_64 9.1.14-1.el8_7.elrepo @elrepo

Best Regards,
Nigel



On 14 April 2023 10:28:42 IST, Akemi Yagi < [ mailto:toracat@elrepo.org | toracat@elrepo.org ] > wrote:
BQ_BEGIN

On Fri, Apr 14, 2023 at 2:18 AM Nigel Phillips < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] > wrote:

BQ_BEGIN

Morning,

AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64

Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my secondary and after a reboot was greeted with a

drbdadm status
r0 role:Secondary
disk:Diskless

Looking at /proc/drbd I noticed it still had the previous version listed

cat /proc/drbd
version: 9.1.13 (api:2/proto:86-121)
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50
Transports (api:18):

Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and now back and working with /proc/drbd showing the correct version.

cat /proc/drbd
version: 9.1.14 (api:2/proto:86-121)
GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-08 19:54:28
Transports (api:18): tcp (9.1.14)

Did I miss a step on the upgrade, should I have brought drbd down first (it was set to secondary) or intitally booted into an earlier kernel first before the upgrade?

Best Regards,
Nigel



You installed the kmod package built for el9 on your el8 system. Please try installing kmod-drbd90 for el8.

Akemi

BQ_END

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

BQ_END

Hi Nigel,

I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if
that resolves the issue.

Akemi
On Fri, Apr 14, 2023 at 8:23?AM Nigel Phillips <nigel@ntalk.ie> wrote:

> Akemi,
>
> Current values, reboot to new kernel, then values again in steps below.
> And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd
>
> $ uname -r
> 4.18.0-425.13.1.el8_7.x86_64
>
> $ drbdadm status
> r0 role:Secondary
> disk:UpToDate
> vmstorage1-telecity role:Primary
> peer-disk:UpToDate
>
> $ find /lib/modules -name drbd.ko
> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>
> $ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"
>
> $shutdown -r now
>
> $uname -r
> 4.18.0-425.19.2.el8_7.x86_64
>
> $drbdadm status
> r0 role:Secondary
> disk:Diskless
>
> $ find /lib/modules -name drbd.ko
> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>
> $ cat /proc/drbd
> version: 9.1.13 (api:2/proto:86-121)
> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@,
> 2023-01-30 18:33:50
> Transports (api:18):
>
> Also some symbol errors from dmesg with newer kernel
>
> [Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from drbdsetup
> [2088])
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_find_path_by_addr
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_find_path_by_addr (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_get_listener
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_get_listener (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_stream_send_timed_out
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_stream_send_timed_out (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_register_transport_class
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_register_transport_class (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_should_abort_listening
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_should_abort_listening (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_put_listener
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_put_listener (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_path_event
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_path_event (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_free_pages
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_free_pages (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_unregister_transport_class
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_unregister_transport_class (err -22)
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
> symbol drbd_alloc_pages
> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
> drbd_alloc_pages (err -22)
>
>
>
> Nigel
>
>
>
>
> *Nigel Phillips * | IT Consultant
>
> Tel: (+353) 86 6057580
> Skype: live:nigel_2260
> ------------------------------
> www.ntalk.ie | nigel@ntalk.ie
>
> ------------------------------
> *From: *"Akemi Yagi" <toracat@elrepo.org>
> *To: *"Nigel Phillips" <nigel@ntalk.ie>
> *Cc: *"drbd-user" <drbd-user@lists.linbit.com>
> *Sent: *Friday, 14 April, 2023 16:05:30
> *Subject: *Re: [DRBD-user] 9.1.14 upgrade issue
>
> Hi Nigel,
>
> Can you show the output from:
>
> $ find /lib/modules -name drbd.ko
>
> Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens?
> Do you still see version: 9.1.13?
>
> Akemi
>
> On Fri, Apr 14, 2023 at 4:53?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>
>> Akemi,
>>
>> Sorry syntax in email, did a copy and paste of the new update package
>> name from the release email rather than from installed system package
>> names. Actual system installed files are correct though, so the original
>> problem does unfortunately still exist.
>>
>> $dnf list --installed | grep drbd
>> drbd90-utils.x86_64
>> 9.23.1-1.el8.elrepo @elrepo
>> kmod-drbd90.x86_64
>> 9.1.14-1.el8_7.elrepo @elrepo
>>
>> Best Regards,
>> Nigel
>>
>>
>>
>> On 14 April 2023 10:28:42 IST, Akemi Yagi <toracat@elrepo.org> wrote:
>>>
>>> On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>>
>>>> Morning,
>>>>
>>>> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>>>>
>>>> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
>>>> secondary and after a reboot was greeted with a
>>>>
>>>> drbdadm status
>>>> r0 role:Secondary
>>>> disk:Diskless
>>>>
>>>> Looking at /proc/drbd I noticed it still had the previous version listed
>>>>
>>>> cat /proc/drbd
>>>> version: 9.1.13 (api:2/proto:86-121)
>>>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
>>>> mockbuild@, 2023-01-30 18:33:50
>>>> Transports (api:18):
>>>>
>>>> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64
>>>> and now back and working with /proc/drbd showing the correct version.
>>>>
>>>> cat /proc/drbd
>>>> version: 9.1.14 (api:2/proto:86-121)
>>>> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
>>>> 2023-04-08 19:54:28
>>>> Transports (api:18): tcp (9.1.14)
>>>>
>>>> Did I miss a step on the upgrade, should I have brought drbd down first
>>>> (it was set to secondary) or intitally booted into an earlier kernel first
>>>> before the upgrade?
>>>>
>>>> Best Regards,
>>>> Nigel
>>>>
>>>
>>> You installed the kmod package built for el9 on your el8 system. Please
>>> try installing kmod-drbd90 for el8.
>>>
>>> Akemi
>>>
>> --
>> Sent from my Android device with K-9 Mail. Please excuse my brevity.
>>
>
>

Hi Nigel,

kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors
shortly.

Akemi

On Fri, Apr 14, 2023 at 8:31?AM Akemi Yagi <toracat@elrepo.org> wrote:

> Hi Nigel,
>
> I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if
> that resolves the issue.
>
> Akemi
> On Fri, Apr 14, 2023 at 8:23?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>
>> Akemi,
>>
>> Current values, reboot to new kernel, then values again in steps below.
>> And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd
>>
>> $ uname -r
>> 4.18.0-425.13.1.el8_7.x86_64
>>
>> $ drbdadm status
>> r0 role:Secondary
>> disk:UpToDate
>> vmstorage1-telecity role:Primary
>> peer-disk:UpToDate
>>
>> $ find /lib/modules -name drbd.ko
>> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
>> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>
>> $ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"
>>
>> $shutdown -r now
>>
>> $uname -r
>> 4.18.0-425.19.2.el8_7.x86_64
>>
>> $drbdadm status
>> r0 role:Secondary
>> disk:Diskless
>>
>> $ find /lib/modules -name drbd.ko
>> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
>> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>
>> $ cat /proc/drbd
>> version: 9.1.13 (api:2/proto:86-121)
>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@,
>> 2023-01-30 18:33:50
>> Transports (api:18):
>>
>> Also some symbol errors from dmesg with newer kernel
>>
>> [Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from
>> drbdsetup [2088])
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_find_path_by_addr
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_find_path_by_addr (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_get_listener
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_get_listener (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_stream_send_timed_out
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_stream_send_timed_out (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_register_transport_class
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_register_transport_class (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_should_abort_listening
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_should_abort_listening (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_put_listener
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_put_listener (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_path_event
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_path_event (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_free_pages
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_free_pages (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_unregister_transport_class
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_unregister_transport_class (err -22)
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of
>> symbol drbd_alloc_pages
>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>> drbd_alloc_pages (err -22)
>>
>>
>>
>> Nigel
>>
>>
>>
>>
>> *Nigel Phillips * | IT Consultant
>>
>> Tel: (+353) 86 6057580
>> Skype: live:nigel_2260
>> ------------------------------
>> www.ntalk.ie | nigel@ntalk.ie
>>
>> ------------------------------
>> *From: *"Akemi Yagi" <toracat@elrepo.org>
>> *To: *"Nigel Phillips" <nigel@ntalk.ie>
>> *Cc: *"drbd-user" <drbd-user@lists.linbit.com>
>> *Sent: *Friday, 14 April, 2023 16:05:30
>> *Subject: *Re: [DRBD-user] 9.1.14 upgrade issue
>>
>> Hi Nigel,
>>
>> Can you show the output from:
>>
>> $ find /lib/modules -name drbd.ko
>>
>> Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens?
>> Do you still see version: 9.1.13?
>>
>> Akemi
>>
>> On Fri, Apr 14, 2023 at 4:53?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>
>>> Akemi,
>>>
>>> Sorry syntax in email, did a copy and paste of the new update package
>>> name from the release email rather than from installed system package
>>> names. Actual system installed files are correct though, so the original
>>> problem does unfortunately still exist.
>>>
>>> $dnf list --installed | grep drbd
>>> drbd90-utils.x86_64
>>> 9.23.1-1.el8.elrepo @elrepo
>>> kmod-drbd90.x86_64
>>> 9.1.14-1.el8_7.elrepo @elrepo
>>>
>>> Best Regards,
>>> Nigel
>>>
>>>
>>>
>>> On 14 April 2023 10:28:42 IST, Akemi Yagi <toracat@elrepo.org> wrote:
>>>>
>>>> On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>>>
>>>>> Morning,
>>>>>
>>>>> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>>>>>
>>>>> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
>>>>> secondary and after a reboot was greeted with a
>>>>>
>>>>> drbdadm status
>>>>> r0 role:Secondary
>>>>> disk:Diskless
>>>>>
>>>>> Looking at /proc/drbd I noticed it still had the previous version
>>>>> listed
>>>>>
>>>>> cat /proc/drbd
>>>>> version: 9.1.13 (api:2/proto:86-121)
>>>>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
>>>>> mockbuild@, 2023-01-30 18:33:50
>>>>> Transports (api:18):
>>>>>
>>>>> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64
>>>>> and now back and working with /proc/drbd showing the correct version.
>>>>>
>>>>> cat /proc/drbd
>>>>> version: 9.1.14 (api:2/proto:86-121)
>>>>> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
>>>>> 2023-04-08 19:54:28
>>>>> Transports (api:18): tcp (9.1.14)
>>>>>
>>>>> Did I miss a step on the upgrade, should I have brought drbd down
>>>>> first (it was set to secondary) or intitally booted into an earlier kernel
>>>>> first before the upgrade?
>>>>>
>>>>> Best Regards,
>>>>> Nigel
>>>>>
>>>>
>>>> You installed the kmod package built for el9 on your el8 system. Please
>>>> try installing kmod-drbd90 for el8.
>>>>
>>>> Akemi
>>>>
>>> --
>>> Sent from my Android device with K-9 Mail. Please excuse my brevity.
>>>
>>
>>

On Fri, Apr 14, 2023 at 08:54:39AM -0700, Akemi Yagi wrote:
> Hi Nigel,
>
> kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors
> shortly.

Since we modularized the "transport",
DRBD consists of (at least) two modules,
"drbd" and "drbd_transport_tcp".

You ship
./lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
./lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd_transport_tcp.ko

and a depmod conf snippet in
./etc/depmod.d/kmod-drbd90.conf

which contains
------
override drbd90 * weak-updates/drbd90
------

And that does not make any sense at all.
Because it does not match any module
(unless you patched in some funny alias, which I doubt).
Also it does not even attempt to match the transport tcp.

It should contain something like
------
override drbd * weak-updates/drbd90
override drbd_transport_tcp * weak-updates/drbd90
------

after a depmod run with a corrected depmod conf,
# modinfo -F filename drbd drbd_transport_tcp
should report the same path for both drbd and drbd_transport_tcp, and
not find them in different directories with potentially different versions.
(that would explain the "symbols" errors)

Also you may want to check which path takes precedence,
and which path you _want_ to take precedence,
the "extra" or the "weak-updates" one,
should you have both a "built for this kernel version"
and a "compatible with this kernel version" module installed.

Cheers,
Lars

_______________________________________________
Star us on GITHUB: https://github.com/LINBIT
drbd-user mailing list
drbd-user@lists.linbit.com
https://lists.linbit.com/mailman/listinfo/drbd-user

On Fri, Apr 14, 2023 at 9:13?AM Lars Ellenberg <lars.ellenberg@linbit.com>
wrote:

> On Fri, Apr 14, 2023 at 08:54:39AM -0700, Akemi Yagi wrote:
> > Hi Nigel,
> >
> > kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors
> > shortly.
>
> Since we modularized the "transport",
> DRBD consists of (at least) two modules,
> "drbd" and "drbd_transport_tcp".
>
> You ship
> ./lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
>
> ./lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd_transport_tcp.ko
>
> and a depmod conf snippet in
> ./etc/depmod.d/kmod-drbd90.conf
>
> which contains
> ------
> override drbd90 * weak-updates/drbd90
> ------
>
> And that does not make any sense at all.
> Because it does not match any module
> (unless you patched in some funny alias, which I doubt).
> Also it does not even attempt to match the transport tcp.
>
> It should contain something like
> ------
> override drbd * weak-updates/drbd90
> override drbd_transport_tcp * weak-updates/drbd90
> ------
>
> after a depmod run with a corrected depmod conf,
> # modinfo -F filename drbd drbd_transport_tcp
> should report the same path for both drbd and drbd_transport_tcp, and
> not find them in different directories with potentially different versions.
> (that would explain the "symbols" errors)
>
> Also you may want to check which path takes precedence,
> and which path you _want_ to take precedence,
> the "extra" or the "weak-updates" one,
> should you have both a "built for this kernel version"
> and a "compatible with this kernel version" module installed.
>
> Cheers,
> Lars
>

Hi Lars,

Thank you for your notes. I'll have more detailed look and see if I can fix
the problem.

Akemi

Akemi,

Version kmod-drbd90-9.1.14-2.el8_7.x86_64 is in and installed and has sorted the issue, thank you.

$ uname -r
4.18.0-425.19.2.el8_7.x86_64

$ cat /proc/drbd
version: 9.1.14 (api:2/proto:86-121)
GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-14 11:47:35
Transports (api:18): tcp (9.1.14)

$ drbdadm status
r0 role:Secondary
disk:UpToDate
vmstorage1-telecity role:Primary
peer-disk:UpToDate

Regards,
Nigel






Nigel Phillips | IT Consultant

Tel: (+353) 86 6057580
Skype: live:nigel_2260

www.ntalk.ie | nigel@ntalk.ie


From: "Akemi Yagi" <toracat@elrepo.org>
To: "Nigel Phillips" <nigel@ntalk.ie>
Cc: "drbd-user" <drbd-user@lists.linbit.com>
Sent: Friday, 14 April, 2023 16:54:39
Subject: Re: [DRBD-user] 9.1.14 upgrade issue

Hi Nigel,

kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors shortly.

Akemi

On Fri, Apr 14, 2023 at 8:31 AM Akemi Yagi < [ mailto:toracat@elrepo.org | toracat@elrepo.org ] > wrote:



Hi Nigel,

I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if that resolves the issue.

Akemi
On Fri, Apr 14, 2023 at 8:23 AM Nigel Phillips < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] > wrote:

BQ_BEGIN

Akemi,
Current values, reboot to new kernel, then values again in steps below. And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd

$ uname -r
4.18.0-425.13.1.el8_7.x86_64

$ drbdadm status
r0 role:Secondary
disk:UpToDate
vmstorage1-telecity role:Primary
peer-disk:UpToDate

$ find /lib/modules -name drbd.ko
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko

$ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"

$shutdown -r now

$uname -r
4.18.0-425.19.2.el8_7.x86_64

$drbdadm status
r0 role:Secondary
disk:Diskless

$ find /lib/modules -name drbd.ko
/lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
/lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
/lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko

$ cat /proc/drbd
version: 9.1.13 (api:2/proto:86-121)
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50
Transports (api:18):

Also some symbol errors from dmesg with newer kernel

[Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from drbdsetup [2088])
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_find_path_by_addr
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_find_path_by_addr (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_get_listener
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_get_listener (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_stream_send_timed_out
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_stream_send_timed_out (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_register_transport_class
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_register_transport_class (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_should_abort_listening
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_should_abort_listening (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_put_listener
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_put_listener (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_path_event
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_path_event (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_free_pages
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_free_pages (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_unregister_transport_class
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_unregister_transport_class (err -22)
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version of symbol drbd_alloc_pages
[Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol drbd_alloc_pages (err -22)



Nigel




Nigel Phillips | IT Consultant

Tel: (+353) 86 6057580
Skype: live:nigel_2260

[ http://www.ntalk.ie/ | www.ntalk.ie ] | [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ]


From: "Akemi Yagi" < [ mailto:toracat@elrepo.org | toracat@elrepo.org ] >
To: "Nigel Phillips" < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] >
Cc: "drbd-user" < [ mailto:drbd-user@lists.linbit.com | drbd-user@lists.linbit.com ] >
Sent: Friday, 14 April, 2023 16:05:30
Subject: Re: [DRBD-user] 9.1.14 upgrade issue

Hi Nigel,

Can you show the output from:

$ find /lib/modules -name drbd.ko

Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens? Do you still see version: 9.1.13?

Akemi

On Fri, Apr 14, 2023 at 4:53 AM Nigel Phillips < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] > wrote:

BQ_BEGIN

Akemi,

Sorry syntax in email, did a copy and paste of the new update package name from the release email rather than from installed system package names. Actual system installed files are correct though, so the original problem does unfortunately still exist.

$dnf list --installed | grep drbd
drbd90-utils.x86_64 9.23.1-1.el8.elrepo @elrepo
kmod-drbd90.x86_64 9.1.14-1.el8_7.elrepo @elrepo

Best Regards,
Nigel



On 14 April 2023 10:28:42 IST, Akemi Yagi < [ mailto:toracat@elrepo.org | toracat@elrepo.org ] > wrote:
BQ_BEGIN

On Fri, Apr 14, 2023 at 2:18 AM Nigel Phillips < [ mailto:nigel@ntalk.ie | nigel@ntalk.ie ] > wrote:

BQ_BEGIN

Morning,

AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64

Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my secondary and after a reboot was greeted with a

drbdadm status
r0 role:Secondary
disk:Diskless

Looking at /proc/drbd I noticed it still had the previous version listed

cat /proc/drbd
version: 9.1.13 (api:2/proto:86-121)
GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@, 2023-01-30 18:33:50
Transports (api:18):

Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64 and now back and working with /proc/drbd showing the correct version.

cat /proc/drbd
version: 9.1.14 (api:2/proto:86-121)
GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@, 2023-04-08 19:54:28
Transports (api:18): tcp (9.1.14)

Did I miss a step on the upgrade, should I have brought drbd down first (it was set to secondary) or intitally booted into an earlier kernel first before the upgrade?

Best Regards,
Nigel



You installed the kmod package built for el9 on your el8 system. Please try installing kmod-drbd90 for el8.

Akemi

BQ_END

--
Sent from my Android device with K-9 Mail. Please excuse my brevity.

BQ_END



BQ_END


BQ_END

Hi Nigel,

Thank you for letting me know that it's working for you.

Akemi

On Fri, Apr 14, 2023 at 10:51?AM Nigel Phillips <nigel@ntalk.ie> wrote:

> Akemi,
>
> Version kmod-drbd90-9.1.14-2.el8_7.x86_64 is in and installed and has
> sorted the issue, thank you.
>
> $ uname -r
> 4.18.0-425.19.2.el8_7.x86_64
>
> $ cat /proc/drbd
> version: 9.1.14 (api:2/proto:86-121)
> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
> 2023-04-14 11:47:35
> Transports (api:18): tcp (9.1.14)
>
> $ drbdadm status
> r0 role:Secondary
> disk:UpToDate
> vmstorage1-telecity role:Primary
> peer-disk:UpToDate
>
> Regards,
> Nigel
>
>
>
>
>
>
> *Nigel Phillips * | IT Consultant
>
> Tel: (+353) 86 6057580
> Skype: live:nigel_2260
> ------------------------------
> www.ntalk.ie | nigel@ntalk.ie
>
> ------------------------------
> *From: *"Akemi Yagi" <toracat@elrepo.org>
> *To: *"Nigel Phillips" <nigel@ntalk.ie>
> *Cc: *"drbd-user" <drbd-user@lists.linbit.com>
> *Sent: *Friday, 14 April, 2023 16:54:39
> *Subject: *Re: [DRBD-user] 9.1.14 upgrade issue
>
> Hi Nigel,
>
> kmod-drbd90-9.1.14-2.el8_7.x86_64.rpm will start syncing to our mirrors
> shortly.
>
> Akemi
>
> On Fri, Apr 14, 2023 at 8:31?AM Akemi Yagi <toracat@elrepo.org> wrote:
>
>> Hi Nigel,
>>
>> I will rebuild the kmod package against kernel-425.19.2.el8_7 and see if
>> that resolves the issue.
>>
>> Akemi
>> On Fri, Apr 14, 2023 at 8:23?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>
>>> Akemi,
>>> Current values, reboot to new kernel, then values again in steps below.
>>> And yes, on reboot to newer kernel I still see 9.1.13 for /proc/drbd
>>>
>>> $ uname -r
>>> 4.18.0-425.13.1.el8_7.x86_64
>>>
>>> $ drbdadm status
>>> r0 role:Secondary
>>> disk:UpToDate
>>> vmstorage1-telecity role:Primary
>>> peer-disk:UpToDate
>>>
>>> $ find /lib/modules -name drbd.ko
>>> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
>>> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>>
>>> $ grubby --set-default "/boot/vmlinuz-4.18.0-425.19.2.el8_7.x86_64"
>>>
>>> $shutdown -r now
>>>
>>> $uname -r
>>> 4.18.0-425.19.2.el8_7.x86_64
>>>
>>> $drbdadm status
>>> r0 role:Secondary
>>> disk:Diskless
>>>
>>> $ find /lib/modules -name drbd.ko
>>> /lib/modules/4.18.0-425.13.1.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>> /lib/modules/4.18.0-425.10.1.el8_7.x86_64/extra/drbd90/drbd.ko
>>> /lib/modules/4.18.0-425.19.2.el8_7.x86_64/weak-updates/drbd90/drbd.ko
>>>
>>> $ cat /proc/drbd
>>> version: 9.1.13 (api:2/proto:86-121)
>>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by mockbuild@,
>>> 2023-01-30 18:33:50
>>> Transports (api:18):
>>>
>>> Also some symbol errors from dmesg with newer kernel
>>>
>>> [Fri Apr 14 16:14:18 2023] drbd r0: Starting worker thread (from
>>> drbdsetup [2088])
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_find_path_by_addr
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_find_path_by_addr (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_get_listener
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_get_listener (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_stream_send_timed_out
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_stream_send_timed_out (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_register_transport_class
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_register_transport_class (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_should_abort_listening
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_should_abort_listening (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_put_listener
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_put_listener (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_path_event
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_path_event (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_free_pages
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_free_pages (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_unregister_transport_class
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_unregister_transport_class (err -22)
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: disagrees about version
>>> of symbol drbd_alloc_pages
>>> [Fri Apr 14 16:14:18 2023] drbd_transport_tcp: Unknown symbol
>>> drbd_alloc_pages (err -22)
>>>
>>>
>>>
>>> Nigel
>>>
>>>
>>>
>>>
>>> *Nigel Phillips * | IT Consultant
>>>
>>> Tel: (+353) 86 6057580
>>> Skype: live:nigel_2260
>>> ------------------------------
>>> www.ntalk.ie | nigel@ntalk.ie
>>>
>>> ------------------------------
>>> *From: *"Akemi Yagi" <toracat@elrepo.org>
>>> *To: *"Nigel Phillips" <nigel@ntalk.ie>
>>> *Cc: *"drbd-user" <drbd-user@lists.linbit.com>
>>> *Sent: *Friday, 14 April, 2023 16:05:30
>>> *Subject: *Re: [DRBD-user] 9.1.14 upgrade issue
>>>
>>> Hi Nigel,
>>>
>>> Can you show the output from:
>>>
>>> $ find /lib/modules -name drbd.ko
>>>
>>> Also, if you boot kernel 4.18.0-425.19.2.el8_7 once again, what happens?
>>> Do you still see version: 9.1.13?
>>>
>>> Akemi
>>>
>>> On Fri, Apr 14, 2023 at 4:53?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>>
>>>> Akemi,
>>>>
>>>> Sorry syntax in email, did a copy and paste of the new update package
>>>> name from the release email rather than from installed system package
>>>> names. Actual system installed files are correct though, so the original
>>>> problem does unfortunately still exist.
>>>>
>>>> $dnf list --installed | grep drbd
>>>> drbd90-utils.x86_64
>>>> 9.23.1-1.el8.elrepo @elrepo
>>>> kmod-drbd90.x86_64
>>>> 9.1.14-1.el8_7.elrepo @elrepo
>>>>
>>>> Best Regards,
>>>> Nigel
>>>>
>>>>
>>>>
>>>> On 14 April 2023 10:28:42 IST, Akemi Yagi <toracat@elrepo.org> wrote:
>>>>>
>>>>> On Fri, Apr 14, 2023 at 2:18?AM Nigel Phillips <nigel@ntalk.ie> wrote:
>>>>>
>>>>>> Morning,
>>>>>>
>>>>>> AlmaLinux 8.7, kernel 4.18.0-425.19.2.el8_7.x86_64
>>>>>>
>>>>>> Just installed kmod-drbd9x-9.1.14-1.el9_1.elrepo.x86_64.rpm on my
>>>>>> secondary and after a reboot was greeted with a
>>>>>>
>>>>>> drbdadm status
>>>>>> r0 role:Secondary
>>>>>> disk:Diskless
>>>>>>
>>>>>> Looking at /proc/drbd I noticed it still had the previous version
>>>>>> listed
>>>>>>
>>>>>> cat /proc/drbd
>>>>>> version: 9.1.13 (api:2/proto:86-121)
>>>>>> GIT-hash: 834511a4957bba1a6aa4245a99ceebca5c42a4f2 build by
>>>>>> mockbuild@, 2023-01-30 18:33:50
>>>>>> Transports (api:18):
>>>>>>
>>>>>> Rebooting again into an earlier kernel, 4.18.0-425.13.1.el8_7.x86_64
>>>>>> and now back and working with /proc/drbd showing the correct version.
>>>>>>
>>>>>> cat /proc/drbd
>>>>>> version: 9.1.14 (api:2/proto:86-121)
>>>>>> GIT-hash: df55dfb7a93484b7d7eb0c4deac62d887cfcbf67 build by mockbuild@,
>>>>>> 2023-04-08 19:54:28
>>>>>> Transports (api:18): tcp (9.1.14)
>>>>>>
>>>>>> Did I miss a step on the upgrade, should I have brought drbd down
>>>>>> first (it was set to secondary) or intitally booted into an earlier kernel
>>>>>> first before the upgrade?
>>>>>>
>>>>>> Best Regards,
>>>>>> Nigel
>>>>>>
>>>>>
>>>>> You installed the kmod package built for el9 on your el8 system.
>>>>> Please try installing kmod-drbd90 for el8.
>>>>>
>>>>> Akemi
>>>>>
>>>> --
>>>> Sent from my Android device with K-9 Mail. Please excuse my brevity.
>>>>
>>>
>>>
>