Mailing List Archive

linstor-server 1.9.0 release
Hi!

Here is a new minor Linstor release, this release contains more bug fixes
than new features.
Notable features are a new auto-unplace option, to reduce the replica-count
of resources
to the value set in the resource-group after a certain time. And
error-reports can now be deleted
from the REST-API (client).

linstor-server 1.9.0
--------------------
* Added auto-"unplace", automatically removes resources if they exceed the
replica count if `DrbdOptions/auto-unplace` is set
* Added error-report deletion API
* Expose DRBD promotion_score and may_promote via REST-API and server sent
events
* Prometheus metrics are now mostly cached and much faster to query
* Send SD_NOTIFY READY to systemd if services are ready
* OpenFlex resource are now correctly limited to 32 characters
* Fix etcd modify net-interface (incorrect serialization)
* Fix autoplacer also toggling diskless resources
* Fix snapshot-shipping with more than 1 volume definitions
* Fix zfs create options handling
* Fixed recaching of lvm-filter
* Fix missing client answer if drbd device doesn't become ready in
reasonable time
* REST-API v1.4.0

https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz

Linstor PPA:
https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack

Cheers,
Rene
Re: linstor-server 1.9.0 release [ In reply to ]
Hi,

After upgrading on one of my test nodes I got some errors, so I thought
to upgrade the controller, and now I am unable to start the controller.

Here is what I get in the system log:

Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
Sep 24 02:33:41 castle Controller[1093]: Version:            1.9.0
(678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
Sep 24 02:33:41 castle Controller[1093]: Build time:
2020-09-23T10:27:49+00:00
Sep 24 02:33:41 castle Controller[1093]: Java Version:       11
Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian, Version
11.0.8+10-post-Debian-1deb10u1
Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
Version 4.19.0-10-amd64
Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
processors, 1988 MiB memory reserved for allocations
Sep 24 02:33:41 castle Controller[1093]: System components
initialization in progress
Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
LINSTOR/Controller - SYSTEM - Log directory set to:
'/var/log/linstor-controller'
Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
will do nothing! See documentation: https://docs.sentry.io/clients/java/ ***
Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
LINSTOR/Controller - SYSTEM - Loading API classes started.
Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
LINSTOR/Controller - SYSTEM - Dependency injection started.
Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension
module "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
LINSTOR/Controller - SYSTEM - Extension module
"com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
installed
Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
access operation has occurred
Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
access by com.google.inject.internal.cglib.core.$ReflectUtils$1
(file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
reporting this to the maintainers of
com.google.inject.internal.cglib.core.$ReflectUtils$1
Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
--illegal-access=warn to enable warnings of further illegal reflective
access operations
Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
operations will be denied in a future release
Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
LINSTOR/Controller - SYSTEM - Starting service instance
'TimerEventService' of type TimerEventService
Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
LINSTOR/Controller - SYSTEM - Initializing the database connection pool
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
LINSTOR/Controller - SYSTEM - Database initialization error [Report
number 5F6B78E5-00000-000000]
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Shutdown in progress
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Shutting down service instance
'TaskScheduleService' of type TaskScheduleService
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Waiting for service instance
'TaskScheduleService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Shutting down service instance
'DatabaseService' of type DatabaseService
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Waiting for service instance
'DatabaseService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Shutting down service instance
'TimerEventService' of type TimerEventService
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Waiting for service instance
'TimerEventService' to complete shutdown
Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO 
LINSTOR/Controller - SYSTEM - Shutdown complete
Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
process exited, code=exited, status=20/n/a
Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed
with result 'exit-code'.

Here is /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log

ERROR REPORT 5F6B78E5-00000-000000

============================================================

Application:                        LINBIT® LINSTOR
Module:                             Controller
Version:                            1.9.0
Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
Build time:                         2020-09-23T10:27:49+00:00
Error time:                         2020-09-24 02:33:46
Node:                               castle

============================================================

Reported error:
===============

Description:
    Database initialization error

Category:                           LinStorException
Class name:                         SystemServiceStartException
Class canonical name: com.linbit.SystemServiceStartException
Generated at:                       Method 'initialize', Source file
'DbConnectionPoolInitializer.java', Line #56
Error message:                      Database initialization error

Call backtrace:

    Method                                   Native Class:Line number
    initialize                               N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
    startSystemServices                      N
com.linbit.linstor.core.ApplicationLifecycleManager:87
    start                                    N
com.linbit.linstor.core.Controller:337
    main                                     N
com.linbit.linstor.core.Controller:556

Caused by:
==========

Category:                           RuntimeException
Class name:                         LinStorDBRuntimeException
Class canonical name: com.linbit.linstor.LinStorDBRuntimeException
Generated at:                       Method 'setTransactionIsolation',
Source file 'DbConnectionPool.java', Line #485

Error message:                      Failed to set transaction isolation

Call backtrace:

    Method                                   Native Class:Line number
    setTransactionIsolation                  N
com.linbit.linstor.dbcp.DbConnectionPool:485
    migrate                                  N
com.linbit.linstor.dbcp.DbConnectionPool:202
    initialize                               N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
    startSystemServices                      N
com.linbit.linstor.core.ApplicationLifecycleManager:87
    start                                    N
com.linbit.linstor.core.Controller:337
    main                                     N
com.linbit.linstor.core.Controller:556

Caused by:
==========

Category:                           Exception
Class name:                         JdbcSQLException
Class canonical name:               org.h2.jdbc.JdbcSQLException
Generated at:                       Method 'getJdbcSQLException', Source
file 'DbException.java', Line #357

Error message:                      Wrong user name or password [28000-197]

Call backtrace:

    Method                                   Native Class:Line number
    getJdbcSQLException                      N
org.h2.message.DbException:357
    get                                      N
org.h2.message.DbException:179
    get                                      N
org.h2.message.DbException:155
    get                                      N
org.h2.message.DbException:144
    validateUserAndPassword                  N org.h2.engine.Engine:341
    createSessionAndValidate                 N org.h2.engine.Engine:165
    createSession                            N org.h2.engine.Engine:140
    createSession                            N org.h2.engine.Engine:28
    connectEmbeddedOrServer                  N
org.h2.engine.SessionRemote:351
    <init>                                   N
org.h2.jdbc.JdbcConnection:124
    <init>                                   N
org.h2.jdbc.JdbcConnection:103
    connect                                  N org.h2.Driver:69
    getConnection                            N java.sql.DriverManager:677
    getConnection                            N java.sql.DriverManager:189
    createConnection                         N
org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
    makeObject                               N
org.apache.commons.dbcp2.PoolableConnectionFactory:355
    create                                   N
org.apache.commons.pool2.impl.GenericObjectPool:889
    borrowObject                             N
org.apache.commons.pool2.impl.GenericObjectPool:424
    borrowObject                             N
org.apache.commons.pool2.impl.GenericObjectPool:349
    getConnection                            N
org.apache.commons.dbcp2.PoolingDataSource:134
    setTransactionIsolation                  N
com.linbit.linstor.dbcp.DbConnectionPool:477
    migrate                                  N
com.linbit.linstor.dbcp.DbConnectionPool:202
    initialize                               N
com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
    startSystemServices                      N
com.linbit.linstor.core.ApplicationLifecycleManager:87
    start                                    N
com.linbit.linstor.core.Controller:337
    main                                     N
com.linbit.linstor.core.Controller:556

Finally I found another log in /var/lib/linstor/linstordb.trace.db

2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
org.h2.message.DbException: Wrong user name or password [28000-197]
        at org.h2.message.DbException.get(DbException.java:179)
        at org.h2.message.DbException.get(DbException.java:155)
        at org.h2.message.DbException.get(DbException.java:144)
        at org.h2.engine.Engine.openSession(Engine.java:107)
        at org.h2.engine.Engine.openSession(Engine.java:179)
        at org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
        at org.h2.engine.Engine.createSession(Engine.java:140)
        at org.h2.engine.Engine.createSession(Engine.java:28)
        at
org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
        at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
        at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
        at org.h2.Driver.connect(Driver.java:69)
        at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
        at
java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
        at
org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
        at
org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
        at
org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
        at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
        at
org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
        at
org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
        at
com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
        at
com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
        at
com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
        at
com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
        at com.linbit.linstor.core.Controller.start(Controller.java:337)
        at com.linbit.linstor.core.Controller.main(Controller.java:556)
Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
[28000-197]
        at
org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
        ... 26 more


Luckily, this is just a test environment, but I'd like to know if I
messed up in my upgrade process somehow or this is a bug in the new
version. I haven't downgraded or anything yet.

Regards,
Adam


On 23/9/20 22:31, Rene Peinthor wrote:
> Hi!
>
> Here is a new minor Linstor release, this release contains more bug
> fixes than new features.
> Notable features are a new auto-unplace option, to reduce the
> replica-count of resources
> to the value set in the resource-group after a certain time. And
> error-reports can now be deleted
> from the REST-API (client).
>
> linstor-server 1.9.0
> --------------------
>  * Added auto-"unplace", automatically removes resources if they
> exceed the replica count if `DrbdOptions/auto-unplace` is set
>  * Added error-report deletion API
>  * Expose DRBD promotion_score and may_promote via REST-API and server
> sent events
>  * Prometheus metrics are now mostly cached and much faster to query
>  * Send SD_NOTIFY READY to systemd if services are ready
>  * OpenFlex resource are now correctly limited to 32 characters
>  * Fix etcd modify net-interface (incorrect serialization)
>  * Fix autoplacer also toggling diskless resources
>  * Fix snapshot-shipping with more than 1 volume definitions
>  * Fix zfs create options handling
>  * Fixed recaching of lvm-filter
>  * Fix missing client answer if drbd device doesn't become ready in
> reasonable time
>  * REST-API v1.4.0
>
> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
> <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>
> Linstor PPA:
> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
> <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>
> Cheers,
> Rene
>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing list
> drbd-user@lists.linbit.com
> https://lists.linbit.com/mailman/listinfo/drbd-user
Re: linstor-server 1.9.0 release [ In reply to ]
Caused by: org.h2.jdbc.JdbcSQLException: *Wrong user name or password*
[28000-197]



Pagarbiai
Mindaugas Milinavi?ius
UAB STARNITA
Direktorius
http://www.clustspace.com
LT: +37068882880
RU: +79199993933

Tomorrow's possibilities today
<http://www.clustspace.com/>

- 1 core CPU, 512MB RAM, 20GB (€2.50)
- 1 core CPU, 1GB RAM, 30GB (€5.00)
- 2 core CPU, 2GB RAM, 40GB (€10.00)
- 2 core CPU, 4GB RAM, 60GB (€20.00)
- 4 core CPU, 8GB RAM, 80GB (€40.00)



On Wed, Sep 23, 2020 at 7:54 PM Adam Goryachev <
mailinglists@websitemanagers.com.au> wrote:

> Hi,
>
> After upgrading on one of my test nodes I got some errors, so I thought to
> upgrade the controller, and now I am unable to start the controller.
>
> Here is what I get in the system log:
>
> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
> Sep 24 02:33:41 castle Controller[1093]: Build time:
> 2020-09-23T10:27:49+00:00
> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
> Version 11.0.8+10-post-Debian-1deb10u1
> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
> Version 4.19.0-10-amd64
> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
> processors, 1988 MiB memory reserved for allocations
> Sep 24 02:33:41 castle Controller[1093]: System components initialization
> in progress
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
> LINSTOR/Controller - SYSTEM - Log directory set to:
> '/var/log/linstor-controller'
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
> will do nothing! See documentation: https://docs.sentry.io/clients/java/
> ***
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
> LINSTOR/Controller - SYSTEM - Loading API classes started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
> LINSTOR/Controller - SYSTEM - Dependency injection started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
> LINSTOR/Controller - SYSTEM - Extension module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
> installed
> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
> access operation has occurred
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
> reporting this to the maintainers of
> com.google.inject.internal.cglib.core.$ReflectUtils$1
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
> --illegal-access=warn to enable warnings of further illegal reflective
> access operations
> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
> operations will be denied in a future release
> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
> LINSTOR/Controller - SYSTEM - Starting service instance 'TimerEventService'
> of type TimerEventService
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
> LINSTOR/Controller - SYSTEM - Initializing the database connection pool
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
> LINSTOR/Controller - SYSTEM - Database initialization error [Report number
> 5F6B78E5-00000-000000]
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutdown in progress
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TaskScheduleService' of type TaskScheduleService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TaskScheduleService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'DatabaseService' of type DatabaseService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'DatabaseService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TimerEventService' of type TimerEventService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TimerEventService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutdown complete
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
> process exited, code=exited, status=20/n/a
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed with
> result 'exit-code'.
>
> Here is /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>
> ERROR REPORT 5F6B78E5-00000-000000
>
> ============================================================
>
> Application: LINBIT® LINSTOR
> Module: Controller
> Version: 1.9.0
> Build ID:
> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
> Build time: 2020-09-23T10:27:49+00:00
> Error time: 2020-09-24 02:33:46
> Node: castle
>
> ============================================================
>
> Reported error:
> ===============
>
> Description:
> Database initialization error
>
> Category: LinStorException
> Class name: SystemServiceStartException
> Class canonical name: com.linbit.SystemServiceStartException
> Generated at: Method 'initialize', Source file
> 'DbConnectionPoolInitializer.java', Line #56
> Error message: Database initialization error
>
> Call backtrace:
>
> Method Native Class:Line number
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category: RuntimeException
> Class name: LinStorDBRuntimeException
> Class canonical name:
> com.linbit.linstor.LinStorDBRuntimeException
> Generated at: Method 'setTransactionIsolation',
> Source file 'DbConnectionPool.java', Line #485
>
> Error message: Failed to set transaction isolation
>
> Call backtrace:
>
> Method Native Class:Line number
> setTransactionIsolation N
> com.linbit.linstor.dbcp.DbConnectionPool:485
> migrate N
> com.linbit.linstor.dbcp.DbConnectionPool:202
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category: Exception
> Class name: JdbcSQLException
> Class canonical name: org.h2.jdbc.JdbcSQLException
> Generated at: Method 'getJdbcSQLException', Source
> file 'DbException.java', Line #357
>
> Error message: Wrong user name or password [28000-197]
>
> Call backtrace:
>
> Method Native Class:Line number
> getJdbcSQLException N
> org.h2.message.DbException:357
> get N
> org.h2.message.DbException:179
> get N
> org.h2.message.DbException:155
> get N
> org.h2.message.DbException:144
> validateUserAndPassword N
> org.h2.engine.Engine:341
> createSessionAndValidate N
> org.h2.engine.Engine:165
> createSession N
> org.h2.engine.Engine:140
> createSession N org.h2.engine.Engine:28
> connectEmbeddedOrServer N
> org.h2.engine.SessionRemote:351
> <init> N
> org.h2.jdbc.JdbcConnection:124
> <init> N
> org.h2.jdbc.JdbcConnection:103
> connect N org.h2.Driver:69
> getConnection N
> java.sql.DriverManager:677
> getConnection N
> java.sql.DriverManager:189
> createConnection N
> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
> makeObject N
> org.apache.commons.dbcp2.PoolableConnectionFactory:355
> create N
> org.apache.commons.pool2.impl.GenericObjectPool:889
> borrowObject N
> org.apache.commons.pool2.impl.GenericObjectPool:424
> borrowObject N
> org.apache.commons.pool2.impl.GenericObjectPool:349
> getConnection N
> org.apache.commons.dbcp2.PoolingDataSource:134
> setTransactionIsolation N
> com.linbit.linstor.dbcp.DbConnectionPool:477
> migrate N
> com.linbit.linstor.dbcp.DbConnectionPool:202
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>
> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
> org.h2.message.DbException: Wrong user name or password [28000-197]
> at org.h2.message.DbException.get(DbException.java:179)
> at org.h2.message.DbException.get(DbException.java:155)
> at org.h2.message.DbException.get(DbException.java:144)
> at org.h2.engine.Engine.openSession(Engine.java:107)
> at org.h2.engine.Engine.openSession(Engine.java:179)
> at org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
> at org.h2.engine.Engine.createSession(Engine.java:140)
> at org.h2.engine.Engine.createSession(Engine.java:28)
> at
> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
> at org.h2.Driver.connect(Driver.java:69)
> at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
> at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
> at
> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
> at
> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
> at
> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
> at
> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
> at
> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
> at
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
> at
> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
> at com.linbit.linstor.core.Controller.start(Controller.java:337)
> at com.linbit.linstor.core.Controller.main(Controller.java:556)
> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
> [28000-197]
> at
> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
> ... 26 more
>
>
> Luckily, this is just a test environment, but I'd like to know if I messed
> up in my upgrade process somehow or this is a bug in the new version. I
> haven't downgraded or anything yet.
>
> Regards,
> Adam
>
>
> On 23/9/20 22:31, Rene Peinthor wrote:
>
> Hi!
>
> Here is a new minor Linstor release, this release contains more bug fixes
> than new features.
> Notable features are a new auto-unplace option, to reduce the
> replica-count of resources
> to the value set in the resource-group after a certain time. And
> error-reports can now be deleted
> from the REST-API (client).
>
> linstor-server 1.9.0
> --------------------
> * Added auto-"unplace", automatically removes resources if they exceed
> the replica count if `DrbdOptions/auto-unplace` is set
> * Added error-report deletion API
> * Expose DRBD promotion_score and may_promote via REST-API and server
> sent events
> * Prometheus metrics are now mostly cached and much faster to query
> * Send SD_NOTIFY READY to systemd if services are ready
> * OpenFlex resource are now correctly limited to 32 characters
> * Fix etcd modify net-interface (incorrect serialization)
> * Fix autoplacer also toggling diskless resources
> * Fix snapshot-shipping with more than 1 volume definitions
> * Fix zfs create options handling
> * Fixed recaching of lvm-filter
> * Fix missing client answer if drbd device doesn't become ready in
> reasonable time
> * REST-API v1.4.0
>
> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>
> Linstor PPA:
> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>
> Cheers,
> Rene
>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing list
> drbd-user@lists.linbit.com
> https://lists.linbit.com/mailman/listinfo/drbd-user
>
Re: linstor-server 1.9.0 release [ In reply to ]
Thanks, I saw that, but I'm not sure why it is reporting that. I'm starting the service from root, and the config didn't change from the old package to the new (I didn't change it, just compile new package and install)...

Do you know where it gets the username/password from?


On 24 September 2020 3:13:38 am AEST, "Mindaugas Milinavi?ius" <mindaugas@clustspace.com> wrote:
>Caused by: org.h2.jdbc.JdbcSQLException: *Wrong user name or password*
>[28000-197]
>
>
>
>Pagarbiai
>Mindaugas Milinavi?ius
>UAB STARNITA
>Direktorius
>http://www.clustspace.com
>LT: +37068882880
>RU: +79199993933
>
>Tomorrow's possibilities today
><http://www.clustspace.com/>
>
> - 1 core CPU, 512MB RAM, 20GB (€2.50)
> - 1 core CPU, 1GB RAM, 30GB (€5.00)
> - 2 core CPU, 2GB RAM, 40GB (€10.00)
> - 2 core CPU, 4GB RAM, 60GB (€20.00)
> - 4 core CPU, 8GB RAM, 80GB (€40.00)
>
>
>
>On Wed, Sep 23, 2020 at 7:54 PM Adam Goryachev <
>mailinglists@websitemanagers.com.au> wrote:
>
>> Hi,
>>
>> After upgrading on one of my test nodes I got some errors, so I
>thought to
>> upgrade the controller, and now I am unable to start the controller.
>>
>> Here is what I get in the system log:
>>
>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller
>Service.
>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
>> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>> Sep 24 02:33:41 castle Controller[1093]: Build time:
>> 2020-09-23T10:27:49+00:00
>> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
>> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
>> Version 11.0.8+10-post-Debian-1deb10u1
>> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
>> Version 4.19.0-10-amd64
>> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
>> processors, 1988 MiB memory reserved for allocations
>> Sep 24 02:33:41 castle Controller[1093]: System components
>initialization
>> in progress
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
>> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
>> LINSTOR/Controller - SYSTEM - Log directory set to:
>> '/var/log/linstor-controller'
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
>> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry
>operations
>> will do nothing! See documentation:
>https://docs.sentry.io/clients/java/
>> ***
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Loading API classes started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
>> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Dependency injection started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension
>module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Extension module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is
>not
>> installed
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal
>reflective
>> access operation has occurred
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
>> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
>> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
>>
>java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
>> reporting this to the maintainers of
>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>> --illegal-access=warn to enable warnings of further illegal
>reflective
>> access operations
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
>> operations will be denied in a future release
>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Starting service instance
>'TimerEventService'
>> of type TimerEventService
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Initializing the database connection
>pool
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
>> LINSTOR/Controller - SYSTEM - Database initialization error [Report
>number
>> 5F6B78E5-00000-000000]
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutdown in progress
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'TaskScheduleService' of type TaskScheduleService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'TaskScheduleService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'DatabaseService' of type DatabaseService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'DatabaseService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'TimerEventService' of type TimerEventService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'TimerEventService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutdown complete
>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
>> process exited, code=exited, status=20/n/a
>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed
>with
>> result 'exit-code'.
>>
>> Here is
>/var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>
>> ERROR REPORT 5F6B78E5-00000-000000
>>
>> ============================================================
>>
>> Application: LINBIT® LINSTOR
>> Module: Controller
>> Version: 1.9.0
>> Build ID:
>> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>> Build time: 2020-09-23T10:27:49+00:00
>> Error time: 2020-09-24 02:33:46
>> Node: castle
>>
>> ============================================================
>>
>> Reported error:
>> ===============
>>
>> Description:
>> Database initialization error
>>
>> Category: LinStorException
>> Class name: SystemServiceStartException
>> Class canonical name:
>com.linbit.SystemServiceStartException
>> Generated at: Method 'initialize', Source file
>> 'DbConnectionPoolInitializer.java', Line #56
>> Error message: Database initialization error
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category: RuntimeException
>> Class name: LinStorDBRuntimeException
>> Class canonical name:
>> com.linbit.linstor.LinStorDBRuntimeException
>> Generated at: Method 'setTransactionIsolation',
>> Source file 'DbConnectionPool.java', Line #485
>>
>> Error message: Failed to set transaction
>isolation
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:485
>> migrate N
>> com.linbit.linstor.dbcp.DbConnectionPool:202
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category: Exception
>> Class name: JdbcSQLException
>> Class canonical name: org.h2.jdbc.JdbcSQLException
>> Generated at: Method 'getJdbcSQLException',
>Source
>> file 'DbException.java', Line #357
>>
>> Error message: Wrong user name or password
>[28000-197]
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> getJdbcSQLException N
>> org.h2.message.DbException:357
>> get N
>> org.h2.message.DbException:179
>> get N
>> org.h2.message.DbException:155
>> get N
>> org.h2.message.DbException:144
>> validateUserAndPassword N
>> org.h2.engine.Engine:341
>> createSessionAndValidate N
>> org.h2.engine.Engine:165
>> createSession N
>> org.h2.engine.Engine:140
>> createSession N
>org.h2.engine.Engine:28
>> connectEmbeddedOrServer N
>> org.h2.engine.SessionRemote:351
>> <init> N
>> org.h2.jdbc.JdbcConnection:124
>> <init> N
>> org.h2.jdbc.JdbcConnection:103
>> connect N org.h2.Driver:69
>> getConnection N
>> java.sql.DriverManager:677
>> getConnection N
>> java.sql.DriverManager:189
>> createConnection N
>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>> makeObject N
>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>> create N
>> org.apache.commons.pool2.impl.GenericObjectPool:889
>> borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:424
>> borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:349
>> getConnection N
>> org.apache.commons.dbcp2.PoolingDataSource:134
>> setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:477
>> migrate N
>> com.linbit.linstor.dbcp.DbConnectionPool:202
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>>
>> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
>> org.h2.message.DbException: Wrong user name or password [28000-197]
>> at org.h2.message.DbException.get(DbException.java:179)
>> at org.h2.message.DbException.get(DbException.java:155)
>> at org.h2.message.DbException.get(DbException.java:144)
>> at org.h2.engine.Engine.openSession(Engine.java:107)
>> at org.h2.engine.Engine.openSession(Engine.java:179)
>> at
>org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>> at org.h2.engine.Engine.createSession(Engine.java:140)
>> at org.h2.engine.Engine.createSession(Engine.java:28)
>> at
>>
>org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>> at org.h2.Driver.connect(Driver.java:69)
>> at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>> at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>> at
>>
>org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>> at
>>
>org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>> at
>>
>org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>> at
>>
>org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>> at
>>
>org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>> at
>>
>org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>> at
>>
>com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>> at
>>
>com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>> at
>>
>com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>> at
>>
>com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>> at
>com.linbit.linstor.core.Controller.start(Controller.java:337)
>> at
>com.linbit.linstor.core.Controller.main(Controller.java:556)
>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
>> [28000-197]
>> at
>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>> ... 26 more
>>
>>
>> Luckily, this is just a test environment, but I'd like to know if I
>messed
>> up in my upgrade process somehow or this is a bug in the new version.
>I
>> haven't downgraded or anything yet.
>>
>> Regards,
>> Adam
>>
>>
>> On 23/9/20 22:31, Rene Peinthor wrote:
>>
>> Hi!
>>
>> Here is a new minor Linstor release, this release contains more bug
>fixes
>> than new features.
>> Notable features are a new auto-unplace option, to reduce the
>> replica-count of resources
>> to the value set in the resource-group after a certain time. And
>> error-reports can now be deleted
>> from the REST-API (client).
>>
>> linstor-server 1.9.0
>> --------------------
>> * Added auto-"unplace", automatically removes resources if they
>exceed
>> the replica count if `DrbdOptions/auto-unplace` is set
>> * Added error-report deletion API
>> * Expose DRBD promotion_score and may_promote via REST-API and
>server
>> sent events
>> * Prometheus metrics are now mostly cached and much faster to query
>> * Send SD_NOTIFY READY to systemd if services are ready
>> * OpenFlex resource are now correctly limited to 32 characters
>> * Fix etcd modify net-interface (incorrect serialization)
>> * Fix autoplacer also toggling diskless resources
>> * Fix snapshot-shipping with more than 1 volume definitions
>> * Fix zfs create options handling
>> * Fixed recaching of lvm-filter
>> * Fix missing client answer if drbd device doesn't become ready in
>> reasonable time
>> * REST-API v1.4.0
>>
>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>
>> Linstor PPA:
>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>
>> Cheers,
>> Rene
>>
>> _______________________________________________
>> Star us on GITHUB: https://github.com/LINBIT
>> drbd-user mailing
>listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>>
>> _______________________________________________
>> Star us on GITHUB: https://github.com/LINBIT
>> drbd-user mailing list
>> drbd-user@lists.linbit.com
>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>
Re: linstor-server 1.9.0 release [ In reply to ]
Sounds weird, I don't think we changed anything with the database
initialization.

Can you post your /etc/linstor/linstor.toml?

Cheers,
Rene

On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev <
mailinglists@websitemanagers.com.au> wrote:

> Hi,
>
> After upgrading on one of my test nodes I got some errors, so I thought to
> upgrade the controller, and now I am unable to start the controller.
>
> Here is what I get in the system log:
>
> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
> Sep 24 02:33:41 castle Controller[1093]: Build time:
> 2020-09-23T10:27:49+00:00
> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
> Version 11.0.8+10-post-Debian-1deb10u1
> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
> Version 4.19.0-10-amd64
> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
> processors, 1988 MiB memory reserved for allocations
> Sep 24 02:33:41 castle Controller[1093]: System components initialization
> in progress
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
> LINSTOR/Controller - SYSTEM - Log directory set to:
> '/var/log/linstor-controller'
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
> will do nothing! See documentation: https://docs.sentry.io/clients/java/
> ***
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
> LINSTOR/Controller - SYSTEM - Loading API classes started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
> LINSTOR/Controller - SYSTEM - Dependency injection started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
> LINSTOR/Controller - SYSTEM - Extension module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
> installed
> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
> access operation has occurred
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
> reporting this to the maintainers of
> com.google.inject.internal.cglib.core.$ReflectUtils$1
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
> --illegal-access=warn to enable warnings of further illegal reflective
> access operations
> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
> operations will be denied in a future release
> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
> LINSTOR/Controller - SYSTEM - Starting service instance 'TimerEventService'
> of type TimerEventService
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
> LINSTOR/Controller - SYSTEM - Initializing the database connection pool
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
> LINSTOR/Controller - SYSTEM - Database initialization error [Report number
> 5F6B78E5-00000-000000]
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutdown in progress
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TaskScheduleService' of type TaskScheduleService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TaskScheduleService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'DatabaseService' of type DatabaseService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'DatabaseService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TimerEventService' of type TimerEventService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TimerEventService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
> LINSTOR/Controller - SYSTEM - Shutdown complete
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
> process exited, code=exited, status=20/n/a
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed with
> result 'exit-code'.
>
> Here is /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>
> ERROR REPORT 5F6B78E5-00000-000000
>
> ============================================================
>
> Application: LINBIT® LINSTOR
> Module: Controller
> Version: 1.9.0
> Build ID:
> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
> Build time: 2020-09-23T10:27:49+00:00
> Error time: 2020-09-24 02:33:46
> Node: castle
>
> ============================================================
>
> Reported error:
> ===============
>
> Description:
> Database initialization error
>
> Category: LinStorException
> Class name: SystemServiceStartException
> Class canonical name: com.linbit.SystemServiceStartException
> Generated at: Method 'initialize', Source file
> 'DbConnectionPoolInitializer.java', Line #56
> Error message: Database initialization error
>
> Call backtrace:
>
> Method Native Class:Line number
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category: RuntimeException
> Class name: LinStorDBRuntimeException
> Class canonical name:
> com.linbit.linstor.LinStorDBRuntimeException
> Generated at: Method 'setTransactionIsolation',
> Source file 'DbConnectionPool.java', Line #485
>
> Error message: Failed to set transaction isolation
>
> Call backtrace:
>
> Method Native Class:Line number
> setTransactionIsolation N
> com.linbit.linstor.dbcp.DbConnectionPool:485
> migrate N
> com.linbit.linstor.dbcp.DbConnectionPool:202
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category: Exception
> Class name: JdbcSQLException
> Class canonical name: org.h2.jdbc.JdbcSQLException
> Generated at: Method 'getJdbcSQLException', Source
> file 'DbException.java', Line #357
>
> Error message: Wrong user name or password [28000-197]
>
> Call backtrace:
>
> Method Native Class:Line number
> getJdbcSQLException N
> org.h2.message.DbException:357
> get N
> org.h2.message.DbException:179
> get N
> org.h2.message.DbException:155
> get N
> org.h2.message.DbException:144
> validateUserAndPassword N
> org.h2.engine.Engine:341
> createSessionAndValidate N
> org.h2.engine.Engine:165
> createSession N
> org.h2.engine.Engine:140
> createSession N org.h2.engine.Engine:28
> connectEmbeddedOrServer N
> org.h2.engine.SessionRemote:351
> <init> N
> org.h2.jdbc.JdbcConnection:124
> <init> N
> org.h2.jdbc.JdbcConnection:103
> connect N org.h2.Driver:69
> getConnection N
> java.sql.DriverManager:677
> getConnection N
> java.sql.DriverManager:189
> createConnection N
> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
> makeObject N
> org.apache.commons.dbcp2.PoolableConnectionFactory:355
> create N
> org.apache.commons.pool2.impl.GenericObjectPool:889
> borrowObject N
> org.apache.commons.pool2.impl.GenericObjectPool:424
> borrowObject N
> org.apache.commons.pool2.impl.GenericObjectPool:349
> getConnection N
> org.apache.commons.dbcp2.PoolingDataSource:134
> setTransactionIsolation N
> com.linbit.linstor.dbcp.DbConnectionPool:477
> migrate N
> com.linbit.linstor.dbcp.DbConnectionPool:202
> initialize N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
> startSystemServices N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
> start N
> com.linbit.linstor.core.Controller:337
> main N
> com.linbit.linstor.core.Controller:556
>
> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>
> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
> org.h2.message.DbException: Wrong user name or password [28000-197]
> at org.h2.message.DbException.get(DbException.java:179)
> at org.h2.message.DbException.get(DbException.java:155)
> at org.h2.message.DbException.get(DbException.java:144)
> at org.h2.engine.Engine.openSession(Engine.java:107)
> at org.h2.engine.Engine.openSession(Engine.java:179)
> at org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
> at org.h2.engine.Engine.createSession(Engine.java:140)
> at org.h2.engine.Engine.createSession(Engine.java:28)
> at
> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
> at org.h2.Driver.connect(Driver.java:69)
> at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
> at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
> at
> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
> at
> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
> at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
> at
> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
> at
> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
> at
> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
> at
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
> at
> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
> at com.linbit.linstor.core.Controller.start(Controller.java:337)
> at com.linbit.linstor.core.Controller.main(Controller.java:556)
> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
> [28000-197]
> at
> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
> ... 26 more
>
>
> Luckily, this is just a test environment, but I'd like to know if I messed
> up in my upgrade process somehow or this is a bug in the new version. I
> haven't downgraded or anything yet.
>
> Regards,
> Adam
>
>
> On 23/9/20 22:31, Rene Peinthor wrote:
>
> Hi!
>
> Here is a new minor Linstor release, this release contains more bug fixes
> than new features.
> Notable features are a new auto-unplace option, to reduce the
> replica-count of resources
> to the value set in the resource-group after a certain time. And
> error-reports can now be deleted
> from the REST-API (client).
>
> linstor-server 1.9.0
> --------------------
> * Added auto-"unplace", automatically removes resources if they exceed
> the replica count if `DrbdOptions/auto-unplace` is set
> * Added error-report deletion API
> * Expose DRBD promotion_score and may_promote via REST-API and server
> sent events
> * Prometheus metrics are now mostly cached and much faster to query
> * Send SD_NOTIFY READY to systemd if services are ready
> * OpenFlex resource are now correctly limited to 32 characters
> * Fix etcd modify net-interface (incorrect serialization)
> * Fix autoplacer also toggling diskless resources
> * Fix snapshot-shipping with more than 1 volume definitions
> * Fix zfs create options handling
> * Fixed recaching of lvm-filter
> * Fix missing client answer if drbd device doesn't become ready in
> reasonable time
> * REST-API v1.4.0
>
> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>
> Linstor PPA:
> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>
> Cheers,
> Rene
>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> drbd-user mailing list
> drbd-user@lists.linbit.com
> https://lists.linbit.com/mailman/listinfo/drbd-user
>
Re: linstor-server 1.9.0 release [ In reply to ]
On 24/9/20 15:30, Rene Peinthor wrote:
> Sounds weird, I don't think we changed anything with the database
> initialization.
>
> Can you post your /etc/linstor/linstor.toml?
>
> Cheers,
> Rene
>
Hi, please see the contents below (I assume these are default settings):

# Basic linstor configuration toml file
# For more options check documentation

[db]
  user = "linstor"
  password = "linstor"
  connection_url = "jdbc:h2:/var/lib/linstor/linstordb"

Thanks,
Adam


> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
> <mailinglists@websitemanagers.com.au
> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>
> Hi,
>
> After upgrading on one of my test nodes I got some errors, so I
> thought to upgrade the controller, and now I am unable to start
> the controller.
>
> Here is what I get in the system log:
>
> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
> Sep 24 02:33:41 castle Controller[1093]: Version:            1.9.0
> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
> Sep 24 02:33:41 castle Controller[1093]: Build time:        
> 2020-09-23T10:27:49+00:00
> Sep 24 02:33:41 castle Controller[1093]: Java Version:       11
> Sep 24 02:33:41 castle Controller[1093]: Java VM:           
> Debian, Version 11.0.8+10-post-Debian-1deb10u1
> Sep 24 02:33:41 castle Controller[1093]: Operating system:  
> Linux, Version 4.19.0-10-amd64
> Sep 24 02:33:41 castle Controller[1093]: Environment:       
> amd64, 2 processors, 1988 MiB memory reserved for allocations
> Sep 24 02:33:41 castle Controller[1093]: System components
> initialization in progress
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO 
> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO 
> LINSTOR/Controller - SYSTEM - Log directory set to:
> '/var/log/linstor-controller'
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN 
> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry
> operations will do nothing! See documentation:
> https://docs.sentry.io/clients/java/
> <https://docs.sentry.io/clients/java/> ***
> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Loading API classes started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO 
> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Dependency injection started.
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension
> module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Extension module
> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
> is not installed
> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal
> reflective access operation has occurred
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal
> reflective access by
> com.google.inject.internal.cglib.core.$ReflectUtils$1
> (file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
> reporting this to the maintainers of
> com.google.inject.internal.cglib.core.$ReflectUtils$1
> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
> --illegal-access=warn to enable warnings of further illegal
> reflective access operations
> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal
> access operations will be denied in a future release
> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Starting service instance
> 'TimerEventService' of type TimerEventService
> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO 
> LINSTOR/Controller - SYSTEM - Initializing the database connection
> pool
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
> LINSTOR/Controller - SYSTEM - Database initialization error
> [Report number 5F6B78E5-00000-000000]
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Shutdown in progress
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TaskScheduleService' of type TaskScheduleService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TaskScheduleService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'DatabaseService' of type DatabaseService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'DatabaseService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Shutting down service instance
> 'TimerEventService' of type TimerEventService
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Waiting for service instance
> 'TimerEventService' to complete shutdown
> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2]
> INFO  LINSTOR/Controller - SYSTEM - Shutdown complete
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service:
> Main process exited, code=exited, status=20/n/a
> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service:
> Failed with result 'exit-code'.
>
> Here is
> /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>
> ERROR REPORT 5F6B78E5-00000-000000
>
> ============================================================
>
> Application:                        LINBIT® LINSTOR
> Module:                             Controller
> Version:                            1.9.0
> Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
> Build time: 2020-09-23T10:27:49+00:00
> Error time:                         2020-09-24 02:33:46
> Node:                               castle
>
> ============================================================
>
> Reported error:
> ===============
>
> Description:
>     Database initialization error
>
> Category:                           LinStorException
> Class name: SystemServiceStartException
> Class canonical name: com.linbit.SystemServiceStartException
> Generated at:                       Method 'initialize', Source
> file 'DbConnectionPoolInitializer.java', Line #56
> Error message:                      Database initialization error
>
> Call backtrace:
>
>     Method                                   Native Class:Line number
>     initialize                               N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>     startSystemServices                      N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
>     start                                    N
> com.linbit.linstor.core.Controller:337
>     main                                     N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category:                           RuntimeException
> Class name: LinStorDBRuntimeException
> Class canonical name: com.linbit.linstor.LinStorDBRuntimeException
> Generated at:                       Method
> 'setTransactionIsolation', Source file 'DbConnectionPool.java',
> Line #485
>
> Error message:                      Failed to set transaction
> isolation
>
> Call backtrace:
>
>     Method                                   Native Class:Line number
>     setTransactionIsolation                  N
> com.linbit.linstor.dbcp.DbConnectionPool:485
>     migrate                                  N
> com.linbit.linstor.dbcp.DbConnectionPool:202
>     initialize                               N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>     startSystemServices                      N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
>     start                                    N
> com.linbit.linstor.core.Controller:337
>     main                                     N
> com.linbit.linstor.core.Controller:556
>
> Caused by:
> ==========
>
> Category:                           Exception
> Class name:                         JdbcSQLException
> Class canonical name: org.h2.jdbc.JdbcSQLException
> Generated at:                       Method 'getJdbcSQLException',
> Source file 'DbException.java', Line #357
>
> Error message:                      Wrong user name or password
> [28000-197]
>
> Call backtrace:
>
>     Method                                   Native Class:Line number
>     getJdbcSQLException                      N
> org.h2.message.DbException:357
>     get                                      N
> org.h2.message.DbException:179
>     get                                      N
> org.h2.message.DbException:155
>     get                                      N
> org.h2.message.DbException:144
>     validateUserAndPassword                  N
> org.h2.engine.Engine:341
>     createSessionAndValidate                 N
> org.h2.engine.Engine:165
>     createSession                            N
> org.h2.engine.Engine:140
>     createSession                            N org.h2.engine.Engine:28
>     connectEmbeddedOrServer                  N
> org.h2.engine.SessionRemote:351
>     <init>                                   N
> org.h2.jdbc.JdbcConnection:124
>     <init>                                   N
> org.h2.jdbc.JdbcConnection:103
>     connect                                  N org.h2.Driver:69
>     getConnection                            N
> java.sql.DriverManager:677
>     getConnection                            N
> java.sql.DriverManager:189
>     createConnection                         N
> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>     makeObject                               N
> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>     create                                   N
> org.apache.commons.pool2.impl.GenericObjectPool:889
>     borrowObject                             N
> org.apache.commons.pool2.impl.GenericObjectPool:424
>     borrowObject                             N
> org.apache.commons.pool2.impl.GenericObjectPool:349
>     getConnection                            N
> org.apache.commons.dbcp2.PoolingDataSource:134
>     setTransactionIsolation                  N
> com.linbit.linstor.dbcp.DbConnectionPool:477
>     migrate                                  N
> com.linbit.linstor.dbcp.DbConnectionPool:202
>     initialize                               N
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>     startSystemServices                      N
> com.linbit.linstor.core.ApplicationLifecycleManager:87
>     start                                    N
> com.linbit.linstor.core.Controller:337
>     main                                     N
> com.linbit.linstor.core.Controller:556
>
> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>
> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
> org.h2.message.DbException: Wrong user name or password [28000-197]
>         at org.h2.message.DbException.get(DbException.java:179)
>         at org.h2.message.DbException.get(DbException.java:155)
>         at org.h2.message.DbException.get(DbException.java:144)
>         at org.h2.engine.Engine.openSession(Engine.java:107)
>         at org.h2.engine.Engine.openSession(Engine.java:179)
>         at
> org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>         at org.h2.engine.Engine.createSession(Engine.java:140)
>         at org.h2.engine.Engine.createSession(Engine.java:28)
>         at
> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>         at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>         at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>         at org.h2.Driver.connect(Driver.java:69)
>         at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>         at
> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>         at
> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>         at
> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>         at
> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>         at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>         at
> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>         at
> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>         at
> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>         at
> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>         at
> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>         at
> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>         at
> com.linbit.linstor.core.Controller.start(Controller.java:337)
>         at
> com.linbit.linstor.core.Controller.main(Controller.java:556)
> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or
> password [28000-197]
>         at
> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>         ... 26 more
>
>
> Luckily, this is just a test environment, but I'd like to know if
> I messed up in my upgrade process somehow or this is a bug in the
> new version. I haven't downgraded or anything yet.
>
> Regards,
> Adam
>
>
> On 23/9/20 22:31, Rene Peinthor wrote:
>> Hi!
>>
>> Here is a new minor Linstor release, this release contains more
>> bug fixes than new features.
>> Notable features are a new auto-unplace option, to reduce the
>> replica-count of resources
>> to the value set in the resource-group after a certain time. And
>> error-reports can now be deleted
>> from the REST-API (client).
>>
>> linstor-server 1.9.0
>> --------------------
>>  * Added auto-"unplace", automatically removes resources if they
>> exceed the replica count if `DrbdOptions/auto-unplace` is set
>>  * Added error-report deletion API
>>  * Expose DRBD promotion_score and may_promote via REST-API and
>> server sent events
>>  * Prometheus metrics are now mostly cached and much faster to query
>>  * Send SD_NOTIFY READY to systemd if services are ready
>>  * OpenFlex resource are now correctly limited to 32 characters
>>  * Fix etcd modify net-interface (incorrect serialization)
>>  * Fix autoplacer also toggling diskless resources
>>  * Fix snapshot-shipping with more than 1 volume definitions
>>  * Fix zfs create options handling
>>  * Fixed recaching of lvm-filter
>>  * Fix missing client answer if drbd device doesn't become ready
>> in reasonable time
>>  * REST-API v1.4.0
>>
>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>> <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>>
>> Linstor PPA:
>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>> <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>>
>> Cheers,
>> Rene
>>
>> _______________________________________________
>> Star us on GITHUB:https://github.com/LINBIT <https://github.com/LINBIT>
>> drbd-user mailing list
>> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
>> https://lists.linbit.com/mailman/listinfo/drbd-user <https://lists.linbit.com/mailman/listinfo/drbd-user>
> _______________________________________________
> Star us on GITHUB: https://github.com/LINBIT
> <https://github.com/LINBIT>
> drbd-user mailing list
> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
> https://lists.linbit.com/mailman/listinfo/drbd-user
> <https://lists.linbit.com/mailman/listinfo/drbd-user>
>
Re: linstor-server 1.9.0 release [ In reply to ]
They are.
And how do you start the controller?

On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev <
mailinglists@websitemanagers.com.au> wrote:

>
> On 24/9/20 15:30, Rene Peinthor wrote:
>
> Sounds weird, I don't think we changed anything with the database
> initialization.
>
> Can you post your /etc/linstor/linstor.toml?
>
> Cheers,
> Rene
>
> Hi, please see the contents below (I assume these are default settings):
>
> # Basic linstor configuration toml file
> # For more options check documentation
>
> [db]
> user = "linstor"
> password = "linstor"
> connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>
> Thanks,
> Adam
>
>
> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev <
> mailinglists@websitemanagers.com.au> wrote:
>
>> Hi,
>>
>> After upgrading on one of my test nodes I got some errors, so I thought
>> to upgrade the controller, and now I am unable to start the controller.
>>
>> Here is what I get in the system log:
>>
>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
>> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>> Sep 24 02:33:41 castle Controller[1093]: Build time:
>> 2020-09-23T10:27:49+00:00
>> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
>> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
>> Version 11.0.8+10-post-Debian-1deb10u1
>> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
>> Version 4.19.0-10-amd64
>> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
>> processors, 1988 MiB memory reserved for allocations
>> Sep 24 02:33:41 castle Controller[1093]: System components initialization
>> in progress
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
>> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
>> LINSTOR/Controller - SYSTEM - Log directory set to:
>> '/var/log/linstor-controller'
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
>> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
>> will do nothing! See documentation: https://docs.sentry.io/clients/java/
>> ***
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Loading API classes started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
>> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Dependency injection started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Extension module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
>> installed
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
>> access operation has occurred
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
>> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
>> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
>> reporting this to the maintainers of
>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>> --illegal-access=warn to enable warnings of further illegal reflective
>> access operations
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
>> operations will be denied in a future release
>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Starting service instance 'TimerEventService'
>> of type TimerEventService
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
>> LINSTOR/Controller - SYSTEM - Initializing the database connection pool
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
>> LINSTOR/Controller - SYSTEM - Database initialization error [Report number
>> 5F6B78E5-00000-000000]
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutdown in progress
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'TaskScheduleService' of type TaskScheduleService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'TaskScheduleService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'DatabaseService' of type DatabaseService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'DatabaseService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>> 'TimerEventService' of type TimerEventService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>> 'TimerEventService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>> LINSTOR/Controller - SYSTEM - Shutdown complete
>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
>> process exited, code=exited, status=20/n/a
>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed
>> with result 'exit-code'.
>>
>> Here is /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>
>> ERROR REPORT 5F6B78E5-00000-000000
>>
>> ============================================================
>>
>> Application: LINBIT® LINSTOR
>> Module: Controller
>> Version: 1.9.0
>> Build ID:
>> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>> Build time: 2020-09-23T10:27:49+00:00
>> Error time: 2020-09-24 02:33:46
>> Node: castle
>>
>> ============================================================
>>
>> Reported error:
>> ===============
>>
>> Description:
>> Database initialization error
>>
>> Category: LinStorException
>> Class name: SystemServiceStartException
>> Class canonical name: com.linbit.SystemServiceStartException
>> Generated at: Method 'initialize', Source file
>> 'DbConnectionPoolInitializer.java', Line #56
>> Error message: Database initialization error
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category: RuntimeException
>> Class name: LinStorDBRuntimeException
>> Class canonical name:
>> com.linbit.linstor.LinStorDBRuntimeException
>> Generated at: Method 'setTransactionIsolation',
>> Source file 'DbConnectionPool.java', Line #485
>>
>> Error message: Failed to set transaction isolation
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:485
>> migrate N
>> com.linbit.linstor.dbcp.DbConnectionPool:202
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category: Exception
>> Class name: JdbcSQLException
>> Class canonical name: org.h2.jdbc.JdbcSQLException
>> Generated at: Method 'getJdbcSQLException', Source
>> file 'DbException.java', Line #357
>>
>> Error message: Wrong user name or password
>> [28000-197]
>>
>> Call backtrace:
>>
>> Method Native Class:Line number
>> getJdbcSQLException N
>> org.h2.message.DbException:357
>> get N
>> org.h2.message.DbException:179
>> get N
>> org.h2.message.DbException:155
>> get N
>> org.h2.message.DbException:144
>> validateUserAndPassword N
>> org.h2.engine.Engine:341
>> createSessionAndValidate N
>> org.h2.engine.Engine:165
>> createSession N
>> org.h2.engine.Engine:140
>> createSession N
>> org.h2.engine.Engine:28
>> connectEmbeddedOrServer N
>> org.h2.engine.SessionRemote:351
>> <init> N
>> org.h2.jdbc.JdbcConnection:124
>> <init> N
>> org.h2.jdbc.JdbcConnection:103
>> connect N org.h2.Driver:69
>> getConnection N
>> java.sql.DriverManager:677
>> getConnection N
>> java.sql.DriverManager:189
>> createConnection N
>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>> makeObject N
>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>> create N
>> org.apache.commons.pool2.impl.GenericObjectPool:889
>> borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:424
>> borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:349
>> getConnection N
>> org.apache.commons.dbcp2.PoolingDataSource:134
>> setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:477
>> migrate N
>> com.linbit.linstor.dbcp.DbConnectionPool:202
>> initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>> startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>> start N
>> com.linbit.linstor.core.Controller:337
>> main N
>> com.linbit.linstor.core.Controller:556
>>
>> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>>
>> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
>> org.h2.message.DbException: Wrong user name or password [28000-197]
>> at org.h2.message.DbException.get(DbException.java:179)
>> at org.h2.message.DbException.get(DbException.java:155)
>> at org.h2.message.DbException.get(DbException.java:144)
>> at org.h2.engine.Engine.openSession(Engine.java:107)
>> at org.h2.engine.Engine.openSession(Engine.java:179)
>> at org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>> at org.h2.engine.Engine.createSession(Engine.java:140)
>> at org.h2.engine.Engine.createSession(Engine.java:28)
>> at
>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>> at org.h2.Driver.connect(Driver.java:69)
>> at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>> at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>> at
>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>> at
>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>> at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>> at
>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>> at
>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>> at
>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>> at
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>> at
>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>> at com.linbit.linstor.core.Controller.start(Controller.java:337)
>> at com.linbit.linstor.core.Controller.main(Controller.java:556)
>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
>> [28000-197]
>> at
>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>> ... 26 more
>>
>>
>> Luckily, this is just a test environment, but I'd like to know if I
>> messed up in my upgrade process somehow or this is a bug in the new
>> version. I haven't downgraded or anything yet.
>>
>> Regards,
>> Adam
>>
>>
>> On 23/9/20 22:31, Rene Peinthor wrote:
>>
>> Hi!
>>
>> Here is a new minor Linstor release, this release contains more bug fixes
>> than new features.
>> Notable features are a new auto-unplace option, to reduce the
>> replica-count of resources
>> to the value set in the resource-group after a certain time. And
>> error-reports can now be deleted
>> from the REST-API (client).
>>
>> linstor-server 1.9.0
>> --------------------
>> * Added auto-"unplace", automatically removes resources if they exceed
>> the replica count if `DrbdOptions/auto-unplace` is set
>> * Added error-report deletion API
>> * Expose DRBD promotion_score and may_promote via REST-API and server
>> sent events
>> * Prometheus metrics are now mostly cached and much faster to query
>> * Send SD_NOTIFY READY to systemd if services are ready
>> * OpenFlex resource are now correctly limited to 32 characters
>> * Fix etcd modify net-interface (incorrect serialization)
>> * Fix autoplacer also toggling diskless resources
>> * Fix snapshot-shipping with more than 1 volume definitions
>> * Fix zfs create options handling
>> * Fixed recaching of lvm-filter
>> * Fix missing client answer if drbd device doesn't become ready in
>> reasonable time
>> * REST-API v1.4.0
>>
>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>
>> Linstor PPA:
>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>
>> Cheers,
>> Rene
>>
>> _______________________________________________
>> Star us on GITHUB: https://github.com/LINBIT
>> drbd-user mailing listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>>
>> _______________________________________________
>> Star us on GITHUB: https://github.com/LINBIT
>> drbd-user mailing list
>> drbd-user@lists.linbit.com
>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>
>
Re: linstor-server 1.9.0 release [ In reply to ]
On 24/9/20 22:42, Rene Peinthor wrote:
> They are.
> And how do you start the controller?
>
It should start automatically at boot from systemd, but I can start it
manually with:

systemctl restart linstor-controller

In case it is your next question, here is the content of
/etc/systemd/system/multi-user.target.wants/linstor-controller.service

[Unit]
Description=LINSTOR Controller Service
Wants=network-online.target
After=network-online.target

[Service]
Type=simple
ExecStart=/usr/share/linstor-server/bin/Controller
--logs=/var/log/linstor-controller --config-directory=/etc/linstor
# if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
SuccessExitStatus=0 143 129
User=root
PrivateTmp=yes

[Install]
WantedBy=multi-user.target

Regards,
Adam

> On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev
> <mailinglists@websitemanagers.com.au
> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>
>
> On 24/9/20 15:30, Rene Peinthor wrote:
>> Sounds weird, I don't think we changed anything with the database
>> initialization.
>>
>> Can you post your /etc/linstor/linstor.toml?
>>
>> Cheers,
>> Rene
>>
> Hi, please see the contents below (I assume these are default
> settings):
>
> # Basic linstor configuration toml file
> # For more options check documentation
>
> [db]
>   user = "linstor"
>   password = "linstor"
>   connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>
> Thanks,
> Adam
>
>
>> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
>> <mailinglists@websitemanagers.com.au
>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>
>> Hi,
>>
>> After upgrading on one of my test nodes I got some errors, so
>> I thought to upgrade the controller, and now I am unable to
>> start the controller.
>>
>> Here is what I get in the system log:
>>
>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller
>> Service.
>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module
>> Controller
>> Sep 24 02:33:41 castle Controller[1093]: Version:           
>> 1.9.0 (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>> Sep 24 02:33:41 castle Controller[1093]: Build time:        
>> 2020-09-23T10:27:49+00:00
>> Sep 24 02:33:41 castle Controller[1093]: Java Version:       11
>> Sep 24 02:33:41 castle Controller[1093]: Java VM:           
>> Debian, Version 11.0.8+10-post-Debian-1deb10u1
>> Sep 24 02:33:41 castle Controller[1093]: Operating system:  
>> Linux, Version 4.19.0-10-amd64
>> Sep 24 02:33:41 castle Controller[1093]: Environment:       
>> amd64, 2 processors, 1988 MiB memory reserved for allocations
>> Sep 24 02:33:41 castle Controller[1093]: System components
>> initialization in progress
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main]
>> INFO  LINSTOR/Controller - SYSTEM - ErrorReporter DB version
>> 1 found.
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main]
>> INFO  LINSTOR/Controller - SYSTEM - Log directory set to:
>> '/var/log/linstor-controller'
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main]
>> WARN  io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN,
>> Sentry operations will do nothing! See documentation:
>> https://docs.sentry.io/clients/java/
>> <https://docs.sentry.io/clients/java/> ***
>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Loading API classes started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - API classes loading
>> finished: 611ms
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Dependency injection started.
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Attempting dynamic load
>> of extension module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Extension module
>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>> is not installed
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal
>> reflective access operation has occurred
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal
>> reflective access by
>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>> (file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to
>> method
>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please
>> consider reporting this to the maintainers of
>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>> --illegal-access=warn to enable warnings of further illegal
>> reflective access operations
>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal
>> access operations will be denied in a future release
>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Dependency injection
>> finished: 1915ms
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Initializing
>> authentication subsystem
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Starting service instance
>> 'TimerEventService' of type TimerEventService
>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main]
>> INFO  LINSTOR/Controller - SYSTEM - Initializing the database
>> connection pool
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main]
>> ERROR LINSTOR/Controller - SYSTEM - Database initialization
>> error [Report number 5F6B78E5-00000-000000]
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Shutdown in
>> progress
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Shutting down
>> service instance 'TaskScheduleService' of type
>> TaskScheduleService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Waiting for
>> service instance 'TaskScheduleService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Shutting down
>> service instance 'DatabaseService' of type DatabaseService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Waiting for
>> service instance 'DatabaseService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Shutting down
>> service instance 'TimerEventService' of type TimerEventService
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Waiting for
>> service instance 'TimerEventService' to complete shutdown
>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>> [Thread-2] INFO  LINSTOR/Controller - SYSTEM - Shutdown complete
>> Sep 24 02:33:46 castle systemd[1]:
>> linstor-controller.service: Main process exited, code=exited,
>> status=20/n/a
>> Sep 24 02:33:46 castle systemd[1]:
>> linstor-controller.service: Failed with result 'exit-code'.
>>
>> Here is
>> /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>
>> ERROR REPORT 5F6B78E5-00000-000000
>>
>> ============================================================
>>
>> Application:                        LINBIT® LINSTOR
>> Module:                             Controller
>> Version:                            1.9.0
>> Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>> Build time: 2020-09-23T10:27:49+00:00
>> Error time:                         2020-09-24 02:33:46
>> Node:                               castle
>>
>> ============================================================
>>
>> Reported error:
>> ===============
>>
>> Description:
>>     Database initialization error
>>
>> Category: LinStorException
>> Class name: SystemServiceStartException
>> Class canonical name: com.linbit.SystemServiceStartException
>> Generated at:                       Method 'initialize',
>> Source file 'DbConnectionPoolInitializer.java', Line #56
>> Error message:                      Database initialization error
>>
>> Call backtrace:
>>
>>     Method Native Class:Line number
>>     initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>     startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>     start N      com.linbit.linstor.core.Controller:337
>>     main N      com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category: RuntimeException
>> Class name: LinStorDBRuntimeException
>> Class canonical name:
>> com.linbit.linstor.LinStorDBRuntimeException
>> Generated at:                       Method
>> 'setTransactionIsolation', Source file
>> 'DbConnectionPool.java', Line #485
>>
>> Error message:                      Failed to set transaction
>> isolation
>>
>> Call backtrace:
>>
>>     Method Native Class:Line number
>>     setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:485
>>     migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>     initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>     startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>     start N      com.linbit.linstor.core.Controller:337
>>     main N      com.linbit.linstor.core.Controller:556
>>
>> Caused by:
>> ==========
>>
>> Category:                           Exception
>> Class name: JdbcSQLException
>> Class canonical name: org.h2.jdbc.JdbcSQLException
>> Generated at:                       Method
>> 'getJdbcSQLException', Source file 'DbException.java', Line #357
>>
>> Error message:                      Wrong user name or
>> password [28000-197]
>>
>> Call backtrace:
>>
>>     Method Native Class:Line number
>>     getJdbcSQLException N      org.h2.message.DbException:357
>>     get N      org.h2.message.DbException:179
>>     get N      org.h2.message.DbException:155
>>     get N      org.h2.message.DbException:144
>>     validateUserAndPassword N      org.h2.engine.Engine:341
>>     createSessionAndValidate N      org.h2.engine.Engine:165
>>     createSession N      org.h2.engine.Engine:140
>>     createSession N      org.h2.engine.Engine:28
>>     connectEmbeddedOrServer N     
>> org.h2.engine.SessionRemote:351
>>     <init> N      org.h2.jdbc.JdbcConnection:124
>>     <init> N      org.h2.jdbc.JdbcConnection:103
>>     connect N      org.h2.Driver:69
>>     getConnection N      java.sql.DriverManager:677
>>     getConnection N      java.sql.DriverManager:189
>>     createConnection N
>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>     makeObject N
>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>     create N org.apache.commons.pool2.impl.GenericObjectPool:889
>>     borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:424
>>     borrowObject N
>> org.apache.commons.pool2.impl.GenericObjectPool:349
>>     getConnection N
>> org.apache.commons.dbcp2.PoolingDataSource:134
>>     setTransactionIsolation N
>> com.linbit.linstor.dbcp.DbConnectionPool:477
>>     migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>     initialize N
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>     startSystemServices N
>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>     start N      com.linbit.linstor.core.Controller:337
>>     main N      com.linbit.linstor.core.Controller:556
>>
>> Finally I found another log in
>> /var/lib/linstor/linstordb.trace.db
>>
>> 2020-09-24 02:33:45 database: wrong user or password; user:
>> "LINSTOR"
>> org.h2.message.DbException: Wrong user name or password
>> [28000-197]
>>         at org.h2.message.DbException.get(DbException.java:179)
>>         at org.h2.message.DbException.get(DbException.java:155)
>>         at org.h2.message.DbException.get(DbException.java:144)
>>         at org.h2.engine.Engine.openSession(Engine.java:107)
>>         at org.h2.engine.Engine.openSession(Engine.java:179)
>>         at
>> org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>         at org.h2.engine.Engine.createSession(Engine.java:140)
>>         at org.h2.engine.Engine.createSession(Engine.java:28)
>>         at
>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>         at
>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>         at
>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>         at org.h2.Driver.connect(Driver.java:69)
>>         at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>         at
>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>         at
>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>         at
>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>         at
>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>         at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>         at
>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>         at
>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>         at
>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>         at
>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>         at
>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>         at
>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>         at
>> com.linbit.linstor.core.Controller.start(Controller.java:337)
>>         at
>> com.linbit.linstor.core.Controller.main(Controller.java:556)
>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or
>> password [28000-197]
>>         at
>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>         ... 26 more
>>
>>
>> Luckily, this is just a test environment, but I'd like to
>> know if I messed up in my upgrade process somehow or this is
>> a bug in the new version. I haven't downgraded or anything yet.
>>
>> Regards,
>> Adam
>>
>>
>> On 23/9/20 22:31, Rene Peinthor wrote:
>>> Hi!
>>>
>>> Here is a new minor Linstor release, this release contains
>>> more bug fixes than new features.
>>> Notable features are a new auto-unplace option, to reduce
>>> the replica-count of resources
>>> to the value set in the resource-group after a certain time.
>>> And error-reports can now be deleted
>>> from the REST-API (client).
>>>
>>> linstor-server 1.9.0
>>> --------------------
>>>  * Added auto-"unplace", automatically removes resources if
>>> they exceed the replica count if `DrbdOptions/auto-unplace`
>>> is set
>>>  * Added error-report deletion API
>>>  * Expose DRBD promotion_score and may_promote via REST-API
>>> and server sent events
>>>  * Prometheus metrics are now mostly cached and much faster
>>> to query
>>>  * Send SD_NOTIFY READY to systemd if services are ready
>>>  * OpenFlex resource are now correctly limited to 32 characters
>>>  * Fix etcd modify net-interface (incorrect serialization)
>>>  * Fix autoplacer also toggling diskless resources
>>>  * Fix snapshot-shipping with more than 1 volume definitions
>>>  * Fix zfs create options handling
>>>  * Fixed recaching of lvm-filter
>>>  * Fix missing client answer if drbd device doesn't become
>>> ready in reasonable time
>>>  * REST-API v1.4.0
>>>
>>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>> <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>>>
>>> Linstor PPA:
>>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>> <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>>>
>>> Cheers,
>>> Rene
>>>
>>> _______________________________________________
>>> Star us on GITHUB:https://github.com/LINBIT <https://github.com/LINBIT>
>>> drbd-user mailing list
>>> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
>>> https://lists.linbit.com/mailman/listinfo/drbd-user <https://lists.linbit.com/mailman/listinfo/drbd-user>
>> _______________________________________________
>> Star us on GITHUB: https://github.com/LINBIT
>> <https://github.com/LINBIT>
>> drbd-user mailing list
>> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
>> https://lists.linbit.com/mailman/listinfo/drbd-user
>> <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>
Re: linstor-server 1.9.0 release [ In reply to ]
I can only recreate that error, if I actively change the password in the
linstor.toml to something incorrect.
I don't know how this would happen in normal operation, are you sure you
never had another password or changed the password?

if you can connect to the h2 database with the commandline tool, you might
be able to set a new password.

Cheers,
Rene

On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev <
mailinglists@websitemanagers.com.au> wrote:

>
> On 24/9/20 22:42, Rene Peinthor wrote:
>
> They are.
> And how do you start the controller?
>
> It should start automatically at boot from systemd, but I can start it
> manually with:
>
> systemctl restart linstor-controller
>
> In case it is your next question, here is the content of
> /etc/systemd/system/multi-user.target.wants/linstor-controller.service
>
> [Unit]
> Description=LINSTOR Controller Service
> Wants=network-online.target
> After=network-online.target
>
> [Service]
> Type=simple
> ExecStart=/usr/share/linstor-server/bin/Controller
> --logs=/var/log/linstor-controller --config-directory=/etc/linstor
> # if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
> SuccessExitStatus=0 143 129
> User=root
> PrivateTmp=yes
>
> [Install]
> WantedBy=multi-user.target
>
> Regards,
> Adam
>
> On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev <
> mailinglists@websitemanagers.com.au> wrote:
>
>>
>> On 24/9/20 15:30, Rene Peinthor wrote:
>>
>> Sounds weird, I don't think we changed anything with the database
>> initialization.
>>
>> Can you post your /etc/linstor/linstor.toml?
>>
>> Cheers,
>> Rene
>>
>> Hi, please see the contents below (I assume these are default settings):
>>
>> # Basic linstor configuration toml file
>> # For more options check documentation
>>
>> [db]
>> user = "linstor"
>> password = "linstor"
>> connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>>
>> Thanks,
>> Adam
>>
>>
>> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev <
>> mailinglists@websitemanagers.com.au> wrote:
>>
>>> Hi,
>>>
>>> After upgrading on one of my test nodes I got some errors, so I thought
>>> to upgrade the controller, and now I am unable to start the controller.
>>>
>>> Here is what I get in the system log:
>>>
>>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
>>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
>>> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
>>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>>> Sep 24 02:33:41 castle Controller[1093]: Build time:
>>> 2020-09-23T10:27:49+00:00
>>> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
>>> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
>>> Version 11.0.8+10-post-Debian-1deb10u1
>>> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
>>> Version 4.19.0-10-amd64
>>> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
>>> processors, 1988 MiB memory reserved for allocations
>>> Sep 24 02:33:41 castle Controller[1093]: System components
>>> initialization in progress
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
>>> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
>>> LINSTOR/Controller - SYSTEM - Log directory set to:
>>> '/var/log/linstor-controller'
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
>>> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
>>> will do nothing! See documentation: https://docs.sentry.io/clients/java/
>>> ***
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Loading API classes started.
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Dependency injection started.
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension module
>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Extension module
>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
>>> installed
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
>>> access operation has occurred
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
>>> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
>>> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
>>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
>>> reporting this to the maintainers of
>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>>> --illegal-access=warn to enable warnings of further illegal reflective
>>> access operations
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
>>> operations will be denied in a future release
>>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Starting service instance 'TimerEventService'
>>> of type TimerEventService
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
>>> LINSTOR/Controller - SYSTEM - Initializing the database connection pool
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
>>> LINSTOR/Controller - SYSTEM - Database initialization error [Report number
>>> 5F6B78E5-00000-000000]
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Shutdown in progress
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>> 'TaskScheduleService' of type TaskScheduleService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>> 'TaskScheduleService' to complete shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>> 'DatabaseService' of type DatabaseService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>> 'DatabaseService' to complete shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>> 'TimerEventService' of type TimerEventService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>> 'TimerEventService' to complete shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>>> LINSTOR/Controller - SYSTEM - Shutdown complete
>>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
>>> process exited, code=exited, status=20/n/a
>>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed
>>> with result 'exit-code'.
>>>
>>> Here is /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>>
>>> ERROR REPORT 5F6B78E5-00000-000000
>>>
>>> ============================================================
>>>
>>> Application: LINBIT® LINSTOR
>>> Module: Controller
>>> Version: 1.9.0
>>> Build ID:
>>> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>>> Build time: 2020-09-23T10:27:49+00:00
>>> Error time: 2020-09-24 02:33:46
>>> Node: castle
>>>
>>> ============================================================
>>>
>>> Reported error:
>>> ===============
>>>
>>> Description:
>>> Database initialization error
>>>
>>> Category: LinStorException
>>> Class name: SystemServiceStartException
>>> Class canonical name:
>>> com.linbit.SystemServiceStartException
>>> Generated at: Method 'initialize', Source file
>>> 'DbConnectionPoolInitializer.java', Line #56
>>> Error message: Database initialization error
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N
>>> com.linbit.linstor.core.Controller:337
>>> main N
>>> com.linbit.linstor.core.Controller:556
>>>
>>> Caused by:
>>> ==========
>>>
>>> Category: RuntimeException
>>> Class name: LinStorDBRuntimeException
>>> Class canonical name:
>>> com.linbit.linstor.LinStorDBRuntimeException
>>> Generated at: Method 'setTransactionIsolation',
>>> Source file 'DbConnectionPool.java', Line #485
>>>
>>> Error message: Failed to set transaction isolation
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> setTransactionIsolation N
>>> com.linbit.linstor.dbcp.DbConnectionPool:485
>>> migrate N
>>> com.linbit.linstor.dbcp.DbConnectionPool:202
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N
>>> com.linbit.linstor.core.Controller:337
>>> main N
>>> com.linbit.linstor.core.Controller:556
>>>
>>> Caused by:
>>> ==========
>>>
>>> Category: Exception
>>> Class name: JdbcSQLException
>>> Class canonical name: org.h2.jdbc.JdbcSQLException
>>> Generated at: Method 'getJdbcSQLException', Source
>>> file 'DbException.java', Line #357
>>>
>>> Error message: Wrong user name or password
>>> [28000-197]
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> getJdbcSQLException N
>>> org.h2.message.DbException:357
>>> get N
>>> org.h2.message.DbException:179
>>> get N
>>> org.h2.message.DbException:155
>>> get N
>>> org.h2.message.DbException:144
>>> validateUserAndPassword N
>>> org.h2.engine.Engine:341
>>> createSessionAndValidate N
>>> org.h2.engine.Engine:165
>>> createSession N
>>> org.h2.engine.Engine:140
>>> createSession N
>>> org.h2.engine.Engine:28
>>> connectEmbeddedOrServer N
>>> org.h2.engine.SessionRemote:351
>>> <init> N
>>> org.h2.jdbc.JdbcConnection:124
>>> <init> N
>>> org.h2.jdbc.JdbcConnection:103
>>> connect N org.h2.Driver:69
>>> getConnection N
>>> java.sql.DriverManager:677
>>> getConnection N
>>> java.sql.DriverManager:189
>>> createConnection N
>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>> makeObject N
>>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>> create N
>>> org.apache.commons.pool2.impl.GenericObjectPool:889
>>> borrowObject N
>>> org.apache.commons.pool2.impl.GenericObjectPool:424
>>> borrowObject N
>>> org.apache.commons.pool2.impl.GenericObjectPool:349
>>> getConnection N
>>> org.apache.commons.dbcp2.PoolingDataSource:134
>>> setTransactionIsolation N
>>> com.linbit.linstor.dbcp.DbConnectionPool:477
>>> migrate N
>>> com.linbit.linstor.dbcp.DbConnectionPool:202
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N
>>> com.linbit.linstor.core.Controller:337
>>> main N
>>> com.linbit.linstor.core.Controller:556
>>>
>>> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>>>
>>> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
>>> org.h2.message.DbException: Wrong user name or password [28000-197]
>>> at org.h2.message.DbException.get(DbException.java:179)
>>> at org.h2.message.DbException.get(DbException.java:155)
>>> at org.h2.message.DbException.get(DbException.java:144)
>>> at org.h2.engine.Engine.openSession(Engine.java:107)
>>> at org.h2.engine.Engine.openSession(Engine.java:179)
>>> at org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>> at org.h2.engine.Engine.createSession(Engine.java:140)
>>> at org.h2.engine.Engine.createSession(Engine.java:28)
>>> at
>>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>> at org.h2.Driver.connect(Driver.java:69)
>>> at
>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>> at
>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>> at
>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>> at
>>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>> at
>>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>> at
>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>> at
>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>> at
>>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>> at
>>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>> at
>>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>> at
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>> at
>>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>> at com.linbit.linstor.core.Controller.start(Controller.java:337)
>>> at com.linbit.linstor.core.Controller.main(Controller.java:556)
>>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
>>> [28000-197]
>>> at
>>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>> ... 26 more
>>>
>>>
>>> Luckily, this is just a test environment, but I'd like to know if I
>>> messed up in my upgrade process somehow or this is a bug in the new
>>> version. I haven't downgraded or anything yet.
>>>
>>> Regards,
>>> Adam
>>>
>>>
>>> On 23/9/20 22:31, Rene Peinthor wrote:
>>>
>>> Hi!
>>>
>>> Here is a new minor Linstor release, this release contains more bug
>>> fixes than new features.
>>> Notable features are a new auto-unplace option, to reduce the
>>> replica-count of resources
>>> to the value set in the resource-group after a certain time. And
>>> error-reports can now be deleted
>>> from the REST-API (client).
>>>
>>> linstor-server 1.9.0
>>> --------------------
>>> * Added auto-"unplace", automatically removes resources if they exceed
>>> the replica count if `DrbdOptions/auto-unplace` is set
>>> * Added error-report deletion API
>>> * Expose DRBD promotion_score and may_promote via REST-API and server
>>> sent events
>>> * Prometheus metrics are now mostly cached and much faster to query
>>> * Send SD_NOTIFY READY to systemd if services are ready
>>> * OpenFlex resource are now correctly limited to 32 characters
>>> * Fix etcd modify net-interface (incorrect serialization)
>>> * Fix autoplacer also toggling diskless resources
>>> * Fix snapshot-shipping with more than 1 volume definitions
>>> * Fix zfs create options handling
>>> * Fixed recaching of lvm-filter
>>> * Fix missing client answer if drbd device doesn't become ready in
>>> reasonable time
>>> * REST-API v1.4.0
>>>
>>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>>
>>> Linstor PPA:
>>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>>
>>> Cheers,
>>> Rene
>>>
>>> _______________________________________________
>>> Star us on GITHUB: https://github.com/LINBIT
>>> drbd-user mailing listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>>>
>>> _______________________________________________
>>> Star us on GITHUB: https://github.com/LINBIT
>>> drbd-user mailing list
>>> drbd-user@lists.linbit.com
>>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>>
>>
Re: linstor-server 1.9.0 release [ In reply to ]
On 24/9/20 23:48, Rene Peinthor wrote:
> I can only recreate that error, if I actively change the password in
> the linstor.toml to something incorrect.
> I don't know how this would happen in normal operation, are you sure
> you never had another password or changed the password?
>
> if you can connect to the h2 database with the commandline tool, you
> might be able to set a new password.
>
I tried this method:

castle:/usr/share/linstor-server/lib#  java -cp h2*.jar org.h2.tools.Shell

Welcome to H2 Shell 1.4.197 (2018-03-18)
Exit with Ctrl+C
[Enter]   jdbc:h2:~/test
URL       jdbc:h2:/var/lib/linstor/linstordb
[Enter]   org.h2.Driver
Driver
[Enter]
User      linstor
[Enter]   Hide
Password  linstor
SQL Exception: Wrong user name or password [28000-197]

However, it requires user/pass, which clearly is wrong....

Is there a method to confirm that the file is "valid" ? I seem to have
three versions of this file all identical content:

-rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db
-rw-r--r-- 1 root root 376832 Sep 24 02:25
linstordb.mv.db-2020-09-24T02:25+10:00.bak
-rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak

Should I just delete the DB file and start again? Is this data
replicated to other nodes automatically?

Thanks,
Adam


> Cheers,
> Rene
>
> On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev
> <mailinglists@websitemanagers.com.au
> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>
>
> On 24/9/20 22:42, Rene Peinthor wrote:
>> They are.
>> And how do you start the controller?
>>
> It should start automatically at boot from systemd, but I can
> start it manually with:
>
> systemctl restart linstor-controller
>
> In case it is your next question, here is the content of
> /etc/systemd/system/multi-user.target.wants/linstor-controller.service
>
> [Unit]
> Description=LINSTOR Controller Service
> Wants=network-online.target
> After=network-online.target
>
> [Service]
> Type=simple
> ExecStart=/usr/share/linstor-server/bin/Controller
> --logs=/var/log/linstor-controller --config-directory=/etc/linstor
> # if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
> SuccessExitStatus=0 143 129
> User=root
> PrivateTmp=yes
>
> [Install]
> WantedBy=multi-user.target
>
> Regards,
> Adam
>
>> On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev
>> <mailinglists@websitemanagers.com.au
>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>
>>
>> On 24/9/20 15:30, Rene Peinthor wrote:
>>> Sounds weird, I don't think we changed anything with the
>>> database initialization.
>>>
>>> Can you post your /etc/linstor/linstor.toml?
>>>
>>> Cheers,
>>> Rene
>>>
>> Hi, please see the contents below (I assume these are default
>> settings):
>>
>> # Basic linstor configuration toml file
>> # For more options check documentation
>>
>> [db]
>>   user = "linstor"
>>   password = "linstor"
>>   connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>>
>> Thanks,
>> Adam
>>
>>
>>> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
>>> <mailinglists@websitemanagers.com.au
>>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>>
>>> Hi,
>>>
>>> After upgrading on one of my test nodes I got some
>>> errors, so I thought to upgrade the controller, and now
>>> I am unable to start the controller.
>>>
>>> Here is what I get in the system log:
>>>
>>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR
>>> Controller Service.
>>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module
>>> Controller
>>> Sep 24 02:33:41 castle Controller[1093]:
>>> Version:            1.9.0
>>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>>> Sep 24 02:33:41 castle Controller[1093]: Build time:
>>> 2020-09-23T10:27:49+00:00
>>> Sep 24 02:33:41 castle Controller[1093]: Java
>>> Version:       11
>>> Sep 24 02:33:41 castle Controller[1093]: Java
>>> VM:            Debian, Version
>>> 11.0.8+10-post-Debian-1deb10u1
>>> Sep 24 02:33:41 castle Controller[1093]: Operating
>>> system:   Linux, Version 4.19.0-10-amd64
>>> Sep 24 02:33:41 castle Controller[1093]:
>>> Environment:        amd64, 2 processors, 1988 MiB memory
>>> reserved for allocations
>>> Sep 24 02:33:41 castle Controller[1093]: System
>>> components initialization in progress
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355
>>> [main] INFO LINSTOR/Controller - SYSTEM - ErrorReporter
>>> DB version 1 found.
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359
>>> [main] INFO LINSTOR/Controller - SYSTEM - Log directory
>>> set to: '/var/log/linstor-controller'
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410
>>> [main] WARN io.sentry.dsn.Dsn - *** Couldn't find a
>>> suitable DSN, Sentry operations will do nothing! See
>>> documentation: https://docs.sentry.io/clients/java/
>>> <https://docs.sentry.io/clients/java/> ***
>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Loading API
>>> classes started.
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046
>>> [Main] INFO LINSTOR/Controller - SYSTEM - API classes
>>> loading finished: 611ms
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Dependency
>>> injection started.
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Attempting
>>> dynamic load of extension module
>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Extension
>>> module
>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>> is not installed
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An
>>> illegal reflective access operation has occurred
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>> Illegal reflective access by
>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>> (file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to
>>> method
>>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please
>>> consider reporting this to the maintainers of
>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>>> --illegal-access=warn to enable warnings of further
>>> illegal reflective access operations
>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All
>>> illegal access operations will be denied in a future release
>>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Dependency
>>> injection finished: 1915ms
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Initializing
>>> authentication subsystem
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Starting
>>> service instance 'TimerEventService' of type
>>> TimerEventService
>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740
>>> [Main] INFO LINSTOR/Controller - SYSTEM - Initializing
>>> the database connection pool
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303
>>> [Main] ERROR LINSTOR/Controller - SYSTEM - Database
>>> initialization error [Report number 5F6B78E5-00000-000000]
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutdown
>>> in progress
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>> down service instance 'TaskScheduleService' of type
>>> TaskScheduleService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>> for service instance 'TaskScheduleService' to complete
>>> shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>> down service instance 'DatabaseService' of type
>>> DatabaseService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>> for service instance 'DatabaseService' to complete shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutting
>>> down service instance 'TimerEventService' of type
>>> TimerEventService
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Waiting
>>> for service instance 'TimerEventService' to complete
>>> shutdown
>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351
>>> [Thread-2] INFO LINSTOR/Controller - SYSTEM - Shutdown
>>> complete
>>> Sep 24 02:33:46 castle systemd[1]:
>>> linstor-controller.service: Main process exited,
>>> code=exited, status=20/n/a
>>> Sep 24 02:33:46 castle systemd[1]:
>>> linstor-controller.service: Failed with result 'exit-code'.
>>>
>>> Here is
>>> /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>>
>>> ERROR REPORT 5F6B78E5-00000-000000
>>>
>>> ============================================================
>>>
>>> Application: LINBIT® LINSTOR
>>> Module: Controller
>>> Version:                            1.9.0
>>> Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>>> Build time: 2020-09-23T10:27:49+00:00
>>> Error time: 2020-09-24 02:33:46
>>> Node:                               castle
>>>
>>> ============================================================
>>>
>>> Reported error:
>>> ===============
>>>
>>> Description:
>>>     Database initialization error
>>>
>>> Category: LinStorException
>>> Class name: SystemServiceStartException
>>> Class canonical name: com.linbit.SystemServiceStartException
>>> Generated at:                       Method 'initialize',
>>> Source file 'DbConnectionPoolInitializer.java', Line #56
>>> Error message: Database initialization error
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N com.linbit.linstor.core.Controller:337
>>> main N com.linbit.linstor.core.Controller:556
>>>
>>> Caused by:
>>> ==========
>>>
>>> Category: RuntimeException
>>> Class name: LinStorDBRuntimeException
>>> Class canonical name:
>>> com.linbit.linstor.LinStorDBRuntimeException
>>> Generated at:                       Method
>>> 'setTransactionIsolation', Source file
>>> 'DbConnectionPool.java', Line #485
>>>
>>> Error message:                      Failed to set
>>> transaction isolation
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> setTransactionIsolation N
>>> com.linbit.linstor.dbcp.DbConnectionPool:485
>>> migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N com.linbit.linstor.core.Controller:337
>>> main N com.linbit.linstor.core.Controller:556
>>>
>>> Caused by:
>>> ==========
>>>
>>> Category: Exception
>>> Class name: JdbcSQLException
>>> Class canonical name: org.h2.jdbc.JdbcSQLException
>>> Generated at:                       Method
>>> 'getJdbcSQLException', Source file 'DbException.java',
>>> Line #357
>>>
>>> Error message:                      Wrong user name or
>>> password [28000-197]
>>>
>>> Call backtrace:
>>>
>>> Method Native Class:Line number
>>> getJdbcSQLException N      org.h2.message.DbException:357
>>> get N      org.h2.message.DbException:179
>>> get N      org.h2.message.DbException:155
>>> get N      org.h2.message.DbException:144
>>> validateUserAndPassword N      org.h2.engine.Engine:341
>>> createSessionAndValidate N      org.h2.engine.Engine:165
>>> createSession N      org.h2.engine.Engine:140
>>> createSession N      org.h2.engine.Engine:28
>>> connectEmbeddedOrServer N     
>>> org.h2.engine.SessionRemote:351
>>> <init> N      org.h2.jdbc.JdbcConnection:124
>>> <init> N      org.h2.jdbc.JdbcConnection:103
>>> connect N      org.h2.Driver:69
>>> getConnection N      java.sql.DriverManager:677
>>> getConnection N      java.sql.DriverManager:189
>>> createConnection N
>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>> makeObject N
>>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>> create N org.apache.commons.pool2.impl.GenericObjectPool:889
>>> borrowObject N
>>> org.apache.commons.pool2.impl.GenericObjectPool:424
>>> borrowObject N
>>> org.apache.commons.pool2.impl.GenericObjectPool:349
>>> getConnection N
>>> org.apache.commons.dbcp2.PoolingDataSource:134
>>> setTransactionIsolation N
>>> com.linbit.linstor.dbcp.DbConnectionPool:477
>>> migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>> initialize N
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>> startSystemServices N
>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>> start N com.linbit.linstor.core.Controller:337
>>> main N com.linbit.linstor.core.Controller:556
>>>
>>> Finally I found another log in
>>> /var/lib/linstor/linstordb.trace.db
>>>
>>> 2020-09-24 02:33:45 database: wrong user or password;
>>> user: "LINSTOR"
>>> org.h2.message.DbException: Wrong user name or password
>>> [28000-197]
>>>         at
>>> org.h2.message.DbException.get(DbException.java:179)
>>>         at
>>> org.h2.message.DbException.get(DbException.java:155)
>>>         at
>>> org.h2.message.DbException.get(DbException.java:144)
>>>         at org.h2.engine.Engine.openSession(Engine.java:107)
>>>         at org.h2.engine.Engine.openSession(Engine.java:179)
>>>         at
>>> org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>>         at
>>> org.h2.engine.Engine.createSession(Engine.java:140)
>>>         at
>>> org.h2.engine.Engine.createSession(Engine.java:28)
>>>         at
>>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>>         at
>>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>>         at
>>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>>         at org.h2.Driver.connect(Driver.java:69)
>>>         at
>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>>         at
>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>>         at
>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>>         at
>>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>>         at
>>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>>         at
>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>>         at
>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>>         at
>>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>>         at
>>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>>         at
>>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>>         at
>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>>         at
>>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>>         at
>>> com.linbit.linstor.core.Controller.start(Controller.java:337)
>>>         at
>>> com.linbit.linstor.core.Controller.main(Controller.java:556)
>>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name
>>> or password [28000-197]
>>>         at
>>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>>         ... 26 more
>>>
>>>
>>> Luckily, this is just a test environment, but I'd like
>>> to know if I messed up in my upgrade process somehow or
>>> this is a bug in the new version. I haven't downgraded
>>> or anything yet.
>>>
>>> Regards,
>>> Adam
>>>
>>>
>>> On 23/9/20 22:31, Rene Peinthor wrote:
>>>> Hi!
>>>>
>>>> Here is a new minor Linstor release, this release
>>>> contains more bug fixes than new features.
>>>> Notable features are a new auto-unplace option, to
>>>> reduce the replica-count of resources
>>>> to the value set in the resource-group after a certain
>>>> time. And error-reports can now be deleted
>>>> from the REST-API (client).
>>>>
>>>> linstor-server 1.9.0
>>>> --------------------
>>>>  * Added auto-"unplace", automatically removes
>>>> resources if they exceed the replica count if
>>>> `DrbdOptions/auto-unplace` is set
>>>>  * Added error-report deletion API
>>>>  * Expose DRBD promotion_score and may_promote via
>>>> REST-API and server sent events
>>>>  * Prometheus metrics are now mostly cached and much
>>>> faster to query
>>>>  * Send SD_NOTIFY READY to systemd if services are ready
>>>>  * OpenFlex resource are now correctly limited to 32
>>>> characters
>>>>  * Fix etcd modify net-interface (incorrect serialization)
>>>>  * Fix autoplacer also toggling diskless resources
>>>>  * Fix snapshot-shipping with more than 1 volume
>>>> definitions
>>>>  * Fix zfs create options handling
>>>>  * Fixed recaching of lvm-filter
>>>>  * Fix missing client answer if drbd device doesn't
>>>> become ready in reasonable time
>>>>  * REST-API v1.4.0
>>>>
>>>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>>> <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>>>>
>>>> Linstor PPA:
>>>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>>> <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>>>>
>>>> Cheers,
>>>> Rene
>>>>
>>>> _______________________________________________
>>>> Star us on GITHUB:https://github.com/LINBIT <https://github.com/LINBIT>
>>>> drbd-user mailing list
>>>> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
>>>> https://lists.linbit.com/mailman/listinfo/drbd-user <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>> _______________________________________________
>>> Star us on GITHUB: https://github.com/LINBIT
>>> <https://github.com/LINBIT>
>>> drbd-user mailing list
>>> drbd-user@lists.linbit.com
>>> <mailto:drbd-user@lists.linbit.com>
>>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>> <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>>
Re: linstor-server 1.9.0 release [ In reply to ]
My last idea is that you didn't run with a linstor.toml file until now and
so user/password would have been empty.
You can comment out user/password in the linstor.toml and restart the
controller, if this doesn't work it is probably simpler to start fresh.

You can delete the DB file and start over again, but your LV/ZFS volumes
will still be there.
Your data will still be replicated, but the Satellite will delete the
resource files once restarted.

Cheers,
Rene

On Thu, Sep 24, 2020 at 4:55 PM Adam Goryachev <
mailinglists@websitemanagers.com.au> wrote:

>
> On 24/9/20 23:48, Rene Peinthor wrote:
>
> I can only recreate that error, if I actively change the password in the
> linstor.toml to something incorrect.
> I don't know how this would happen in normal operation, are you sure you
> never had another password or changed the password?
>
> if you can connect to the h2 database with the commandline tool, you might
> be able to set a new password.
>
> I tried this method:
>
> castle:/usr/share/linstor-server/lib# java -cp h2*.jar org.h2.tools.Shell
>
> Welcome to H2 Shell 1.4.197 (2018-03-18)
> Exit with Ctrl+C
> [Enter] jdbc:h2:~/test
> URL jdbc:h2:/var/lib/linstor/linstordb
> [Enter] org.h2.Driver
> Driver
> [Enter]
> User linstor
> [Enter] Hide
> Password linstor
> SQL Exception: Wrong user name or password [28000-197]
>
> However, it requires user/pass, which clearly is wrong....
>
> Is there a method to confirm that the file is "valid" ? I seem to have
> three versions of this file all identical content:
>
> -rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db
> -rw-r--r-- 1 root root 376832 Sep 24 02:25
> linstordb.mv.db-2020-09-24T02:25+10:00.bak
> -rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak
>
> Should I just delete the DB file and start again? Is this data replicated
> to other nodes automatically?
>
> Thanks,
> Adam
>
> Cheers,
> Rene
>
> On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev <
> mailinglists@websitemanagers.com.au> wrote:
>
>>
>> On 24/9/20 22:42, Rene Peinthor wrote:
>>
>> They are.
>> And how do you start the controller?
>>
>> It should start automatically at boot from systemd, but I can start it
>> manually with:
>>
>> systemctl restart linstor-controller
>>
>> In case it is your next question, here is the content of
>> /etc/systemd/system/multi-user.target.wants/linstor-controller.service
>>
>> [Unit]
>> Description=LINSTOR Controller Service
>> Wants=network-online.target
>> After=network-online.target
>>
>> [Service]
>> Type=simple
>> ExecStart=/usr/share/linstor-server/bin/Controller
>> --logs=/var/log/linstor-controller --config-directory=/etc/linstor
>> # if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
>> SuccessExitStatus=0 143 129
>> User=root
>> PrivateTmp=yes
>>
>> [Install]
>> WantedBy=multi-user.target
>>
>> Regards,
>> Adam
>>
>> On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev <
>> mailinglists@websitemanagers.com.au> wrote:
>>
>>>
>>> On 24/9/20 15:30, Rene Peinthor wrote:
>>>
>>> Sounds weird, I don't think we changed anything with the database
>>> initialization.
>>>
>>> Can you post your /etc/linstor/linstor.toml?
>>>
>>> Cheers,
>>> Rene
>>>
>>> Hi, please see the contents below (I assume these are default settings):
>>>
>>> # Basic linstor configuration toml file
>>> # For more options check documentation
>>>
>>> [db]
>>> user = "linstor"
>>> password = "linstor"
>>> connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>>>
>>> Thanks,
>>> Adam
>>>
>>>
>>> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev <
>>> mailinglists@websitemanagers.com.au> wrote:
>>>
>>>> Hi,
>>>>
>>>> After upgrading on one of my test nodes I got some errors, so I thought
>>>> to upgrade the controller, and now I am unable to start the controller.
>>>>
>>>> Here is what I get in the system log:
>>>>
>>>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR Controller Service.
>>>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR, Module Controller
>>>> Sep 24 02:33:41 castle Controller[1093]: Version: 1.9.0
>>>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>>>> Sep 24 02:33:41 castle Controller[1093]: Build time:
>>>> 2020-09-23T10:27:49+00:00
>>>> Sep 24 02:33:41 castle Controller[1093]: Java Version: 11
>>>> Sep 24 02:33:41 castle Controller[1093]: Java VM: Debian,
>>>> Version 11.0.8+10-post-Debian-1deb10u1
>>>> Sep 24 02:33:41 castle Controller[1093]: Operating system: Linux,
>>>> Version 4.19.0-10-amd64
>>>> Sep 24 02:33:41 castle Controller[1093]: Environment: amd64, 2
>>>> processors, 1988 MiB memory reserved for allocations
>>>> Sep 24 02:33:41 castle Controller[1093]: System components
>>>> initialization in progress
>>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.355 [main] INFO
>>>> LINSTOR/Controller - SYSTEM - ErrorReporter DB version 1 found.
>>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.359 [main] INFO
>>>> LINSTOR/Controller - SYSTEM - Log directory set to:
>>>> '/var/log/linstor-controller'
>>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.410 [main] WARN
>>>> io.sentry.dsn.Dsn - *** Couldn't find a suitable DSN, Sentry operations
>>>> will do nothing! See documentation:
>>>> https://docs.sentry.io/clients/java/ ***
>>>> Sep 24 02:33:42 castle Controller[1093]: 02:33:42.434 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Loading API classes started.
>>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.046 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - API classes loading finished: 611ms
>>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.047 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Dependency injection started.
>>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Attempting dynamic load of extension module
>>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>>> Sep 24 02:33:43 castle Controller[1093]: 02:33:43.065 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Extension module
>>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule" is not
>>>> installed
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: An illegal reflective
>>>> access operation has occurred
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Illegal reflective
>>>> access by com.google.inject.internal.cglib.core.$ReflectUtils$1 (
>>>> file:/usr/share/linstor-server/lib/guice-4.2.2.jar) to method
>>>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Please consider
>>>> reporting this to the maintainers of
>>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: Use
>>>> --illegal-access=warn to enable warnings of further illegal reflective
>>>> access operations
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING: All illegal access
>>>> operations will be denied in a future release
>>>> Sep 24 02:33:44 castle Controller[1093]: 02:33:44.962 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Dependency injection finished: 1915ms
>>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.533 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Initializing authentication subsystem
>>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.736 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Starting service instance 'TimerEventService'
>>>> of type TimerEventService
>>>> Sep 24 02:33:45 castle Controller[1093]: 02:33:45.740 [Main] INFO
>>>> LINSTOR/Controller - SYSTEM - Initializing the database connection pool
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.303 [Main] ERROR
>>>> LINSTOR/Controller - SYSTEM - Database initialization error [Report number
>>>> 5F6B78E5-00000-000000]
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.343 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Shutdown in progress
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.344 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>>> 'TaskScheduleService' of type TaskScheduleService
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>>> 'TaskScheduleService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.345 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>>> 'DatabaseService' of type DatabaseService
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.349 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>>> 'DatabaseService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.350 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Shutting down service instance
>>>> 'TimerEventService' of type TimerEventService
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Waiting for service instance
>>>> 'TimerEventService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]: 02:33:46.351 [Thread-2] INFO
>>>> LINSTOR/Controller - SYSTEM - Shutdown complete
>>>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Main
>>>> process exited, code=exited, status=20/n/a
>>>> Sep 24 02:33:46 castle systemd[1]: linstor-controller.service: Failed
>>>> with result 'exit-code'.
>>>>
>>>> Here is
>>>> /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>>>
>>>> ERROR REPORT 5F6B78E5-00000-000000
>>>>
>>>> ============================================================
>>>>
>>>> Application: LINBIT® LINSTOR
>>>> Module: Controller
>>>> Version: 1.9.0
>>>> Build ID:
>>>> 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>>>> Build time: 2020-09-23T10:27:49+00:00
>>>> Error time: 2020-09-24 02:33:46
>>>> Node: castle
>>>>
>>>> ============================================================
>>>>
>>>> Reported error:
>>>> ===============
>>>>
>>>> Description:
>>>> Database initialization error
>>>>
>>>> Category: LinStorException
>>>> Class name: SystemServiceStartException
>>>> Class canonical name:
>>>> com.linbit.SystemServiceStartException
>>>> Generated at: Method 'initialize', Source file
>>>> 'DbConnectionPoolInitializer.java', Line #56
>>>> Error message: Database initialization error
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N
>>>> com.linbit.linstor.core.Controller:337
>>>> main N
>>>> com.linbit.linstor.core.Controller:556
>>>>
>>>> Caused by:
>>>> ==========
>>>>
>>>> Category: RuntimeException
>>>> Class name: LinStorDBRuntimeException
>>>> Class canonical name:
>>>> com.linbit.linstor.LinStorDBRuntimeException
>>>> Generated at: Method 'setTransactionIsolation',
>>>> Source file 'DbConnectionPool.java', Line #485
>>>>
>>>> Error message: Failed to set transaction isolation
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> setTransactionIsolation N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:485
>>>> migrate N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:202
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N
>>>> com.linbit.linstor.core.Controller:337
>>>> main N
>>>> com.linbit.linstor.core.Controller:556
>>>>
>>>> Caused by:
>>>> ==========
>>>>
>>>> Category: Exception
>>>> Class name: JdbcSQLException
>>>> Class canonical name: org.h2.jdbc.JdbcSQLException
>>>> Generated at: Method 'getJdbcSQLException',
>>>> Source file 'DbException.java', Line #357
>>>>
>>>> Error message: Wrong user name or password
>>>> [28000-197]
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> getJdbcSQLException N
>>>> org.h2.message.DbException:357
>>>> get N
>>>> org.h2.message.DbException:179
>>>> get N
>>>> org.h2.message.DbException:155
>>>> get N
>>>> org.h2.message.DbException:144
>>>> validateUserAndPassword N
>>>> org.h2.engine.Engine:341
>>>> createSessionAndValidate N
>>>> org.h2.engine.Engine:165
>>>> createSession N
>>>> org.h2.engine.Engine:140
>>>> createSession N
>>>> org.h2.engine.Engine:28
>>>> connectEmbeddedOrServer N
>>>> org.h2.engine.SessionRemote:351
>>>> <init> N
>>>> org.h2.jdbc.JdbcConnection:124
>>>> <init> N
>>>> org.h2.jdbc.JdbcConnection:103
>>>> connect N org.h2.Driver:69
>>>> getConnection N
>>>> java.sql.DriverManager:677
>>>> getConnection N
>>>> java.sql.DriverManager:189
>>>> createConnection N
>>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>>> makeObject N
>>>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>>> create N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:889
>>>> borrowObject N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:424
>>>> borrowObject N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:349
>>>> getConnection N
>>>> org.apache.commons.dbcp2.PoolingDataSource:134
>>>> setTransactionIsolation N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:477
>>>> migrate N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:202
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N
>>>> com.linbit.linstor.core.Controller:337
>>>> main N
>>>> com.linbit.linstor.core.Controller:556
>>>>
>>>> Finally I found another log in /var/lib/linstor/linstordb.trace.db
>>>>
>>>> 2020-09-24 02:33:45 database: wrong user or password; user: "LINSTOR"
>>>> org.h2.message.DbException: Wrong user name or password [28000-197]
>>>> at org.h2.message.DbException.get(DbException.java:179)
>>>> at org.h2.message.DbException.get(DbException.java:155)
>>>> at org.h2.message.DbException.get(DbException.java:144)
>>>> at org.h2.engine.Engine.openSession(Engine.java:107)
>>>> at org.h2.engine.Engine.openSession(Engine.java:179)
>>>> at
>>>> org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>>> at org.h2.engine.Engine.createSession(Engine.java:140)
>>>> at org.h2.engine.Engine.createSession(Engine.java:28)
>>>> at
>>>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>>> at org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>>> at org.h2.Driver.connect(Driver.java:69)
>>>> at
>>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>>> at
>>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>>> at
>>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>>> at
>>>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>>> at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>>> at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>>> at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>>> at
>>>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>>> at
>>>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>>> at
>>>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>>> at
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>>> at
>>>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>>> at com.linbit.linstor.core.Controller.start(Controller.java:337)
>>>> at com.linbit.linstor.core.Controller.main(Controller.java:556)
>>>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user name or password
>>>> [28000-197]
>>>> at
>>>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>>> ... 26 more
>>>>
>>>>
>>>> Luckily, this is just a test environment, but I'd like to know if I
>>>> messed up in my upgrade process somehow or this is a bug in the new
>>>> version. I haven't downgraded or anything yet.
>>>>
>>>> Regards,
>>>> Adam
>>>>
>>>>
>>>> On 23/9/20 22:31, Rene Peinthor wrote:
>>>>
>>>> Hi!
>>>>
>>>> Here is a new minor Linstor release, this release contains more bug
>>>> fixes than new features.
>>>> Notable features are a new auto-unplace option, to reduce the
>>>> replica-count of resources
>>>> to the value set in the resource-group after a certain time. And
>>>> error-reports can now be deleted
>>>> from the REST-API (client).
>>>>
>>>> linstor-server 1.9.0
>>>> --------------------
>>>> * Added auto-"unplace", automatically removes resources if they exceed
>>>> the replica count if `DrbdOptions/auto-unplace` is set
>>>> * Added error-report deletion API
>>>> * Expose DRBD promotion_score and may_promote via REST-API and server
>>>> sent events
>>>> * Prometheus metrics are now mostly cached and much faster to query
>>>> * Send SD_NOTIFY READY to systemd if services are ready
>>>> * OpenFlex resource are now correctly limited to 32 characters
>>>> * Fix etcd modify net-interface (incorrect serialization)
>>>> * Fix autoplacer also toggling diskless resources
>>>> * Fix snapshot-shipping with more than 1 volume definitions
>>>> * Fix zfs create options handling
>>>> * Fixed recaching of lvm-filter
>>>> * Fix missing client answer if drbd device doesn't become ready in
>>>> reasonable time
>>>> * REST-API v1.4.0
>>>>
>>>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>>>
>>>> Linstor PPA:
>>>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>>>
>>>> Cheers,
>>>> Rene
>>>>
>>>> _______________________________________________
>>>> Star us on GITHUB: https://github.com/LINBIT
>>>> drbd-user mailing listdrbd-user@lists.linbit.comhttps://lists.linbit.com/mailman/listinfo/drbd-user
>>>>
>>>> _______________________________________________
>>>> Star us on GITHUB: https://github.com/LINBIT
>>>> drbd-user mailing list
>>>> drbd-user@lists.linbit.com
>>>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>>>
>>>
Re: linstor-server 1.9.0 release [ In reply to ]
On 25/9/20 16:12, Rene Peinthor wrote:
> My last idea is that you didn't run with a linstor.toml file until now
> and so user/password would have been empty.
> You can comment out user/password in the linstor.toml and restart the
> controller, if this doesn't work it is probably simpler to start fresh.
>
Interesting, you are correct, it works if I comment out the
username/password.

So, in order to try and get a more standard installation, I tried
connecting to the DB and running these commands:

SET PASSWORD='linstor';
ALTER USER "" rename to "linstor";

They seemed to work, but after resetting the linstor.toml file with the
user/pass, it wouldn't work, and I couldn't connect to the DB  with the
linstor/linstor nor with the details as blanks.

So, for now, I've restored the DB, and commented out the user/pass from
the linstor.toml file.

Could you offer any advice on how to fix things so that it will use the
linstor/linstor credentials normally?

linstor n l
????????????????????????????????????????????????????????????
? Node   ? NodeType  ? Addresses                  ? State  ?
????????????????????????????????????????????????????????????
? castle ? SATELLITE ? 192.168.5.204:3366 (PLAIN) ? Online ?
? san5   ? SATELLITE ? 192.168.5.205:3366 (PLAIN) ? Online ?
? san6   ? SATELLITE ? 192.168.5.206:3366 (PLAIN) ? Online ?
????????????????????????????????????????????????????????????

Regards,
Adam

> You can delete the DB file and start over again, but your LV/ZFS
> volumes will still be there.
> Your data will still be replicated, but the Satellite will delete the
> resource files once restarted.
>
> Cheers,
> Rene
>
> On Thu, Sep 24, 2020 at 4:55 PM Adam Goryachev
> <mailinglists@websitemanagers.com.au
> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>
>
> On 24/9/20 23:48, Rene Peinthor wrote:
>> I can only recreate that error, if I actively change the password
>> in the linstor.toml to something incorrect.
>> I don't know how this would happen in normal operation, are you
>> sure you never had another password or changed the password?
>>
>> if you can connect to the h2 database with the commandline tool,
>> you might be able to set a new password.
>>
> I tried this method:
>
> castle:/usr/share/linstor-server/lib#  java -cp h2*.jar
> org.h2.tools.Shell
>
> Welcome to H2 Shell 1.4.197 (2018-03-18)
> Exit with Ctrl+C
> [Enter]   jdbc:h2:~/test
> URL       jdbc:h2:/var/lib/linstor/linstordb
> [Enter]   org.h2.Driver
> Driver
> [Enter]
> User      linstor
> [Enter]   Hide
> Password  linstor
> SQL Exception: Wrong user name or password [28000-197]
>
> However, it requires user/pass, which clearly is wrong....
>
> Is there a method to confirm that the file is "valid" ? I seem to
> have three versions of this file all identical content:
>
> -rw-r--r-- 1 root root 376832 Sep 18 16:45 linstordb.mv.db
> -rw-r--r-- 1 root root 376832 Sep 24 02:25
> linstordb.mv.db-2020-09-24T02:25+10:00.bak
> -rw-r--r-- 1 root root 376832 Sep 24 02:25 linstordb.mv.db.bak
>
> Should I just delete the DB file and start again? Is this data
> replicated to other nodes automatically?
>
> Thanks,
> Adam
>
>
>> Cheers,
>> Rene
>>
>> On Thu, Sep 24, 2020 at 2:48 PM Adam Goryachev
>> <mailinglists@websitemanagers.com.au
>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>
>>
>> On 24/9/20 22:42, Rene Peinthor wrote:
>>> They are.
>>> And how do you start the controller?
>>>
>> It should start automatically at boot from systemd, but I can
>> start it manually with:
>>
>> systemctl restart linstor-controller
>>
>> In case it is your next question, here is the content of
>> /etc/systemd/system/multi-user.target.wants/linstor-controller.service
>>
>> [Unit]
>> Description=LINSTOR Controller Service
>> Wants=network-online.target
>> After=network-online.target
>>
>> [Service]
>> Type=simple
>> ExecStart=/usr/share/linstor-server/bin/Controller
>> --logs=/var/log/linstor-controller
>> --config-directory=/etc/linstor
>> # if killed by signal 143 -> SIGTERM, 129 -> SIGHUP
>> SuccessExitStatus=0 143 129
>> User=root
>> PrivateTmp=yes
>>
>> [Install]
>> WantedBy=multi-user.target
>>
>> Regards,
>> Adam
>>
>>> On Thu, Sep 24, 2020 at 2:19 PM Adam Goryachev
>>> <mailinglists@websitemanagers.com.au
>>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>>
>>>
>>> On 24/9/20 15:30, Rene Peinthor wrote:
>>>> Sounds weird, I don't think we changed anything with
>>>> the database initialization.
>>>>
>>>> Can you post your /etc/linstor/linstor.toml?
>>>>
>>>> Cheers,
>>>> Rene
>>>>
>>> Hi, please see the contents below (I assume these are
>>> default settings):
>>>
>>> # Basic linstor configuration toml file
>>> # For more options check documentation
>>>
>>> [db]
>>>   user = "linstor"
>>>   password = "linstor"
>>>   connection_url = "jdbc:h2:/var/lib/linstor/linstordb"
>>>
>>> Thanks,
>>> Adam
>>>
>>>
>>>> On Wed, Sep 23, 2020 at 6:54 PM Adam Goryachev
>>>> <mailinglists@websitemanagers.com.au
>>>> <mailto:mailinglists@websitemanagers.com.au>> wrote:
>>>>
>>>> Hi,
>>>>
>>>> After upgrading on one of my test nodes I got some
>>>> errors, so I thought to upgrade the controller, and
>>>> now I am unable to start the controller.
>>>>
>>>> Here is what I get in the system log:
>>>>
>>>> Sep 24 02:33:40 castle systemd[1]: Started LINSTOR
>>>> Controller Service.
>>>> Sep 24 02:33:41 castle Controller[1093]: LINSTOR,
>>>> Module Controller
>>>> Sep 24 02:33:41 castle Controller[1093]:
>>>> Version:            1.9.0
>>>> (678acd24a8b9b73a735407cd79ca33a5e95eb2e2)
>>>> Sep 24 02:33:41 castle Controller[1093]: Build
>>>> time: 2020-09-23T10:27:49+00:00
>>>> Sep 24 02:33:41 castle Controller[1093]: Java
>>>> Version:       11
>>>> Sep 24 02:33:41 castle Controller[1093]: Java
>>>> VM:            Debian, Version
>>>> 11.0.8+10-post-Debian-1deb10u1
>>>> Sep 24 02:33:41 castle Controller[1093]: Operating
>>>> system:   Linux, Version 4.19.0-10-amd64
>>>> Sep 24 02:33:41 castle Controller[1093]:
>>>> Environment:        amd64, 2 processors, 1988 MiB
>>>> memory reserved for allocations
>>>> Sep 24 02:33:41 castle Controller[1093]: System
>>>> components initialization in progress
>>>> Sep 24 02:33:42 castle Controller[1093]:
>>>> 02:33:42.355 [main] INFO  LINSTOR/Controller -
>>>> SYSTEM - ErrorReporter DB version 1 found.
>>>> Sep 24 02:33:42 castle Controller[1093]:
>>>> 02:33:42.359 [main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Log directory set to:
>>>> '/var/log/linstor-controller'
>>>> Sep 24 02:33:42 castle Controller[1093]:
>>>> 02:33:42.410 [main] WARN  io.sentry.dsn.Dsn - ***
>>>> Couldn't find a suitable DSN, Sentry operations
>>>> will do nothing! See documentation:
>>>> https://docs.sentry.io/clients/java/
>>>> <https://docs.sentry.io/clients/java/> ***
>>>> Sep 24 02:33:42 castle Controller[1093]:
>>>> 02:33:42.434 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Loading API classes started.
>>>> Sep 24 02:33:43 castle Controller[1093]:
>>>> 02:33:43.046 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - API classes loading finished: 611ms
>>>> Sep 24 02:33:43 castle Controller[1093]:
>>>> 02:33:43.047 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Dependency injection started.
>>>> Sep 24 02:33:43 castle Controller[1093]:
>>>> 02:33:43.065 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Attempting dynamic load of extension
>>>> module
>>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>>> Sep 24 02:33:43 castle Controller[1093]:
>>>> 02:33:43.065 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Extension module
>>>> "com.linbit.linstor.spacetracking.ControllerSpaceTrackingModule"
>>>> is not installed
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>> An illegal reflective access operation has occurred
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>> Illegal reflective access by
>>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>>> (file:/usr/share/linstor-server/lib/guice-4.2.2.jar)
>>>> to method
>>>> java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain)
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>> Please consider reporting this to the maintainers
>>>> of
>>>> com.google.inject.internal.cglib.core.$ReflectUtils$1
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>> Use --illegal-access=warn to enable warnings of
>>>> further illegal reflective access operations
>>>> Sep 24 02:33:43 castle Controller[1093]: WARNING:
>>>> All illegal access operations will be denied in a
>>>> future release
>>>> Sep 24 02:33:44 castle Controller[1093]:
>>>> 02:33:44.962 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Dependency injection finished: 1915ms
>>>> Sep 24 02:33:45 castle Controller[1093]:
>>>> 02:33:45.533 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Initializing authentication subsystem
>>>> Sep 24 02:33:45 castle Controller[1093]:
>>>> 02:33:45.736 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Starting service instance
>>>> 'TimerEventService' of type TimerEventService
>>>> Sep 24 02:33:45 castle Controller[1093]:
>>>> 02:33:45.740 [Main] INFO  LINSTOR/Controller -
>>>> SYSTEM - Initializing the database connection pool
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.303 [Main] ERROR LINSTOR/Controller -
>>>> SYSTEM - Database initialization error [Report
>>>> number 5F6B78E5-00000-000000]
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.343 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Shutdown in progress
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.344 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Shutting down service instance
>>>> 'TaskScheduleService' of type TaskScheduleService
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.345 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Waiting for service instance
>>>> 'TaskScheduleService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.345 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Shutting down service instance
>>>> 'DatabaseService' of type DatabaseService
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.349 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Waiting for service instance
>>>> 'DatabaseService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.350 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Shutting down service instance
>>>> 'TimerEventService' of type TimerEventService
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.351 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Waiting for service instance
>>>> 'TimerEventService' to complete shutdown
>>>> Sep 24 02:33:46 castle Controller[1093]:
>>>> 02:33:46.351 [Thread-2] INFO LINSTOR/Controller -
>>>> SYSTEM - Shutdown complete
>>>> Sep 24 02:33:46 castle systemd[1]:
>>>> linstor-controller.service: Main process exited,
>>>> code=exited, status=20/n/a
>>>> Sep 24 02:33:46 castle systemd[1]:
>>>> linstor-controller.service: Failed with result
>>>> 'exit-code'.
>>>>
>>>> Here is
>>>> /var/log/linstor-controller/ErrorReport-5F6B78E5-00000-000000.log
>>>>
>>>> ERROR REPORT 5F6B78E5-00000-000000
>>>>
>>>> ============================================================
>>>>
>>>> Application:                        LINBIT® LINSTOR
>>>> Module:                             Controller
>>>> Version:                            1.9.0
>>>> Build ID: 678acd24a8b9b73a735407cd79ca33a5e95eb2e2
>>>> Build time: 2020-09-23T10:27:49+00:00
>>>> Error time: 2020-09-24 02:33:46
>>>> Node:                               castle
>>>>
>>>> ============================================================
>>>>
>>>> Reported error:
>>>> ===============
>>>>
>>>> Description:
>>>>     Database initialization error
>>>>
>>>> Category:                           LinStorException
>>>> Class name: SystemServiceStartException
>>>> Class canonical name:
>>>> com.linbit.SystemServiceStartException
>>>> Generated at:                       Method
>>>> 'initialize', Source file
>>>> 'DbConnectionPoolInitializer.java', Line #56
>>>> Error message: Database initialization error
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:56
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N com.linbit.linstor.core.Controller:337
>>>> main N com.linbit.linstor.core.Controller:556
>>>>
>>>> Caused by:
>>>> ==========
>>>>
>>>> Category:                           RuntimeException
>>>> Class name: LinStorDBRuntimeException
>>>> Class canonical name:
>>>> com.linbit.linstor.LinStorDBRuntimeException
>>>> Generated at:                       Method
>>>> 'setTransactionIsolation', Source file
>>>> 'DbConnectionPool.java', Line #485
>>>>
>>>> Error message: Failed to set transaction isolation
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> setTransactionIsolation N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:485
>>>> migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N com.linbit.linstor.core.Controller:337
>>>> main N com.linbit.linstor.core.Controller:556
>>>>
>>>> Caused by:
>>>> ==========
>>>>
>>>> Category:                           Exception
>>>> Class name: JdbcSQLException
>>>> Class canonical name: org.h2.jdbc.JdbcSQLException
>>>> Generated at:                       Method
>>>> 'getJdbcSQLException', Source file
>>>> 'DbException.java', Line #357
>>>>
>>>> Error message: Wrong user name or password [28000-197]
>>>>
>>>> Call backtrace:
>>>>
>>>> Method Native Class:Line number
>>>> getJdbcSQLException N org.h2.message.DbException:357
>>>> get N org.h2.message.DbException:179
>>>> get N org.h2.message.DbException:155
>>>> get N org.h2.message.DbException:144
>>>> validateUserAndPassword N      org.h2.engine.Engine:341
>>>> createSessionAndValidate N     
>>>> org.h2.engine.Engine:165
>>>> createSession N      org.h2.engine.Engine:140
>>>> createSession N      org.h2.engine.Engine:28
>>>> connectEmbeddedOrServer N
>>>> org.h2.engine.SessionRemote:351
>>>> <init> N org.h2.jdbc.JdbcConnection:124
>>>> <init> N org.h2.jdbc.JdbcConnection:103
>>>> connect N      org.h2.Driver:69
>>>> getConnection N      java.sql.DriverManager:677
>>>> getConnection N      java.sql.DriverManager:189
>>>> createConnection N
>>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory:123
>>>> makeObject N
>>>> org.apache.commons.dbcp2.PoolableConnectionFactory:355
>>>> create N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:889
>>>> borrowObject N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:424
>>>> borrowObject N
>>>> org.apache.commons.pool2.impl.GenericObjectPool:349
>>>> getConnection N
>>>> org.apache.commons.dbcp2.PoolingDataSource:134
>>>> setTransactionIsolation N
>>>> com.linbit.linstor.dbcp.DbConnectionPool:477
>>>> migrate N com.linbit.linstor.dbcp.DbConnectionPool:202
>>>> initialize N
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer:50
>>>> startSystemServices N
>>>> com.linbit.linstor.core.ApplicationLifecycleManager:87
>>>> start N com.linbit.linstor.core.Controller:337
>>>> main N com.linbit.linstor.core.Controller:556
>>>>
>>>> Finally I found another log in
>>>> /var/lib/linstor/linstordb.trace.db
>>>>
>>>> 2020-09-24 02:33:45 database: wrong user or
>>>> password; user: "LINSTOR"
>>>> org.h2.message.DbException: Wrong user name or
>>>> password [28000-197]
>>>>         at
>>>> org.h2.message.DbException.get(DbException.java:179)
>>>>         at
>>>> org.h2.message.DbException.get(DbException.java:155)
>>>>         at
>>>> org.h2.message.DbException.get(DbException.java:144)
>>>>         at
>>>> org.h2.engine.Engine.openSession(Engine.java:107)
>>>>         at
>>>> org.h2.engine.Engine.openSession(Engine.java:179)
>>>>         at
>>>> org.h2.engine.Engine.createSessionAndValidate(Engine.java:157)
>>>>         at
>>>> org.h2.engine.Engine.createSession(Engine.java:140)
>>>>         at
>>>> org.h2.engine.Engine.createSession(Engine.java:28)
>>>>         at
>>>> org.h2.engine.SessionRemote.connectEmbeddedOrServer(SessionRemote.java:351)
>>>>         at
>>>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:124)
>>>>         at
>>>> org.h2.jdbc.JdbcConnection.<init>(JdbcConnection.java:103)
>>>>         at org.h2.Driver.connect(Driver.java:69)
>>>>         at
>>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:677)
>>>>         at
>>>> java.sql/java.sql.DriverManager.getConnection(DriverManager.java:189)
>>>>         at
>>>> org.apache.commons.dbcp2.DriverManagerConnectionFactory.createConnection(DriverManagerConnectionFactory.java:123)
>>>>         at
>>>> org.apache.commons.dbcp2.PoolableConnectionFactory.makeObject(PoolableConnectionFactory.java:355)
>>>>         at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.create(GenericObjectPool.java:889)
>>>>         at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:424)
>>>>         at
>>>> org.apache.commons.pool2.impl.GenericObjectPool.borrowObject(GenericObjectPool.java:349)
>>>>         at
>>>> org.apache.commons.dbcp2.PoolingDataSource.getConnection(PoolingDataSource.java:134)
>>>>         at
>>>> com.linbit.linstor.dbcp.DbConnectionPool.setTransactionIsolation(DbConnectionPool.java:477)
>>>>         at
>>>> com.linbit.linstor.dbcp.DbConnectionPool.migrate(DbConnectionPool.java:202)
>>>>         at
>>>> com.linbit.linstor.dbcp.DbConnectionPoolInitializer.initialize(DbConnectionPoolInitializer.java:50)
>>>>         at
>>>> com.linbit.linstor.core.ApplicationLifecycleManager.startSystemServices(ApplicationLifecycleManager.java:87)
>>>>         at
>>>> com.linbit.linstor.core.Controller.start(Controller.java:337)
>>>>         at
>>>> com.linbit.linstor.core.Controller.main(Controller.java:556)
>>>> Caused by: org.h2.jdbc.JdbcSQLException: Wrong user
>>>> name or password [28000-197]
>>>>         at
>>>> org.h2.message.DbException.getJdbcSQLException(DbException.java:357)
>>>>         ... 26 more
>>>>
>>>>
>>>> Luckily, this is just a test environment, but I'd
>>>> like to know if I messed up in my upgrade process
>>>> somehow or this is a bug in the new version. I
>>>> haven't downgraded or anything yet.
>>>>
>>>> Regards,
>>>> Adam
>>>>
>>>>
>>>> On 23/9/20 22:31, Rene Peinthor wrote:
>>>>> Hi!
>>>>>
>>>>> Here is a new minor Linstor release, this release
>>>>> contains more bug fixes than new features.
>>>>> Notable features are a new auto-unplace option, to
>>>>> reduce the replica-count of resources
>>>>> to the value set in the resource-group after a
>>>>> certain time. And error-reports can now be deleted
>>>>> from the REST-API (client).
>>>>>
>>>>> linstor-server 1.9.0
>>>>> --------------------
>>>>>  * Added auto-"unplace", automatically removes
>>>>> resources if they exceed the replica count if
>>>>> `DrbdOptions/auto-unplace` is set
>>>>>  * Added error-report deletion API
>>>>>  * Expose DRBD promotion_score and may_promote via
>>>>> REST-API and server sent events
>>>>>  * Prometheus metrics are now mostly cached and
>>>>> much faster to query
>>>>>  * Send SD_NOTIFY READY to systemd if services are
>>>>> ready
>>>>>  * OpenFlex resource are now correctly limited to
>>>>> 32 characters
>>>>>  * Fix etcd modify net-interface (incorrect
>>>>> serialization)
>>>>>  * Fix autoplacer also toggling diskless resources
>>>>>  * Fix snapshot-shipping with more than 1 volume
>>>>> definitions
>>>>>  * Fix zfs create options handling
>>>>>  * Fixed recaching of lvm-filter
>>>>>  * Fix missing client answer if drbd device
>>>>> doesn't become ready in reasonable time
>>>>>  * REST-API v1.4.0
>>>>>
>>>>> https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz
>>>>> <https://www.linbit.com/downloads/linstor/linstor-server-1.9.0.tar.gz>
>>>>>
>>>>> Linstor PPA:
>>>>> https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack
>>>>> <https://launchpad.net/~linbit/+archive/ubuntu/linbit-drbd9-stack>
>>>>>
>>>>> Cheers,
>>>>> Rene
>>>>>
>>>>> _______________________________________________
>>>>> Star us on GITHUB:https://github.com/LINBIT <https://github.com/LINBIT>
>>>>> drbd-user mailing list
>>>>> drbd-user@lists.linbit.com <mailto:drbd-user@lists.linbit.com>
>>>>> https://lists.linbit.com/mailman/listinfo/drbd-user <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>>> _______________________________________________
>>>> Star us on GITHUB: https://github.com/LINBIT
>>>> <https://github.com/LINBIT>
>>>> drbd-user mailing list
>>>> drbd-user@lists.linbit.com
>>>> <mailto:drbd-user@lists.linbit.com>
>>>> https://lists.linbit.com/mailman/listinfo/drbd-user
>>>> <https://lists.linbit.com/mailman/listinfo/drbd-user>
>>>>
Re: linstor-server 1.9.0 release [ In reply to ]
I think you should use:

ALTER USER "" RENAME TO "linstor";
ALTER USER "linstor" SET PASSWORD 'linstor';

Cheers,
Rene