Skip to content

ACS is giving "HTTP ERROR 503 Service Unavailable" post upgrade form 4.19.1.2 to 4.20.2.0 #13018

Closed

Description

@GerorgeEG

problem

We have upgrade the ACS from 4.19.1.2 to 4.20.2.0 and after that Apache CloudStack is giving "HTTP ERROR 503 Service Unavailable"
We verified ACS databse is up but ACS itself is not trying to (not able to ) connect to database.
Below is the error log

systemctl status cloudstack-management.service
● cloudstack-management.service - CloudStack Management Server
Loaded: loaded (/usr/lib/systemd/system/cloudstack-management.service; disabled; vendor preset: disabled)
Drop-In: /etc/systemd/system/cloudstack-management.service.d
└─filelimit.conf
Active: active (running) since Tue 2026-04-14 02:16:47 CST; 16min ago
Main PID: 3598 (java)
Tasks: 45 (limit: 203511)
Memory: 2.8G
CGroup: /system.slice/cloudstack-management.service
└─3598 /usr/bin/java -Djava.security.properties=/etc/cloudstack/management/java.security.ciphers -Djava.awt.headless=true -Xmx8G -XX:+UseParallelGC -XX:MaxGCPauseMillis=500 -XX:+HeapDumpOnOutOfM>

Apr 14 02:16:47 systemd[1]: Started CloudStack Management Server.
lines 1-12/12 (END)

=============

Error in the ACS log

2026-04-14 02:16:58,510 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Failed to start module [sharedfs-provider-storagevm] due to: [Error creating bean with name 'org.springframework.b
eans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable
.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named '
DefaultConfigResources' available].
2026-04-14 02:16:58,510 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) module start failure of module [sharedfs-provider-storagevm] was due to: org.springframework.beans.factory.BeanCre
ationException: Error creating bean with name 'org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar
!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]: Cannot resolve reference to bean 'DefaultConfigResources' while setting bean property 'locations'; nested exception is org.springfr
amework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:342)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:113)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1707)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1452)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:213)
at org.springframework.context.support.PostProcessorRegistrationDelegate.invokeBeanFactoryPostProcessors(PostProcessorRegistrationDelegate.java:171)
at org.springframework.context.support.AbstractApplicationContext.invokeBeanFactoryPostProcessors(AbstractApplicationContext.java:748)
at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:564)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:174)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:143)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:274)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:262)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:131)
at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:79)
at org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37)
at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:71)
at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:58)
at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:62)
at org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:53)
at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1073)
at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:572)
at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:1002)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:765)
at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:426)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
at org.eclipse.jetty.server.Server.start(Server.java:423)
at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
at org.eclipse.jetty.server.Server.doStart(Server.java:387)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
at org.apache.cloudstack.ServerDaemon.start(ServerDaemon.java:204)
at org.apache.cloudstack.ServerDaemon.main(ServerDaemon.java:115)
Caused by: org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'DefaultConfigResources' available
at org.springframework.beans.factory.support.DefaultListableBeanFactory.getBeanDefinition(DefaultListableBeanFactory.java:874)
at org.springframework.beans.factory.support.AbstractBeanFactory.getMergedLocalBeanDefinition(AbstractBeanFactory.java:1358)
at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:309)
at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:330)
... 56 more

2026-04-14 02:16:58,510 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to obtain module [storage-allocator] context.
2026-04-14 02:16:58,510 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to load module [storage-allocator] context.

versions

ACS Version pre-upgrade : 4.19.1.2
ACS version post-upgrade : 4.20.2.0

Management and DB OS : RHEL 8

The steps to reproduce the bug

...

What to do about it?

No response

Activity

  1. weizhouapache commented on Apr 14, 2026

    @weizhouapache
    Member

    @GerorgeEG
    this logs are not useful
    maybe search by "Creating datasource for database" and share the logs starting from it

  2. GerorgeEG commented on Apr 14, 2026

    @GerorgeEG
    Author

    @weizhouapache there is no logs starting with this "Creating datasource for database" or even with word "datasource" in /var/log/cloudstack/management/management-server.log. Is is any specific logs need to be checked ?

  3. weizhouapache commented on Apr 14, 2026

    @weizhouapache
    Member

    @weizhouapache there is no logs starting with this "Creating datasource for database" or even with word "datasource" in /var/log/cloudstack/management/management-server.log. Is is any specific logs need to be checked ?

    can you search server.properties ?

  4. GerorgeEG commented on Apr 14, 2026

    @GerorgeEG
    Author

    @weizhouapache there is no logs starting with this "Creating datasource for database" or even with word "datasource" in /var/log/cloudstack/management/management-server.log. Is is any specific logs need to be checked ?

    can you search server.properties ?
    yes below is output of server.properties
    ======

    # Licensed to the Apache Software Foundation (ASF) under one
    # or more contributor license agreements.  See the NOTICE file
    # distributed with this work for additional information
    # regarding copyright ownership.  The ASF licenses this file
    # to you under the Apache License, Version 2.0 (the
    # "License"); you may not use this file except in compliance
    # with the License.  You may obtain a copy of the License at
    #
    #   http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing,
    # software distributed under the License is distributed on an
    # "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
    # KIND, either express or implied.  See the License for the
    # specific language governing permissions and limitations
    # under the License.
     
    # The binding interface for the management server
    # The management server will listen on all interfaces by default
    # bind.interface=::
     
    # The service context path where URL requests should be served
    context.path=/client
     
    # The HTTP port to be used by the management server
    http.enable=true
    http.port=8080
     
    # Max inactivity time in minutes for the session
    session.timeout=30
     
    # Max allowed API request payload/content size in bytes
    request.content.size=1048576
     
    # Options to configure and enable HTTPS on the management server
    #
    # For the management server to pick up these configuration settings, the configured
    # keystore file should exist and be readable by the management server.
    # https.enable=true
    # https.port=8080
     
    # The keystore and manager passwords are assumed to be same.
    https.keystore=/etc/cloudstack/management/cloud.jks
    # If you want to encrypt the password itself, follow the steps mentioned at:
    http://docs.cloudstack.apache.org/en/latest/adminguide/management.html?highlight=jasypt#changing-the-database-password
    # https.keystore.password=NxP_jks.store
    # If an encrypted password is used, specify the encryption type. Valid types: file, web, env (set environment variable CLOUD_SECRET_KEY)
    # password.encryption.type=none
     
    # The path to webapp directory
    webapp.dir=/usr/share/cloudstack-management/webapp
     
    # The path to access log file
    access.log=/var/log/cloudstack/management/access.log
    
  5. weizhouapache commented on Apr 14, 2026

    @weizhouapache
    Member

    @weizhouapache there is no logs starting with this "Creating datasource for database" or even with word "datasource" in /var/log/cloudstack/management/management-server.log. Is is any specific logs need to be checked ?

    can you search server.properties ?
    yes below is output of server.properties

    @GerorgeEG
    sorry, I meant searching server.properties in the management-server.log

  6. GerorgeEG commented on Apr 14, 2026

    @GerorgeEG
    Author

    @weizhouapache there is no logs starting with this "Creating datasource for database" or even with word "datasource" in /var/log/cloudstack/management/management-server.log. Is is any specific logs need to be checked ?

    can you search server.properties ?

    yes below is output of server.properties

    @GerorgeEG sorry, I meant searching server.properties in the management-server.log

  7. GerorgeEG commented on Apr 14, 2026

    @GerorgeEG
    Author

    Sure, below is the log

    2026-04-14 00:51:15,671 INFO [o.a.c.ServerDaemon] (main:[]) (logid:) Server configuration file found: /etc/cloudstack/management/server.properties
    2026-04-14 00:51:15,678 DEBUG [c.c.u.c.EncryptionSecretKeyChecker] (main:[]) (logid:) Encryption Type: null
    2026-04-14 00:51:15,679 INFO [o.a.c.ServerDaemon] (main:[]) (logid:) Initializing server daemon on null, with http.enable=true, http.port=8080, https.enable=false, https.port=8443, context.path=/client
    2026-04-14 00:51:22,192 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [bootstrap] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context.xml]
    2026-04-14 00:51:22,192 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [bootstrap] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]
    2026-04-14 00:51:22,257 DEBUG [c.c.u.c.EncryptionSecretKeyChecker] (main:[]) (logid:) Encryption Type: file
    2026-04-14 00:51:22,260 DEBUG [c.c.u.c.CloudStackEncryptor] (main:[]) (logid:) Calling to initialize for class com.cloud.utils.crypt.EncryptionSecretKeyChecker
    2026-04-14 00:51:22,353 DEBUG [c.c.u.c.CloudStackEncryptor] (main:[]) (logid:) Initialized with all possible encryptors
    2026-04-14 00:51:22,360 DEBUG [c.c.u.c.CloudStackEncryptor] (main:[]) (logid:) CloudStack will encrypt and decrypt values using encryptor : AeadBase64Encryptor for class EncryptionSecretKeyChecker
    2026-04-14 00:51:22,400 INFO [c.c.u.LogUtils] (main:[]) (logid:) log4j configuration found at /etc/cloudstack/management/log4j-cloud.xml
    2026-04-14 00:51:22,403 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loaded module context [bootstrap] in 209 ms
    2026-04-14 00:51:22,403 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: bootstrap
    2026-04-14 00:51:22,403 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: system
    2026-04-14 00:51:22,403 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: core
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: allocator
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: host-allocator-random
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: planner
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: api-planner
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: baremetal-planner
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: explicit-dedication
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: host-affinity
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: host-anti-affinity
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: implicit-dedication
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: non-strict-host-affinity
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: non-strict-host-anti-affinity
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-planner
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: skip-heurestics
    2026-04-14 00:51:22,404 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: user-concentrated-pod
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-allocator
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: api
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: acl-dynamic-role-based
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: acl-project-role-based
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: acl-static-role-based
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: cloudian
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ldap
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: md5
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: metrics
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: oauth2
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: pbkdf2
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: plaintext
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: prometheus
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: quota
    2026-04-14 00:51:22,405 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: rate-limit
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: saml2
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-api
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: sha256salted
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: shutdown
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: solidfire-intg-test
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: staticpin
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: totp
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vmware-sioc
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: api-config
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: backend
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: backup
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: dummy-backup
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: nas
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: networker
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: veeam
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ca
    2026-04-14 00:51:22,406 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: root-ca
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: baremetal-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: hyperv-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: kubernetes
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: kubernetes-service
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: kvm-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ovm-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ovm3-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-alert-adapter-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-fencer
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-investigator
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vmware-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: xenserver-compute
    2026-04-14 00:51:22,407 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: network
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: baremetal-network
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: bigswitch
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: cisco-vnmc
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: contrail
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: elb
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: globodns
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: netscaler
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: nsx
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: nvp
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: opendaylight
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ovs
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: paloalto
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-network
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ssp
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: tungsten
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vcs
    2026-04-14 00:51:22,408 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vmware-network
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vxlan
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-alert-adapter-backend
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: baremetal-storage
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-alert-adapter-storage
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-storage
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-template-adapter
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: sharedfs-provider-storagevm
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-allocator
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-image-default
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-image-s3
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-image-swift
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-object-ceph
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-object-minio
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-object-simulator
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-cloudbyte
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-datera
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-default
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-flasharray
    2026-04-14 00:51:22,409 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-linstor
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-primera
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-scaleio
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-solidfire
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: storage-volume-storpool
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vmware-storage
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: cluster
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: balanced
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: condensed
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: baremetal-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: hyperv-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ovm-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ovm3-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: secondary-storage-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: server-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: vmware-discoverer
    2026-04-14 00:51:22,410 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: xenserver-discoverer
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: event
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: webhook
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: outofbandmanagement
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: ipmitool
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: nested-cloudstack
    2026-04-14 00:51:22,411 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Module Hierarchy: redfish
    2026-04-14 00:51:22,411 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Could not find module [bootstrap] context as they have no parents.
    2026-04-14 00:51:22,411 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to obtain module [system] context.
    2026-04-14 00:51:22,411 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to load module [system] context.
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-core-system-context.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-db-system-context.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-server-system-context.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-engine-schema-system-checkers-context.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-core-system-context-inheritable.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context-inheritable.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-contrail-system-context-inheritable.xml]
    2026-04-14 00:51:22,412 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [system] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/bootstrap/spring-bootstrap-context-inheritable.xml]
    2026-04-14 00:51:22,680 WARN [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Failed to start module [system] due to: [Error creating bean with name 'org.apache.cloudstack.spring.lifecycle.ConfigDepotLifeCycle#0': Unsatisfied dependency expressed through field 'configDepotAdmin'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'configDepot': Unsatisfied dependency expressed through field '_configDao'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'configurationDaoImpl' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl]: Constructor threw exception; nested exception is java.lang.ExceptionInInitializerError].
    2026-04-14 00:51:22,683 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) module start failure of module [system] was due to: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'org.apache.cloudstack.spring.lifecycle.ConfigDepotLifeCycle#0': Unsatisfied dependency expressed through field 'configDepotAdmin'; nested exception is org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'configDepot': Unsatisfied dependency expressed through field '_configDao'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'configurationDaoImpl' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl]: Constructor threw exception; nested exception is java.lang.ExceptionInInitializerError
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
    at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
    at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:213)
    at org.springframework.context.support.PostProcessorRegistrationDelegate.registerBeanPostProcessors(PostProcessorRegistrationDelegate.java:270)
    at org.springframework.context.support.AbstractApplicationContext.registerBeanPostProcessors(AbstractApplicationContext.java:764)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:567)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContext(DefaultModuleDefinitionSet.java:174)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet$2.with(DefaultModuleDefinitionSet.java:143)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:274)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:279)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.withModule(DefaultModuleDefinitionSet.java:262)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.loadContexts(DefaultModuleDefinitionSet.java:131)
    at org.apache.cloudstack.spring.module.model.impl.DefaultModuleDefinitionSet.load(DefaultModuleDefinitionSet.java:79)
    at org.apache.cloudstack.spring.module.factory.ModuleBasedContextFactory.loadModules(ModuleBasedContextFactory.java:37)
    at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.init(CloudStackSpringContext.java:71)
    at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:58)
    at org.apache.cloudstack.spring.module.factory.CloudStackSpringContext.(CloudStackSpringContext.java:62)
    at org.apache.cloudstack.spring.module.web.CloudStackContextLoaderListener.contextInitialized(CloudStackContextLoaderListener.java:53)
    at org.eclipse.jetty.server.handler.ContextHandler.callContextInitialized(ContextHandler.java:1073)
    at org.eclipse.jetty.servlet.ServletContextHandler.callContextInitialized(ServletContextHandler.java:572)
    at org.eclipse.jetty.server.handler.ContextHandler.contextInitialized(ContextHandler.java:1002)
    at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:765)
    at org.eclipse.jetty.servlet.ServletContextHandler.startContext(ServletContextHandler.java:379)
    at org.eclipse.jetty.webapp.WebAppContext.startWebapp(WebAppContext.java:1449)
    at org.eclipse.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1414)
    at org.eclipse.jetty.server.handler.ContextHandler.doStart(ContextHandler.java:916)
    at org.eclipse.jetty.servlet.ServletContextHandler.doStart(ServletContextHandler.java:288)
    at org.eclipse.jetty.webapp.WebAppContext.doStart(WebAppContext.java:524)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
    at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
    at org.eclipse.jetty.server.handler.gzip.GzipHandler.doStart(GzipHandler.java:426)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:117)
    at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.start(ContainerLifeCycle.java:169)
    at org.eclipse.jetty.server.Server.start(Server.java:423)
    at org.eclipse.jetty.util.component.ContainerLifeCycle.doStart(ContainerLifeCycle.java:110)
    at org.eclipse.jetty.server.handler.AbstractHandler.doStart(AbstractHandler.java:97)
    at org.eclipse.jetty.server.Server.doStart(Server.java:387)
    at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:73)
    at org.apache.cloudstack.ServerDaemon.start(ServerDaemon.java:204)
    at org.apache.cloudstack.ServerDaemon.main(ServerDaemon.java:115)
    Caused by: org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'configDepot': Unsatisfied dependency expressed through field '_configDao'; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'configurationDaoImpl' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl]: Constructor threw exception; nested exception is java.lang.ExceptionInInitializerError
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:660)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.inject(AutowiredAnnotationBeanPostProcessor.java:640)
    at org.springframework.beans.factory.annotation.InjectionMetadata.inject(InjectionMetadata.java:119)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor.postProcessProperties(AutowiredAnnotationBeanPostProcessor.java:399)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1431)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:619)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
    at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
    at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
    ... 53 more
    Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'configurationDaoImpl' defined in URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/system/spring-framework-config-system-context.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl]: Constructor threw exception; nested exception is java.lang.ExceptionInInitializerError
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1334)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:1232)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:582)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:542)
    at org.springframework.beans.factory.support.AbstractBeanFactory.lambda$doGetBean$0(AbstractBeanFactory.java:335)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:234)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:333)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:208)
    at org.springframework.beans.factory.config.DependencyDescriptor.resolveCandidate(DependencyDescriptor.java:276)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.doResolveDependency(DefaultListableBeanFactory.java:1391)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.resolveDependency(DefaultListableBeanFactory.java:1311)
    at org.springframework.beans.factory.annotation.AutowiredAnnotationBeanPostProcessor$AutowiredFieldElement.resolveFieldValue(AutowiredAnnotationBeanPostProcessor.java:657)
    ... 67 more
    Caused by: org.springframework.beans.BeanInstantiationException: Failed to instantiate [org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl]: Constructor threw exception; nested exception is java.lang.ExceptionInInitializerError
    at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:224)
    at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:87)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateBean(AbstractAutowireCapableBeanFactory.java:1326)
    ... 78 more
    Caused by: java.lang.ExceptionInInitializerError
    at com.cloud.utils.db.GenericDaoBase.(GenericDaoBase.java:264)
    at org.apache.cloudstack.framework.config.dao.ConfigurationDaoImpl.(ConfigurationDaoImpl.java:49)
    at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:77)
    at java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.base/java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:500)
    at java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:481)
    at org.springframework.beans.BeanUtils.instantiateClass(BeanUtils.java:211)
    ... 80 more
    Caused by: net.sf.cglib.core.CodeGenerationException: java.lang.reflect.InaccessibleObjectException-->Unable to make protected final java.lang.Class java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain) throws java.lang.ClassFormatError accessible: module java.base does not "opens java.lang" to unnamed module @543788f3
    at net.sf.cglib.core.ReflectUtils.defineClass(ReflectUtils.java:464)
    at net.sf.cglib.core.AbstractClassGenerator.generate(AbstractClassGenerator.java:339)
    at net.sf.cglib.core.AbstractClassGenerator$ClassLoaderData$3.apply(AbstractClassGenerator.java:96)
    at net.sf.cglib.core.AbstractClassGenerator$ClassLoaderData$3.apply(AbstractClassGenerator.java:94)
    at net.sf.cglib.core.internal.LoadingCache$2.call(LoadingCache.java:54)
    at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
    at net.sf.cglib.core.internal.LoadingCache.createEntry(LoadingCache.java:61)
    at net.sf.cglib.core.internal.LoadingCache.get(LoadingCache.java:34)
    at net.sf.cglib.core.AbstractClassGenerator$ClassLoaderData.get(AbstractClassGenerator.java:119)
    at net.sf.cglib.core.AbstractClassGenerator.create(AbstractClassGenerator.java:294)
    at net.sf.cglib.core.KeyFactory$Generator.create(KeyFactory.java:221)
    at net.sf.cglib.core.KeyFactory.create(KeyFactory.java:174)
    at net.sf.cglib.core.KeyFactory.create(KeyFactory.java:153)
    at net.sf.cglib.proxy.Enhancer.(Enhancer.java:73)
    ... 88 more
    Caused by: java.lang.reflect.InaccessibleObjectException: Unable to make protected final java.lang.Class java.lang.ClassLoader.defineClass(java.lang.String,byte[],int,int,java.security.ProtectionDomain) throws java.lang.ClassFormatError accessible: module java.base does not "opens java.lang" to unnamed module @543788f3
    at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:354)
    at java.base/java.lang.reflect.AccessibleObject.checkCanSetAccessible(AccessibleObject.java:297)
    at java.base/java.lang.reflect.Method.checkCanSetAccessible(Method.java:200)
    at java.base/java.lang.reflect.Method.setAccessible(Method.java:194)
    at net.sf.cglib.core.ReflectUtils$1.run(ReflectUtils.java:61)
    at java.base/java.security.AccessController.doPrivileged(AccessController.java:569)
    at net.sf.cglib.core.ReflectUtils.(ReflectUtils.java:52)
    at net.sf.cglib.core.KeyFactory$Generator.generateClass(KeyFactory.java:243)
    at net.sf.cglib.core.DefaultGeneratorStrategy.generate(DefaultGeneratorStrategy.java:25)
    at net.sf.cglib.core.AbstractClassGenerator.generate(AbstractClassGenerator.java:332)
    ... 100 more

    2026-04-14 00:51:22,684 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to obtain module [core] context.
    2026-04-14 00:51:22,684 DEBUG [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Trying to load module [core] context.
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-core-registry-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-framework-cluster-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-framework-jobs-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-framework-security-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-server-core-managers-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-server-core-misc-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-dedicated-resources-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-internallb-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-baremetal-core-context.xml]
    2026-04-14 00:51:22,684 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-ucs-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-hyperv-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-userdata-cloud-init-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-userdata-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-framework-ipc-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-api-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-components-api-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-orchestration-core-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-schema-core-common-daos-between-management-and-usage-context.xml]
    2026-04-14 00:51:22,685 INFO [o.a.c.s.m.m.i.DefaultModuleDefinitionSet] (main:[]) (logid:) Loading module context [core] from URL [jar:file:/usr/share/cloudstack-management/lib/cloudstack-4.20.2.0.jar!/META-INF/cloudstack/core/spring-engine-schema-core-daos-context.xml]

  8. weizhouapache commented on Apr 14, 2026

    @weizhouapache
    Member

    @GerorgeEG
    please check the JAVA_OPTS in /etc/default/cloudstack-management
    it should be same as
    https://github.com/apache/cloudstack/blob/4.20.2.0/packaging/systemd/cloudstack-management.default

    you may need to check /etc/default/cloudstack-usage on management servers and /etc/default/cloudstack-agent on kvm hosts if you use kvm.

  9. locked and limited conversation to collaborators on Apr 15, 2026
  10. converted this issue into a discussion #13029 on Apr 15, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions