[ 486.678157] nova-scheduler[50582]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 487.742826] nova-scheduler[50582]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 487.753588] nova-scheduler[50582]: DEBUG oslo_db.sqlalchemy.engines [None req-914c7b81-e9a3-4c7e-b161-cd08a4f77243 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50582) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 487.866466] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-914c7b81-e9a3-4c7e-b161-cd08a4f77243 None None] Found 1 cells: 74f912f4-43d8-4d2a-9ea1-d6a83c370e35 {{(pid=50582) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 487.866616] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-914c7b81-e9a3-4c7e-b161-cd08a4f77243 None None] Found 0 disabled cells: {{(pid=50582) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 487.898591] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-914c7b81-e9a3-4c7e-b161-cd08a4f77243 None None] START:_async_init_instance_info {{(pid=50582) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 487.900281] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 487.900491] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 487.901848] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 487.909466] nova-scheduler[50582]: DEBUG oslo_db.sqlalchemy.engines [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50582) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 487.914734] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Total number of compute nodes: 0 {{(pid=50582) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 487.915066] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 487.915257] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 487.915409] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 487.966723] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] Adding 0 instances for hosts 10-20 {{(pid=50582) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 487.966723] nova-scheduler[50582]: DEBUG nova.scheduler.host_manager [None req-ef3a6fa0-1bd4-46a2-81ad-e8c74ee0c467 None None] END:_async_init_instance_info {{(pid=50582) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 488.000342] nova-scheduler[50582]: DEBUG nova.context [None req-914c7b81-e9a3-4c7e-b161-cd08a4f77243 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),74f912f4-43d8-4d2a-9ea1-d6a83c370e35(cell1) {{(pid=50582) load_cells /opt/stack/nova/nova/context.py:464}} [ 488.000467] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 488.000686] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 488.001974] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 488.001974] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 488.001974] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 488.002178] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50582) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 488.006983] nova-scheduler[50582]: DEBUG oslo_db.sqlalchemy.engines [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50582) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 488.015546] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Acquiring lock "singleton_lock" {{(pid=50582) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 488.015714] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Acquired lock "singleton_lock" {{(pid=50582) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 488.015945] nova-scheduler[50582]: DEBUG oslo_concurrency.lockutils [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Releasing lock "singleton_lock" {{(pid=50582) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 488.016175] nova-scheduler[50582]: INFO oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Starting 2 workers [ 488.022082] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Started child 51596 {{(pid=50582) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 488.028202] nova-scheduler[51596]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Started child 51602 {{(pid=50582) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Full set of CONF: {{(pid=50582) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ******************************************************************************** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] Configuration options gathered from: {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 488.028436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] config files: ['/etc/nova/nova.conf'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 488.028620] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ================================================================================ {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 488.028620] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] allow_resize_to_same_host = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.028695] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] arq_binding_timeout = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.028887] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] block_device_allocate_retries = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.029316] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] block_device_allocate_retries_interval = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.029316] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cert = self.pem {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.029487] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute_driver = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.029709] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute_monitors = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.029937] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] config_dir = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.030160] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] config_drive_format = iso9660 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.030304] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.030508] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] config_source = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.030697] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] console_host = devstack {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.030895] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] control_exchange = nova {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.031114] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cpu_allocation_ratio = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.031322] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] daemon = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.031494] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] debug = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.031670] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] default_access_ip_network_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.031859] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] default_availability_zone = nova {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.032038] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] default_ephemeral_format = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.032337] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.032535] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] default_schedule_zone = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.032700] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] disk_allocation_ratio = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.032889] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] enable_new_services = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.033310] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] enabled_apis = ['osapi_compute'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.033391] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] enabled_ssl_apis = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.033447] nova-scheduler[51602]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 488.033644] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] flat_injected = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.033705] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] force_config_drive = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.033883] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] force_raw_images = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.034076] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] graceful_shutdown_timeout = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.034249] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] heal_instance_info_cache_interval = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.034787] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] host = devstack {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.035011] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.035190] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] initial_disk_allocation_ratio = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.035368] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] initial_ram_allocation_ratio = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.035620] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.035797] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_build_timeout = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036284] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_delete_interval = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036284] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_format = [instance: %(uuid)s] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036407] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_name_template = instance-%08x {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036471] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_usage_audit = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036681] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_usage_audit_period = month {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.036852] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037037] nova-scheduler[51596]: DEBUG oslo_db.sqlalchemy.engines [None req-9f5aed84-aa08-4fb7-94a5-fa905ff85692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 488.037121] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] instances_path = /opt/stack/data/nova/instances {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037203] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] internal_service_availability_zone = internal {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037369] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] key = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] live_migration_retry_count = 30 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_config_append = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.037921] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038057] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_dir = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038232] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038362] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_options = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038543] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_rotate_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038731] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_rotate_interval_type = days {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.038920] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] log_rotation_type = none {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039059] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039184] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039351] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039535] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039674] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.039889] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] long_rpc_timeout = 1800 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.040058] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_concurrent_builds = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.040520] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_concurrent_live_migrations = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.040520] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_concurrent_snapshots = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.040520] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_local_block_devices = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.040674] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_logfile_count = 30 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.041684] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] max_logfile_size_mb = 200 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.041684] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] maximum_instance_delete_attempts = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.041684] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metadata_listen = 0.0.0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.041684] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metadata_listen_port = 8775 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.041684] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metadata_workers = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.042074] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] migrate_max_retries = -1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.042074] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] mkisofs_cmd = genisoimage {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.042266] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] my_block_storage_ip = 10.180.1.21 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.042300] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] my_ip = 10.180.1.21 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.042523] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] network_allocate_retries = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043429] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043429] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] osapi_compute_listen = 0.0.0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043429] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] osapi_compute_listen_port = 8774 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043429] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] osapi_compute_unique_server_name_scope = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043429] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] osapi_compute_workers = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043783] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] password_length = 12 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043783] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] periodic_enable = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.043901] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] periodic_fuzzy_delay = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.044125] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] pointer_model = usbtablet {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.044387] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] preallocate_images = none {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.044567] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] publish_errors = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.044699] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] pybasedir = /opt/stack/nova {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.044873] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ram_allocation_ratio = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045051] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rate_limit_burst = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045240] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rate_limit_except_level = CRITICAL {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045398] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rate_limit_interval = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045561] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reboot_timeout = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045718] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reclaim_instance_interval = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.045895] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] record = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046080] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reimage_timeout_per_gb = 20 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046264] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] report_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046425] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rescue_timeout = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046609] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reserved_host_cpus = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046769] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reserved_host_disk_mb = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.046923] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reserved_host_memory_mb = 512 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047162] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] reserved_huge_pages = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047343] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] resize_confirm_window = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047507] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] resize_fs_using_block_device = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047665] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] resume_guests_state_on_host_boot = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047829] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.047990] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] run_external_periodic_tasks = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048170] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] running_deleted_instance_action = reap {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048833] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] running_deleted_instance_poll_interval = 1800 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048833] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] running_deleted_instance_timeout = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048833] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler_instance_sync_interval = 120 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048833] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_down_time = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.048983] nova-scheduler[51602]: DEBUG oslo_db.sqlalchemy.engines [None req-9e98bb5d-269a-4aef-91f9-37b89c433ec8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51602) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 488.049102] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] servicegroup_driver = db {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.049212] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] shelved_offload_time = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.049373] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] shelved_poll_interval = 3600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.049538] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] shutdown_timeout = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.049725] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] source_is_ipv6 = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.049896] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ssl_only = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050092] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] state_path = /opt/stack/data/nova {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050294] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] sync_power_state_interval = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050480] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] sync_power_state_pool_size = 1000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050653] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] syslog_log_facility = LOG_USER {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050838] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] tempdir = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.050967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] timeout_nbd = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.051162] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] transport_url = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.051326] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] update_resources_interval = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.051505] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_cow_images = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.051686] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_eventlog = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.051862] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_journal = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052044] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_json = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052406] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_rootwrap_daemon = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052406] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_stderr = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052558] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] use_syslog = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052717] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vcpu_pin_set = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.052878] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vif_plugging_is_fatal = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.053049] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vif_plugging_timeout = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.053267] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] virt_mkfs = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.053670] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] volume_usage_poll_interval = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.053670] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] watch_log_file = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.053811] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] web = /usr/share/spice-html5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 488.054142] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_concurrency.disable_process_locking = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.054330] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.054562] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.auth_strategy = keystone {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.054741] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.compute_link_prefix = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.054937] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.055150] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.dhcp_domain = novalocal {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.055324] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.enable_instance_password = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.055505] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.glance_link_prefix = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.055672] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.055844] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.056023] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.instance_list_per_project_cells = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.056193] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.list_records_by_skipping_down_cells = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.056380] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.local_metadata_per_cell = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.056585] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.max_limit = 1000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.056741] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.metadata_cache_expiration = 15 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057024] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.neutron_default_tenant_id = default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057092] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.use_forwarded_for = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057280] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.use_neutron_default_nets = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057448] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057738] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057807] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.057968] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.058159] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_dynamic_targets = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.058307] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_jsonfile_path = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.058516] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.058766] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.backend = dogpile.cache.memcached {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.058956] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.backend_argument = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.059147] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.config_prefix = cache.oslo {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.059339] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.dead_timeout = 60.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.059385] nova-scheduler[51596]: DEBUG nova.service [None req-9f5aed84-aa08-4fb7-94a5-fa905ff85692 None None] Creating RPC server for service scheduler {{(pid=51596) start /opt/stack/nova/nova/service.py:182}} [ 488.059510] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.debug_cache_backend = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.059671] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.enable_retry_client = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.059835] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.enable_socket_keepalive = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.060009] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.enabled = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.060197] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.expiration_time = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.060361] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.hashclient_retry_attempts = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.060522] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.hashclient_retry_delay = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.060686] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_dead_retry = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061026] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_password = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061026] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061171] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061327] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_pool_maxsize = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061513] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061678] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_sasl_enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.061874] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062073] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_socket_timeout = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062344] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.memcache_username = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062424] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.proxies = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062701] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.retry_attempts = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062786] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.retry_delay = 0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.062951] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.socket_keepalive_count = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063123] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.socket_keepalive_idle = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063282] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.socket_keepalive_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063434] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.tls_allowed_ciphers = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063590] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.tls_cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063745] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.tls_certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.063898] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.tls_enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.064062] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cache.tls_keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.064164] nova-scheduler[51602]: DEBUG nova.service [None req-9e98bb5d-269a-4aef-91f9-37b89c433ec8 None None] Creating RPC server for service scheduler {{(pid=51602) start /opt/stack/nova/nova/service.py:182}} [ 488.064292] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.064490] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.auth_type = password {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.064652] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.064845] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.catalog_info = volumev3::publicURL {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065030] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065212] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065386] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.cross_az_attach = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065548] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.debug = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065703] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.endpoint_template = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.065879] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.http_retries = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066050] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066210] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066395] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.os_region_name = RegionOne {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066556] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066717] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cinder.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.066887] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067053] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.cpu_dedicated_set = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067211] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.cpu_shared_set = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067375] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.image_type_exclude_list = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067542] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067701] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.max_concurrent_disk_ops = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.067862] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.max_disk_devices_to_attach = -1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068054] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068222] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068378] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.resource_provider_association_refresh = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068537] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.shutdown_retry_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068714] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.068895] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] conductor.workers = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069079] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] console.allowed_origins = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069241] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] console.ssl_ciphers = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069408] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] console.ssl_minimum_version = default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069581] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] consoleauth.token_ttl = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069772] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.069929] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070099] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070259] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070415] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070569] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070727] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.070879] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.service_type = accelerator {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.071967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.072230] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.072278] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.072482] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073081] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] cyborg.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073081] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.backend = sqlalchemy {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073081] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.connection = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073202] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.connection_debug = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073366] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.connection_parameters = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073856] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.connection_recycle_time = 3600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073856] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.connection_trace = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073856] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.db_inc_retry_interval = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.073982] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.db_max_retries = 20 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074149] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.db_max_retry_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074325] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.db_retry_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074467] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.max_overflow = 50 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074629] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.max_pool_size = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074781] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.max_retries = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.074939] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.mysql_enable_ndb = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075115] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075267] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.mysql_wsrep_sync_wait = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075420] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.pool_timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075580] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.retry_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075731] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.slave_connection = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.075896] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.sqlite_synchronous = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076065] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] database.use_db_reconnect = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076255] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.backend = sqlalchemy {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076435] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.connection = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076602] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.connection_debug = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076769] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.connection_parameters = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.076927] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.connection_recycle_time = 3600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077100] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.connection_trace = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077260] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.db_inc_retry_interval = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077420] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.db_max_retries = 20 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077579] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.db_max_retry_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077736] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.db_retry_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.077900] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.max_overflow = 50 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078070] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.max_pool_size = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078241] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.max_retries = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078400] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.mysql_enable_ndb = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078565] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078719] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.078875] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.pool_timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079047] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.retry_interval = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079205] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.slave_connection = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079373] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] api_database.sqlite_synchronous = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079573] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] devices.enabled_mdev_types = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079753] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.079918] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ephemeral_storage_encryption.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080114] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080310] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.api_servers = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080472] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080633] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080792] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.080967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081136] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081297] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.debug = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081516] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.default_trusted_certificate_ids = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081639] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.enable_certificate_validation = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081815] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.enable_rbd_download = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.081940] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082196] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082323] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082492] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082751] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082834] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.num_retries = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.082982] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.rbd_ceph_conf = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.083155] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.rbd_connect_timeout = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.083327] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.rbd_pool = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.083501] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.rbd_user = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.083665] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.083822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.084019] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.service_type = image {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.084200] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.084350] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.084511] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085024] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085024] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085024] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.verify_glance_signatures = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085209] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] glance.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085318] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] guestfs.debug = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085501] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.config_drive_cdrom = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085661] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.config_drive_inject_password = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085897] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.085976] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.enable_instance_metrics_collection = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.086252] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.enable_remotefx = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.086339] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.instances_path_share = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.086478] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.iscsi_initiator_list = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.086716] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.limit_cpu_features = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.086895] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087070] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087234] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.power_state_check_timeframe = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087386] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087563] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087728] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.use_multipath_io = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.087864] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.volume_attach_retry_count = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.088010] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.088175] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.vswitch_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.088331] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.088610] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] mks.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.089258] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.089493] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.manager_interval = 2400 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.089835] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.precache_concurrency = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.089835] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.remove_unused_base_images = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.089893] nova-scheduler[51596]: DEBUG nova.service [None req-9f5aed84-aa08-4fb7-94a5-fa905ff85692 None None] Join ServiceGroup membership for this service scheduler {{(pid=51596) start /opt/stack/nova/nova/service.py:199}} [ 488.089998] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.090402] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-9f5aed84-aa08-4fb7-94a5-fa905ff85692 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51596) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 488.090440] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.090440] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] image_cache.subdirectory_name = _base {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.090687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.api_max_retries = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.090687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.api_retry_interval = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.090850] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091313] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.auth_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091313] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091313] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091494] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091677] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.091858] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092016] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092498] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092498] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092621] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092686] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.092865] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.partition_key = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.093687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.peer_list = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.093687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.093687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.serial_console_state_timeout = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.093687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.093687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.service_type = baremetal {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094105] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094105] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094164] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094306] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094490] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094635] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ironic.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.094842] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095339] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] key_manager.fixed_key = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095339] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095450] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.barbican_api_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095577] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.barbican_endpoint = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095771] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.barbican_endpoint_type = public {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095932] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.barbican_region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.095985] nova-scheduler[51602]: DEBUG nova.service [None req-9e98bb5d-269a-4aef-91f9-37b89c433ec8 None None] Join ServiceGroup membership for this service scheduler {{(pid=51602) start /opt/stack/nova/nova/service.py:199}} [ 488.096127] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.096210] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-9e98bb5d-269a-4aef-91f9-37b89c433ec8 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51602) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 488.096285] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.096463] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.096619] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.096768] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.096944] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.number_of_retries = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097118] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.retry_delay = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097296] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.send_service_user_token = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097454] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097608] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097763] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.verify_ssl = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.097913] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican.verify_ssl_path = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098089] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098266] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.auth_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098421] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098575] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098730] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.098886] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099048] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099207] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099359] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] barbican_service_user.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099545] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.approle_role_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099705] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.approle_secret_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.099856] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.100033] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.100203] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.100532] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.100532] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.100689] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.kv_mountpoint = secret {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101078] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.kv_version = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101078] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.namespace = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101195] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.root_token_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101330] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101510] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.ssl_ca_crt_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101670] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.101829] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.use_ssl = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.102037] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.102216] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.102405] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.102594] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.102771] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103269] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103269] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103269] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103443] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103529] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103682] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103830] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.103985] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104164] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.service_type = identity {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104317] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104477] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104631] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104783] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.104954] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.105143] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] keystone.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.105403] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.connection_uri = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.105583] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_mode = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.105745] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_model_extra_flags = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.105919] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_models = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106113] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_power_governor_high = performance {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106285] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_power_governor_low = powersave {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106443] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_power_management = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106628] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106811] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.device_detach_attempts = 8 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.106969] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.device_detach_timeout = 20 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.107136] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.disk_cachemodes = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.107288] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.disk_prefix = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.107572] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.enabled_perf_events = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.107606] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.file_backed_memory = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.107751] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.gid_maps = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108104] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.hw_disk_discard = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108104] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.hw_machine_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108244] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_rbd_ceph_conf = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108406] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108585] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108745] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_rbd_glance_store_name = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.108906] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_rbd_pool = rbd {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109078] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_type = default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109236] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.images_volume_group = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109397] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.inject_key = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109556] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.inject_partition = -2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109718] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.inject_password = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.109872] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.iscsi_iface = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110059] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.iser_use_multipath = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110215] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_bandwidth = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110372] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110523] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_downtime = 500 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110679] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110835] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.110985] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_inbound_addr = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.111152] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.111305] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_permit_post_copy = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.111507] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_scheme = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.111698] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_timeout_action = abort {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.111861] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_tunnelled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112026] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_uri = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112193] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.live_migration_with_native_tls = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112703] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.max_queues = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112703] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112703] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.nfs_mount_options = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.112967] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113154] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113316] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_iser_scan_tries = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113472] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_memory_encrypted_guests = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113637] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113794] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_pcie_ports = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.113955] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.num_volume_scan_tries = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.114135] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.pmem_namespaces = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.114583] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.quobyte_client_cfg = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.114583] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.114699] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rbd_connect_timeout = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.114845] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115043] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115177] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rbd_secret_uuid = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115332] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rbd_user = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115494] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115663] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.remote_filesystem_transport = ssh {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115818] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rescue_image_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.115975] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rescue_kernel_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.116142] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rescue_ramdisk_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.rx_queue_size = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.smbfs_mount_options = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.snapshot_compression = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117224] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.snapshot_image_format = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117395] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117559] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.sparse_logical_volumes = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117719] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.swtpm_enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.117888] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.swtpm_group = tss {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118063] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.swtpm_user = tss {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118234] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.sysinfo_serial = unique {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118392] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.tx_queue_size = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118607] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.uid_maps = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118770] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.use_virtio_for_bridges = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.118930] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.virt_type = kvm {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119111] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.volume_clear = zero {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119590] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.volume_clear_size = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119590] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.volume_use_multipath = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119590] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_cache_path = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119765] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.119930] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_mount_group = qemu {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120106] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_mount_opts = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120270] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120480] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120650] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.vzstorage_mount_user = stack {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120809] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.120995] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.121434] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.auth_type = password {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.121434] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.121529] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.121671] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.121849] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122011] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122202] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.default_floating_pool = public {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122376] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122589] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.extension_sync_interval = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122780] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.http_retries = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.122944] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123108] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123544] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123544] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123672] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123716] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.ovs_bridge = br-int {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.123879] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.physnets = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124056] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.region_name = RegionOne {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124226] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.service_metadata_proxy = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124379] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.service_type = network {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124704] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.124869] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125057] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125216] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125392] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125555] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] neutron.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125723] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] notifications.bdms_in_notifications = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.125897] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] notifications.default_level = INFO {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126366] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] notifications.notification_format = unversioned {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126366] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] notifications.notify_on_state_change = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126500] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126576] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] pci.alias = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126750] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] pci.device_spec = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.126908] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] pci.report_in_placement = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127130] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127304] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.auth_type = password {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127473] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127630] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127783] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.127943] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128107] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128263] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128416] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.default_domain_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128577] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.default_domain_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128730] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.domain_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.128883] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.domain_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129050] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129210] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129362] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129515] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129666] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129827] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.password = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.129985] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.project_domain_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130158] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.project_domain_name = Default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130321] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.project_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130489] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.project_name = service {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130653] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.region_name = RegionOne {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130807] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.130971] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.service_type = placement {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131304] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131304] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131489] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131843] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.system_scope = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131843] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.131953] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.trust_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.132117] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.user_domain_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.132305] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.user_domain_name = Default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.132498] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.user_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.132709] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.username = placement {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.132976] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133079] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] placement.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133263] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.cores = 20 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133426] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.count_usage_from_placement = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.injected_file_content_bytes = 10240 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.133962] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.injected_file_path_length = 255 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134081] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.injected_files = 5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134247] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.instances = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134417] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.key_pairs = 100 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134580] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.metadata_items = 128 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134745] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.ram = 51200 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.134927] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.recheck_quota = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.135103] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.server_group_members = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.135266] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] quota.server_groups = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.135436] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rdp.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.135749] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.135963] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.136173] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.136617] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.image_metadata_prefilter = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.136617] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.136743] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.max_attempts = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.136859] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.max_placement_results = 1000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.137057] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.137233] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.query_placement_for_availability_zone = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.137392] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.query_placement_for_image_type_support = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.137547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.137760] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] scheduler.workers = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138030] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138204] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138405] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138594] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138776] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.138960] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.139159] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.139373] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.139545] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.host_subset_size = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.139706] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.139888] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140069] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.isolated_hosts = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140231] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.isolated_images = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140388] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140709] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.pci_in_placement = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.140891] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141062] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141222] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141425] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141578] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141891] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.141891] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.track_instance_changes = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.142256] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.142326] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metrics.required = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.142508] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metrics.weight_multiplier = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.142686] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.142849] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] metrics.weight_setting = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.143159] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.143332] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.143526] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.port_range = 10000:20000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.143702] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.143870] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144070] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] serial_console.serialproxy_port = 6083 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144573] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144573] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.auth_type = password {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144573] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144719] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.144878] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145047] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145205] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145372] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.send_service_user_token = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145533] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145686] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] service_user.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.145849] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.agent_enabled = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.146042] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.146375] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.146579] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.146747] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.html5proxy_port = 6082 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.146907] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.image_compression = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147074] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.jpeg_compression = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147237] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.playback_compression = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147402] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.server_listen = 127.0.0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147600] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147758] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.streaming_mode = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.147912] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] spice.zlib_compression = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148105] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] upgrade_levels.baseapi = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148261] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] upgrade_levels.cert = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148426] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] upgrade_levels.compute = auto {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148583] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] upgrade_levels.conductor = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148899] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] upgrade_levels.scheduler = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.148930] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149078] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.auth_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149259] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149378] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149537] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149692] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.149846] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150030] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150168] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vendordata_dynamic_auth.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150374] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.api_retry_count = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150535] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.ca_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150707] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.cache_prefix = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.150861] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.cluster_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.151046] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.connection_pool_size = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.151240] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.console_delay_seconds = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.151433] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.datastore_regex = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.151633] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.host_ip = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152049] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.host_password = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152049] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.host_port = 443 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152125] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.host_username = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152236] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152390] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.integration_bridge = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152569] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.maximum_objects = 100 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152730] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.pbm_default_policy = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.152892] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.pbm_enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153052] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.pbm_wsdl_location = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153223] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153379] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.serial_port_proxy_uri = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153533] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.serial_port_service_uri = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153972] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.task_poll_interval = 0.5 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.153972] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.use_linked_clone = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.154089] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.vnc_keymap = en-us {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.154268] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.vnc_port = 5900 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.154356] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vmware.vnc_port_total = 10000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.154547] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.auth_schemes = ['none'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.154730] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.enabled = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155062] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155249] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155435] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.novncproxy_port = 6080 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155635] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.server_listen = 127.0.0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155808] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.155962] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.vencrypt_ca_certs = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.156279] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.vencrypt_client_cert = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.156279] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] vnc.vencrypt_client_key = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.156473] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.156639] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_deep_image_inspection = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157203] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157203] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157203] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157367] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.disable_rootwrap = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157411] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.enable_numa_live_migration = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157569] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157725] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.157885] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158050] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.libvirt_disable_apic = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158210] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158369] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158528] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158694] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.158849] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159013] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159178] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159331] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159767] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159767] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159890] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.159990] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.client_socket_timeout = 900 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.160165] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.default_pool_size = 1000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.160326] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.keep_alive = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.160490] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.max_header_line = 16384 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.160650] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.secure_proxy_ssl_header = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.160810] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.ssl_ca_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161187] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.ssl_cert_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161187] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.ssl_key_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161312] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.tcp_keepidle = 600 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161469] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161639] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] zvm.ca_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.161798] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] zvm.cloud_connector_url = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.162035] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.162204] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] zvm.reachable_timeout = 300 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.162421] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.162645] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163043] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163043] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163160] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163380] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.enforce_new_defaults = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163549] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.enforce_scope = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163724] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.policy_default_rule = default {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.163919] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164108] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.policy_file = policy.yaml {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164302] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164468] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164915] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164915] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.164915] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.165117] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.165296] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166168] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.connection_string = messaging:// {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166168] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.enabled = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166168] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.es_doc_type = notification {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166351] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.es_scroll_size = 10000 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166460] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.es_scroll_time = 2m {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166624] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.filter_error_trace = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166808] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.hmac_keys = SECRET_KEY {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.166970] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.sentinel_service_name = mymaster {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167145] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.socket_timeout = 0.1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167306] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] profiler.trace_sqlalchemy = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167477] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] remote_debug.host = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167836] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] remote_debug.port = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167836] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.167970] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168145] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168305] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168468] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168626] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168789] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.168946] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.169162] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.169352] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.169529] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.169696] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.169862] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170035] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170199] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170373] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170533] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170687] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.170849] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171016] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171172] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171330] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171510] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171679] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.171842] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172010] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172182] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172466] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172515] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172956] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.172956] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_rabbit.ssl_version = {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173069] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173225] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_notifications.retry = -1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173430] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173602] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_messaging_notifications.transport_url = **** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173802] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.auth_section = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.173965] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.auth_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174133] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.cafile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174289] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.certfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174443] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.collect_timing = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174886] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.connect_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174886] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.connect_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.174886] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.endpoint_id = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175047] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.endpoint_override = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175206] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.insecure = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175358] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.keyfile = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175518] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.max_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175671] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.min_version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175822] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.region_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.175978] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.service_name = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176143] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.service_type = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176298] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.split_loggers = False {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176452] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.status_code_retries = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176606] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.status_code_retry_delay = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176756] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.timeout = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.176912] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.valid_interfaces = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.177074] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_limit.version = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.177275] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_reports.file_event_handler = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.177767] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.177767] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] oslo_reports.log_dir = None {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 488.177767] nova-scheduler[50582]: DEBUG oslo_service.service [None req-8d5ef498-2623-4a28-84e6-d91a30c25755 None None] ******************************************************************************** {{(pid=50582) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 618.674456] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Starting to schedule for instances: ['42920efb-be41-4813-b33e-d49c6f4fb47c'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 618.675278] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 618.675447] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.675757] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.676544] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.676798] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 619.314368] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.314675] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.318163] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.324638] nova-scheduler[51596]: DEBUG oslo_db.sqlalchemy.engines [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 619.340838] nova-scheduler[51596]: DEBUG oslo_db.sqlalchemy.engines [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Parent process 50582 forked (51596) with an open database connection, which is being discarded and recreated. {{(pid=51596) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 619.349022] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.349248] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.349412] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.352265] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.352468] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.353654] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:42:54Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 619.354098] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 619.354270] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 619.354420] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 619.354582] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.355436] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 619.355722] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.355948] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.356258] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.356456] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.356617] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.356796] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.356959] nova-scheduler[51596]: DEBUG nova.filters [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.357704] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 619.357704] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 619.357704] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Attempting to claim resources in the placement API for instance 42920efb-be41-4813-b33e-d49c6f4fb47c {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 619.439548] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] [instance: 42920efb-be41-4813-b33e-d49c6f4fb47c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 619.439895] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.440107] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.440306] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-79d3ea84-51be-4b75-9270-5e934848994d tempest-ImagesNegativeTestJSON-1415358462 tempest-ImagesNegativeTestJSON-1415358462-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.635932] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Starting to schedule for instances: ['75398340-5ec7-4e3f-abc1-602f838d7ef3'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 619.635932] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 619.635932] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.635932] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.635932] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 619.636395] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 619.730319] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.730645] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.732419] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.740772] nova-scheduler[51602]: DEBUG oslo_db.sqlalchemy.engines [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51602) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 619.761564] nova-scheduler[51602]: DEBUG oslo_db.sqlalchemy.engines [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Parent process 50582 forked (51602) with an open database connection, which is being discarded and recreated. {{(pid=51602) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 619.770134] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.770526] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.770930] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.774364] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.774689] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.776059] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:42:54Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 619.776885] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 619.778018] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 619.778018] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 619.778018] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 619.778207] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 619.778456] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.778810] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.779289] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.779640] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.779926] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.780226] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.780507] nova-scheduler[51602]: DEBUG nova.filters [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 619.780807] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 619.781223] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 619.782019] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Attempting to claim resources in the placement API for instance 75398340-5ec7-4e3f-abc1-602f838d7ef3 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 619.859632] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] [instance: 75398340-5ec7-4e3f-abc1-602f838d7ef3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 619.859841] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 619.860070] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 619.860300] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ad1b777c-d99f-48ed-9fd1-ccc8fb9bba27 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.725982] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Starting to schedule for instances: ['5e7637fe-8828-4c16-a629-0d82f1efded9'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 620.726963] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 620.726963] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.726963] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.730050] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.730338] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 620.796921] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.797048] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.797479] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.813438] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.813656] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.813820] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.816246] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.816458] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.816837] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_acb2cb42f7814275b0d7369f2e7ab372='1',num_proj_fa8a67eb479240bfa25cc71563cdde3d='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:33Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 620.817330] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 620.817330] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 620.817461] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Update host state with instances: ['42920efb-be41-4813-b33e-d49c6f4fb47c', '75398340-5ec7-4e3f-abc1-602f838d7ef3'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 620.817630] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.817884] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 620.818097] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.818279] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.818473] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.818648] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.818863] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.818991] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.819165] nova-scheduler[51596]: DEBUG nova.filters [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.819831] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 620.819831] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 620.819831] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Attempting to claim resources in the placement API for instance 5e7637fe-8828-4c16-a629-0d82f1efded9 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 620.907348] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] [instance: 5e7637fe-8828-4c16-a629-0d82f1efded9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 620.908553] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.908553] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.908553] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2f705d30-d0d0-4cac-8f43-0110043792d2 tempest-ServerDiagnosticsNegativeTest-1416714911 tempest-ServerDiagnosticsNegativeTest-1416714911-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.304368] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Starting to schedule for instances: ['4cdfac2f-6963-4f71-9a42-709f2eeb4f9a'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 624.305339] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 624.305339] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.306295] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.307036] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.307203] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 624.362404] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.362640] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.362807] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.372120] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.372350] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.372865] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.374713] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.374974] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.375278] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_acb2cb42f7814275b0d7369f2e7ab372='1',num_proj_da38ec4f2cad4c0b8b429771350420a8='1',num_proj_fa8a67eb479240bfa25cc71563cdde3d='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:34Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 624.376062] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 624.376062] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 624.376062] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with instances: ['42920efb-be41-4813-b33e-d49c6f4fb47c', '75398340-5ec7-4e3f-abc1-602f838d7ef3', '5e7637fe-8828-4c16-a629-0d82f1efded9'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 624.376225] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.376452] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 624.376768] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.376968] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.377186] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.377354] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.377713] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.377713] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.377841] nova-scheduler[51602]: DEBUG nova.filters [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.378197] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 624.378383] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 624.378559] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Attempting to claim resources in the placement API for instance 4cdfac2f-6963-4f71-9a42-709f2eeb4f9a {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 624.433413] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] [instance: 4cdfac2f-6963-4f71-9a42-709f2eeb4f9a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 624.433831] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.433933] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.434121] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b5ae6b81-1aa9-4a97-9b4a-ac3fc144c56d tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.985964] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Starting to schedule for instances: ['b0f907a1-c4f4-4d02-9f07-8a640af4cdc4'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 625.986362] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 625.986521] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.986711] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.986904] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 625.987604] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 626.041476] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.041867] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.042204] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.053021] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.053021] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.053021] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.054778] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.054971] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.055348] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_acb2cb42f7814275b0d7369f2e7ab372='0',num_proj_da38ec4f2cad4c0b8b429771350420a8='1',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_proj_fa8a67eb479240bfa25cc71563cdde3d='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:38Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 626.056233] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 626.056434] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 626.056594] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Update host state with instances: ['75398340-5ec7-4e3f-abc1-602f838d7ef3', '5e7637fe-8828-4c16-a629-0d82f1efded9', '4cdfac2f-6963-4f71-9a42-709f2eeb4f9a'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 626.056760] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 626.057036] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 626.057242] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.057421] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.057613] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.057773] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.061020] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.061020] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.061020] nova-scheduler[51596]: DEBUG nova.filters [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 626.061020] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 626.061020] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 626.061339] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Attempting to claim resources in the placement API for instance b0f907a1-c4f4-4d02-9f07-8a640af4cdc4 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 626.130508] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] [instance: b0f907a1-c4f4-4d02-9f07-8a640af4cdc4] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 626.131014] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 626.131100] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 626.131286] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5f5a6212-82be-4bec-b863-18b40972328e tempest-ServerDiagnosticsTest-1663640938 tempest-ServerDiagnosticsTest-1663640938-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.013758] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Starting to schedule for instances: ['4a21b251-816d-4668-9a2e-eeabd9ed347b'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 631.015709] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 631.015709] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.015709] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.015709] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.015709] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 631.154455] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.154764] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.154877] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.161500] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.161702] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.161778] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.163784] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.163986] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.164383] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='1',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6502f31a94194708b7eb572e3c9dd2d6='1',num_proj_acb2cb42f7814275b0d7369f2e7ab372='0',num_proj_da38ec4f2cad4c0b8b429771350420a8='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_proj_fa8a67eb479240bfa25cc71563cdde3d='0',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:43Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 631.164662] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 631.164832] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 631.165139] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Update host state with instances: ['4cdfac2f-6963-4f71-9a42-709f2eeb4f9a', 'b0f907a1-c4f4-4d02-9f07-8a640af4cdc4'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 631.165182] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.165396] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 631.165595] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.165777] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.165997] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.166155] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.166317] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.166482] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.166641] nova-scheduler[51602]: DEBUG nova.filters [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.166798] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 631.166990] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 631.167684] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Attempting to claim resources in the placement API for instance 4a21b251-816d-4668-9a2e-eeabd9ed347b {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 631.233491] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] [instance: 4a21b251-816d-4668-9a2e-eeabd9ed347b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 631.233810] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.234037] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.234247] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-e65b6231-b29f-4a1a-bf29-cdf65abe061a tempest-TenantUsagesTestJSON-217578962 tempest-TenantUsagesTestJSON-217578962-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.480243] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Starting to schedule for instances: ['dff5937a-0c12-46d4-878a-8c0e783c6695'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 633.480577] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 633.480725] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.481443] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.481443] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.481443] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 633.539481] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.540216] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.540216] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.546631] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.546924] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.547026] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.549523] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.549523] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.549655] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='3',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6502f31a94194708b7eb572e3c9dd2d6='1',num_proj_acb2cb42f7814275b0d7369f2e7ab372='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='1',num_proj_da38ec4f2cad4c0b8b429771350420a8='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_proj_fa8a67eb479240bfa25cc71563cdde3d='0',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:45Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 633.550101] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 633.550101] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 633.550300] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Update host state with instances: ['b0f907a1-c4f4-4d02-9f07-8a640af4cdc4', '4a21b251-816d-4668-9a2e-eeabd9ed347b'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 633.550827] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.550827] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 633.551022] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.551089] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.551726] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.551726] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.551726] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.551726] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.552123] nova-scheduler[51596]: DEBUG nova.filters [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.552123] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 633.552313] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 633.552388] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Attempting to claim resources in the placement API for instance dff5937a-0c12-46d4-878a-8c0e783c6695 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 633.640301] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] [instance: dff5937a-0c12-46d4-878a-8c0e783c6695] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 633.640941] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.640941] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.641144] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea7ab62e-3009-4f78-a5f1-fb437042f5ef tempest-ServersV294TestFqdnHostnames-1499296313 tempest-ServersV294TestFqdnHostnames-1499296313-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.542078] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Starting to schedule for instances: ['39f071f7-2895-4cf8-aa41-0e683397a2de'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 634.543391] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 634.543742] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.544178] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.544840] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.546390] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 634.621125] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.621326] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.621500] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.630748] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.630810] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.630976] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.633177] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.633373] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.633786] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='4',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='1',num_task_networking='1',num_task_spawning='1',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:47Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 634.634034] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 634.635369] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 634.635369] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Update host state with instances: ['4a21b251-816d-4668-9a2e-eeabd9ed347b', 'dff5937a-0c12-46d4-878a-8c0e783c6695'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 634.635369] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.635548] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 634.635548] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.635548] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.635548] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.635675] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.635805] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.635965] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.636479] nova-scheduler[51602]: DEBUG nova.filters [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.636479] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 634.636584] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 634.637061] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Attempting to claim resources in the placement API for instance 39f071f7-2895-4cf8-aa41-0e683397a2de {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 634.715206] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] [instance: 39f071f7-2895-4cf8-aa41-0e683397a2de] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 634.715839] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.715839] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.716015] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-22a13f65-88df-47bd-a90b-d541d8a36016 tempest-ServerExternalEventsTest-103728035 tempest-ServerExternalEventsTest-103728035-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.137054] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Starting to schedule for instances: ['10fc8044-6912-412f-9b84-50efb0e9a398'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 638.137371] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 638.137602] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.137711] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.138353] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.138739] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 638.192519] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.192519] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.192519] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.197397] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.197606] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.197765] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.201020] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.201981] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.201981] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='5',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_8b11b617cfb243bca8848f333b96f265='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='1',num_proj_dad9bedbe759426d9c98810f2789dbfd='1',num_task_None='1',num_task_networking='1',num_task_spawning='1',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:48Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 638.202267] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 638.202411] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 638.202516] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with instances: ['4a21b251-816d-4668-9a2e-eeabd9ed347b', 'dff5937a-0c12-46d4-878a-8c0e783c6695', '39f071f7-2895-4cf8-aa41-0e683397a2de'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 638.202642] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.202930] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 638.203161] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.203347] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.203544] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.203711] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.204118] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.204301] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.204532] nova-scheduler[51596]: DEBUG nova.filters [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 638.204617] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 638.204790] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 638.205532] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Attempting to claim resources in the placement API for instance 10fc8044-6912-412f-9b84-50efb0e9a398 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 638.274362] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] [instance: 10fc8044-6912-412f-9b84-50efb0e9a398] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 638.274661] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.275245] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.275475] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-afee1a71-dd09-4d66-8b96-5a4780ed3593 tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.216752] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Starting to schedule for instances: ['dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 642.217777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 642.217777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.217777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.217777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 642.217941] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 642.266766] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.267058] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.267414] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.274306] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.275217] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.277811] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.277811] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.277811] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.278509] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='6',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_task_None='1',num_task_networking='0',num_task_spawning='0',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:52Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 642.278509] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 642.278641] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 642.279038] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 642.279038] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 642.279292] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 642.279686] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.279686] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.279883] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.280083] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.280252] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.280537] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.280712] nova-scheduler[51602]: DEBUG nova.filters [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 642.280897] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 642.281281] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 642.281281] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Attempting to claim resources in the placement API for instance dd588677-08d1-43d8-bff3-62b655a5a194 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 642.347026] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] [instance: dd588677-08d1-43d8-bff3-62b655a5a194] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 642.347026] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 642.347026] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 642.347240] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-056bcff0-52e4-4165-b6bc-eca6ea1b5ae6 tempest-DeleteServersAdminTestJSON-1437841386 tempest-DeleteServersAdminTestJSON-1437841386-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.339324] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Starting to schedule for instances: ['a268fbf0-c4dc-42d2-9d49-f8f6c9aee169'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 646.342670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 646.342670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.342670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.342670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.342670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 646.402336] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.402336] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.402609] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.412810] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.413380] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.413700] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.416689] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.417180] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.417834] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='8',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_task_None='2',num_task_networking='0',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 646.420019] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 646.420019] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 646.420019] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398', 'dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 646.420198] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.420198] nova-scheduler[51596]: DEBUG nova.filters [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 646.420198] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 63.284776 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 646.420198] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 646.420198] nova-scheduler[51596]: INFO nova.filters [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Filter ComputeFilter returned 0 hosts [ 646.420369] nova-scheduler[51596]: DEBUG nova.filters [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Filtering removed all hosts for the request with instance ID 'a268fbf0-c4dc-42d2-9d49-f8f6c9aee169'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 646.420575] nova-scheduler[51596]: INFO nova.filters [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Filtering removed all hosts for the request with instance ID 'a268fbf0-c4dc-42d2-9d49-f8f6c9aee169'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 646.420843] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 646.421174] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a599293b-9e44-4955-b39b-b79cd6a4522f tempest-AttachInterfacesV270Test-2100975528 tempest-AttachInterfacesV270Test-2100975528-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 648.662313] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Starting to schedule for instances: ['ce1dc0d1-a5fc-4fe4-b6f1-71d3d5c35a26'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 648.662762] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 648.662762] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.662908] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.666319] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.666535] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 648.712027] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.712027] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.713628] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.719136] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.719671] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.719671] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.722749] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.723076] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.723430] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='8',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_task_None='2',num_task_networking='0',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 648.723650] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 648.724199] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 648.724199] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398', 'dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 648.724199] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.724449] nova-scheduler[51602]: DEBUG nova.filters [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 648.724680] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 65.590019 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 648.724863] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 648.725027] nova-scheduler[51602]: INFO nova.filters [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filter ComputeFilter returned 0 hosts [ 648.725193] nova-scheduler[51602]: DEBUG nova.filters [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filtering removed all hosts for the request with instance ID 'ce1dc0d1-a5fc-4fe4-b6f1-71d3d5c35a26'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 648.725333] nova-scheduler[51602]: INFO nova.filters [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filtering removed all hosts for the request with instance ID 'ce1dc0d1-a5fc-4fe4-b6f1-71d3d5c35a26'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 648.725481] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 648.726169] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-10a7d33e-ba26-496a-a693-f7c1dbfd02d2 tempest-MigrationsAdminTest-1048639197 tempest-MigrationsAdminTest-1048639197-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 651.636241] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Starting to schedule for instances: ['ede2bc3e-4e4a-43b4-a31c-8d3ff6ccaf0e'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 651.636550] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 651.636713] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.636958] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.637563] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.638803] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 651.692026] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.692026] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.692220] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.699608] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.699608] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.699608] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.702462] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.702462] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.702890] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='8',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_task_None='2',num_task_networking='0',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 651.703153] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 651.703310] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 651.703464] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398', 'dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 651.703623] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 651.703940] nova-scheduler[51596]: DEBUG nova.filters [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 651.704167] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 68.569512 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 651.704325] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 651.704474] nova-scheduler[51596]: INFO nova.filters [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Filter ComputeFilter returned 0 hosts [ 651.704619] nova-scheduler[51596]: DEBUG nova.filters [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Filtering removed all hosts for the request with instance ID 'ede2bc3e-4e4a-43b4-a31c-8d3ff6ccaf0e'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 651.704752] nova-scheduler[51596]: INFO nova.filters [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Filtering removed all hosts for the request with instance ID 'ede2bc3e-4e4a-43b4-a31c-8d3ff6ccaf0e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 651.704945] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 651.705073] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ed784811-79b8-42e8-8ab4-931ac781db0d tempest-ServersAaction247Test-742979346 tempest-ServersAaction247Test-742979346-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 654.007878] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Starting to schedule for instances: ['287c0977-e6ad-4704-9f5c-a4fd321c10b0'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 654.009320] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 654.009320] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.009320] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.009320] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.009451] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 654.061777] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.065036] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.065036] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.073387] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.073603] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.073763] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.076243] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.076699] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.077599] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='8',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_task_None='2',num_task_networking='0',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 654.077965] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 654.078604] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 654.078814] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398', 'dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 654.079057] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.079378] nova-scheduler[51602]: DEBUG nova.filters [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 654.079629] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 70.944982 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 654.079823] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 654.081064] nova-scheduler[51602]: INFO nova.filters [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Filter ComputeFilter returned 0 hosts [ 654.081064] nova-scheduler[51602]: DEBUG nova.filters [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Filtering removed all hosts for the request with instance ID '287c0977-e6ad-4704-9f5c-a4fd321c10b0'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 654.081064] nova-scheduler[51602]: INFO nova.filters [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Filtering removed all hosts for the request with instance ID '287c0977-e6ad-4704-9f5c-a4fd321c10b0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 654.081064] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 654.081064] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66dd64f9-d3a9-468d-b250-58dc7cb11e8e tempest-VolumesAssistedSnapshotsTest-1414147223 tempest-VolumesAssistedSnapshotsTest-1414147223-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 654.614097] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Starting to schedule for instances: ['639a41f1-ec0b-45e7-bf19-5949594ac4c5'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 654.614409] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 654.614565] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.614739] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.614944] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.616314] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 654.690888] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.691295] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.691476] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.706292] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.706504] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.706667] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.711451] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.711674] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.712133] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='8',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='1',num_task_None='2',num_task_networking='0',num_task_spawning='0',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:43:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 654.712460] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 654.712632] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 654.713411] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398', 'dd588677-08d1-43d8-bff3-62b655a5a194'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 654.714133] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.714417] nova-scheduler[51596]: DEBUG nova.filters [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 654.714671] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 71.580005 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 654.714856] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 654.715027] nova-scheduler[51596]: INFO nova.filters [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Filter ComputeFilter returned 0 hosts [ 654.715177] nova-scheduler[51596]: DEBUG nova.filters [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Filtering removed all hosts for the request with instance ID '639a41f1-ec0b-45e7-bf19-5949594ac4c5'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 654.715313] nova-scheduler[51596]: INFO nova.filters [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Filtering removed all hosts for the request with instance ID '639a41f1-ec0b-45e7-bf19-5949594ac4c5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 654.715458] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 654.715600] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ff5fa752-c5e5-47ad-88a5-7f8888d27e75 tempest-ServerDiagnosticsV248Test-206544477 tempest-ServerDiagnosticsV248Test-206544477-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 657.748298] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Starting to schedule for instances: ['de629542-18cb-4cbd-8360-8a6d933c50fa'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 657.748578] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 657.748745] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.748923] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.751316] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 657.751584] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 657.797139] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.797380] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.797606] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.806406] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.806657] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.806797] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.808978] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 657.809206] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 657.810105] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='8',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='1',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='1',num_task_networking='0',num_task_spawning='0',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:07Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 657.810572] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 657.810745] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 657.811088] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Update host state with instances: ['10fc8044-6912-412f-9b84-50efb0e9a398'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 657.811330] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 657.811614] nova-scheduler[51602]: DEBUG nova.filters [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 657.811831] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 74.677192 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 657.812078] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 657.812463] nova-scheduler[51602]: INFO nova.filters [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Filter ComputeFilter returned 0 hosts [ 657.812634] nova-scheduler[51602]: DEBUG nova.filters [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Filtering removed all hosts for the request with instance ID 'de629542-18cb-4cbd-8360-8a6d933c50fa'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 657.812774] nova-scheduler[51602]: INFO nova.filters [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Filtering removed all hosts for the request with instance ID 'de629542-18cb-4cbd-8360-8a6d933c50fa'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 657.813120] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 657.813120] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1cd2028c-12ad-4bcf-b17d-9844b8fefb93 tempest-ServersWithSpecificFlavorTestJSON-580366979 tempest-ServersWithSpecificFlavorTestJSON-580366979-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.610160] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting to schedule for instances: ['b09fba68-8f40-473c-a1b8-d58e494e79b6'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.610363] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.610624] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.610734] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.610938] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.611166] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.657122] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.657404] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.657563] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.670367] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.670589] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.670759] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.676180] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.679331] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.679331] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.679850] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.679850] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.680258] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.682248] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.682248] nova-scheduler[51596]: DEBUG nova.filters [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.682248] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 77.546327 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.682248] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 660.682248] nova-scheduler[51596]: INFO nova.filters [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ComputeFilter returned 0 hosts [ 660.682579] nova-scheduler[51596]: DEBUG nova.filters [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtering removed all hosts for the request with instance ID 'b09fba68-8f40-473c-a1b8-d58e494e79b6'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.682579] nova-scheduler[51596]: INFO nova.filters [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtering removed all hosts for the request with instance ID 'b09fba68-8f40-473c-a1b8-d58e494e79b6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.682579] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.682579] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-87e5cdff-76b6-4045-9c9b-a5b164abff38 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 664.347037] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Starting to schedule for instances: ['d8986ce9-b41e-47c0-8dd8-7643a97f7fd1'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.347898] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.347898] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.347898] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.347898] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.349169] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 664.403793] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.404041] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.406016] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.411878] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.412099] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.412265] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.416292] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.416292] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.416485] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 664.416485] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 664.416684] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 664.417038] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 664.417038] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.417247] nova-scheduler[51602]: DEBUG nova.filters [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.417447] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 81.282803 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 664.417601] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 664.417769] nova-scheduler[51602]: INFO nova.filters [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Filter ComputeFilter returned 0 hosts [ 664.420850] nova-scheduler[51602]: DEBUG nova.filters [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Filtering removed all hosts for the request with instance ID 'd8986ce9-b41e-47c0-8dd8-7643a97f7fd1'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 664.420850] nova-scheduler[51602]: INFO nova.filters [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Filtering removed all hosts for the request with instance ID 'd8986ce9-b41e-47c0-8dd8-7643a97f7fd1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 664.420850] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.420850] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf55f77b-3a11-4db5-a587-c9eed79374fc tempest-AttachInterfacesUnderV243Test-1875895513 tempest-AttachInterfacesUnderV243Test-1875895513-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 664.523354] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Starting to schedule for instances: ['68ea9b7a-7fda-49ab-b8d3-ac42feb181aa'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 664.523716] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 664.523904] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.524079] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.524266] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 664.524440] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 664.584827] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.584827] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.585987] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.598769] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.598855] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.598983] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.604149] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 664.604149] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 664.604315] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 664.604315] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 664.604424] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 664.604424] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 664.604424] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 664.604965] nova-scheduler[51596]: DEBUG nova.filters [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 664.604965] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 81.470243 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 664.605662] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 664.605662] nova-scheduler[51596]: INFO nova.filters [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Filter ComputeFilter returned 0 hosts [ 664.605662] nova-scheduler[51596]: DEBUG nova.filters [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Filtering removed all hosts for the request with instance ID '68ea9b7a-7fda-49ab-b8d3-ac42feb181aa'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 664.605662] nova-scheduler[51596]: INFO nova.filters [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Filtering removed all hosts for the request with instance ID '68ea9b7a-7fda-49ab-b8d3-ac42feb181aa'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 664.605850] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 664.605930] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-ea878fc6-1b68-45dd-9cf9-86e0eeb13b08 tempest-ServersAdmin275Test-1034469438 tempest-ServersAdmin275Test-1034469438-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 676.852698] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Starting to schedule for instances: ['077e7b18-cc79-46e5-9347-ec5847df3220', '103d252a-4723-4f02-9c8b-77d48284705c', '711970b0-1099-4e30-90a6-1df1b5450713'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 676.852995] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 676.853183] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.853515] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.853619] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.853821] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 676.904012] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.904012] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.904181] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.918013] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.918013] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.918013] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.920036] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.920171] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.921023] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 676.921023] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 676.921379] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 676.921379] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 676.921379] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.921700] nova-scheduler[51602]: DEBUG nova.filters [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 676.921775] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 93.787129 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 676.921929] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 676.922090] nova-scheduler[51602]: INFO nova.filters [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Filter ComputeFilter returned 0 hosts [ 676.922243] nova-scheduler[51602]: DEBUG nova.filters [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Filtering removed all hosts for the request with instance ID '077e7b18-cc79-46e5-9347-ec5847df3220'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 676.922382] nova-scheduler[51602]: INFO nova.filters [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Filtering removed all hosts for the request with instance ID '077e7b18-cc79-46e5-9347-ec5847df3220'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 676.922531] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 676.922677] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ddd2e828-7280-4440-8cc5-1ec91cd7944e tempest-ListServersNegativeTestJSON-1833845881 tempest-ListServersNegativeTestJSON-1833845881-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 677.485523] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Starting to schedule for instances: ['d9d81e57-4969-4fbf-b49e-7d0fe447e91b'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 677.487210] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 677.487210] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.489583] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.489703] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.489937] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 677.542800] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.542800] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.542800] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.554491] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.554491] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.554491] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.556442] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.556639] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.557018] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 677.560130] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 677.560130] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 677.560130] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 677.560432] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.560432] nova-scheduler[51596]: DEBUG nova.filters [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 677.560432] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 94.425648 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 677.560432] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 677.560589] nova-scheduler[51596]: INFO nova.filters [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Filter ComputeFilter returned 0 hosts [ 677.560712] nova-scheduler[51596]: DEBUG nova.filters [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Filtering removed all hosts for the request with instance ID 'd9d81e57-4969-4fbf-b49e-7d0fe447e91b'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 677.560982] nova-scheduler[51596]: INFO nova.filters [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Filtering removed all hosts for the request with instance ID 'd9d81e57-4969-4fbf-b49e-7d0fe447e91b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 677.561167] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 677.561310] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-891c5445-b7eb-4a94-8e0d-c677614054cc tempest-FloatingIPsAssociationNegativeTestJSON-1669177020 tempest-FloatingIPsAssociationNegativeTestJSON-1669177020-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 678.747460] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Starting to schedule for instances: ['8b238463-aa3f-4ded-aac8-f0f64a142be9'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 678.747460] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 678.751477] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.751477] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.751477] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 678.751477] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 678.815838] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.815838] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.815947] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.826754] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.826754] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.826963] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.828972] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 678.829197] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 678.829577] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 678.830697] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 678.831475] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 678.831475] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 678.832296] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 678.834597] nova-scheduler[51602]: DEBUG nova.filters [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 678.834597] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 95.698212 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 678.834597] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 678.834597] nova-scheduler[51602]: INFO nova.filters [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Filter ComputeFilter returned 0 hosts [ 678.834597] nova-scheduler[51602]: DEBUG nova.filters [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Filtering removed all hosts for the request with instance ID '8b238463-aa3f-4ded-aac8-f0f64a142be9'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 678.834832] nova-scheduler[51602]: INFO nova.filters [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Filtering removed all hosts for the request with instance ID '8b238463-aa3f-4ded-aac8-f0f64a142be9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 678.834832] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 678.834832] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-3831ef87-c4b3-4d6c-9622-6916b6b2bb67 tempest-InstanceActionsTestJSON-50949956 tempest-InstanceActionsTestJSON-50949956-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 679.902350] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Starting to schedule for instances: ['65c88d52-d555-4b66-b11a-b59e44380632'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 679.903288] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 679.903634] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.905954] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.906142] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 679.906338] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 679.954094] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.954341] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.954509] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.962679] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.962679] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.962845] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.965515] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 679.965749] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 679.966308] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 679.966611] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 679.966785] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 679.966942] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 679.967124] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 679.967378] nova-scheduler[51596]: DEBUG nova.filters [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 679.967587] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 96.832952 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 679.967853] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 679.967934] nova-scheduler[51596]: INFO nova.filters [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Filter ComputeFilter returned 0 hosts [ 679.968050] nova-scheduler[51596]: DEBUG nova.filters [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Filtering removed all hosts for the request with instance ID '65c88d52-d555-4b66-b11a-b59e44380632'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 679.968193] nova-scheduler[51596]: INFO nova.filters [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Filtering removed all hosts for the request with instance ID '65c88d52-d555-4b66-b11a-b59e44380632'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 679.968338] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 679.968490] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6ebd77c2-5c23-4f3e-801a-62623ded21d9 tempest-ServerTagsTestJSON-94776460 tempest-ServerTagsTestJSON-94776460-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 681.523165] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Starting to schedule for instances: ['93c7d003-8b18-45b6-97db-fea68c5f6fab'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 681.523462] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 681.523623] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.523803] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.524480] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.524480] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 681.572471] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.572471] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.572471] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.581836] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.581836] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.581836] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.582910] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.583118] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.583473] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 681.583746] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 681.584052] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 681.584156] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 681.584233] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.584490] nova-scheduler[51602]: DEBUG nova.filters [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 681.584945] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 98.45006 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 681.584945] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 681.585181] nova-scheduler[51602]: INFO nova.filters [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filter ComputeFilter returned 0 hosts [ 681.585181] nova-scheduler[51602]: DEBUG nova.filters [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtering removed all hosts for the request with instance ID '93c7d003-8b18-45b6-97db-fea68c5f6fab'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 681.585637] nova-scheduler[51602]: INFO nova.filters [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtering removed all hosts for the request with instance ID '93c7d003-8b18-45b6-97db-fea68c5f6fab'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 681.585837] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 681.585992] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-1f14ae9a-f612-4e14-8226-b51c91f10dc2 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 683.063793] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Starting to schedule for instances: ['6b473921-600d-4d9b-95d2-f7552026dd0b'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 683.064117] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 683.064293] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.064477] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.064670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.064850] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 683.124966] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.125316] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.125577] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.136463] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.136729] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.136835] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.144141] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.144141] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.144493] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 683.144819] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 683.144993] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 683.145160] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 683.145326] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.146862] nova-scheduler[51596]: DEBUG nova.filters [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 683.147469] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 100.012483 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 683.147698] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 683.148653] nova-scheduler[51596]: INFO nova.filters [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Filter ComputeFilter returned 0 hosts [ 683.148860] nova-scheduler[51596]: DEBUG nova.filters [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Filtering removed all hosts for the request with instance ID '6b473921-600d-4d9b-95d2-f7552026dd0b'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 683.149059] nova-scheduler[51596]: INFO nova.filters [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Filtering removed all hosts for the request with instance ID '6b473921-600d-4d9b-95d2-f7552026dd0b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 683.150127] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 683.150773] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2c819f17-b05a-4752-8a36-6bd4c7efeceb tempest-ImagesOneServerNegativeTestJSON-728750141 tempest-ImagesOneServerNegativeTestJSON-728750141-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 684.455266] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Starting to schedule for instances: ['0e7d3589-5c00-43b0-b3af-920958d1d6c1'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 684.455266] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 684.459024] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.459024] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.459024] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.459024] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 684.513367] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.513622] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.513813] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.522568] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.523079] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.523324] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.525434] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.525644] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.526024] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 684.526979] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 684.526979] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 684.526979] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 684.527161] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.527161] nova-scheduler[51602]: DEBUG nova.filters [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 684.527308] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 101.39263 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 684.527430] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 684.527564] nova-scheduler[51602]: INFO nova.filters [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Filter ComputeFilter returned 0 hosts [ 684.527715] nova-scheduler[51602]: DEBUG nova.filters [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Filtering removed all hosts for the request with instance ID '0e7d3589-5c00-43b0-b3af-920958d1d6c1'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 684.527854] nova-scheduler[51602]: INFO nova.filters [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Filtering removed all hosts for the request with instance ID '0e7d3589-5c00-43b0-b3af-920958d1d6c1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 684.527997] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 684.528176] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f7bee0b7-3179-433d-8ad1-fa7369dca9b3 tempest-ServerRescueTestJSON-2068892925 tempest-ServerRescueTestJSON-2068892925-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 685.189264] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting to schedule for instances: ['cb48da9d-6aa9-43ba-96ae-6328f505b007'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 685.189655] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 685.189730] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.191085] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.191085] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 685.191085] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 685.243064] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.243827] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.243827] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.254446] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.254754] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.255063] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.258127] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 685.258127] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 685.258441] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 685.259166] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 685.259166] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 685.259166] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 685.259344] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 685.259396] nova-scheduler[51596]: DEBUG nova.filters [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 685.259600] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 102.124969 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 685.259758] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 685.259907] nova-scheduler[51596]: INFO nova.filters [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ComputeFilter returned 0 hosts [ 685.260061] nova-scheduler[51596]: DEBUG nova.filters [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtering removed all hosts for the request with instance ID 'cb48da9d-6aa9-43ba-96ae-6328f505b007'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 685.260444] nova-scheduler[51596]: INFO nova.filters [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtering removed all hosts for the request with instance ID 'cb48da9d-6aa9-43ba-96ae-6328f505b007'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 685.260444] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 685.260521] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0fdc151b-26fd-4a6a-8689-ca475e4c36ea tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 686.438088] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting to schedule for instances: ['1afef74c-34fd-4193-8533-9c2194f15b48'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 686.438088] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 686.440589] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 686.441375] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 686.441375] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 686.441489] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 686.504745] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 686.505406] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 686.506169] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 686.515818] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 686.515818] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 686.516356] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 686.518965] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 686.519370] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 686.522102] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 686.522102] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 686.522221] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 686.522221] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 686.522221] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 686.522442] nova-scheduler[51602]: DEBUG nova.filters [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 686.522442] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 103.386704 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 686.522442] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 686.522442] nova-scheduler[51602]: INFO nova.filters [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ComputeFilter returned 0 hosts [ 686.522442] nova-scheduler[51602]: DEBUG nova.filters [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filtering removed all hosts for the request with instance ID '1afef74c-34fd-4193-8533-9c2194f15b48'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 686.523035] nova-scheduler[51602]: INFO nova.filters [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filtering removed all hosts for the request with instance ID '1afef74c-34fd-4193-8533-9c2194f15b48'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 686.523446] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 686.523759] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-b3f89d5c-8a22-454f-aa67-becbd5414abf tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 687.984014] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Starting to schedule for instances: ['a55dc971-c3d8-4c44-856b-71b14cc66b82'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 687.984584] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 687.984817] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.985051] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.985287] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 687.985506] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.032331] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.032627] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.032862] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.040290] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.040566] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.041640] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.045050] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.045050] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.045409] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.045409] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.045596] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.045596] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.045596] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.045749] nova-scheduler[51596]: DEBUG nova.filters [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.045749] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 104.910372 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 688.045749] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 688.045871] nova-scheduler[51596]: INFO nova.filters [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filter ComputeFilter returned 0 hosts [ 688.046064] nova-scheduler[51596]: DEBUG nova.filters [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtering removed all hosts for the request with instance ID 'a55dc971-c3d8-4c44-856b-71b14cc66b82'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 688.046235] nova-scheduler[51596]: INFO nova.filters [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtering removed all hosts for the request with instance ID 'a55dc971-c3d8-4c44-856b-71b14cc66b82'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 688.046410] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.046615] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-f1574f70-906f-411c-b98c-916efcc1adb6 tempest-ServersAdminTestJSON-675913171 tempest-ServersAdminTestJSON-675913171-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 688.643417] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Starting to schedule for instances: ['c4362ac3-43c8-483b-8cf7-890fe3360eda'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 688.643792] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 688.643989] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.644321] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.644563] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.645285] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.695165] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.695680] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.695883] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.707288] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.707494] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.707656] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.711498] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.711697] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.712109] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.712411] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.712580] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.712732] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.712903] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.713200] nova-scheduler[51602]: DEBUG nova.filters [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.713838] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 105.579137 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 688.714029] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 688.714203] nova-scheduler[51602]: INFO nova.filters [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filter ComputeFilter returned 0 hosts [ 688.714350] nova-scheduler[51602]: DEBUG nova.filters [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filtering removed all hosts for the request with instance ID 'c4362ac3-43c8-483b-8cf7-890fe3360eda'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 688.714484] nova-scheduler[51602]: INFO nova.filters [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filtering removed all hosts for the request with instance ID 'c4362ac3-43c8-483b-8cf7-890fe3360eda'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 688.714631] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.714772] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-cf187ccc-88bb-4806-9fe0-8cc57e908c6c tempest-ServersTestMultiNic-532910345 tempest-ServersTestMultiNic-532910345-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 692.005464] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Starting to schedule for instances: ['289c148e-386a-4104-a536-05d7e552d319'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 692.007735] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 692.007973] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.008191] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.008404] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.008613] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 692.051948] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.052299] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.052487] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.062570] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.062797] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.063171] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.069573] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.070309] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.070722] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 692.074522] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 692.074522] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 692.074522] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 692.074779] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.074779] nova-scheduler[51596]: DEBUG nova.filters [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 692.074779] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 108.938398 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 692.074779] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 692.074779] nova-scheduler[51596]: INFO nova.filters [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ComputeFilter returned 0 hosts [ 692.075055] nova-scheduler[51596]: DEBUG nova.filters [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filtering removed all hosts for the request with instance ID '289c148e-386a-4104-a536-05d7e552d319'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 692.075055] nova-scheduler[51596]: INFO nova.filters [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filtering removed all hosts for the request with instance ID '289c148e-386a-4104-a536-05d7e552d319'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 692.075055] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 692.075055] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-13e1c047-3504-4a17-83a8-07d922d63437 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 692.441521] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Starting to schedule for instances: ['d6cfab8e-8d89-40dd-90c8-ec837c4ad5be'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 692.441817] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 692.442077] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.442229] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.442487] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.442611] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 692.502218] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.502218] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.502218] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.511326] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.511419] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.511582] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.513646] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.513847] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.514239] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 692.514915] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 692.515104] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 692.515264] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 692.515430] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.515695] nova-scheduler[51602]: DEBUG nova.filters [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 692.516329] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 109.38127 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 692.516329] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 692.516329] nova-scheduler[51602]: INFO nova.filters [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Filter ComputeFilter returned 0 hosts [ 692.516480] nova-scheduler[51602]: DEBUG nova.filters [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Filtering removed all hosts for the request with instance ID 'd6cfab8e-8d89-40dd-90c8-ec837c4ad5be'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 692.516480] nova-scheduler[51602]: INFO nova.filters [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Filtering removed all hosts for the request with instance ID 'd6cfab8e-8d89-40dd-90c8-ec837c4ad5be'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 692.516622] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 692.518308] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ffc5fdd7-04d1-4627-92b5-fb76d599dd09 tempest-ImagesOneServerTestJSON-2065743937 tempest-ImagesOneServerTestJSON-2065743937-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 694.416272] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.416272] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.416272] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.416272] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.416272] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.419538] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.420652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.420652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.420652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.420652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.428098] nova-scheduler[51596]: INFO nova.scheduler.host_manager [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 694.428303] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.013s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.429955] nova-scheduler[51602]: INFO nova.scheduler.host_manager [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 694.429955] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5a52e4d1-dbd3-4cda-8c1c-b7e4650d5733 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.010s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.625674] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Starting to schedule for instances: ['c2a06ce5-763d-4d34-88fd-2b2e9d4b067f'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 695.625916] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 695.626123] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.626425] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.626556] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.626739] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 695.674128] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.674312] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.674479] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.681164] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.681380] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.681846] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.683500] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.683702] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.684065] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='9',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_8b11b617cfb243bca8848f333b96f265='0',num_proj_8c9fe156687d4221b76f0e662bd590a7='0',num_proj_c58ea55e246943a083fa2eb0e98cb0c1='0',num_proj_dad9bedbe759426d9c98810f2789dbfd='0',num_proj_e35d0d53e9be49c4812e6268e521dfaf='0',num_task_None='0',num_task_networking='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:11Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 695.684362] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 695.684697] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 695.684697] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 695.684839] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.685104] nova-scheduler[51596]: DEBUG nova.filters [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 695.685348] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 112.550673 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 695.685957] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 695.685957] nova-scheduler[51596]: INFO nova.filters [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ComputeFilter returned 0 hosts [ 695.685957] nova-scheduler[51596]: DEBUG nova.filters [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filtering removed all hosts for the request with instance ID 'c2a06ce5-763d-4d34-88fd-2b2e9d4b067f'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 695.685957] nova-scheduler[51596]: INFO nova.filters [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filtering removed all hosts for the request with instance ID 'c2a06ce5-763d-4d34-88fd-2b2e9d4b067f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 695.686109] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 695.686189] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-023f987b-6bd1-44df-8a67-d93010099df1 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 698.220916] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['a0cadc05-539b-4f36-9b19-8aec4c5f92b6'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 698.221410] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 698.224329] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.224329] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.224329] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 698.224329] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 698.276231] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.276231] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.276231] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.285613] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.285854] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.286053] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.288794] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 698.288894] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 698.289232] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 698.289667] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 698.289762] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 698.289907] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 698.290136] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 698.290592] nova-scheduler[51602]: DEBUG nova.filters [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 698.290846] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 115.156174 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 698.291039] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 698.291221] nova-scheduler[51602]: INFO nova.filters [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 0 hosts [ 698.291390] nova-scheduler[51602]: DEBUG nova.filters [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID 'a0cadc05-539b-4f36-9b19-8aec4c5f92b6'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 698.291532] nova-scheduler[51602]: INFO nova.filters [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID 'a0cadc05-539b-4f36-9b19-8aec4c5f92b6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 698.291836] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 698.291836] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-804c0b3c-db16-4079-b8e0-fa0f9b1ff7ec tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 700.183364] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Starting to schedule for instances: ['081de977-9854-4e53-b7e3-425cedbe2f75'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.183673] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.185280] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.187548] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.187548] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.187548] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 700.251903] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.251903] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.252079] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.259813] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.260037] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.260111] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.262338] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.262540] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.262902] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 700.263204] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 700.263900] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 700.263900] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 700.263900] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.264084] nova-scheduler[51596]: DEBUG nova.filters [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 700.264256] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 117.129595 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 700.264431] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 700.264591] nova-scheduler[51596]: INFO nova.filters [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ComputeFilter returned 0 hosts [ 700.264792] nova-scheduler[51596]: DEBUG nova.filters [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filtering removed all hosts for the request with instance ID '081de977-9854-4e53-b7e3-425cedbe2f75'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 700.264864] nova-scheduler[51596]: INFO nova.filters [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filtering removed all hosts for the request with instance ID '081de977-9854-4e53-b7e3-425cedbe2f75'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 700.265016] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 700.265166] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-7f5f8d90-28ec-49fb-82ea-a7851964f3bc tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 700.737888] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Starting to schedule for instances: ['79046690-e296-49cf-86f7-aefb1b9d23ff'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.738499] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.739107] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.739826] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.739826] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.739826] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 700.788622] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.788851] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.789033] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.798119] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.798348] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.798506] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.802708] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.802908] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.803552] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 700.803731] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 700.803785] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 700.803952] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 700.804229] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.804439] nova-scheduler[51602]: DEBUG nova.filters [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 700.804630] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 117.669986 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 700.804986] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 700.805380] nova-scheduler[51602]: INFO nova.filters [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Filter ComputeFilter returned 0 hosts [ 700.805380] nova-scheduler[51602]: DEBUG nova.filters [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Filtering removed all hosts for the request with instance ID '79046690-e296-49cf-86f7-aefb1b9d23ff'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 700.805464] nova-scheduler[51602]: INFO nova.filters [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Filtering removed all hosts for the request with instance ID '79046690-e296-49cf-86f7-aefb1b9d23ff'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 700.805613] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 700.805872] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72a57f64-bdf8-4b8c-b4d5-eb5aaf5b2c99 tempest-ServersNegativeTestMultiTenantJSON-1661334709 tempest-ServersNegativeTestMultiTenantJSON-1661334709-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 703.123698] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Starting to schedule for instances: ['c86a0f45-516c-47c3-a012-f56839e05e91'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 703.124217] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 703.124217] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 703.124356] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 703.124565] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 703.126759] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 703.186202] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.186202] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.186352] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.193450] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.194688] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.194688] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.196025] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 703.196562] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 703.196562] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 703.196894] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 703.197086] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 42, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 703.197240] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 703.197399] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 703.197655] nova-scheduler[51596]: DEBUG nova.filters [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 703.198031] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:42:56. Elapsed time is 120.063228 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 703.198031] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 703.198179] nova-scheduler[51596]: INFO nova.filters [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Filter ComputeFilter returned 0 hosts [ 703.198322] nova-scheduler[51596]: DEBUG nova.filters [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Filtering removed all hosts for the request with instance ID 'c86a0f45-516c-47c3-a012-f56839e05e91'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 703.198456] nova-scheduler[51596]: INFO nova.filters [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Filtering removed all hosts for the request with instance ID 'c86a0f45-516c-47c3-a012-f56839e05e91'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 703.198833] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 703.198833] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a65b451a-838b-47d9-8b0b-15bd68adfefe tempest-ServerActionsTestOtherB-1433247059 tempest-ServerActionsTestOtherB-1433247059-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 710.182775] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Starting to schedule for instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 710.183118] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 710.183283] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.183461] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.183755] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 710.183849] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 710.250711] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.250711] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.250711] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.255145] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.255286] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.255421] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.257872] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.258113] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.258473] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:44:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=0) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 710.258796] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 710.261801] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 710.261801] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 710.261801] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 710.261954] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 710.261954] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.261954] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.261954] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.261954] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.262093] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.262093] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.262093] nova-scheduler[51602]: DEBUG nova.filters [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 710.262093] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 710.262093] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 710.262271] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Attempting to claim resources in the placement API for instance ea968312-62ea-4f55-87e9-f91823fc14c2 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 710.332864] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] [instance: ea968312-62ea-4f55-87e9-f91823fc14c2] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 710.332864] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 710.332864] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 710.332864] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20524171-0491-451c-acd6-bf4548e093fb tempest-ServerShowV257Test-1565272682 tempest-ServerShowV257Test-1565272682-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.507148] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Starting to schedule for instances: ['9759f284-26e2-466e-9504-ffb63a359f27'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 711.508248] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 711.508550] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.508725] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.508985] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.509239] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 711.566837] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.567111] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.567282] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.576674] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.576892] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.577069] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.580192] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.580192] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.580397] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='10',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 711.580522] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 711.580687] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 711.580838] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 711.580997] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.581261] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 711.581459] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.581648] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.581841] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.582013] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.582567] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.582772] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.582942] nova-scheduler[51596]: DEBUG nova.filters [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.583115] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 711.583283] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 711.583454] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Attempting to claim resources in the placement API for instance 9759f284-26e2-466e-9504-ffb63a359f27 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 711.673337] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] [instance: 9759f284-26e2-466e-9504-ffb63a359f27] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 711.674953] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.676397] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.676815] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-04894b72-62f4-42ce-bcd9-93286e30827e tempest-ServersAdminNegativeTestJSON-370113334 tempest-ServersAdminNegativeTestJSON-370113334-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.142741] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Starting to schedule for instances: ['fdd34513-15af-4294-8a8a-e3b095188eda'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 712.142741] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 712.142741] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.142741] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.142741] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 712.143233] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 712.202066] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.202066] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.202066] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.209108] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.209332] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.209494] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.211668] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.211882] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.213630] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='10',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:05Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 712.213630] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 712.213723] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 712.213723] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 712.213802] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 712.214262] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 712.214262] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.214458] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.214676] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.214853] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.215034] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.215207] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.215393] nova-scheduler[51602]: DEBUG nova.filters [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 712.215553] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 712.215726] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 712.215903] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Attempting to claim resources in the placement API for instance fdd34513-15af-4294-8a8a-e3b095188eda {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 712.331693] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] [instance: fdd34513-15af-4294-8a8a-e3b095188eda] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 712.332065] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 712.332197] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 712.332393] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-fb650bf2-8157-43bb-9fcc-30774c4f895c tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.345831] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Starting to schedule for instances: ['62ade33c-5283-432d-872c-cc162254317d'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 713.346409] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 713.346863] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.347298] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.347562] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.347764] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 713.408360] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.408578] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.408746] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.423508] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.423508] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.423508] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.426161] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.426208] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.426788] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='10',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:05Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 713.427115] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 713.427294] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 713.427451] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 713.427617] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.427875] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 713.428385] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.428608] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.428875] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.429248] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.433020] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.433020] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.433020] nova-scheduler[51596]: DEBUG nova.filters [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.433020] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 713.433020] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 713.433280] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Attempting to claim resources in the placement API for instance 62ade33c-5283-432d-872c-cc162254317d {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 713.496750] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] [instance: 62ade33c-5283-432d-872c-cc162254317d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 713.497064] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.497280] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.497715] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8d1248a1-05de-4a70-8c0b-9763d4c8c4e3 tempest-VolumesAdminNegativeTest-116106725 tempest-VolumesAdminNegativeTest-116106725-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.682622] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Starting to schedule for instances: ['ce3bd633-4538-428d-9258-9222c3c72edd'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.683993] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.689030] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.689030] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.689030] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.689030] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.735189] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.735189] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.735189] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.741615] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.741825] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.741999] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.744772] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.744977] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.745355] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='10',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:06Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=4) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.745641] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.745813] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.745968] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda', '62ade33c-5283-432d-872c-cc162254317d'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.746147] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.746401] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.746599] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.746781] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.746974] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.747151] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.747311] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.747473] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.747631] nova-scheduler[51602]: DEBUG nova.filters [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.747785] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.747990] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.748133] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Attempting to claim resources in the placement API for instance ce3bd633-4538-428d-9258-9222c3c72edd {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 714.797517] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] [instance: ce3bd633-4538-428d-9258-9222c3c72edd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.797991] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.798090] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.798826] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a23dfe6a-4389-4ef3-ba9e-9ebf54fba058 tempest-InstanceActionsNegativeTestJSON-307740395 tempest-InstanceActionsNegativeTestJSON-307740395-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 715.992178] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['f7fc4465-02a5-4715-b50b-04172f097350'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 715.992480] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 715.992654] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.992883] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.993108] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 715.993294] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 716.019087] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting to schedule for instances: ['588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 716.019087] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 716.019359] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.019359] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.020057] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.020057] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 716.055876] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.055876] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.055876] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.065437] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.066078] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.067205] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.070069] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.070678] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.071197] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='10',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:08Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 716.072177] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 716.072486] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 716.072844] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda', '62ade33c-5283-432d-872c-cc162254317d', 'ce3bd633-4538-428d-9258-9222c3c72edd'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 716.073282] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077022] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077302] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077302] nova-scheduler[51596]: DEBUG nova.filters [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.077302] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 716.077302] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 716.077431] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.077462] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Attempting to claim resources in the placement API for instance f7fc4465-02a5-4715-b50b-04172f097350 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 716.077489] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.077489] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.083146] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.083348] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.083515] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.085727] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.085929] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.086929] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='10',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:08Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 716.087236] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 716.087447] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 716.087616] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda', '62ade33c-5283-432d-872c-cc162254317d', 'ce3bd633-4538-428d-9258-9222c3c72edd'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 716.087785] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.088088] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 716.088312] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.088505] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.088705] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.088873] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.089158] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.089227] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.089371] nova-scheduler[51602]: DEBUG nova.filters [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.089526] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 716.089697] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 716.090091] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Attempting to claim resources in the placement API for instance 588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 716.136017] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] [instance: f7fc4465-02a5-4715-b50b-04172f097350] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 716.136017] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.136017] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.136017] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bfee6349-6a74-41ed-8ad7-a6e50bc9516d tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.155137] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] [instance: 588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 716.155592] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.155925] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.156283] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-2185c308-83d0-4687-8494-f4cfcd93bb63 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.654138] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Starting to schedule for instances: ['1f7f6276-cfe5-4427-90b6-893e7ad6cffe'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 719.654363] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 719.654363] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.654562] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.654738] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 719.654919] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 719.712537] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.712537] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.712537] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.724640] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.724640] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.724640] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.727193] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.727486] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.728010] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='10',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:09Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 719.728509] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 719.728791] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 719.729694] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda', '62ade33c-5283-432d-872c-cc162254317d', 'ce3bd633-4538-428d-9258-9222c3c72edd', 'f7fc4465-02a5-4715-b50b-04172f097350', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 719.730048] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 719.730430] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 719.731039] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.731347] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.731667] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.732554] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.732554] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.732554] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.732942] nova-scheduler[51596]: DEBUG nova.filters [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 719.732942] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 719.733103] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 719.733191] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Attempting to claim resources in the placement API for instance 1f7f6276-cfe5-4427-90b6-893e7ad6cffe {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 719.796008] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] [instance: 1f7f6276-cfe5-4427-90b6-893e7ad6cffe] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 719.796312] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 719.797232] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 719.797232] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0098a2d1-2506-4fba-9164-111089f7368c tempest-ServersTestBootFromVolume-1432150623 tempest-ServersTestBootFromVolume-1432150623-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 720.970604] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting to schedule for instances: ['ad58bbc3-1ec8-4567-ba07-c8161bcc8380'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 720.970905] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 720.974615] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.974875] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.975125] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.975329] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 721.031473] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.031473] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.031473] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.038279] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.038279] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.038279] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.041303] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.041303] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.041454] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='10',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:13Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=8) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 721.041454] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 721.041572] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 721.042324] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', 'fdd34513-15af-4294-8a8a-e3b095188eda', '62ade33c-5283-432d-872c-cc162254317d', 'ce3bd633-4538-428d-9258-9222c3c72edd', 'f7fc4465-02a5-4715-b50b-04172f097350', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06', '1f7f6276-cfe5-4427-90b6-893e7ad6cffe'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 721.042324] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.042324] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 721.042544] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.042544] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.042726] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.043285] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.046345] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.046345] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.046345] nova-scheduler[51602]: DEBUG nova.filters [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.046345] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 721.046345] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 721.046571] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Attempting to claim resources in the placement API for instance ad58bbc3-1ec8-4567-ba07-c8161bcc8380 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 721.103970] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] [instance: ad58bbc3-1ec8-4567-ba07-c8161bcc8380] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 721.103970] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.103970] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.104177] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5dbb8e33-93eb-4bbc-9d22-46826868e029 tempest-AttachInterfacesTestJSON-113667225 tempest-AttachInterfacesTestJSON-113667225-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.176477] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting to schedule for instances: ['7b7c9dcb-3ddd-419e-a6fa-6b37b01cc998'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 722.176477] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 722.176477] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.176477] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.176849] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 722.176849] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 722.231474] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.231474] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.231474] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.239057] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.239057] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.239362] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.241899] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.242244] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.242743] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='10',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_20659337b9974b26a9f4123181bd14ce='1',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='1',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='1',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:15Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=8) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 722.243219] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 722.243505] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 722.243785] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '9759f284-26e2-466e-9504-ffb63a359f27', '62ade33c-5283-432d-872c-cc162254317d', 'ce3bd633-4538-428d-9258-9222c3c72edd', 'f7fc4465-02a5-4715-b50b-04172f097350', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06', '1f7f6276-cfe5-4427-90b6-893e7ad6cffe', 'ad58bbc3-1ec8-4567-ba07-c8161bcc8380'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 722.244139] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 722.246021] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 722.246021] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246021] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246021] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246021] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246218] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246218] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246218] nova-scheduler[51596]: DEBUG nova.filters [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 722.246218] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 722.246401] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 722.246778] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Attempting to claim resources in the placement API for instance 7b7c9dcb-3ddd-419e-a6fa-6b37b01cc998 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 722.326128] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] [instance: 7b7c9dcb-3ddd-419e-a6fa-6b37b01cc998] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 197632MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 722.326128] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 722.326128] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 722.326343] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-333acd96-25f6-4d5e-b8a6-27bcdb473198 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.518818] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['a411c5e7-5a49-463e-b270-800e35a31188'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 724.519146] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 724.519285] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.521094] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.521094] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.521094] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 724.577908] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.578146] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.578314] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.585714] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.585928] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.586160] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.588652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.588652] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.589020] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='11',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='1',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:16Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 724.589354] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 724.590076] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 724.590076] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'ce3bd633-4538-428d-9258-9222c3c72edd', 'f7fc4465-02a5-4715-b50b-04172f097350', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06', '1f7f6276-cfe5-4427-90b6-893e7ad6cffe', 'ad58bbc3-1ec8-4567-ba07-c8161bcc8380', '7b7c9dcb-3ddd-419e-a6fa-6b37b01cc998'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 724.590430] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.590430] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 724.590430] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.590550] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.590764] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.590934] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.591114] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.591368] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.591428] nova-scheduler[51602]: DEBUG nova.filters [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.591598] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 198656MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 724.591787] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 198656MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 724.591977] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Attempting to claim resources in the placement API for instance a411c5e7-5a49-463e-b270-800e35a31188 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 724.651549] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] [instance: a411c5e7-5a49-463e-b270-800e35a31188] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 198656MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 724.651847] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.652071] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.652280] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-07b21824-c498-423f-91e4-177f5a80294a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.443949] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Starting to schedule for instances: ['1670e7a3-656a-444d-85ed-292956498612'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 728.444734] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 728.444734] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.444734] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.446937] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.447173] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 728.506115] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.506115] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.506115] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.516145] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.516145] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.516145] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.517053] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.517194] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.517611] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='13',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:20Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 728.518218] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 728.518528] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 728.518735] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'f7fc4465-02a5-4715-b50b-04172f097350', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06', 'ad58bbc3-1ec8-4567-ba07-c8161bcc8380', '7b7c9dcb-3ddd-419e-a6fa-6b37b01cc998', 'a411c5e7-5a49-463e-b270-800e35a31188'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 728.518946] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.519252] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 728.519510] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.519720] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.520046] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.520257] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.520468] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.520668] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.520858] nova-scheduler[51596]: DEBUG nova.filters [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.521059] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 728.521264] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 728.521442] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Attempting to claim resources in the placement API for instance 1670e7a3-656a-444d-85ed-292956498612 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 728.590541] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] [instance: 1670e7a3-656a-444d-85ed-292956498612] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 728.590817] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.591030] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.591280] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4eb49f41-f4bb-489a-b035-264871b492e1 tempest-ServerRescueTestJSONUnderV235-580767535 tempest-ServerRescueTestJSONUnderV235-580767535-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.550074] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Starting to schedule for instances: ['ee7de02d-e1c1-4fe7-8df9-e9f82a39ef24'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 730.551841] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 730.552223] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.552534] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.552851] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.553293] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 730.607173] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.607572] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.608101] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.616563] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.618293] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.618502] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.620874] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.621171] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.621573] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='14',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:22Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=6) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 730.621864] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 730.622060] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 730.622239] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '588ad4c7-67fd-4d4f-ae0f-bb1ded40ef06', 'ad58bbc3-1ec8-4567-ba07-c8161bcc8380', 'a411c5e7-5a49-463e-b270-800e35a31188', '1670e7a3-656a-444d-85ed-292956498612'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 730.622448] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.622775] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 730.622988] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.623246] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628339] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628339] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628472] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628644] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628809] nova-scheduler[51602]: DEBUG nova.filters [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 730.628966] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 730.629159] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 730.629339] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Attempting to claim resources in the placement API for instance ee7de02d-e1c1-4fe7-8df9-e9f82a39ef24 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 730.684818] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] [instance: ee7de02d-e1c1-4fe7-8df9-e9f82a39ef24] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 730.685475] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 730.685475] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 730.685640] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-00ef82e1-26e6-453a-86ca-1f086efe3204 tempest-ServerMetadataTestJSON-382877116 tempest-ServerMetadataTestJSON-382877116-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.855069] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Starting to schedule for instances: ['e90ee443-efe0-4f3e-999b-b9376e41fcb5'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 731.855069] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 731.855069] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.855069] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.855069] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 731.855402] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 731.896985] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.897232] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.897394] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.903870] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.904090] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.904290] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.906516] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.906714] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.907083] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='16',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='0',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='1',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:24Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 731.907360] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 731.907530] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 731.907682] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'ad58bbc3-1ec8-4567-ba07-c8161bcc8380', 'a411c5e7-5a49-463e-b270-800e35a31188', '1670e7a3-656a-444d-85ed-292956498612', 'ee7de02d-e1c1-4fe7-8df9-e9f82a39ef24'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 731.907843] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.908098] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.908303] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.908543] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.908813] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.908991] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.909172] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.909337] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.909494] nova-scheduler[51596]: DEBUG nova.filters [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.909647] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.909812] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 731.909985] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Attempting to claim resources in the placement API for instance e90ee443-efe0-4f3e-999b-b9376e41fcb5 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 731.978209] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] [instance: e90ee443-efe0-4f3e-999b-b9376e41fcb5] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 731.978520] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.978724] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.978930] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a507a8ca-f2f0-480c-9b31-211a8ebd4d11 tempest-ServersTestJSON-1603309010 tempest-ServersTestJSON-1603309010-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 736.356017] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Starting to schedule for instances: ['508c2a14-5f5b-4968-843a-1378d1c46e2f'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 736.360014] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 736.360014] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 736.360014] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 736.360014] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 736.360014] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 736.415635] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 736.416019] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 736.416306] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 736.424702] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 736.424904] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 736.425095] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 736.430110] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 736.430110] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 736.430265] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='19',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:28Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 736.430340] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 736.430340] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 736.430340] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'ee7de02d-e1c1-4fe7-8df9-e9f82a39ef24', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 736.430500] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 736.430500] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 736.430500] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.430500] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.430791] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.431016] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.431221] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.431454] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.432208] nova-scheduler[51602]: DEBUG nova.filters [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 736.432208] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 736.432208] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 736.432208] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Attempting to claim resources in the placement API for instance 508c2a14-5f5b-4968-843a-1378d1c46e2f {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 736.508926] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] [instance: 508c2a14-5f5b-4968-843a-1378d1c46e2f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 736.509245] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 736.509921] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 736.509921] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-54d6db5f-fa9c-4c6d-83d6-e41dfdf83fa0 tempest-AttachVolumeTestJSON-1478151191 tempest-AttachVolumeTestJSON-1478151191-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.215554] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['b8404801-b787-4db2-aa13-320f87ca5ac5'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 740.215865] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 740.216037] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.216223] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.216420] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.216598] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 740.261935] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.261935] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.261935] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.268360] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.268570] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.268734] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.270705] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.270899] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.271274] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='21',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:32Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 740.271550] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 740.271730] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 740.271882] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5', '508c2a14-5f5b-4968-843a-1378d1c46e2f'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 740.272088] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.272290] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 740.272492] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.272671] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.272860] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.273033] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.273200] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.273363] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.273545] nova-scheduler[51596]: DEBUG nova.filters [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.273711] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 740.273875] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 740.274054] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Attempting to claim resources in the placement API for instance b8404801-b787-4db2-aa13-320f87ca5ac5 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 740.322975] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Starting to schedule for instances: ['e2620c94-5629-4094-a92f-d83d9efd6205'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 740.323353] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 740.323585] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.323790] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.323998] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.324514] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 740.346182] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] [instance: b8404801-b787-4db2-aa13-320f87ca5ac5] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 740.346182] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.346182] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.346182] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-3b83ff7a-707a-4d4d-9e7a-aa78aae545c9 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.368591] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.368819] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.368991] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.375639] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.375899] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.376042] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.378076] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.378281] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.378648] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='21',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:32Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 740.379016] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 740.379244] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 740.379415] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5', '508c2a14-5f5b-4968-843a-1378d1c46e2f'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 740.379796] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.379905] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 740.380234] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.380234] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.380429] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.380598] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.380771] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.381068] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.381152] nova-scheduler[51602]: DEBUG nova.filters [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.381254] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 740.381422] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 740.381620] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Attempting to claim resources in the placement API for instance e2620c94-5629-4094-a92f-d83d9efd6205 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 740.440455] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] [instance: e2620c94-5629-4094-a92f-d83d9efd6205] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 740.440767] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.440980] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.441203] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-feb153f7-953e-4e96-b1a6-23f5996cad56 tempest-AttachVolumeShelveTestJSON-687008755 tempest-AttachVolumeShelveTestJSON-687008755-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 741.994734] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Starting to schedule for instances: ['b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 741.995604] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 741.995894] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.996177] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.996472] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 741.996714] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.022386] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting to schedule for instances: ['f05a805d-7896-477c-b2ea-437faec88fba'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 742.022386] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 742.022386] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.026790] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.026957] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.027217] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.052663] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.056020] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.056020] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.060218] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.060435] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.060599] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.062833] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.063759] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.063836] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='22',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_18959b240e3b49d6a94dc7aa1e92487c='1',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:33Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.063916] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.063916] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.064202] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5', '508c2a14-5f5b-4968-843a-1378d1c46e2f', 'b8404801-b787-4db2-aa13-320f87ca5ac5', 'e2620c94-5629-4094-a92f-d83d9efd6205'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.064202] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.064539] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.064677] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.064888] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065105] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065274] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065435] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065895] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065895] nova-scheduler[51596]: DEBUG nova.filters [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.065895] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.066093] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 742.066418] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Attempting to claim resources in the placement API for instance b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 742.099767] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.099961] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.100150] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.112743] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.112967] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.113147] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.117751] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.118093] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.120062] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='22',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_18959b240e3b49d6a94dc7aa1e92487c='1',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:33Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.120602] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.120786] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.120945] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5', '508c2a14-5f5b-4968-843a-1378d1c46e2f', 'b8404801-b787-4db2-aa13-320f87ca5ac5', 'e2620c94-5629-4094-a92f-d83d9efd6205'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.121301] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.121403] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.122255] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.127068] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.127389] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.127581] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.127763] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.127933] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.128214] nova-scheduler[51602]: DEBUG nova.filters [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.128534] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.128598] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 742.130968] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Attempting to claim resources in the placement API for instance f05a805d-7896-477c-b2ea-437faec88fba {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 742.150566] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] [instance: b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 742.150566] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.150873] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.151009] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6e21e153-a5d9-418f-91b1-946ea426e46d tempest-FloatingIPsAssociationTestJSON-246739974 tempest-FloatingIPsAssociationTestJSON-246739974-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.201570] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] [instance: f05a805d-7896-477c-b2ea-437faec88fba] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 742.201570] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.201570] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.201570] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-20a0ea14-6eb7-4fc0-84ed-491fc82e1ed9 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.394331] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Starting to schedule for instances: ['78ed17da-e8e8-4872-b1bf-95c4e77de8e6'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 742.394559] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 742.395782] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.396115] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.396269] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 742.400886] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 742.455747] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.455747] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.455747] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.463789] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.464216] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.464311] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.467150] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.467542] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.468316] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='22',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_18959b240e3b49d6a94dc7aa1e92487c='1',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:33Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 742.468766] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 742.468846] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 742.469757] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'e90ee443-efe0-4f3e-999b-b9376e41fcb5', '508c2a14-5f5b-4968-843a-1378d1c46e2f', 'b8404801-b787-4db2-aa13-320f87ca5ac5', 'e2620c94-5629-4094-a92f-d83d9efd6205', 'b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 742.469757] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 742.469757] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 742.469757] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.469955] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.469987] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470148] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470307] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470465] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.470630] nova-scheduler[51596]: DEBUG nova.filters [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 742.471612] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 742.471612] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 742.471612] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Attempting to claim resources in the placement API for instance 78ed17da-e8e8-4872-b1bf-95c4e77de8e6 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 742.551885] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] [instance: 78ed17da-e8e8-4872-b1bf-95c4e77de8e6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 742.551885] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 742.552060] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 742.552216] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-8b302e70-ca17-499e-9ee1-9a7ccf961b0c tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.446544] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['abec9f87-4cde-4b5e-ad2a-fa682842ac7a'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 746.447488] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 746.447610] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.447868] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.448285] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 746.448389] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 746.507634] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.508126] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.508126] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.516827] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.517813] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.518081] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.522853] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.523155] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.524387] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='22',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_18959b240e3b49d6a94dc7aa1e92487c='1',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:36Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 746.524798] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 746.525465] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 746.526276] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '508c2a14-5f5b-4968-843a-1378d1c46e2f', 'b8404801-b787-4db2-aa13-320f87ca5ac5', 'e2620c94-5629-4094-a92f-d83d9efd6205', 'b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30', 'f05a805d-7896-477c-b2ea-437faec88fba', '78ed17da-e8e8-4872-b1bf-95c4e77de8e6'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 746.526276] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.526276] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 746.526436] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.526475] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.526673] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.526847] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.527017] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.527790] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.528080] nova-scheduler[51602]: DEBUG nova.filters [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 746.528731] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 746.528731] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 746.528731] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Attempting to claim resources in the placement API for instance abec9f87-4cde-4b5e-ad2a-fa682842ac7a {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 746.586272] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] [instance: abec9f87-4cde-4b5e-ad2a-fa682842ac7a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 746.586272] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.586272] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.586499] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-77dcc848-a5f0-4c0e-92f4-b129eec2903d tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 747.489990] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Starting to schedule for instances: ['a75a3491-94b0-4754-8e42-7bf49194a022'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 747.490324] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 747.490552] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 747.490670] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 747.493457] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 747.493457] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 747.552071] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 747.552299] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 747.552458] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 747.559672] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 747.559883] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 747.560062] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 747.562747] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 747.562949] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 747.563327] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='23',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_18959b240e3b49d6a94dc7aa1e92487c='1',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_35f14b46451443d48ce9154de8a09045='1',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='8',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:39Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=8) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 747.563604] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 747.564107] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 747.564212] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', '508c2a14-5f5b-4968-843a-1378d1c46e2f', 'b8404801-b787-4db2-aa13-320f87ca5ac5', 'e2620c94-5629-4094-a92f-d83d9efd6205', 'b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30', 'f05a805d-7896-477c-b2ea-437faec88fba', '78ed17da-e8e8-4872-b1bf-95c4e77de8e6', 'abec9f87-4cde-4b5e-ad2a-fa682842ac7a'] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 747.564387] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 747.564649] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 747.564863] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565117] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565337] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565506] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565667] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565903] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.565985] nova-scheduler[51596]: DEBUG nova.filters [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 747.566156] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 747.566319] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 747.566491] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Attempting to claim resources in the placement API for instance a75a3491-94b0-4754-8e42-7bf49194a022 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 747.620013] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] [instance: a75a3491-94b0-4754-8e42-7bf49194a022] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 747.622361] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 747.622361] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 747.622361] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6480e2eb-733f-45d4-9040-d43f38b81be4 tempest-ServerShowV247Test-1842064909 tempest-ServerShowV247Test-1842064909-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.413487] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Starting to schedule for instances: ['1195d592-faa2-43d7-af58-12b75abd5ed0'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 754.413804] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 754.413968] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.414331] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.414642] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 754.414772] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 754.459816] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.460730] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.460974] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.474172] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.474470] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.474730] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.477147] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.477418] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.477937] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='24',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_18959b240e3b49d6a94dc7aa1e92487c='0',num_proj_20659337b9974b26a9f4123181bd14ce='0',num_proj_291b1c241186446bb53562f866315ad9='0',num_proj_319a39cba8574bc7a3c92d4527f59cad='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_35f14b46451443d48ce9154de8a09045='0',num_proj_580e685106a749aca0f9769c5c269798='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_8689e7ba4d544dfcbbdf7c864cb3f823='0',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_aa0980bc89de477bbd5ad4ad8f6ce2b4='0',num_proj_b04115b4b0ed49aea28a1bee3ee07a27='0',num_proj_cd4ace35259947bfa4d07c4c3f42d55b='0',num_proj_cefaf2236f784faaa0f6d81a0ccda6f8='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_proj_e235144751dc4f10be76b379d3e6e53d='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:45Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=6) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 754.478299] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 754.478547] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 754.478772] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Update host state with instances: ['ea968312-62ea-4f55-87e9-f91823fc14c2', 'b4a2d6ae-f580-43a6-b1b7-9a4727c3ac30', 'f05a805d-7896-477c-b2ea-437faec88fba', '78ed17da-e8e8-4872-b1bf-95c4e77de8e6', 'abec9f87-4cde-4b5e-ad2a-fa682842ac7a', 'a75a3491-94b0-4754-8e42-7bf49194a022'] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 754.479106] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 754.479442] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 754.479790] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.480096] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.480369] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.480614] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.480835] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.481074] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.481343] nova-scheduler[51602]: DEBUG nova.filters [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 754.481569] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 754.481840] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 754.482060] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Attempting to claim resources in the placement API for instance 1195d592-faa2-43d7-af58-12b75abd5ed0 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 754.539707] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] [instance: 1195d592-faa2-43d7-af58-12b75abd5ed0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 754.540036] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 754.540256] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 754.540462] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8908f05b-872f-4666-993f-86042f4b27f5 tempest-ServerActionsTestJSON-335386642 tempest-ServerActionsTestJSON-335386642-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.312258] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.312829] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.312908] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 755.313126] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 755.313164] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 755.313281] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b9327b63-17c3-4cf9-a544-0081ceef4d95 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 756.621523] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Starting to schedule for instances: ['0ed4be35-b845-48ca-b892-657d96c12728'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 756.621990] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 756.621990] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 756.623620] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 756.624882] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 756.624882] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 756.690251] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 756.690523] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 756.690701] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 756.706081] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 756.706439] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 756.706978] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='26',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_145cbf0470004e0e8f468d7823433a21='1',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='1',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='1',num_task_deleting='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 756.707312] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 756.708065] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 756.708150] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 756.708374] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 756.710932] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 756.710932] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.710932] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.710932] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.710932] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.711163] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.711163] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.711163] nova-scheduler[51596]: DEBUG nova.filters [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 756.711163] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 756.711292] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 756.711292] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Attempting to claim resources in the placement API for instance 0ed4be35-b845-48ca-b892-657d96c12728 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 756.792343] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] [instance: 0ed4be35-b845-48ca-b892-657d96c12728] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 756.792647] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 756.792856] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 756.793076] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b211c439-48eb-45de-87a9-a1524f59bf9a tempest-ServerMetadataNegativeTestJSON-1677081655 tempest-ServerMetadataNegativeTestJSON-1677081655-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 757.464610] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting to schedule for instances: ['938a2016-8eaa-446a-b69c-3af59448d944'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 757.468233] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 757.468412] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.468812] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.468812] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 757.469825] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 757.516181] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 757.516428] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 757.516615] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 757.529688] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 757.530008] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.003s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 757.530415] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='26',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_145cbf0470004e0e8f468d7823433a21='1',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:49Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 757.530718] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 757.530891] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 757.531210] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 757.531290] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 757.531496] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 757.531905] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.531905] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.532095] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.532285] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.532460] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.532625] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.532782] nova-scheduler[51602]: DEBUG nova.filters [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 757.533664] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 757.533833] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 757.534974] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Attempting to claim resources in the placement API for instance 938a2016-8eaa-446a-b69c-3af59448d944 {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 757.629171] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] [instance: 938a2016-8eaa-446a-b69c-3af59448d944] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 757.629252] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 757.629503] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 757.629752] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a286a9f0-510d-4024-931c-d2c960680507 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.632784] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting to schedule for instances: ['72a92098-562e-47bf-8dde-8b62b182d7bb'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 758.637022] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 758.637299] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.637524] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.637775] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 758.637974] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 758.692302] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.692554] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.692725] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.701885] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.702204] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.702622] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='26',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_145cbf0470004e0e8f468d7823433a21='1',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f8b200f828624b43b290c7894018dec6='1',num_task_None='2',num_task_deleting='1',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:51Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=7) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 758.702946] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 758.703219] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 758.703435] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 758.703650] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 758.703957] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 758.704248] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.704516] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.705380] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.705463] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.705716] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.705902] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.706091] nova-scheduler[51596]: DEBUG nova.filters [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 758.706255] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 758.706472] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 758.706633] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Attempting to claim resources in the placement API for instance 72a92098-562e-47bf-8dde-8b62b182d7bb {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 758.756935] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] [instance: 72a92098-562e-47bf-8dde-8b62b182d7bb] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 758.757277] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 758.757479] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 758.757678] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bbfcb3a2-6871-4da0-9d3f-41fc23dce976 tempest-AttachVolumeNegativeTest-1432714470 tempest-AttachVolumeNegativeTest-1432714470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.035149] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Starting to schedule for instances: ['2d63a2a4-b912-487e-aa10-9e68d877baab'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.035454] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.035741] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.035788] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.037614] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.037614] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 760.094128] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.094423] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.095993] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.102647] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.102647] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.102857] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='27',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_145cbf0470004e0e8f468d7823433a21='1',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='1',num_proj_91232108c8944a3da00233e9c54c9749='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_task_None='3',num_task_deleting='1',num_task_spawning='4',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:52Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=8) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 760.103147] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 760.103320] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 760.103469] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 760.103635] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.103889] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 760.104127] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.104410] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.104661] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.104863] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.105067] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.105241] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.105413] nova-scheduler[51602]: DEBUG nova.filters [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 760.105620] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 760.105801] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 760.105975] nova-scheduler[51602]: DEBUG nova.scheduler.utils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Attempting to claim resources in the placement API for instance 2d63a2a4-b912-487e-aa10-9e68d877baab {{(pid=51602) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 760.174804] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] [instance: 2d63a2a4-b912-487e-aa10-9e68d877baab] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=51602) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 760.174804] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.174804] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.175361] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-57ce834c-bcce-426a-ba4b-ceda0f1c5b75 tempest-ServersTestFqdnHostnames-512619947 tempest-ServersTestFqdnHostnames-512619947-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.816291] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Starting to schedule for instances: ['f31b7ca3-60d1-4206-ac49-f85ec6194f85'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 762.816583] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 762.816757] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.816952] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.817159] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 762.817353] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 762.868016] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.868456] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.868456] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.874922] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.875150] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.875688] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='29',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='1',num_task_None='4',num_task_deleting='0',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:55Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=6) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 762.875819] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 762.875929] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 762.876094] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 762.876267] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 762.876510] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 762.876709] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.877362] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.877827] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.878078] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.878324] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.878582] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.878727] nova-scheduler[51596]: DEBUG nova.filters [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 762.878879] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 762.879062] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 762.879237] nova-scheduler[51596]: DEBUG nova.scheduler.utils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Attempting to claim resources in the placement API for instance f31b7ca3-60d1-4206-ac49-f85ec6194f85 {{(pid=51596) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 762.947229] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] [instance: f31b7ca3-60d1-4206-ac49-f85ec6194f85] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51596) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 762.947544] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 762.947745] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 762.947945] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6c2ffaa1-e526-4f8f-8dd1-68bec88e766a tempest-ServerActionsV293TestJSON-1756577926 tempest-ServerActionsV293TestJSON-1756577926-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.664034] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.664312] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.664498] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.665918] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.666784] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.667099] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-5efc2d9d-ed13-4a66-91cf-0c348fc8d21a tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.560358] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['563c0d3b-c08c-484b-80b2-7e029ccc0a04'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 764.560773] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 764.560991] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.561321] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.561497] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.561979] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 764.591790] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting to schedule for instances: ['4b971377-36b2-4512-8aad-2684e8f32c80'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 764.591790] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 764.591790] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.591790] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.591790] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.594219] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 764.608545] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.608758] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.608930] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.618373] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.618603] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.618965] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='31',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='4',num_task_deleting='0',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:56Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=6) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 764.619254] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 764.620120] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 764.620290] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 764.620454] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.620705] nova-scheduler[51602]: DEBUG nova.filters [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 764.620915] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 61.486283 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 764.621081] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 199680MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 764.621261] nova-scheduler[51602]: INFO nova.filters [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 0 hosts [ 764.621419] nova-scheduler[51602]: DEBUG nova.filters [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '563c0d3b-c08c-484b-80b2-7e029ccc0a04'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 764.621560] nova-scheduler[51602]: INFO nova.filters [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '563c0d3b-c08c-484b-80b2-7e029ccc0a04'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 764.622269] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 764.622443] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-96b42d87-98f9-4721-895e-37005f320fb3 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 764.634983] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.635306] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.635522] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.642992] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.643283] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.643728] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='31',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='1',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='4',num_task_deleting='0',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:56Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=6) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 764.644150] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 764.644424] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 764.644658] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 764.644840] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.645248] nova-scheduler[51596]: DEBUG nova.filters [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 764.645430] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 61.510744 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 764.645686] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 199680MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 764.645789] nova-scheduler[51596]: INFO nova.filters [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ComputeFilter returned 0 hosts [ 764.645964] nova-scheduler[51596]: DEBUG nova.filters [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtering removed all hosts for the request with instance ID '4b971377-36b2-4512-8aad-2684e8f32c80'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 764.646281] nova-scheduler[51596]: INFO nova.filters [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtering removed all hosts for the request with instance ID '4b971377-36b2-4512-8aad-2684e8f32c80'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 764.646281] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 764.647753] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4a56b9bb-27ff-4b74-9662-940e85dcfd99 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.500332] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Starting to schedule for instances: ['98e71cf6-94e8-4107-8d61-bfa799620fc9'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.500332] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.500332] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.500332] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.500332] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.501123] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.557020] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.557020] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.557020] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.566105] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.566382] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.567420] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='3',num_task_deleting='0',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:58Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.567741] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.567928] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.568099] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.569844] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.570211] nova-scheduler[51602]: DEBUG nova.filters [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.570458] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 64.435793 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.570950] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 767.570950] nova-scheduler[51602]: INFO nova.filters [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Filter ComputeFilter returned 0 hosts [ 767.571082] nova-scheduler[51602]: DEBUG nova.filters [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Filtering removed all hosts for the request with instance ID '98e71cf6-94e8-4107-8d61-bfa799620fc9'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.571140] nova-scheduler[51602]: INFO nova.filters [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Filtering removed all hosts for the request with instance ID '98e71cf6-94e8-4107-8d61-bfa799620fc9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.571302] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.571456] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a7361e93-5a3a-4afb-b48b-9a3780f01b4b tempest-ServerPasswordTestJSON-443041768 tempest-ServerPasswordTestJSON-443041768-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 768.156583] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting to schedule for instances: ['bbe8d0ce-a8c5-460d-812b-9e776f9a7721'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 768.156896] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 768.157931] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.158155] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.158371] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.158650] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 768.215666] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.215898] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.216116] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.222960] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.224028] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.224142] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='3',num_task_deleting='0',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:58Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 768.224229] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 768.224229] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 768.224229] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 768.224400] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.224575] nova-scheduler[51596]: DEBUG nova.filters [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 768.224852] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 65.090156 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 768.225064] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 768.225234] nova-scheduler[51596]: INFO nova.filters [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filter ComputeFilter returned 0 hosts [ 768.225552] nova-scheduler[51596]: DEBUG nova.filters [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtering removed all hosts for the request with instance ID 'bbe8d0ce-a8c5-460d-812b-9e776f9a7721'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 768.225552] nova-scheduler[51596]: INFO nova.filters [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtering removed all hosts for the request with instance ID 'bbe8d0ce-a8c5-460d-812b-9e776f9a7721'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 768.225775] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 768.225819] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5d7caa52-b712-4f57-a65c-c3f0fc61ca82 tempest-ListServerFiltersTestJSON-278412246 tempest-ListServerFiltersTestJSON-278412246-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 768.829993] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['5fd87270-2cb4-4b82-aac7-ce774fb9e704'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 768.830332] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 768.830524] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.830722] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.830922] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.831538] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 768.877932] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.878253] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.878478] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.885296] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.885974] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.886340] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='32',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='1',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='1',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='3',num_task_deleting='0',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:45:58Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=5) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 768.886643] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 768.886782] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 768.886938] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 768.887161] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.887387] nova-scheduler[51602]: DEBUG nova.filters [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 768.887595] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 65.752962 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 768.887751] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 768.887903] nova-scheduler[51602]: INFO nova.filters [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 0 hosts [ 768.888430] nova-scheduler[51602]: DEBUG nova.filters [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '5fd87270-2cb4-4b82-aac7-ce774fb9e704'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 768.888724] nova-scheduler[51602]: INFO nova.filters [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '5fd87270-2cb4-4b82-aac7-ce774fb9e704'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 768.888925] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 768.889227] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-f143b18b-ffc2-468e-9068-e516efb33487 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.004863] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Starting to schedule for instances: ['05feb163-b097-40bd-9889-7ca4479876c8'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.006793] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.006793] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.006793] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.006793] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.006793] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.057541] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.057853] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.058030] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.067840] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.068099] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.068503] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='33',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='1',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='1',num_task_deleting='0',num_task_spawning='2',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:02Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=3) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.068747] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.069209] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.069209] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.069376] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.069493] nova-scheduler[51596]: DEBUG nova.filters [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.069694] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 66.935066 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.076017] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 770.076017] nova-scheduler[51596]: INFO nova.filters [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Filter ComputeFilter returned 0 hosts [ 770.076017] nova-scheduler[51596]: DEBUG nova.filters [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Filtering removed all hosts for the request with instance ID '05feb163-b097-40bd-9889-7ca4479876c8'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.076017] nova-scheduler[51596]: INFO nova.filters [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Filtering removed all hosts for the request with instance ID '05feb163-b097-40bd-9889-7ca4479876c8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.076017] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.076350] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-76123a85-7758-42f2-95e2-0c0b650306cf tempest-InstanceActionsV221TestJSON-1108763158 tempest-InstanceActionsV221TestJSON-1108763158-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.686099] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Starting to schedule for instances: ['9f290d28-a018-4a06-8c84-81463a83b0b2', 'e1c51f22-c186-4a2f-a2c9-827319b2d8e6'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.688029] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.688029] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.688029] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.688029] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.689077] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.751250] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.752353] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.752353] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.760287] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.760491] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.761340] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.761519] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.761519] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.761519] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.763147] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.763147] nova-scheduler[51602]: DEBUG nova.filters [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.763147] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 67.627423 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.763147] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 770.763147] nova-scheduler[51602]: INFO nova.filters [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filter ComputeFilter returned 0 hosts [ 770.763324] nova-scheduler[51602]: DEBUG nova.filters [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtering removed all hosts for the request with instance ID '9f290d28-a018-4a06-8c84-81463a83b0b2'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.763324] nova-scheduler[51602]: INFO nova.filters [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtering removed all hosts for the request with instance ID '9f290d28-a018-4a06-8c84-81463a83b0b2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.763324] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.763324] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-47dfadc9-479f-411b-b305-7f48f3905139 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.043631] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting to schedule for instances: ['47c85522-bb7b-4cf8-a959-9038d63eec79'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.043959] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.044080] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.044758] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.044758] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.044758] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.109062] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.109062] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.109062] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.116633] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.116633] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.117281] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.117425] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.118249] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.118249] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.118249] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.118249] nova-scheduler[51596]: DEBUG nova.filters [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.118444] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 68.983786 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.118565] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 772.118711] nova-scheduler[51596]: INFO nova.filters [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeFilter returned 0 hosts [ 772.118888] nova-scheduler[51596]: DEBUG nova.filters [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtering removed all hosts for the request with instance ID '47c85522-bb7b-4cf8-a959-9038d63eec79'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.118978] nova-scheduler[51596]: INFO nova.filters [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtering removed all hosts for the request with instance ID '47c85522-bb7b-4cf8-a959-9038d63eec79'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.119522] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.119522] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-10d6eac8-35e9-4158-a24a-8956a32b0053 tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 776.236943] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['8510b3fe-38d8-4c49-aab0-76c709818fd7'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 776.236943] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 776.236943] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.236943] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.236943] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.237368] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 776.243101] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['7962aa39-04ac-4865-b0e0-aa9119505d22'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 776.243404] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 776.247424] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.247705] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.247919] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.248116] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 776.287785] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.288097] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.288307] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.294287] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.294568] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.294782] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.298678] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.298891] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.299273] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 776.299563] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 776.300038] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 776.300211] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 776.300372] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.300627] nova-scheduler[51602]: DEBUG nova.filters [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 776.300834] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 73.166203 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 776.300990] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 776.301159] nova-scheduler[51602]: INFO nova.filters [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 0 hosts [ 776.301307] nova-scheduler[51602]: DEBUG nova.filters [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '8510b3fe-38d8-4c49-aab0-76c709818fd7'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 776.301779] nova-scheduler[51602]: INFO nova.filters [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '8510b3fe-38d8-4c49-aab0-76c709818fd7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 776.301779] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 776.301779] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72720bf1-f30e-4c4d-9f15-6bb858a6d80b tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 776.301960] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.302201] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.302583] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 776.306022] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 776.306022] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 776.306022] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 776.307950] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.307950] nova-scheduler[51596]: DEBUG nova.filters [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 776.307950] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 73.169278 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 776.307950] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 776.307950] nova-scheduler[51596]: INFO nova.filters [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 0 hosts [ 776.309086] nova-scheduler[51596]: DEBUG nova.filters [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '7962aa39-04ac-4865-b0e0-aa9119505d22'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 776.309086] nova-scheduler[51596]: INFO nova.filters [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '7962aa39-04ac-4865-b0e0-aa9119505d22'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 776.309086] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 776.309086] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-5ae4decc-1ce4-4104-bfae-e90062f57462 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 778.427153] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Starting to schedule for instances: ['37925396-9a25-40a9-8eb0-9fb84dab1db6'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 778.427448] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 778.427613] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.427795] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.427979] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.430355] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 778.490133] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.491028] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.491299] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.499602] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.499797] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.500214] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 778.500680] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 778.501389] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 778.501389] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 778.501389] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.501622] nova-scheduler[51602]: DEBUG nova.filters [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 778.501930] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 75.367037 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 778.502157] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 778.502377] nova-scheduler[51602]: INFO nova.filters [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Filter ComputeFilter returned 0 hosts [ 778.502574] nova-scheduler[51602]: DEBUG nova.filters [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Filtering removed all hosts for the request with instance ID '37925396-9a25-40a9-8eb0-9fb84dab1db6'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 778.502757] nova-scheduler[51602]: INFO nova.filters [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Filtering removed all hosts for the request with instance ID '37925396-9a25-40a9-8eb0-9fb84dab1db6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 778.502950] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 778.503160] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-8a15b21a-b52e-412a-a9d3-2a4e31fe2c16 tempest-ServerAddressesTestJSON-145131219 tempest-ServerAddressesTestJSON-145131219-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.219022] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting to schedule for instances: ['8b74fc20-68b5-4685-b079-472d8bae0f6f'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 780.219022] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 780.219022] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.219022] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.219022] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.219394] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 780.273983] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.273983] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.273983] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.283228] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.283736] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.284305] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 780.284665] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 780.285097] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 780.285451] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 780.285617] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.286062] nova-scheduler[51596]: DEBUG nova.filters [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 780.286345] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 77.151681 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 780.286580] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 780.286819] nova-scheduler[51596]: INFO nova.filters [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filter ComputeFilter returned 0 hosts [ 780.287075] nova-scheduler[51596]: DEBUG nova.filters [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtering removed all hosts for the request with instance ID '8b74fc20-68b5-4685-b079-472d8bae0f6f'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 780.287284] nova-scheduler[51596]: INFO nova.filters [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtering removed all hosts for the request with instance ID '8b74fc20-68b5-4685-b079-472d8bae0f6f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 780.287478] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 780.287701] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-6cb3a564-5218-4011-b742-fc28e350f35e tempest-ImagesTestJSON-1854810537 tempest-ImagesTestJSON-1854810537-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.678539] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Starting to schedule for instances: ['50e91d7a-911b-4b9c-9f69-6180335366c0'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 780.680266] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 780.680488] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.680948] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.680948] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.681077] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 780.728626] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.728853] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.729028] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.737932] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.738178] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.738583] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 780.738892] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 780.739076] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 780.739232] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 780.739396] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.739651] nova-scheduler[51602]: DEBUG nova.filters [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 780.739850] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 77.605221 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 780.740008] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 780.740164] nova-scheduler[51602]: INFO nova.filters [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filter ComputeFilter returned 0 hosts [ 780.740308] nova-scheduler[51602]: DEBUG nova.filters [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filtering removed all hosts for the request with instance ID '50e91d7a-911b-4b9c-9f69-6180335366c0'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 780.740443] nova-scheduler[51602]: INFO nova.filters [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filtering removed all hosts for the request with instance ID '50e91d7a-911b-4b9c-9f69-6180335366c0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 780.740581] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 780.740736] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-c0eaa05a-193b-4839-9d73-31ef689e4d13 tempest-SecurityGroupsTestJSON-536329627 tempest-SecurityGroupsTestJSON-536329627-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 780.840535] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Starting to schedule for instances: ['46f9cfe6-f752-4aae-aa30-b2cbbd42b4df'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 780.840799] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 780.841493] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.843060] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.843374] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 780.843585] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 780.908971] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.908971] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.908971] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.917274] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 780.917532] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 780.917925] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 780.918238] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 780.918428] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 780.918646] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 780.918825] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 780.919100] nova-scheduler[51596]: DEBUG nova.filters [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 780.919309] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 77.784676 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 780.919474] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 780.919608] nova-scheduler[51596]: INFO nova.filters [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filter ComputeFilter returned 0 hosts [ 780.919738] nova-scheduler[51596]: DEBUG nova.filters [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtering removed all hosts for the request with instance ID '46f9cfe6-f752-4aae-aa30-b2cbbd42b4df'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 780.919870] nova-scheduler[51596]: INFO nova.filters [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtering removed all hosts for the request with instance ID '46f9cfe6-f752-4aae-aa30-b2cbbd42b4df'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 780.921254] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 780.921254] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-41dd8cee-006e-49de-860a-6072d876bbd7 tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 781.758566] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Starting to schedule for instances: ['52d42714-e52c-48b3-ae4a-49715fbff016'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 781.758837] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 781.758989] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 781.760864] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 781.761185] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 781.761261] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 781.827449] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 781.827693] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 781.827902] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 781.838992] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 781.839237] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 781.839608] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 781.840139] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 781.840139] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 781.841212] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 781.841212] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 781.841212] nova-scheduler[51602]: DEBUG nova.filters [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 781.841212] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 78.706374 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 781.841448] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 781.841448] nova-scheduler[51602]: INFO nova.filters [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filter ComputeFilter returned 0 hosts [ 781.841448] nova-scheduler[51602]: DEBUG nova.filters [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtering removed all hosts for the request with instance ID '52d42714-e52c-48b3-ae4a-49715fbff016'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 781.841650] nova-scheduler[51602]: INFO nova.filters [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtering removed all hosts for the request with instance ID '52d42714-e52c-48b3-ae4a-49715fbff016'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 781.841763] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 781.841846] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-66f7dbf4-8e9d-440c-bf9c-c8932d056d2c tempest-ListImageFiltersTestJSON-614978481 tempest-ListImageFiltersTestJSON-614978481-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 782.467247] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Starting to schedule for instances: ['0b0f0761-8b9f-4975-a7ab-bf4bd2686d04', '0b203a37-91eb-47b3-ad22-99db57d9e7ed'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 782.467569] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 782.467773] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.468207] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.468370] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.468628] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 782.541861] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.543771] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.543771] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.555545] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.555545] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.556437] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 782.556577] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 782.556577] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 782.556754] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 782.556754] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.556997] nova-scheduler[51596]: DEBUG nova.filters [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 782.557305] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 79.422595 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 782.557497] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 782.557581] nova-scheduler[51596]: INFO nova.filters [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filter ComputeFilter returned 0 hosts [ 782.557723] nova-scheduler[51596]: DEBUG nova.filters [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtering removed all hosts for the request with instance ID '0b0f0761-8b9f-4975-a7ab-bf4bd2686d04'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 782.558312] nova-scheduler[51596]: INFO nova.filters [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtering removed all hosts for the request with instance ID '0b0f0761-8b9f-4975-a7ab-bf4bd2686d04'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 782.558736] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 782.559156] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-dfb02a0e-837f-4400-ae82-b2f12f29f6d1 tempest-MultipleCreateTestJSON-1191137847 tempest-MultipleCreateTestJSON-1191137847-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 782.630019] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['94758992-1d4a-492d-b4d7-30443aa3bbe7'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 782.630331] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 782.630834] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.631056] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.631265] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 782.631443] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 782.679200] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.679447] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.680700] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.688028] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 782.688354] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 782.688616] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 782.688908] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 782.689092] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 782.689587] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 782.689587] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 782.689717] nova-scheduler[51602]: DEBUG nova.filters [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 782.689843] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 79.555213 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 782.689991] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 782.693405] nova-scheduler[51602]: INFO nova.filters [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 0 hosts [ 782.693644] nova-scheduler[51602]: DEBUG nova.filters [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '94758992-1d4a-492d-b4d7-30443aa3bbe7'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 782.693683] nova-scheduler[51602]: INFO nova.filters [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID '94758992-1d4a-492d-b4d7-30443aa3bbe7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 782.693822] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 782.693982] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-851ee1f7-492b-49b0-9601-8487b964d883 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 783.250926] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['56f16d5e-8949-4a36-8bc1-9981e1d190ab'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 783.251556] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 783.251831] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.252127] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.252438] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 783.253095] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 783.297379] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.297379] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.297379] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.303374] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 783.303768] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 783.304358] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 783.306030] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 783.306030] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 783.306030] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 783.306298] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 783.306298] nova-scheduler[51596]: DEBUG nova.filters [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 783.306526] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 80.171426 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 783.306856] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 783.307148] nova-scheduler[51596]: INFO nova.filters [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 0 hosts [ 783.307410] nova-scheduler[51596]: DEBUG nova.filters [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '56f16d5e-8949-4a36-8bc1-9981e1d190ab'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 783.308759] nova-scheduler[51596]: INFO nova.filters [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '56f16d5e-8949-4a36-8bc1-9981e1d190ab'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 783.308759] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 783.308759] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-b3e235fe-7eac-4674-91e1-f66d3ea51a37 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 784.916192] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Starting to schedule for instances: ['62b668da-d57c-405a-8c37-63a15f2a506e'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 784.916974] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 784.917393] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.917945] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.918677] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 784.918934] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 784.975019] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.975019] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.975019] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.981242] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 784.981445] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 784.981806] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 784.982108] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 784.982282] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 784.982433] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 784.982589] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 784.982848] nova-scheduler[51602]: DEBUG nova.filters [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 784.983064] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 81.848422 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 784.983217] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 784.984846] nova-scheduler[51602]: INFO nova.filters [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Filter ComputeFilter returned 0 hosts [ 784.984846] nova-scheduler[51602]: DEBUG nova.filters [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Filtering removed all hosts for the request with instance ID '62b668da-d57c-405a-8c37-63a15f2a506e'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 784.984846] nova-scheduler[51602]: INFO nova.filters [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Filtering removed all hosts for the request with instance ID '62b668da-d57c-405a-8c37-63a15f2a506e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 784.984846] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 784.984846] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-a5377b21-394c-4888-9ee8-48923c77f4db tempest-ServerActionsTestOtherA-1173896838 tempest-ServerActionsTestOtherA-1173896838-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 787.178492] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting to schedule for instances: ['a9f5cfbc-2394-4eaf-bba4-b6a17cf29dcd'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 787.178807] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 787.178967] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.179161] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.179360] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.179691] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 787.242351] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 787.245139] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 787.245139] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 787.260011] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 787.260389] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 787.260887] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 787.261350] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 787.261636] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 787.261919] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 787.262214] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 787.262620] nova-scheduler[51596]: DEBUG nova.filters [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 787.262929] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 84.128272 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 787.263193] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 787.263460] nova-scheduler[51596]: INFO nova.filters [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filter ComputeFilter returned 0 hosts [ 787.263710] nova-scheduler[51596]: DEBUG nova.filters [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID 'a9f5cfbc-2394-4eaf-bba4-b6a17cf29dcd'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 787.263957] nova-scheduler[51596]: INFO nova.filters [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtering removed all hosts for the request with instance ID 'a9f5cfbc-2394-4eaf-bba4-b6a17cf29dcd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 787.264209] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 787.264472] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-a0af0ff3-ca4f-4720-8553-a6476e97d266 tempest-DeleteServersTestJSON-1071653592 tempest-DeleteServersTestJSON-1071653592-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 787.300455] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['503ed475-7585-4c26-9984-6eaa33bb97ca'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 787.300777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 787.300993] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.301291] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.301291] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 787.301484] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 787.357707] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 787.359403] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 787.359403] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 787.369748] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 787.369748] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 787.369927] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 787.370229] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 787.370368] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 787.370524] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 787.370691] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 787.370949] nova-scheduler[51602]: DEBUG nova.filters [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 787.371895] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 84.236523 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 787.372130] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 787.372299] nova-scheduler[51602]: INFO nova.filters [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 0 hosts [ 787.372450] nova-scheduler[51602]: DEBUG nova.filters [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '503ed475-7585-4c26-9984-6eaa33bb97ca'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 787.372584] nova-scheduler[51602]: INFO nova.filters [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID '503ed475-7585-4c26-9984-6eaa33bb97ca'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 787.372864] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 787.372864] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-0f1aaa9b-a0fa-43fe-baac-3db3a69fd88a tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 788.746329] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Starting to schedule for instances: ['8d0e993e-5738-48d9-a97c-757fe32e82be'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 788.746702] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 788.746832] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.747058] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.747314] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.748657] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 788.801559] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.804020] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.804020] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.813722] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.814240] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.814883] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 788.816115] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 788.816115] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 788.816115] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 788.817705] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.817705] nova-scheduler[51596]: DEBUG nova.filters [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 788.817705] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 85.682373 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 788.817705] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 788.817705] nova-scheduler[51596]: INFO nova.filters [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filter ComputeFilter returned 0 hosts [ 788.817941] nova-scheduler[51596]: DEBUG nova.filters [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtering removed all hosts for the request with instance ID '8d0e993e-5738-48d9-a97c-757fe32e82be'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 788.817941] nova-scheduler[51596]: INFO nova.filters [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtering removed all hosts for the request with instance ID '8d0e993e-5738-48d9-a97c-757fe32e82be'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 788.818162] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 788.818556] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-bf7856c1-a3b0-47da-b203-490070191afc tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 789.834400] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Starting to schedule for instances: ['a8cedd9a-605a-4e00-9f52-8e25b600cc92'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 789.834618] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 789.837960] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.838345] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.838576] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.838777] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 789.864200] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Starting to schedule for instances: ['01edd188-836b-4aac-8a4d-321153d00202'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 789.864515] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 789.864672] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.864845] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.865063] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 789.865257] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 789.901477] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.901477] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.901477] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.910850] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.910850] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.911065] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 789.911458] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 789.911682] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 789.912244] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 789.912244] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.912496] nova-scheduler[51602]: DEBUG nova.filters [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 789.912719] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 86.777947 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 789.912938] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 789.913069] nova-scheduler[51602]: INFO nova.filters [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filter ComputeFilter returned 0 hosts [ 789.913322] nova-scheduler[51602]: DEBUG nova.filters [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtering removed all hosts for the request with instance ID 'a8cedd9a-605a-4e00-9f52-8e25b600cc92'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 789.913501] nova-scheduler[51602]: INFO nova.filters [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtering removed all hosts for the request with instance ID 'a8cedd9a-605a-4e00-9f52-8e25b600cc92'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 789.913712] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 789.913904] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-41bd279b-cee4-45a7-a0f6-9866a25d9a5a tempest-ServerRescueNegativeTestJSON-188112280 tempest-ServerRescueNegativeTestJSON-188112280-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 789.926806] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.926806] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.926806] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.937013] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 789.937357] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 789.937782] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 789.938461] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 789.938461] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 789.938461] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 789.938848] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 789.938848] nova-scheduler[51596]: DEBUG nova.filters [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 789.939019] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 86.804364 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 789.939177] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 789.940111] nova-scheduler[51596]: INFO nova.filters [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Filter ComputeFilter returned 0 hosts [ 789.940111] nova-scheduler[51596]: DEBUG nova.filters [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Filtering removed all hosts for the request with instance ID '01edd188-836b-4aac-8a4d-321153d00202'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 789.940111] nova-scheduler[51596]: INFO nova.filters [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Filtering removed all hosts for the request with instance ID '01edd188-836b-4aac-8a4d-321153d00202'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 789.940111] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 789.940111] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-d686fee6-a757-4ac8-b02a-df6e161f8a13 tempest-ServersNegativeTestJSON-1264316097 tempest-ServersNegativeTestJSON-1264316097-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 790.500681] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Starting to schedule for instances: ['652f04cb-87ca-42a6-9331-df1064070e7f'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 790.500968] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 790.501224] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.501414] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.501607] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.501787] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 790.549643] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.549854] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.550029] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.558808] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.559041] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.563145] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 790.563468] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 790.563684] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 790.563852] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 790.564033] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.564295] nova-scheduler[51602]: DEBUG nova.filters [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 790.564501] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 87.429871 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 790.564655] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 790.564805] nova-scheduler[51602]: INFO nova.filters [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Filter ComputeFilter returned 0 hosts [ 790.564951] nova-scheduler[51602]: DEBUG nova.filters [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Filtering removed all hosts for the request with instance ID '652f04cb-87ca-42a6-9331-df1064070e7f'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 790.565116] nova-scheduler[51602]: INFO nova.filters [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Filtering removed all hosts for the request with instance ID '652f04cb-87ca-42a6-9331-df1064070e7f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 790.565276] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 790.565418] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-68fe73da-00c3-4814-93d7-17bcef934acb tempest-ServerAddressesNegativeTestJSON-841234166 tempest-ServerAddressesNegativeTestJSON-841234166-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 791.962246] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting to schedule for instances: ['ffb89221-a83d-49e9-be1f-d1b7cdb414dd'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 791.962246] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 791.962246] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.962555] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.962591] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 791.962755] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 792.019342] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.019342] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.019342] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.025981] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.028083] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.028222] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 792.028222] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 792.028222] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 792.028222] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 792.028222] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.028222] nova-scheduler[51596]: DEBUG nova.filters [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 792.028797] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 88.893488 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 792.029097] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 792.029444] nova-scheduler[51596]: INFO nova.filters [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filter ComputeFilter returned 0 hosts [ 792.029671] nova-scheduler[51596]: DEBUG nova.filters [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID 'ffb89221-a83d-49e9-be1f-d1b7cdb414dd'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 792.029947] nova-scheduler[51596]: INFO nova.filters [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtering removed all hosts for the request with instance ID 'ffb89221-a83d-49e9-be1f-d1b7cdb414dd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 792.030294] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 792.030594] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-2bc2b86d-cf55-4390-afb8-05199aef22e1 tempest-ServersTestJSON-1247949540 tempest-ServersTestJSON-1247949540-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 796.189580] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting to schedule for instances: ['631b9fc0-bd05-4743-840c-7e6aad9207a8'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 796.189906] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 796.190090] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.190273] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.190480] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 796.190684] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 796.236668] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 796.237032] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 796.237385] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 796.245668] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 796.245668] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 796.246030] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='33',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='2',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:03Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=2) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 796.246315] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 796.246485] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 796.246635] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 796.246794] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 796.248261] nova-scheduler[51602]: DEBUG nova.filters [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 796.248965] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 93.113846 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 796.249162] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 796.249408] nova-scheduler[51602]: INFO nova.filters [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filter ComputeFilter returned 0 hosts [ 796.249580] nova-scheduler[51602]: DEBUG nova.filters [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '631b9fc0-bd05-4743-840c-7e6aad9207a8'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 796.249720] nova-scheduler[51602]: INFO nova.filters [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '631b9fc0-bd05-4743-840c-7e6aad9207a8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 796.249867] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 796.250022] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-72fb459b-7e0c-4a4f-bc86-49277751ccb6 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 798.502430] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Starting to schedule for instances: ['620f0449-48c1-493a-a3c2-d741e032ba3e'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 798.502828] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 798.502998] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.503191] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.503379] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.503667] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 798.559742] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.560855] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.561078] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.572364] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.572623] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.573032] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 798.573427] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 798.574786] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 798.574786] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 798.574786] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.574786] nova-scheduler[51596]: DEBUG nova.filters [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 798.574786] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 95.43988 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 798.574786] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 798.575085] nova-scheduler[51596]: INFO nova.filters [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Filter ComputeFilter returned 0 hosts [ 798.575085] nova-scheduler[51596]: DEBUG nova.filters [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Filtering removed all hosts for the request with instance ID '620f0449-48c1-493a-a3c2-d741e032ba3e'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 798.575151] nova-scheduler[51596]: INFO nova.filters [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Filtering removed all hosts for the request with instance ID '620f0449-48c1-493a-a3c2-d741e032ba3e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 798.575353] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 798.575527] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-80cfb065-a581-4f40-9311-a3271ce83134 tempest-ServerShowV254Test-185728470 tempest-ServerShowV254Test-185728470-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 798.645406] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting to schedule for instances: ['7e1b10c8-ead2-4c26-b8ff-d6f86f06b87d'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 798.645406] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 798.645406] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.645861] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.645901] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 798.646299] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 798.705073] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.705316] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.705478] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.712968] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 798.713200] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 798.713560] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 798.713866] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 798.714053] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 798.714233] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 798.714361] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 798.714608] nova-scheduler[51602]: DEBUG nova.filters [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 798.714809] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 95.580184 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 798.714955] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 798.715110] nova-scheduler[51602]: INFO nova.filters [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filter ComputeFilter returned 0 hosts [ 798.715251] nova-scheduler[51602]: DEBUG nova.filters [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '7e1b10c8-ead2-4c26-b8ff-d6f86f06b87d'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 798.715380] nova-scheduler[51602]: INFO nova.filters [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '7e1b10c8-ead2-4c26-b8ff-d6f86f06b87d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 798.715518] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 798.715655] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-ac867706-159f-4836-9488-98276d914dbd tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 800.459155] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Starting to schedule for instances: ['2d971f3f-6ea3-4ec4-809f-3e0609a3c576'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 800.459510] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 800.459694] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.459880] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.460911] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.461167] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 800.513822] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 800.514096] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 800.514286] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 800.520672] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 800.520875] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 800.521255] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 800.521525] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 800.521698] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 800.521826] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 800.521988] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 800.522242] nova-scheduler[51596]: DEBUG nova.filters [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 800.522441] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 97.387818 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 800.522590] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 800.523305] nova-scheduler[51596]: INFO nova.filters [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Filter ComputeFilter returned 0 hosts [ 800.523305] nova-scheduler[51596]: DEBUG nova.filters [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Filtering removed all hosts for the request with instance ID '2d971f3f-6ea3-4ec4-809f-3e0609a3c576'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 800.523305] nova-scheduler[51596]: INFO nova.filters [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Filtering removed all hosts for the request with instance ID '2d971f3f-6ea3-4ec4-809f-3e0609a3c576'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 800.523305] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 800.523305] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-4c13995c-bd38-4ec8-b67e-5af2ac70eb29 tempest-ServersTestManualDisk-900902045 tempest-ServersTestManualDisk-900902045-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 800.955192] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting to schedule for instances: ['d76ca129-94f4-4d09-9be9-bb29fce459fd'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 800.955598] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 800.955653] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.957015] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.957015] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 800.957015] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 801.010808] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 801.011033] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 801.011201] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 801.017777] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 801.018311] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 801.018427] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 801.018611] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 801.019123] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 801.019123] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 801.019123] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 801.019541] nova-scheduler[51602]: DEBUG nova.filters [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 801.019541] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 97.884883 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 801.019656] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 801.019802] nova-scheduler[51602]: INFO nova.filters [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filter ComputeFilter returned 0 hosts [ 801.019942] nova-scheduler[51602]: DEBUG nova.filters [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID 'd76ca129-94f4-4d09-9be9-bb29fce459fd'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 801.020108] nova-scheduler[51602]: INFO nova.filters [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID 'd76ca129-94f4-4d09-9be9-bb29fce459fd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 801.020254] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 801.020413] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-629b0545-82b8-4b2d-9087-1be782ec0411 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 803.132686] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting to schedule for instances: ['9f6a7260-2a24-40fe-8263-faef96b3800a'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 803.132949] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 803.133126] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 803.134703] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 803.134703] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 803.134703] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 803.191391] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 803.191735] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 803.192025] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 803.200205] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 803.200546] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 803.200871] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 803.201170] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 803.201424] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 803.201555] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 803.201641] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 803.202277] nova-scheduler[51596]: DEBUG nova.filters [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 803.202549] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 100.067851 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 803.203075] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 803.203075] nova-scheduler[51596]: INFO nova.filters [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filter ComputeFilter returned 0 hosts [ 803.203255] nova-scheduler[51596]: DEBUG nova.filters [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '9f6a7260-2a24-40fe-8263-faef96b3800a'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 803.203425] nova-scheduler[51596]: INFO nova.filters [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '9f6a7260-2a24-40fe-8263-faef96b3800a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 803.203538] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 803.203728] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-149dd1ee-56f3-40da-9df3-c27288e71b32 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Starting to schedule for instances: ['1f21a36e-f3b1-4f08-a9a7-eefabf614b89'] {{(pid=51602) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51602) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51602) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.129774] nova-scheduler[51602]: DEBUG nova.scheduler.request_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] ephemeral_encryption_filter skipped {{(pid=51602) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 804.179744] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.179968] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.180145] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.187617] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.187982] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.188374] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 804.188648] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Update host state with aggregates: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 804.188875] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 804.189015] nova-scheduler[51602]: DEBUG nova.scheduler.host_manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Update host state with instances: [] {{(pid=51602) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 804.189252] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.189776] nova-scheduler[51602]: DEBUG nova.filters [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Starting with 1 host(s) {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 804.190141] nova-scheduler[51602]: DEBUG nova.servicegroup.drivers.db [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 101.055361 {{(pid=51602) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 804.190202] nova-scheduler[51602]: WARNING nova.scheduler.filters.compute_filter [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 804.190357] nova-scheduler[51602]: INFO nova.filters [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Filter ComputeFilter returned 0 hosts [ 804.190556] nova-scheduler[51602]: DEBUG nova.filters [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Filtering removed all hosts for the request with instance ID '1f21a36e-f3b1-4f08-a9a7-eefabf614b89'. Filter results: [('ComputeFilter', None)] {{(pid=51602) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 804.190764] nova-scheduler[51602]: INFO nova.filters [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Filtering removed all hosts for the request with instance ID '1f21a36e-f3b1-4f08-a9a7-eefabf614b89'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 804.190924] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] Filtered [] {{(pid=51602) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 804.191087] nova-scheduler[51602]: DEBUG nova.scheduler.manager [None req-7708b3dc-3c0a-4916-88de-0c9dfdf12633 tempest-ServerGroupTestJSON-1094726720 tempest-ServerGroupTestJSON-1094726720-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51602) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 804.815875] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting to schedule for instances: ['4bdbceea-eb47-4fd3-baf5-8cb183574f2d'] {{(pid=51596) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 804.816159] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51596) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 804.816343] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.816531] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.816742] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51596) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.816935] nova-scheduler[51596]: DEBUG nova.scheduler.request_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] ephemeral_encryption_filter skipped {{(pid=51596) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 804.856389] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.856622] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.856785] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.863294] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.863501] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.863851] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-30T19:42:50Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='36',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_145cbf0470004e0e8f468d7823433a21='0',num_proj_352b723cfbb34bfa9e4500f104c508f1='1',num_proj_392af2151280472aa22ca8faa2f253ce='0',num_proj_7a9e45c3a1d148e7b494e0291dae92bf='0',num_proj_834aaa625fd84a18b32ddef466b431a4='0',num_proj_91232108c8944a3da00233e9c54c9749='0',num_proj_d099026ef14c4a9ea51a62cb8dc15673='0',num_proj_dd2add382fb34e309cc9b0acd9403ef6='0',num_proj_f858ee4b23fb49c399f103c4a8bcdebc='0',num_proj_f8b200f828624b43b290c7894018dec6='0',num_proj_f8f74d0c25be4992b4701c8838638ab3='0',num_task_None='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-30T19:46:30Z,uuid=69a84459-8a9e-4a6c-afd9-ec42e61132ce,vcpus=48,vcpus_used=1) {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 804.864130] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with aggregates: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 804.864297] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with service dict: {'id': 7, 'uuid': '5ce28611-e6d3-4425-99f0-eb8f41dcdd4c', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 30, 19, 42, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 30, 19, 44, 56, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 804.864450] nova-scheduler[51596]: DEBUG nova.scheduler.host_manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Update host state with instances: [] {{(pid=51596) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 804.864606] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.864846] nova-scheduler[51596]: DEBUG nova.filters [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Starting with 1 host(s) {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 804.865060] nova-scheduler[51596]: DEBUG nova.servicegroup.drivers.db [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-30 19:44:56. Elapsed time is 101.730419 {{(pid=51596) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 804.865215] nova-scheduler[51596]: WARNING nova.scheduler.filters.compute_filter [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 804.865364] nova-scheduler[51596]: INFO nova.filters [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filter ComputeFilter returned 0 hosts [ 804.865512] nova-scheduler[51596]: DEBUG nova.filters [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '4bdbceea-eb47-4fd3-baf5-8cb183574f2d'. Filter results: [('ComputeFilter', None)] {{(pid=51596) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 804.865644] nova-scheduler[51596]: INFO nova.filters [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtering removed all hosts for the request with instance ID '4bdbceea-eb47-4fd3-baf5-8cb183574f2d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 804.865818] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] Filtered [] {{(pid=51596) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 804.865975] nova-scheduler[51596]: DEBUG nova.scheduler.manager [None req-0330af34-b970-401e-9a5f-179962f56644 tempest-ServerDiskConfigTestJSON-370129714 tempest-ServerDiskConfigTestJSON-370129714-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51596) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 816.036170] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.036421] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.036460] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.036678] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.036737] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.036933] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.037260] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Acquiring lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 816.037348] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.037391] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 816.037391] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "74f912f4-43d8-4d2a-9ea1-d6a83c370e35" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.039963] nova-scheduler[51602]: INFO nova.scheduler.host_manager [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 816.040105] nova-scheduler[51596]: INFO nova.scheduler.host_manager [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 816.040147] nova-scheduler[51602]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51602) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 816.040282] nova-scheduler[51596]: DEBUG oslo_concurrency.lockutils [None req-0fbaf330-f296-4375-83d5-90bdf2faf879 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}