[ 493.502124] nova-scheduler[51383]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 494.554006] nova-scheduler[51383]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 494.565589] nova-scheduler[51383]: DEBUG oslo_db.sqlalchemy.engines [None req-86568c55-63d0-4fe9-b5d6-2c0aa40cb53c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51383) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 494.677092] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-86568c55-63d0-4fe9-b5d6-2c0aa40cb53c None None] Found 1 cells: d0ae54bd-e0f8-43cb-838f-391ff3e34a72 {{(pid=51383) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 494.677319] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-86568c55-63d0-4fe9-b5d6-2c0aa40cb53c None None] Found 0 disabled cells: {{(pid=51383) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 494.708090] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-86568c55-63d0-4fe9-b5d6-2c0aa40cb53c None None] START:_async_init_instance_info {{(pid=51383) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 494.710293] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 494.710293] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 494.711300] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 494.716623] nova-scheduler[51383]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51383) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 494.724855] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Total number of compute nodes: 0 {{(pid=51383) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 494.725587] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 494.725587] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 494.725679] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 494.777666] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] Adding 0 instances for hosts 10-20 {{(pid=51383) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 494.777905] nova-scheduler[51383]: DEBUG nova.scheduler.host_manager [None req-5eb02b38-b459-45d0-bba4-43ae6da56849 None None] END:_async_init_instance_info {{(pid=51383) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 494.809596] nova-scheduler[51383]: DEBUG nova.context [None req-86568c55-63d0-4fe9-b5d6-2c0aa40cb53c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d0ae54bd-e0f8-43cb-838f-391ff3e34a72(cell1) {{(pid=51383) load_cells /opt/stack/nova/nova/context.py:464}} [ 494.810454] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 494.810454] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 494.810790] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 494.811098] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 494.811279] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 494.811436] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51383) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 494.819130] nova-scheduler[51383]: DEBUG oslo_db.sqlalchemy.engines [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51383) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 494.824616] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Acquiring lock "singleton_lock" {{(pid=51383) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 494.824778] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Acquired lock "singleton_lock" {{(pid=51383) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 494.825091] nova-scheduler[51383]: DEBUG oslo_concurrency.lockutils [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Releasing lock "singleton_lock" {{(pid=51383) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 494.825255] nova-scheduler[51383]: INFO oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Starting 2 workers [ 494.830587] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Started child 52393 {{(pid=51383) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 494.835017] nova-scheduler[52393]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 494.835217] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Started child 52396 {{(pid=51383) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 494.835561] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Full set of CONF: {{(pid=51383) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 494.835749] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ******************************************************************************** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] Configuration options gathered from: {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] config files: ['/etc/nova/nova.conf'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ================================================================================ {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] allow_resize_to_same_host = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.837281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] arq_binding_timeout = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.837768] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] block_device_allocate_retries = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.837768] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] block_device_allocate_retries_interval = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.837768] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cert = self.pem {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.837965] nova-scheduler[52396]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 494.838110] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute_driver = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.838292] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute_monitors = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.838430] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] config_dir = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.838638] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] config_drive_format = iso9660 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839442] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] config_file = ['/etc/nova/nova.conf'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839442] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] config_source = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839442] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] console_host = devstack {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839442] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] control_exchange = nova {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839731] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cpu_allocation_ratio = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839778] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] daemon = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.839938] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] debug = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.840114] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] default_access_ip_network_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.840303] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] default_availability_zone = nova {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.840494] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] default_ephemeral_format = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841233] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841233] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] default_schedule_zone = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841233] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] disk_allocation_ratio = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841466] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] enable_new_services = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841643] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] enabled_apis = ['osapi_compute'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.841835] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] enabled_ssl_apis = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.842673] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] flat_injected = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.842673] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] force_config_drive = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.842673] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] force_raw_images = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.842673] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] graceful_shutdown_timeout = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.843120] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] heal_instance_info_cache_interval = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.843183] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] host = devstack {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.843394] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] initial_cpu_allocation_ratio = 4.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.843564] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] initial_disk_allocation_ratio = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.843754] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] initial_ram_allocation_ratio = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.844049] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.844222] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_build_timeout = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.844377] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_delete_interval = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845098] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_format = [instance: %(uuid)s] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845098] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_name_template = instance-%08x {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845098] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_usage_audit = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845267] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_usage_audit_period = month {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845358] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845564] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] instances_path = /opt/stack/data/nova/instances {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845673] nova-scheduler[52393]: DEBUG oslo_db.sqlalchemy.engines [None req-cc75ac1d-3b77-49f7-9407-062150272098 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 494.845837] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] internal_service_availability_zone = internal {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.845904] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] key = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.846173] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] live_migration_retry_count = 30 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.846243] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_config_append = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.846421] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.846582] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_dir = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.846766] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847556] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_options = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847556] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_rotate_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847556] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_rotate_interval_type = days {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847556] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] log_rotation_type = none {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847670] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847697] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.847860] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848075] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848216] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848437] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] long_rpc_timeout = 1800 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848614] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_concurrent_builds = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848790] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_concurrent_live_migrations = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.848950] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_concurrent_snapshots = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.849119] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_local_block_devices = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.849292] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_logfile_count = 30 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.849501] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] max_logfile_size_mb = 200 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.849575] nova-scheduler[52396]: DEBUG oslo_db.sqlalchemy.engines [None req-e8e6130f-8f48-487f-ab39-cf14d1b7374b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52396) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 494.849671] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] maximum_instance_delete_attempts = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.849832] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metadata_listen = 0.0.0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.850069] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metadata_listen_port = 8775 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.850247] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metadata_workers = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.850450] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] migrate_max_retries = -1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.850670] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] mkisofs_cmd = genisoimage {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.851348] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] my_block_storage_ip = 10.180.1.21 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.851348] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] my_ip = 10.180.1.21 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.851348] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] network_allocate_retries = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] osapi_compute_listen = 0.0.0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] osapi_compute_listen_port = 8774 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] osapi_compute_unique_server_name_scope = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] osapi_compute_workers = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] password_length = 12 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853123] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] periodic_enable = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853351] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] periodic_fuzzy_delay = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853351] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] pointer_model = usbtablet {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853351] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] preallocate_images = none {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853351] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] publish_errors = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853575] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] pybasedir = /opt/stack/nova {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853575] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ram_allocation_ratio = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853777] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rate_limit_burst = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.853968] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rate_limit_except_level = CRITICAL {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.854193] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rate_limit_interval = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.854400] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reboot_timeout = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.854557] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reclaim_instance_interval = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.854739] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] record = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.854907] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reimage_timeout_per_gb = 20 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.855075] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] report_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.855249] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rescue_timeout = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.855804] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reserved_host_cpus = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.855804] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reserved_host_disk_mb = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.855804] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reserved_host_memory_mb = 512 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856108] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] reserved_huge_pages = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856108] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] resize_confirm_window = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856295] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] resize_fs_using_block_device = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856408] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] resume_guests_state_on_host_boot = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856576] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856750] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] run_external_periodic_tasks = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.856932] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] running_deleted_instance_action = reap {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857095] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857261] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] running_deleted_instance_timeout = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857431] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler_instance_sync_interval = 120 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857587] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_down_time = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857769] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] servicegroup_driver = db {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.857937] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] shelved_offload_time = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.858112] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] shelved_poll_interval = 3600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.858288] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] shutdown_timeout = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.858447] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] source_is_ipv6 = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.858615] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ssl_only = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.858809] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] state_path = /opt/stack/data/nova {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.859018] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] sync_power_state_interval = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] sync_power_state_pool_size = 1000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] syslog_log_facility = LOG_USER {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] tempdir = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] timeout_nbd = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] transport_url = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] update_resources_interval = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_cow_images = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_eventlog = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_journal = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_json = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_rootwrap_daemon = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_stderr = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] use_syslog = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861418] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vcpu_pin_set = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861489] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vif_plugging_is_fatal = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.861647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vif_plugging_timeout = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.862501] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] virt_mkfs = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.862501] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] volume_usage_poll_interval = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.862501] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] watch_log_file = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.862501] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] web = /usr/share/spice-html5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 494.862678] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_concurrency.disable_process_locking = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.862913] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863340] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.auth_strategy = keystone {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863340] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.compute_link_prefix = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863447] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863619] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.dhcp_domain = novalocal {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863795] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.enable_instance_password = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.863999] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.glance_link_prefix = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.864148] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.864322] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.864499] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.instance_list_per_project_cells = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.864655] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.list_records_by_skipping_down_cells = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.864847] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.local_metadata_per_cell = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865016] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.max_limit = 1000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865496] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.metadata_cache_expiration = 15 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865496] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.neutron_default_tenant_id = default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865589] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.use_forwarded_for = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865698] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.use_neutron_default_nets = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.865867] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866043] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866434] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866434] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_dynamic_ssl_certfile = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866578] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_dynamic_targets = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866735] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_jsonfile_path = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.866918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api.vendordata_providers = ['StaticJSON'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.867176] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.backend = dogpile.cache.memcached {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.867363] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.backend_argument = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.867554] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.config_prefix = cache.oslo {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.867725] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.dead_timeout = 60.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.867892] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.debug_cache_backend = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868376] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.enable_retry_client = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868376] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.enable_socket_keepalive = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868496] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.enabled = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868590] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.expiration_time = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868787] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.hashclient_retry_attempts = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.868991] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.hashclient_retry_delay = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869162] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_dead_retry = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869270] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_password = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869450] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869620] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869782] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_pool_maxsize = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.869942] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.870115] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_sasl_enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.870292] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.870504] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_socket_timeout = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.870689] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.memcache_username = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.870886] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.proxies = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871065] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.retry_attempts = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871235] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.retry_delay = 0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871410] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.socket_keepalive_count = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871574] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.socket_keepalive_idle = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871739] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.socket_keepalive_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.871891] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.tls_allowed_ciphers = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.872053] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.tls_cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.872339] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.tls_certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.872391] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.tls_enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.872578] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cache.tls_keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.872731] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873115] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.auth_type = password {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873115] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873277] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.catalog_info = volumev3::publicURL {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873457] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873769] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.873807] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.cross_az_attach = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874104] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.debug = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874185] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.endpoint_template = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874310] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.http_retries = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874473] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874649] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874700] nova-scheduler[52396]: DEBUG nova.service [None req-e8e6130f-8f48-487f-ab39-cf14d1b7374b None None] Creating RPC server for service scheduler {{(pid=52396) start /opt/stack/nova/nova/service.py:182}} [ 494.874825] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.os_region_name = RegionOne {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.874985] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875156] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cinder.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875329] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875489] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.cpu_dedicated_set = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875645] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.cpu_shared_set = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875809] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.image_type_exclude_list = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.875969] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.876140] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.876301] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.876463] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877191] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877191] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.resource_provider_association_refresh = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877191] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.shutdown_retry_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877191] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877380] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] conductor.workers = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877465] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] console.allowed_origins = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877623] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] console.ssl_ciphers = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877793] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] console.ssl_minimum_version = default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.877968] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] consoleauth.token_ttl = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.878174] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.878330] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.878491] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880647] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880886] nova-scheduler[52393]: DEBUG nova.service [None req-cc75ac1d-3b77-49f7-9407-062150272098 None None] Creating RPC server for service scheduler {{(pid=52393) start /opt/stack/nova/nova/service.py:182}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.service_type = accelerator {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.880918] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881099] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881099] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881099] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] cyborg.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881576] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.backend = sqlalchemy {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881576] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.connection = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881630] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.connection_debug = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881799] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.connection_parameters = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.881937] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.connection_recycle_time = 3600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882110] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.connection_trace = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882280] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.db_inc_retry_interval = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882554] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.db_max_retries = 20 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882607] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.db_max_retry_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882885] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.db_retry_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.882935] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.max_overflow = 50 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883065] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.max_pool_size = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883236] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.max_retries = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883403] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.mysql_enable_ndb = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883573] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883733] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.mysql_wsrep_sync_wait = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.883892] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.pool_timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884066] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.retry_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884226] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.slave_connection = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884390] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.sqlite_synchronous = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884579] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] database.use_db_reconnect = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884732] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.backend = sqlalchemy {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.884926] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.connection = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885105] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.connection_debug = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885603] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.connection_parameters = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885603] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.connection_recycle_time = 3600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885603] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.connection_trace = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885774] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.db_inc_retry_interval = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.885891] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.db_max_retries = 20 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886065] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.db_max_retry_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886226] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.db_retry_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886391] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.max_overflow = 50 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886553] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.max_pool_size = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886769] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.max_retries = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.886875] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.mysql_enable_ndb = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.pool_timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.retry_interval = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.slave_connection = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.887885] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] api_database.sqlite_synchronous = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888027] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] devices.enabled_mdev_types = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888270] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888469] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ephemeral_storage_encryption.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888551] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888735] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.api_servers = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.888979] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.889078] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.889273] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.889698] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.889698] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.889777] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.debug = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890049] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.default_trusted_certificate_ids = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890049] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.enable_certificate_validation = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890203] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.enable_rbd_download = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890340] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890510] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890676] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.890832] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.num_retries = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.rbd_ceph_conf = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.rbd_connect_timeout = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.rbd_pool = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891879] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.rbd_user = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.891970] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892105] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892296] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.service_type = image {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892578] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892632] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892838] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.892949] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893188] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893257] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.verify_glance_signatures = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893612] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] glance.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893612] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] guestfs.debug = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893765] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.config_drive_cdrom = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.893924] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.config_drive_inject_password = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.894279] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.894279] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.894401] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.enable_remotefx = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.894573] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.instances_path_share = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895165] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.iscsi_initiator_list = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895165] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.limit_cpu_features = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895165] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895279] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895425] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895582] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895756] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.895892] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.use_multipath_io = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.896062] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.896224] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.896373] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.vswitch_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.896532] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.896780] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] mks.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.897370] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.897626] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.manager_interval = 2400 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.897768] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.precache_concurrency = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.897945] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.remove_unused_base_images = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.898202] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.898281] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.898581] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] image_cache.subdirectory_name = _base {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.898676] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.api_max_retries = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899062] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.api_retry_interval = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899062] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899170] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.auth_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899289] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899737] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899737] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899837] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.899961] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900161] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900277] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900394] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900569] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900712] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.900850] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.partition_key = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901020] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.peer_list = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901594] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901594] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.serial_console_state_timeout = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901594] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901721] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.service_type = baremetal {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901781] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.901941] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.902113] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.902268] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.902447] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.902611] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ironic.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.902819] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903031] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] key_manager.fixed_key = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903352] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903412] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.barbican_api_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903582] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.barbican_endpoint = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903775] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.barbican_endpoint_type = public {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.903952] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.barbican_region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904141] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904318] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904477] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904634] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904789] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.904952] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.number_of_retries = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905129] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.retry_delay = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905308] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.send_service_user_token = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905448] nova-scheduler[52393]: DEBUG nova.service [None req-cc75ac1d-3b77-49f7-9407-062150272098 None None] Join ServiceGroup membership for this service scheduler {{(pid=52393) start /opt/stack/nova/nova/service.py:199}} [ 494.905485] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905639] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905698] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-cc75ac1d-3b77-49f7-9407-062150272098 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52393) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 494.905801] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.verify_ssl = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.905956] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican.verify_ssl_path = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906150] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906306] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.auth_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906462] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906621] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906781] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.906938] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907104] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907277] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907472] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] barbican_service_user.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907678] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.approle_role_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907840] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.approle_secret_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.907996] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.908163] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.908327] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.908503] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.908792] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.908866] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.kv_mountpoint = secret {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909622] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.kv_version = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909622] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.namespace = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909622] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.root_token_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909622] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909736] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.ssl_ca_crt_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909906] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.909993] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.use_ssl = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910415] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910415] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910514] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910638] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910843] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.910966] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911131] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911308] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911468] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911620] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911975] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.911975] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912125] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912267] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.service_type = identity {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912432] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912684] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912740] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.912886] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.913029] nova-scheduler[52396]: DEBUG nova.service [None req-e8e6130f-8f48-487f-ab39-cf14d1b7374b None None] Join ServiceGroup membership for this service scheduler {{(pid=52396) start /opt/stack/nova/nova/service.py:199}} [ 494.913078] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.913229] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] keystone.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.913263] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-e8e6130f-8f48-487f-ab39-cf14d1b7374b None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=52396) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 494.913462] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.connection_uri = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.913685] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_mode = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.913799] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_model_extra_flags = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914047] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_models = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914128] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_power_governor_high = performance {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914299] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914457] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_power_management = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914650] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914837] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.device_detach_attempts = 8 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.914993] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.device_detach_timeout = 20 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915167] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.disk_cachemodes = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915323] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.disk_prefix = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915487] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.enabled_perf_events = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915645] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.file_backed_memory = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915803] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.gid_maps = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.915955] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.hw_disk_discard = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916119] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.hw_machine_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916284] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_rbd_ceph_conf = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916446] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916626] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916795] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_rbd_glance_store_name = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.916962] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_rbd_pool = rbd {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.917138] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_type = default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.917302] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.images_volume_group = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.917495] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.inject_key = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.917666] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.inject_partition = -2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.917830] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.inject_password = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918021] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.iscsi_iface = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918183] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.iser_use_multipath = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918342] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918505] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918664] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_downtime = 500 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918822] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.918980] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.919149] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_inbound_addr = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.919307] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.919665] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.919665] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_scheme = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.919841] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_timeout_action = abort {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920172] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_tunnelled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920172] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_uri = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920335] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.live_migration_with_native_tls = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920493] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.max_queues = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920658] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.920814] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.nfs_mount_options = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921068] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921237] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921403] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_iser_scan_tries = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921591] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921760] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.921901] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_pcie_ports = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922051] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.num_volume_scan_tries = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922220] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.pmem_namespaces = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922396] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.quobyte_client_cfg = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922638] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922800] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rbd_connect_timeout = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.922964] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923133] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923285] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rbd_secret_uuid = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923438] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rbd_user = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923604] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923774] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.923931] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rescue_image_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924094] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rescue_kernel_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924270] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rescue_ramdisk_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924427] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rng_dev_path = /dev/urandom {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924584] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.rx_queue_size = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924750] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.smbfs_mount_options = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.924974] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.925150] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.snapshot_compression = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.925307] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.snapshot_image_format = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.925521] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.925688] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.sparse_logical_volumes = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.925852] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.swtpm_enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.swtpm_group = tss {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926188] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.swtpm_user = tss {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926352] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.sysinfo_serial = unique {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926510] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.tx_queue_size = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926956] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.uid_maps = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.926956] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.use_virtio_for_bridges = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927189] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.virt_type = kvm {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927220] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.volume_clear = zero {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927675] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.volume_clear_size = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927675] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.volume_use_multipath = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927735] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_cache_path = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.927902] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928080] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_mount_group = qemu {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928244] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_mount_opts = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928413] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928640] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928808] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.vzstorage_mount_user = stack {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.928974] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.929201] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.929325] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.auth_type = password {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.929513] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.929699] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.929870] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930058] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930222] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930401] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.default_floating_pool = public {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930581] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930742] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.extension_sync_interval = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.930900] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.http_retries = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931069] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931228] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931382] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931548] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931705] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.931905] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.ovs_bridge = br-int {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932036] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.physnets = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932204] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.region_name = RegionOne {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932369] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.service_metadata_proxy = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932552] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932732] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.service_type = network {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.932892] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933057] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933217] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933368] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933548] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933709] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] neutron.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.933945] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] notifications.bdms_in_notifications = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.934152] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] notifications.default_level = INFO {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.934329] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] notifications.notification_format = unversioned {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.934490] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] notifications.notify_on_state_change = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.934663] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.934845] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] pci.alias = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] pci.device_spec = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] pci.report_in_placement = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.auth_type = password {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.auth_url = http://10.180.1.21/identity {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936026] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936261] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936292] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936437] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.936592] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.default_domain_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937114] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.default_domain_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937114] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.domain_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937114] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.domain_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937292] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937387] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937672] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937744] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.937895] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938079] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.password = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938240] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.project_domain_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938409] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.project_domain_name = Default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938572] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.project_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938741] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.project_name = service {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.938907] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.region_name = RegionOne {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939072] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939239] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.service_type = placement {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939424] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939585] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939744] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.939916] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.system_scope = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940087] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940243] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.trust_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940402] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.user_domain_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940567] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.user_domain_name = Default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940744] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.user_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.940915] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.username = placement {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941110] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941272] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] placement.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941464] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.cores = 20 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941624] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.count_usage_from_placement = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941793] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.941963] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.injected_file_content_bytes = 10240 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942134] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.injected_file_path_length = 255 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942295] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.injected_files = 5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942458] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.instances = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942617] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.key_pairs = 100 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942774] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.metadata_items = 128 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.942935] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.ram = 51200 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.943104] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.recheck_quota = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.943266] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.server_group_members = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.943425] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] quota.server_groups = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.943589] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rdp.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.943907] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.944137] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.944328] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.944507] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.image_metadata_prefilter = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.944672] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.944830] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.max_attempts = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945080] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.max_placement_results = 1000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945260] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945446] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.query_placement_for_availability_zone = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945626] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945802] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.945995] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] scheduler.workers = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.946200] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.946368] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.946570] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.946738] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.946899] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.947070] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.947252] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.947509] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.947690] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.host_subset_size = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.947853] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948024] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948188] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.isolated_hosts = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948368] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.isolated_images = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948529] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948702] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.948857] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.pci_in_placement = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949022] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949181] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949341] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949523] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949689] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.949920] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.950096] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.track_instance_changes = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.950272] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.950474] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metrics.required = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.950655] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metrics.weight_multiplier = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.950816] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metrics.weight_of_unavailable = -10000.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951217] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] metrics.weight_setting = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951331] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951751] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951751] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.port_range = 10000:20000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951868] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.951996] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.952196] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] serial_console.serialproxy_port = 6083 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.952374] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.952569] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.auth_type = password {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.952728] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.952884] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953058] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953220] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953379] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953549] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.send_service_user_token = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953710] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.953870] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] service_user.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.954077] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.agent_enabled = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.954259] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.954582] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.954799] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.html5proxy_host = 0.0.0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.954969] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.html5proxy_port = 6082 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.955144] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.image_compression = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.955324] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.jpeg_compression = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.955484] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.playback_compression = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.955680] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.server_listen = 127.0.0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.955880] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956454] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.streaming_mode = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956454] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] spice.zlib_compression = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956454] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] upgrade_levels.baseapi = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956571] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] upgrade_levels.cert = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956668] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] upgrade_levels.compute = auto {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.956817] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] upgrade_levels.conductor = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.957017] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] upgrade_levels.scheduler = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.957237] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.957442] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.957663] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.957838] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958009] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958174] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958329] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958489] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958646] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vendordata_dynamic_auth.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.958855] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.api_retry_count = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959023] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.ca_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959204] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.cache_prefix = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959360] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.cluster_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959548] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.connection_pool_size = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959708] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.console_delay_seconds = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.959865] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.datastore_regex = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960029] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.host_ip = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960192] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.host_password = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960353] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.host_port = 443 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960558] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.host_username = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960730] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.960887] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.integration_bridge = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961060] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.maximum_objects = 100 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961217] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.pbm_default_policy = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961375] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.pbm_enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961582] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.pbm_wsdl_location = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961690] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961922] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.serial_port_proxy_uri = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.961987] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.serial_port_service_uri = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.962166] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.task_poll_interval = 0.5 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.962323] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.use_linked_clone = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.962487] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.vnc_keymap = en-us {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.962649] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.vnc_port = 5900 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.962861] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vmware.vnc_port_total = 10000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.963095] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.auth_schemes = ['none'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.963268] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.enabled = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.963585] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.963769] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.963938] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.novncproxy_port = 6080 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964127] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.server_listen = 127.0.0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964298] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964457] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.vencrypt_ca_certs = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964613] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.vencrypt_client_cert = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964765] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] vnc.vencrypt_client_key = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.964961] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965137] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965302] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.disable_group_policy_check_upcall = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965481] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965642] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.disable_rootwrap = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965798] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.enable_numa_live_migration = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.965961] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966130] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966285] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966439] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.libvirt_disable_apic = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966594] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966749] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.966907] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967073] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967232] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967393] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967595] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967760] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.967916] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968095] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968277] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968549] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.client_socket_timeout = 900 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968587] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.default_pool_size = 1000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968877] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.keep_alive = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.968913] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.max_header_line = 16384 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969070] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.secure_proxy_ssl_header = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969231] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.ssl_ca_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969397] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.ssl_cert_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969567] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.ssl_key_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969732] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.tcp_keepidle = 600 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.969914] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.970093] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] zvm.ca_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.970257] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] zvm.cloud_connector_url = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.970515] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.970737] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] zvm.reachable_timeout = 300 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.971032] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.971213] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972032] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972032] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972032] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972032] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.enforce_new_defaults = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.enforce_scope = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972275] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.policy_default_rule = default {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972434] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972609] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.policy_file = policy.yaml {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972800] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.972962] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.973126] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.973285] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.973439] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.973630] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.973806] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974027] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.connection_string = messaging:// {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974199] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.enabled = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974382] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.es_doc_type = notification {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974558] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.es_scroll_size = 10000 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974726] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.es_scroll_time = 2m {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.974883] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.filter_error_trace = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975056] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.hmac_keys = SECRET_KEY {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975225] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.sentinel_service_name = mymaster {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975385] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.socket_timeout = 0.1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975545] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] profiler.trace_sqlalchemy = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975714] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] remote_debug.host = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.975887] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] remote_debug.port = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976079] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976767] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976767] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976767] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976767] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.976972] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977098] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977167] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977322] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977909] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977909] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.977909] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978085] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978138] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978299] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978472] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978631] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978790] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.978958] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979130] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979289] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979476] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979636] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979797] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.979962] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.980144] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.980313] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.980499] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.980662] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.980834] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981007] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981218] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981382] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_notifications.retry = -1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981583] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981767] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.981955] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.auth_section = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982695] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.auth_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982695] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.cafile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982695] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.certfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982695] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.collect_timing = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982695] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.connect_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.982946] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.connect_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983076] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.endpoint_id = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983623] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.endpoint_override = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983623] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.insecure = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983623] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.keyfile = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983623] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.max_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983885] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.min_version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.983939] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.region_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984067] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.service_name = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984219] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.service_type = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984375] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.split_loggers = False {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984526] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.status_code_retries = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984678] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.status_code_retry_delay = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984830] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.timeout = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.984983] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.valid_interfaces = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.985148] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_limit.version = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.985334] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_reports.file_event_handler = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.985493] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.985645] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] oslo_reports.log_dir = None {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 494.985820] nova-scheduler[51383]: DEBUG oslo_service.service [None req-91c4c1fb-fce7-45de-ae83-e35e8f22a1b7 None None] ******************************************************************************** {{(pid=51383) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 624.301677] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Starting to schedule for instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 624.303818] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 624.304746] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.305328] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.305685] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.305960] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 624.998841] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.999432] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.002541] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.007048] nova-scheduler[52393]: DEBUG oslo_db.sqlalchemy.engines [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52393) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 625.024167] nova-scheduler[52393]: DEBUG oslo_db.sqlalchemy.engines [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Parent process 51383 forked (52393) with an open database connection, which is being discarded and recreated. {{(pid=52393) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 625.037267] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.037582] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.037701] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.043210] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.043558] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.045071] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:33:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=0) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 625.048091] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 625.048091] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 625.048091] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with instances: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 625.050818] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.005s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 625.050818] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 625.050818] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.050818] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.050818] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.052641] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.052641] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.052641] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.052641] nova-scheduler[52393]: DEBUG nova.filters [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 625.052641] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 625.052856] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 625.052856] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Attempting to claim resources in the placement API for instance 148f525a-f3c0-40f2-8527-9607cd5e581b {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 625.134073] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] [instance: 148f525a-f3c0-40f2-8527-9607cd5e581b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 625.134435] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 625.134648] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 625.134854] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4e64849-96c2-44a0-ac6a-3831aeb91407 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.157117] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Starting to schedule for instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.157958] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.158294] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.159161] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.160287] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.160853] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.233542] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.234629] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.237167] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.241870] nova-scheduler[52396]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=52396) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 627.258994] nova-scheduler[52396]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Parent process 51383 forked (52396) with an open database connection, which is being discarded and recreated. {{(pid=52396) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 627.267442] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.267737] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.267936] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.271219] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.271481] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.272673] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='0',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_task_None='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:12Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=1) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.273226] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.273441] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.273639] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.273839] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.274271] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.274709] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.275009] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.275653] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.275653] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.275763] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.275980] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.276379] nova-scheduler[52396]: DEBUG nova.filters [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.276447] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.276747] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 627.277433] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Attempting to claim resources in the placement API for instance 30c40353-01fe-407d-8d56-0f6c166d12e3 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 627.365364] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] [instance: 30c40353-01fe-407d-8d56-0f6c166d12e3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 627.365724] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.366907] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.366907] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a6b49098-f299-45d3-806a-7c484bdafc54 tempest-TenantUsagesTestJSON-830737900 tempest-TenantUsagesTestJSON-830737900-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 629.124432] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Starting to schedule for instances: ['130961ce-1e22-4320-abc9-30fc5f652be3'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 629.126154] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 629.126154] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 629.126154] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 629.126154] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 629.127821] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 629.184395] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 629.184540] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 629.184781] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 629.194556] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 629.195946] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 629.195946] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 629.200531] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 629.200531] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 629.200708] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:14Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 629.200708] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 629.200810] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 629.200810] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 629.200810] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 629.201057] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 629.201813] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.202122] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.202451] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.202668] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.202882] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.203135] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.203339] nova-scheduler[52393]: DEBUG nova.filters [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 629.203542] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 629.203750] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 629.207243] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Attempting to claim resources in the placement API for instance 130961ce-1e22-4320-abc9-30fc5f652be3 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 629.283518] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] [instance: 130961ce-1e22-4320-abc9-30fc5f652be3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 629.283784] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 629.285383] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 629.285383] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-69f6c840-b833-4649-8b5d-d7616824cc4a tempest-FloatingIPsAssociationTestJSON-930375277 tempest-FloatingIPsAssociationTestJSON-930375277-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.949774] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Starting to schedule for instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 630.950482] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 630.951355] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.953093] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.953773] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.953773] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 631.001083] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.001319] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.001481] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.010027] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.010548] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.010737] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.013238] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.013448] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.013825] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=3) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 631.014130] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 631.014305] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 631.015196] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 631.015406] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.015751] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 631.016018] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.016166] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.016364] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.016920] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.016920] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.016920] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.017078] nova-scheduler[52396]: DEBUG nova.filters [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.017403] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 631.017403] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 631.017536] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Attempting to claim resources in the placement API for instance 4540cd82-440c-41e3-8bfa-b384da6fc964 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 631.093864] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] [instance: 4540cd82-440c-41e3-8bfa-b384da6fc964] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 631.094461] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.095148] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.095407] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c4a6f749-208e-4e3a-8d68-f35f38a5ab33 tempest-ServerDiagnosticsNegativeTest-285185855 tempest-ServerDiagnosticsNegativeTest-285185855-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.583190] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Starting to schedule for instances: ['a45f24ab-afe1-4ffd-a917-11b68a0b29ec'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 631.583530] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 631.583916] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.584134] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.584350] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 631.584538] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 631.646709] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.647890] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.649551] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.663250] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.664017] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.665336] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.667153] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.667486] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.668312] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='0',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:18Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=4) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 631.668805] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 631.669192] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 631.669578] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 631.673019] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 631.673019] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 631.673019] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673019] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673019] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673366] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673366] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673366] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673366] nova-scheduler[52393]: DEBUG nova.filters [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 631.673366] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 631.673497] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 631.673497] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Attempting to claim resources in the placement API for instance a45f24ab-afe1-4ffd-a917-11b68a0b29ec {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 631.735650] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] [instance: a45f24ab-afe1-4ffd-a917-11b68a0b29ec] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 631.735650] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 631.735650] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 631.736151] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-24f4a051-59a2-4c7d-a10e-f5dc554a9e1d tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.525732] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Starting to schedule for instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 633.526156] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 633.526256] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.526667] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.526667] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 633.527013] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 633.579499] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.579932] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.580169] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.590849] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.592339] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.592339] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.595911] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.595911] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.597253] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='0',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='5',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:19Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 633.598671] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 633.598671] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 633.598671] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 633.598977] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 633.598977] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 633.598977] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.598977] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.599124] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.599383] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.599442] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.599673] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.599729] nova-scheduler[52396]: DEBUG nova.filters [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 633.601615] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 633.601615] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 633.601615] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Attempting to claim resources in the placement API for instance 65bf8cf0-825c-42d8-bd78-62a6277d29d7 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 633.657280] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] [instance: 65bf8cf0-825c-42d8-bd78-62a6277d29d7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 633.657475] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 633.657916] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 633.657916] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-86d4b597-3073-4e37-8c9d-e9ea1f70e56e tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.117144] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Starting to schedule for instances: ['cc1d534d-6a43-4575-895d-c3bef84d772e'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 634.117446] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 634.117685] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.117852] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.120996] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 634.120996] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 634.173978] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.173978] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.173978] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.183335] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.183535] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.183911] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.189319] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.189626] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.190327] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='0',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:20Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=6) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 634.190441] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 634.190622] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 634.190843] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 634.190947] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 634.191237] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 634.191452] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.191637] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.191838] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.193066] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.193827] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.193827] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.193827] nova-scheduler[52393]: DEBUG nova.filters [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 634.193827] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 634.194208] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 634.194427] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Attempting to claim resources in the placement API for instance cc1d534d-6a43-4575-895d-c3bef84d772e {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 634.272890] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] [instance: cc1d534d-6a43-4575-895d-c3bef84d772e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 634.272890] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 634.273045] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 634.273289] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b807944-0c8c-4945-a94a-e83d6972ee79 tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.931632] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Starting to schedule for instances: ['e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 646.932634] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 646.932840] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.933627] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.933627] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.933627] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 646.978392] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.979262] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.979710] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.988662] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.988877] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.989371] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.992796] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.993269] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.993731] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_spawning='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:26Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 646.994081] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 646.994364] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 646.994579] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 646.994801] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.995132] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 646.995399] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.995640] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.995895] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.996295] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.996545] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.996753] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.996930] nova-scheduler[52396]: DEBUG nova.filters [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 646.997106] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 646.997282] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 646.997485] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Attempting to claim resources in the placement API for instance e4f0342a-4169-40aa-b234-a2e2340d5b05 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 647.141604] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] [instance: e4f0342a-4169-40aa-b234-a2e2340d5b05] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 647.141985] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.142270] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.142482] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-851dd7a4-ac55-40e7-8739-5848d9d1a183 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.454117] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Starting to schedule for instances: ['5ad3e093-b7cb-4fe8-b533-506e1f3a92ea'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 647.454687] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 647.454687] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.457113] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.457113] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.457113] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 647.509491] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.510234] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.510234] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.517458] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.517458] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.517597] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.521118] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.523028] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.523028] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_spawning='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:26Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 647.523220] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 647.523462] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 647.523536] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 647.523694] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.523947] nova-scheduler[52393]: DEBUG nova.filters [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 647.524174] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 60.38718 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 647.525724] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 647.525724] nova-scheduler[52393]: INFO nova.filters [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filter ComputeFilter returned 0 hosts [ 647.525724] nova-scheduler[52393]: DEBUG nova.filters [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtering removed all hosts for the request with instance ID '5ad3e093-b7cb-4fe8-b533-506e1f3a92ea'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 647.525724] nova-scheduler[52393]: INFO nova.filters [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtering removed all hosts for the request with instance ID '5ad3e093-b7cb-4fe8-b533-506e1f3a92ea'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 647.525724] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 647.526079] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2b2ce50d-585e-4321-bbe7-49c554f15ba5 tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 649.215902] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting to schedule for instances: ['b2a0923f-6583-4c4d-9601-5cebd8191c51'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 649.217050] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 649.217213] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.218288] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.218288] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 649.218288] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 649.276934] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.277219] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.277388] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.287482] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.287761] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.287885] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.295158] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 649.295158] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 649.295394] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 649.295695] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 649.296517] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 649.296517] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 649.296683] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 649.296683] nova-scheduler[52396]: DEBUG nova.filters [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 649.296683] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 62.159705 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 649.296872] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 649.298929] nova-scheduler[52396]: INFO nova.filters [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filter ComputeFilter returned 0 hosts [ 649.298929] nova-scheduler[52396]: DEBUG nova.filters [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'b2a0923f-6583-4c4d-9601-5cebd8191c51'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 649.298929] nova-scheduler[52396]: INFO nova.filters [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'b2a0923f-6583-4c4d-9601-5cebd8191c51'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 649.298929] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 649.298929] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-67a57505-9e51-428d-9dba-0f99d54e687b tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 650.901675] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Starting to schedule for instances: ['7eb2e403-767f-4253-8173-d1d1e50a2a7b'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 650.901901] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 650.902345] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.902345] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.902462] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.902596] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 650.958475] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.958686] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.958839] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.966390] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.966611] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.966778] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.969069] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.969346] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.969817] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 650.970173] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 650.970319] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 650.970670] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 650.970670] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.970956] nova-scheduler[52393]: DEBUG nova.filters [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 650.971113] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 63.834151 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 650.971274] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 650.971432] nova-scheduler[52393]: INFO nova.filters [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filter ComputeFilter returned 0 hosts [ 650.972020] nova-scheduler[52393]: DEBUG nova.filters [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtering removed all hosts for the request with instance ID '7eb2e403-767f-4253-8173-d1d1e50a2a7b'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 650.972020] nova-scheduler[52393]: INFO nova.filters [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtering removed all hosts for the request with instance ID '7eb2e403-767f-4253-8173-d1d1e50a2a7b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 650.972020] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 650.972210] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4dc4536c-b7ad-457a-b343-5791b908b95b tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 651.937635] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting to schedule for instances: ['d63c231c-dd64-41b2-82d7-e1b190d37582'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 651.938247] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 651.938380] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.938614] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.938778] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 651.938961] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 651.989433] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 651.991759] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 651.991759] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.000757] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.001135] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.001829] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.004660] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.005067] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.005585] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 652.006081] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 652.008017] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 652.008017] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 652.008170] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.008170] nova-scheduler[52396]: DEBUG nova.filters [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 652.008170] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 64.870247 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 652.008170] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 652.008170] nova-scheduler[52396]: INFO nova.filters [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filter ComputeFilter returned 0 hosts [ 652.008352] nova-scheduler[52396]: DEBUG nova.filters [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'd63c231c-dd64-41b2-82d7-e1b190d37582'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 652.008352] nova-scheduler[52396]: INFO nova.filters [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'd63c231c-dd64-41b2-82d7-e1b190d37582'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 652.008352] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 652.009014] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2896a89d-3b19-4e62-9572-11111bf832be tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 653.722596] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Starting to schedule for instances: ['de5100d9-3a8d-4bc9-a9fa-7bf6f6579085'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 653.724708] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 653.724708] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.724708] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.724708] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.724708] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 653.794662] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.795165] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.796159] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.809629] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.809918] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.810869] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.812712] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.812961] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.813400] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 653.813799] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 653.814116] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 653.814216] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 653.814416] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.814707] nova-scheduler[52393]: DEBUG nova.filters [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 653.814956] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 66.677996 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 653.815163] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 653.815978] nova-scheduler[52393]: INFO nova.filters [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filter ComputeFilter returned 0 hosts [ 653.815978] nova-scheduler[52393]: DEBUG nova.filters [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtering removed all hosts for the request with instance ID 'de5100d9-3a8d-4bc9-a9fa-7bf6f6579085'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 653.815978] nova-scheduler[52393]: INFO nova.filters [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtering removed all hosts for the request with instance ID 'de5100d9-3a8d-4bc9-a9fa-7bf6f6579085'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 653.815978] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 653.815978] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfdd3304-7b0e-4d9a-8d02-7ebec4019725 tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 654.553155] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Starting to schedule for instances: ['b7c0fe3d-aa58-4004-9d58-9e1987bec636'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 654.553155] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 654.553372] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.553689] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.553905] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.554103] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 654.588427] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Starting to schedule for instances: ['5df7a407-d68f-4bbe-8c67-4af1b9309073'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 654.588909] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 654.589574] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.590441] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.590785] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 654.591090] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 654.607871] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.608126] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.608655] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.618294] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.619768] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.619768] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.624021] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.624021] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.624203] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 654.624203] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 654.624315] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 654.624315] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 654.624428] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.624428] nova-scheduler[52396]: DEBUG nova.filters [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 654.624428] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 67.486872 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 654.624428] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 654.624793] nova-scheduler[52396]: INFO nova.filters [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Filter ComputeFilter returned 0 hosts [ 654.625067] nova-scheduler[52396]: DEBUG nova.filters [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Filtering removed all hosts for the request with instance ID 'b7c0fe3d-aa58-4004-9d58-9e1987bec636'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 654.625329] nova-scheduler[52396]: INFO nova.filters [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Filtering removed all hosts for the request with instance ID 'b7c0fe3d-aa58-4004-9d58-9e1987bec636'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 654.625577] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 654.625833] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0cd6098a-a5ae-42d1-b645-d40635f008f0 tempest-VolumesAssistedSnapshotsTest-1395115177 tempest-VolumesAssistedSnapshotsTest-1395115177-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 654.654692] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.655790] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.655790] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.664615] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.664615] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.664615] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.668351] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 654.669101] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 654.669357] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 654.669357] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 654.669551] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 654.669672] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 654.671558] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 654.671695] nova-scheduler[52393]: DEBUG nova.filters [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 654.671886] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 67.534933 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 654.672430] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 654.672430] nova-scheduler[52393]: INFO nova.filters [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filter ComputeFilter returned 0 hosts [ 654.672543] nova-scheduler[52393]: DEBUG nova.filters [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtering removed all hosts for the request with instance ID '5df7a407-d68f-4bbe-8c67-4af1b9309073'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 654.672620] nova-scheduler[52393]: INFO nova.filters [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtering removed all hosts for the request with instance ID '5df7a407-d68f-4bbe-8c67-4af1b9309073'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 654.672799] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 654.672962] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-462c9a7f-051b-4b01-a024-31b4f6ced4da tempest-ServersAdminTestJSON-1829072578 tempest-ServersAdminTestJSON-1829072578-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 655.178642] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting to schedule for instances: ['f589f0da-de40-408d-aa9d-9086efeb9213'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 655.181116] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 655.181116] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.181116] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.181116] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.181116] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 655.222937] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.223690] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.224010] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.232304] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.232609] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.232851] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.235479] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.235744] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.236178] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 655.236549] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 655.236787] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 655.237082] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 655.237415] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.237821] nova-scheduler[52396]: DEBUG nova.filters [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 655.238299] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 68.101139 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 655.238551] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 655.238774] nova-scheduler[52396]: INFO nova.filters [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filter ComputeFilter returned 0 hosts [ 655.239105] nova-scheduler[52396]: DEBUG nova.filters [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'f589f0da-de40-408d-aa9d-9086efeb9213'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 655.239834] nova-scheduler[52396]: INFO nova.filters [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtering removed all hosts for the request with instance ID 'f589f0da-de40-408d-aa9d-9086efeb9213'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 655.240075] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 655.240293] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-21213ec1-b30e-4242-9731-976f2de4a0fe tempest-ListServerFiltersTestJSON-310435375 tempest-ListServerFiltersTestJSON-310435375-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 656.379653] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Starting to schedule for instances: ['f0db0f1d-edb1-495d-80bc-73f75501f3c3'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 656.381300] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 656.381300] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.381855] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.381855] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.382835] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 656.441368] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.441696] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.441823] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.449320] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.449577] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.449753] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.454753] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.454961] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.455377] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 656.455670] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 656.455837] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 656.455994] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 656.456173] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.456443] nova-scheduler[52393]: DEBUG nova.filters [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 656.456663] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 69.319717 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 656.456817] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 656.456968] nova-scheduler[52393]: INFO nova.filters [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filter ComputeFilter returned 0 hosts [ 656.457128] nova-scheduler[52393]: DEBUG nova.filters [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtering removed all hosts for the request with instance ID 'f0db0f1d-edb1-495d-80bc-73f75501f3c3'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 656.457264] nova-scheduler[52393]: INFO nova.filters [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtering removed all hosts for the request with instance ID 'f0db0f1d-edb1-495d-80bc-73f75501f3c3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 656.457430] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 656.457797] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d5a95e07-3f67-401e-83f0-725a0f63624f tempest-ListImageFiltersTestJSON-941715649 tempest-ListImageFiltersTestJSON-941715649-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 659.652692] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Starting to schedule for instances: ['b052cfbc-0641-4ad2-97a8-42cf1cd95eaf'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 659.652979] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 659.653152] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.653388] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.654028] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.654028] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 659.709585] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.709873] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.710063] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.717406] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.717683] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.717916] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.720429] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.720748] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.721227] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 659.721703] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 659.721924] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 659.722128] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 659.722310] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.722653] nova-scheduler[52396]: DEBUG nova.filters [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 659.723238] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 72.585923 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 659.723238] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 659.723496] nova-scheduler[52396]: INFO nova.filters [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filter ComputeFilter returned 0 hosts [ 659.723681] nova-scheduler[52396]: DEBUG nova.filters [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtering removed all hosts for the request with instance ID 'b052cfbc-0641-4ad2-97a8-42cf1cd95eaf'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 659.723828] nova-scheduler[52396]: INFO nova.filters [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtering removed all hosts for the request with instance ID 'b052cfbc-0641-4ad2-97a8-42cf1cd95eaf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 659.724335] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 659.728947] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ed02539b-d856-4d36-b0b2-4d9ce0b4f90e tempest-VolumesAdminNegativeTest-957263333 tempest-VolumesAdminNegativeTest-957263333-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.211184] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Starting to schedule for instances: ['fc059271-47e3-4506-8c8d-fa7c9ed46f47'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.213849] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.214115] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.214331] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.214568] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.214815] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.275502] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.275773] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.275959] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.282316] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.282531] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.282850] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.286085] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.286284] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.286998] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.286998] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.287168] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.287264] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.287438] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.287702] nova-scheduler[52393]: DEBUG nova.filters [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.287944] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 73.150963 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.288087] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 660.288247] nova-scheduler[52393]: INFO nova.filters [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Filter ComputeFilter returned 0 hosts [ 660.288410] nova-scheduler[52393]: DEBUG nova.filters [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Filtering removed all hosts for the request with instance ID 'fc059271-47e3-4506-8c8d-fa7c9ed46f47'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.288537] nova-scheduler[52393]: INFO nova.filters [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Filtering removed all hosts for the request with instance ID 'fc059271-47e3-4506-8c8d-fa7c9ed46f47'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.288696] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.288831] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-67c3266a-d96f-4854-a86b-fd4644dfda02 tempest-ServersTestFqdnHostnames-1298183815 tempest-ServersTestFqdnHostnames-1298183815-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 661.812292] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Starting to schedule for instances: ['b79fa25c-7dd3-4df8-84f6-d6c5bd6a1bcd'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 661.813631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 661.813631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.813631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.813631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.813631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 661.837636] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Starting to schedule for instances: ['348bfcf3-88e6-4138-92cf-8b3a58a3b4c1'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 661.838939] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 661.839586] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.839977] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.840563] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 661.842021] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 661.865932] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.866194] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.866366] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.872699] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.872920] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.873108] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.875280] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.875487] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.875858] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 661.876177] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 661.876361] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 661.876574] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 661.876713] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.877043] nova-scheduler[52396]: DEBUG nova.filters [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 661.877275] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 74.740312 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 661.877479] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 661.877753] nova-scheduler[52396]: INFO nova.filters [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Filter ComputeFilter returned 0 hosts [ 661.877811] nova-scheduler[52396]: DEBUG nova.filters [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Filtering removed all hosts for the request with instance ID 'b79fa25c-7dd3-4df8-84f6-d6c5bd6a1bcd'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 661.877952] nova-scheduler[52396]: INFO nova.filters [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Filtering removed all hosts for the request with instance ID 'b79fa25c-7dd3-4df8-84f6-d6c5bd6a1bcd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 661.878118] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 661.878268] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c7d4d0f0-faae-4e0b-97aa-436987e313c6 tempest-ServersWithSpecificFlavorTestJSON-1670131432 tempest-ServersWithSpecificFlavorTestJSON-1670131432-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 661.893636] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.893636] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.893636] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.899953] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.899953] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.899953] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.901066] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 661.901373] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 661.901637] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 661.903097] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 661.903097] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 661.903097] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 661.903097] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 661.903097] nova-scheduler[52393]: DEBUG nova.filters [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 661.903097] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 74.765953 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 661.903097] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 661.904167] nova-scheduler[52393]: INFO nova.filters [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Filter ComputeFilter returned 0 hosts [ 661.904167] nova-scheduler[52393]: DEBUG nova.filters [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Filtering removed all hosts for the request with instance ID '348bfcf3-88e6-4138-92cf-8b3a58a3b4c1'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 661.904167] nova-scheduler[52393]: INFO nova.filters [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Filtering removed all hosts for the request with instance ID '348bfcf3-88e6-4138-92cf-8b3a58a3b4c1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 661.904167] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 661.904167] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3b6ee74d-640a-4a0b-b913-57391182c19d tempest-ServersAdmin275Test-711024600 tempest-ServersAdmin275Test-711024600-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 663.800701] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Starting to schedule for instances: ['8917be5d-d8e0-41ed-aac2-eefe93808482'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 663.800701] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 663.800976] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.801089] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.801297] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 663.801738] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 663.850060] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.850361] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.850591] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.858256] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.859014] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.859271] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.861513] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 663.861728] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 663.862355] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 663.862669] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 663.862848] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 663.863030] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 663.863202] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 663.863456] nova-scheduler[52396]: DEBUG nova.filters [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 663.863712] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 76.726729 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 663.863907] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 663.864837] nova-scheduler[52396]: INFO nova.filters [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Filter ComputeFilter returned 0 hosts [ 663.865024] nova-scheduler[52396]: DEBUG nova.filters [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Filtering removed all hosts for the request with instance ID '8917be5d-d8e0-41ed-aac2-eefe93808482'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 663.865192] nova-scheduler[52396]: INFO nova.filters [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Filtering removed all hosts for the request with instance ID '8917be5d-d8e0-41ed-aac2-eefe93808482'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 663.865379] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 663.865615] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7e1557f6-a295-4888-a002-730942b69aba tempest-AttachInterfacesUnderV243Test-1116763719 tempest-AttachInterfacesUnderV243Test-1116763719-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 666.482335] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Starting to schedule for instances: ['09a03ec9-3269-4ade-af4b-ed49f4f10285'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 666.482620] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 666.483676] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.486218] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.486465] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.487321] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 666.551060] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.551060] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.551060] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.563230] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.563230] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.563230] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.567964] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.568782] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.569343] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 666.569843] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 666.570152] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 666.570486] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 666.570807] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.571251] nova-scheduler[52393]: DEBUG nova.filters [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 666.571572] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 79.434601 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 666.571874] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 666.572163] nova-scheduler[52393]: INFO nova.filters [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ComputeFilter returned 0 hosts [ 666.572417] nova-scheduler[52393]: DEBUG nova.filters [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filtering removed all hosts for the request with instance ID '09a03ec9-3269-4ade-af4b-ed49f4f10285'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 666.572728] nova-scheduler[52393]: INFO nova.filters [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filtering removed all hosts for the request with instance ID '09a03ec9-3269-4ade-af4b-ed49f4f10285'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 666.574308] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 666.574308] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-34023675-2841-491d-afcf-3057f629be04 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 666.599030] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting to schedule for instances: ['eb2774ba-b9c2-48d7-b5bc-3580d02523ce'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 666.599030] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 666.599590] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.599590] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.599590] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 666.599781] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 666.648919] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.648919] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.648919] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.658998] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.658998] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.658998] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.664810] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 666.664810] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 666.664810] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 666.664810] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 666.665055] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 666.665258] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 666.665314] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 666.665868] nova-scheduler[52396]: DEBUG nova.filters [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 666.665868] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 79.528831 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 666.666077] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 666.666487] nova-scheduler[52396]: INFO nova.filters [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ComputeFilter returned 0 hosts [ 666.666644] nova-scheduler[52396]: DEBUG nova.filters [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtering removed all hosts for the request with instance ID 'eb2774ba-b9c2-48d7-b5bc-3580d02523ce'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 666.666787] nova-scheduler[52396]: INFO nova.filters [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtering removed all hosts for the request with instance ID 'eb2774ba-b9c2-48d7-b5bc-3580d02523ce'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 666.666934] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 666.667158] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1a88a0d6-7b5a-4120-b197-cbeac4081cac tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 668.033983] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Starting to schedule for instances: ['c599de60-d129-49fa-abec-cd1d111fa501'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 668.034295] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 668.034458] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.035589] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.035969] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.036650] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 668.092879] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.092879] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.092879] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.100419] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.100716] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.100918] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.103847] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.104111] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.104566] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 668.104934] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 668.105662] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 668.105662] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 668.105662] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.105996] nova-scheduler[52393]: DEBUG nova.filters [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 668.106374] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 80.969218 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 668.106435] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 668.107264] nova-scheduler[52393]: INFO nova.filters [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Filter ComputeFilter returned 0 hosts [ 668.107264] nova-scheduler[52393]: DEBUG nova.filters [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Filtering removed all hosts for the request with instance ID 'c599de60-d129-49fa-abec-cd1d111fa501'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 668.107264] nova-scheduler[52393]: INFO nova.filters [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Filtering removed all hosts for the request with instance ID 'c599de60-d129-49fa-abec-cd1d111fa501'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 668.107264] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 668.107264] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2c321776-543b-4c5f-b401-1bd8256d8b5a tempest-AttachInterfacesV270Test-17097979 tempest-AttachInterfacesV270Test-17097979-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 671.671019] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Starting to schedule for instances: ['d42b72bc-5877-4fb5-bd52-0c741f0deaf5'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 671.671340] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 671.671502] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.671688] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.671967] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.675438] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 671.731592] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.731894] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.732109] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.741036] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.741611] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.741924] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.744918] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.745209] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.745961] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 671.746293] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 671.746484] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 671.746649] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 671.746830] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.747145] nova-scheduler[52396]: DEBUG nova.filters [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 671.747444] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 84.610426 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 671.747676] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 671.747883] nova-scheduler[52396]: INFO nova.filters [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Filter ComputeFilter returned 0 hosts [ 671.748072] nova-scheduler[52396]: DEBUG nova.filters [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Filtering removed all hosts for the request with instance ID 'd42b72bc-5877-4fb5-bd52-0c741f0deaf5'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 671.748228] nova-scheduler[52396]: INFO nova.filters [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Filtering removed all hosts for the request with instance ID 'd42b72bc-5877-4fb5-bd52-0c741f0deaf5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 671.748381] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 671.748532] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-007cc61d-6509-4f02-acad-8f20be5d6da7 tempest-ServerShowV257Test-2019902689 tempest-ServerShowV257Test-2019902689-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 673.209526] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Starting to schedule for instances: ['88c9242f-9cc5-4338-a917-b3d1ba386987'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 673.210270] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 673.210562] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.210868] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.211186] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.211586] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 673.240632] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Starting to schedule for instances: ['a36df24c-379e-4194-b8eb-f73b9761fc7f'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 673.241046] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 673.241293] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.241582] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.241846] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 673.242127] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 673.258228] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.258489] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.261190] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.269617] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.269617] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.269617] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.272024] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.272120] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.272446] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 673.272727] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 673.272907] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 673.275126] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 673.275126] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.275126] nova-scheduler[52393]: DEBUG nova.filters [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 673.275126] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 86.13676 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 673.275126] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 673.275126] nova-scheduler[52393]: INFO nova.filters [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Filter ComputeFilter returned 0 hosts [ 673.275126] nova-scheduler[52393]: DEBUG nova.filters [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Filtering removed all hosts for the request with instance ID '88c9242f-9cc5-4338-a917-b3d1ba386987'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 673.275126] nova-scheduler[52393]: INFO nova.filters [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Filtering removed all hosts for the request with instance ID '88c9242f-9cc5-4338-a917-b3d1ba386987'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 673.275126] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 673.275126] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7ece6ffe-a5b1-4bdf-87f8-f670f9d5ad21 tempest-ServersTestManualDisk-1800173937 tempest-ServersTestManualDisk-1800173937-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 673.299829] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.300150] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.300439] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.309037] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.309250] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.309578] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.313909] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 673.314134] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 673.314568] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='0',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:34:34Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 673.314801] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 673.314973] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 673.318210] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Update host state with instances: ['148f525a-f3c0-40f2-8527-9607cd5e581b', '30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 673.318210] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 673.318210] nova-scheduler[52396]: DEBUG nova.filters [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 673.318210] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 86.178852 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 673.318210] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 has not been heard from in a while [ 673.318210] nova-scheduler[52396]: INFO nova.filters [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Filter ComputeFilter returned 0 hosts [ 673.318210] nova-scheduler[52396]: DEBUG nova.filters [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Filtering removed all hosts for the request with instance ID 'a36df24c-379e-4194-b8eb-f73b9761fc7f'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 673.318210] nova-scheduler[52396]: INFO nova.filters [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Filtering removed all hosts for the request with instance ID 'a36df24c-379e-4194-b8eb-f73b9761fc7f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 673.318210] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 673.318210] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-9a45584c-8140-4832-ae6b-fce014947f32 tempest-ImagesNegativeTestJSON-1901723470 tempest-ImagesNegativeTestJSON-1901723470-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Starting to schedule for instances: ['1e75c548-67e3-4360-89b5-b7e70b2faa4e'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.738033] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.786528] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.786970] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.787320] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.798558] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.798558] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.798558] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.807019] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.807019] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.807019] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.807019] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.807019] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.807019] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.807019] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.807431] nova-scheduler[52393]: DEBUG nova.filters [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.807431] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 101.669578 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 688.807431] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 688.807431] nova-scheduler[52393]: INFO nova.filters [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Filter ComputeFilter returned 0 hosts [ 688.807431] nova-scheduler[52393]: DEBUG nova.filters [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Filtering removed all hosts for the request with instance ID '1e75c548-67e3-4360-89b5-b7e70b2faa4e'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 688.807760] nova-scheduler[52393]: INFO nova.filters [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Filtering removed all hosts for the request with instance ID '1e75c548-67e3-4360-89b5-b7e70b2faa4e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 688.808033] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.808308] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-554263da-efb4-44f2-b170-1125913e8957 tempest-ServerActionsTestOtherA-1736780769 tempest-ServerActionsTestOtherA-1736780769-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 690.694777] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Starting to schedule for instances: ['405eb9a5-29a7-4838-82a4-38e2a5ae6216'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 690.694777] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 690.694777] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.695234] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.695234] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.695309] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 690.746509] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.746509] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.746509] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.750802] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Starting to schedule for instances: ['64ff238e-335c-4126-8cc6-fcee1bc491c2', '1927aa3e-4d9e-43d4-a792-168b61fcf0cd'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 690.751048] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 690.751093] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.751306] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.751472] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.751629] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 690.775349] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.775349] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.775349] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.780797] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.781190] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.781719] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 690.782208] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 690.782623] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 690.782918] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 690.783226] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.783891] nova-scheduler[52396]: DEBUG nova.filters [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 690.784393] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 103.647261 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 690.784651] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 690.784935] nova-scheduler[52396]: INFO nova.filters [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Filter ComputeFilter returned 0 hosts [ 690.785456] nova-scheduler[52396]: DEBUG nova.filters [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Filtering removed all hosts for the request with instance ID '405eb9a5-29a7-4838-82a4-38e2a5ae6216'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 690.786880] nova-scheduler[52396]: INFO nova.filters [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Filtering removed all hosts for the request with instance ID '405eb9a5-29a7-4838-82a4-38e2a5ae6216'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 690.786880] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 690.786880] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-57f2134b-d22c-4692-ba20-673bd6a0e3d4 tempest-ServerActionsV293TestJSON-670399220 tempest-ServerActionsV293TestJSON-670399220-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 690.830104] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.830104] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.830212] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.843990] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.844268] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.844564] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.846938] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.847114] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.847566] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 690.847776] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 690.847992] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 690.848116] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 690.848275] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.848709] nova-scheduler[52393]: DEBUG nova.filters [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 690.848804] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 103.711799 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 690.848908] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 690.849082] nova-scheduler[52393]: INFO nova.filters [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filter ComputeFilter returned 0 hosts [ 690.849240] nova-scheduler[52393]: DEBUG nova.filters [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtering removed all hosts for the request with instance ID '64ff238e-335c-4126-8cc6-fcee1bc491c2'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 690.849381] nova-scheduler[52393]: INFO nova.filters [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtering removed all hosts for the request with instance ID '64ff238e-335c-4126-8cc6-fcee1bc491c2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 690.849548] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 690.849707] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-183ef61d-ad35-45c3-91a9-e0bce92ab34e tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 691.471862] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Starting to schedule for instances: ['c601cfc8-152b-4bdf-854f-55ec681203e0'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 691.472169] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 691.472333] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.472521] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.472759] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 691.472943] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 691.528571] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.528693] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.528831] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.535550] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.535765] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.535928] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.538163] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 691.538377] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 691.539272] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 691.539272] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 691.539272] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 691.539496] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 691.539496] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 691.539786] nova-scheduler[52396]: DEBUG nova.filters [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 691.539996] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 104.403048 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 691.540171] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 691.540328] nova-scheduler[52396]: INFO nova.filters [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Filter ComputeFilter returned 0 hosts [ 691.540485] nova-scheduler[52396]: DEBUG nova.filters [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Filtering removed all hosts for the request with instance ID 'c601cfc8-152b-4bdf-854f-55ec681203e0'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 691.540637] nova-scheduler[52396]: INFO nova.filters [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Filtering removed all hosts for the request with instance ID 'c601cfc8-152b-4bdf-854f-55ec681203e0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 691.540798] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 691.540947] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-943779d7-64aa-4938-9035-91280eddefd2 tempest-InstanceActionsNegativeTestJSON-1805904341 tempest-InstanceActionsNegativeTestJSON-1805904341-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 692.812202] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting to schedule for instances: ['c0128068-3faa-4f0d-9905-336f75e2ca7d'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 692.812506] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 692.812680] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.812868] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.813202] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.813430] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 692.873335] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.873335] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.873335] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.881087] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.881087] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.881087] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.887036] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.887036] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.887036] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 692.887036] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 692.887036] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 692.887036] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 692.887036] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.887576] nova-scheduler[52393]: DEBUG nova.filters [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 692.887576] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 105.748808 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 692.887576] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 692.887576] nova-scheduler[52393]: INFO nova.filters [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ComputeFilter returned 0 hosts [ 692.887576] nova-scheduler[52393]: DEBUG nova.filters [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtering removed all hosts for the request with instance ID 'c0128068-3faa-4f0d-9905-336f75e2ca7d'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 692.887576] nova-scheduler[52393]: INFO nova.filters [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtering removed all hosts for the request with instance ID 'c0128068-3faa-4f0d-9905-336f75e2ca7d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 692.887576] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 692.887576] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-963f0025-c6ed-48cf-8c75-28399d92ffbb tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 692.906161] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting to schedule for instances: ['cd350089-076b-45b0-84c3-5c4e041ca578'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 692.906161] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 692.906161] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.906161] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.906465] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 692.906813] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 692.952609] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.952859] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.953220] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.962632] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.962855] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.963359] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.966381] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 692.966768] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 692.967129] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 692.967990] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 692.968362] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 692.968362] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 692.968691] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 692.968691] nova-scheduler[52396]: DEBUG nova.filters [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 692.968882] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 105.83194 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 692.969152] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 692.969243] nova-scheduler[52396]: INFO nova.filters [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ComputeFilter returned 0 hosts [ 692.969380] nova-scheduler[52396]: DEBUG nova.filters [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtering removed all hosts for the request with instance ID 'cd350089-076b-45b0-84c3-5c4e041ca578'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 692.969541] nova-scheduler[52396]: INFO nova.filters [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtering removed all hosts for the request with instance ID 'cd350089-076b-45b0-84c3-5c4e041ca578'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 692.969703] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 692.969856] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1eba63bf-23de-4512-99aa-6214fd104547 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 694.616213] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Starting to schedule for instances: ['b3bbeeba-c909-4e99-9482-519444a06f7b', 'a5c90864-f54e-4378-8ac4-a4ca8b1ee55b', '475b06c8-c936-47a7-a969-f1a43b0eab9a'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 694.616504] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 694.616687] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.616897] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.617327] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.617327] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 694.660120] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.660120] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.660120] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.666750] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.666951] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.667130] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.670218] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.670218] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.670218] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 694.670218] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 694.670542] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 694.670542] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 694.670542] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.671340] nova-scheduler[52393]: DEBUG nova.filters [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 694.671340] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 107.534179 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 694.671340] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 694.671544] nova-scheduler[52393]: INFO nova.filters [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Filter ComputeFilter returned 0 hosts [ 694.671612] nova-scheduler[52393]: DEBUG nova.filters [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Filtering removed all hosts for the request with instance ID 'b3bbeeba-c909-4e99-9482-519444a06f7b'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 694.671760] nova-scheduler[52393]: INFO nova.filters [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Filtering removed all hosts for the request with instance ID 'b3bbeeba-c909-4e99-9482-519444a06f7b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 694.671922] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 694.672130] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-51e87503-b4ab-44c4-aa3b-fba9431c2c27 tempest-ListServersNegativeTestJSON-1169879222 tempest-ListServersNegativeTestJSON-1169879222-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 694.895824] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Starting to schedule for instances: ['5de30574-c0b5-4db3-9129-087d7dd990fc'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 694.896102] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 694.896241] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.896416] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.896608] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 694.896787] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 694.947151] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.947387] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.947584] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.955156] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.955371] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.955534] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.957907] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 694.958314] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 694.958690] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 694.958974] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 694.959156] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 694.959318] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 694.959496] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 694.961087] nova-scheduler[52396]: DEBUG nova.filters [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 694.961371] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 107.824363 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 694.961547] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 694.961716] nova-scheduler[52396]: INFO nova.filters [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Filter ComputeFilter returned 0 hosts [ 694.961869] nova-scheduler[52396]: DEBUG nova.filters [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Filtering removed all hosts for the request with instance ID '5de30574-c0b5-4db3-9129-087d7dd990fc'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 694.962017] nova-scheduler[52396]: INFO nova.filters [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Filtering removed all hosts for the request with instance ID '5de30574-c0b5-4db3-9129-087d7dd990fc'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 694.962197] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 694.962344] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f3215e6d-3a9e-40ac-a3f0-026d8e4d9b6e tempest-ServerPasswordTestJSON-1057914730 tempest-ServerPasswordTestJSON-1057914730-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Starting to schedule for instances: ['950891af-2c2c-4d15-b938-1e27fca10f9a'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.508095] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 695.562505] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.562505] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.562505] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.568445] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.569447] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.569447] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.571462] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.571930] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.572556] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='0',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_d7324cc23ca541659f0f82bd61038ec5='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:13Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 695.575021] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 695.575021] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 695.575021] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 695.575021] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.575021] nova-scheduler[52393]: DEBUG nova.filters [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 695.575021] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 108.437006 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 695.575021] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 695.575021] nova-scheduler[52393]: INFO nova.filters [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filter ComputeFilter returned 0 hosts [ 695.575021] nova-scheduler[52393]: DEBUG nova.filters [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filtering removed all hosts for the request with instance ID '950891af-2c2c-4d15-b938-1e27fca10f9a'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 695.575021] nova-scheduler[52393]: INFO nova.filters [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filtering removed all hosts for the request with instance ID '950891af-2c2c-4d15-b938-1e27fca10f9a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 695.575021] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 695.575568] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-219af57b-1458-408f-844c-0937b369b5c5 tempest-DeleteServersAdminTestJSON-550626363 tempest-DeleteServersAdminTestJSON-550626363-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 699.529043] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.529320] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.529451] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.529533] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.529581] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.529581] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.529678] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 699.529713] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.529750] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 699.529750] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.532856] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 699.532856] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.005s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 699.536540] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 699.536723] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c3475a6c-e0fb-4208-bd45-09cd631355be None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.009s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.154305] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Starting to schedule for instances: ['f2939eec-c498-4397-8104-7093e78f92f6', '7f024bb9-899a-4f2b-bc8d-b3de8db8291d'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 705.158038] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 705.158038] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.158038] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.158038] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.158038] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 705.207629] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.207629] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.207860] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.217150] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.217348] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.217743] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.222246] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.222246] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.222246] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='1',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_spawning='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:26Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 705.223235] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 705.223235] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 33, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 705.223235] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 705.223402] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.223668] nova-scheduler[52396]: DEBUG nova.filters [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 705.223982] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:33:34. Elapsed time is 118.086911 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 705.224209] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 705.224400] nova-scheduler[52396]: INFO nova.filters [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filter ComputeFilter returned 0 hosts [ 705.224619] nova-scheduler[52396]: DEBUG nova.filters [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtering removed all hosts for the request with instance ID 'f2939eec-c498-4397-8104-7093e78f92f6'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 705.224812] nova-scheduler[52396]: INFO nova.filters [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtering removed all hosts for the request with instance ID 'f2939eec-c498-4397-8104-7093e78f92f6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 705.225805] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 705.225805] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-0fd95366-1f70-4ca6-81d0-1af516a14bf4 tempest-MultipleCreateTestJSON-1222059822 tempest-MultipleCreateTestJSON-1222059822-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 708.774749] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting to schedule for instances: ['f202a181-b5ea-4b06-91ad-86356b51e088'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 708.775064] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 708.775239] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.775453] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.775669] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 708.775957] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 708.825344] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.826208] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.826384] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.838951] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.839186] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.839385] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.842365] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.842480] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.843266] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='1',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_spawning='7',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:26Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=7) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 708.843266] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 708.843403] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 708.843463] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 708.845986] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.filters [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 708.845986] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Attempting to claim resources in the placement API for instance f202a181-b5ea-4b06-91ad-86356b51e088 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 708.906753] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] [instance: f202a181-b5ea-4b06-91ad-86356b51e088] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 708.907061] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 708.907267] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 708.908086] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fe91af8a-8fba-42b4-a11d-86b725f8d324 tempest-AttachInterfacesTestJSON-1960723181 tempest-AttachInterfacesTestJSON-1960723181-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.573274] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting to schedule for instances: ['63151ec9-f383-46cc-ac57-c3f7f1569410'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 709.573669] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 709.573797] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.574009] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.575773] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.575986] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 709.630421] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.630832] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.631194] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.639054] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.639422] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.640471] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.643045] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.643436] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.644873] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=192,free_ram_mb=195054,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=8,mapped=1,memory_mb=196590,memory_mb_used=1536,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=8,service_id=None,stats={failed_builds='1',io_workload='8',num_instances='8',num_os_type_None='8',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_task_None='1',num_task_spawning='7',num_vm_building='8'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:36Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=8) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 709.644873] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 709.644873] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 709.644873] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 709.644873] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.644873] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 709.645717] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.645717] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.645717] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.646325] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.646325] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.646710] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.646710] nova-scheduler[52396]: DEBUG nova.filters [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.646710] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 709.646922] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 709.647071] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Attempting to claim resources in the placement API for instance 63151ec9-f383-46cc-ac57-c3f7f1569410 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 709.734501] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] [instance: 63151ec9-f383-46cc-ac57-c3f7f1569410] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195054MB disk: 196608MB io_ops: 8 instances: 8, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 709.734815] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.735032] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.735236] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a2fa7e35-1ec6-401c-8ac8-9902eb4011f9 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.739448] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Starting to schedule for instances: ['c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.740058] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.740058] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.742572] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.742963] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.743068] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.787837] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.788255] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.788522] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.800719] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.800939] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.801636] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.807050] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.807050] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.807050] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='1',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='2',num_task_spawning='7',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:37Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=9) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.807273] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.807378] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.807565] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.807740] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.808009] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.808228] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.808708] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.808708] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.808816] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.808918] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.809092] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.809261] nova-scheduler[52393]: DEBUG nova.filters [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.809422] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.809619] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.810686] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Attempting to claim resources in the placement API for instance c5b391a9-7969-4119-9bc6-b0e1fe7a9713 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Starting to schedule for instances: ['95f71b47-73c8-4a82-b806-f6f2ed9cdbb3'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 714.842109] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 714.888750] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] [instance: c5b391a9-7969-4119-9bc6-b0e1fe7a9713] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.889170] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.889398] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.889674] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-32fc421e-8762-4d7b-a9f1-02f26540cfda tempest-ServersTestJSON-895806724 tempest-ServersTestJSON-895806724-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.908018] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.908401] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.908687] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.917836] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.917836] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.917836] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.920980] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.920980] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.921157] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='1',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='2',num_task_spawning='7',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:37Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=9) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 714.921509] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 714.921924] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 714.921924] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 714.922084] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 714.922863] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 714.922863] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.922863] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.923532] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.923532] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.filters [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 714.926088] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Attempting to claim resources in the placement API for instance 95f71b47-73c8-4a82-b806-f6f2ed9cdbb3 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 714.994075] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] [instance: 95f71b47-73c8-4a82-b806-f6f2ed9cdbb3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 714.994075] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 714.994320] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 714.994366] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a5a75d1c-a79f-4dd8-aa61-e901aa56caa2 tempest-SecurityGroupsTestJSON-1049045858 tempest-SecurityGroupsTestJSON-1049045858-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.264232] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Starting to schedule for instances: ['7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 716.264557] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 716.264679] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.264861] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.267946] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.267946] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 716.311035] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.311286] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.311457] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.317743] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.317992] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.318117] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.320239] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.320444] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.320847] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:42Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 716.321147] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 716.321321] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 716.321480] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 716.321647] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.321902] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 716.322120] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.322365] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.322503] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.322673] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.322836] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.323007] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.323178] nova-scheduler[52393]: DEBUG nova.filters [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.323340] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 716.323511] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 716.323689] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Attempting to claim resources in the placement API for instance 7476fb96-5247-472c-ab92-ef7e5916cb00 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 716.383270] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] [instance: 7476fb96-5247-472c-ab92-ef7e5916cb00] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 716.383659] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.383795] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.384066] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f7a1adb9-c4cf-45bc-b153-231a528a7e62 tempest-ServerAddressesNegativeTestJSON-1455610660 tempest-ServerAddressesNegativeTestJSON-1455610660-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.691028] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Starting to schedule for instances: ['35630c7b-fdf4-4d6d-8e5a-0045f1387f93'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 718.691314] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 718.692029] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.692029] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.692029] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.692029] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 718.712155] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Starting to schedule for instances: ['837197c0-9ff8-45a2-8bf0-730158a43a17'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 718.712155] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 718.712701] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.712701] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.712701] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 718.712860] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 718.766021] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.766021] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.766021] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.775231] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.775514] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.775609] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.787611] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.788086] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.788627] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:42Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 718.789141] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 718.789141] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 718.789424] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 718.789424] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.789746] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 718.789955] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.790153] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.790350] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.791049] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.791049] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.791049] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.791049] nova-scheduler[52396]: DEBUG nova.filters [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.791224] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.791300] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 718.791330] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.791686] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 718.791767] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.791807] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Attempting to claim resources in the placement API for instance 35630c7b-fdf4-4d6d-8e5a-0045f1387f93 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 718.799227] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.799448] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.799674] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.802402] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.802618] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.803022] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:42Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 718.803391] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 718.803633] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 718.803860] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 718.804046] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.804312] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 718.804522] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.804835] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805140] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805255] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805380] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805546] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805710] nova-scheduler[52393]: DEBUG nova.filters [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 718.805866] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 718.806096] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 718.806292] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Attempting to claim resources in the placement API for instance 837197c0-9ff8-45a2-8bf0-730158a43a17 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 718.849084] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] [instance: 35630c7b-fdf4-4d6d-8e5a-0045f1387f93] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 718.849084] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.849590] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.849816] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6cbba487-f263-4a56-ac67-4992b9ab7c51 tempest-ServerMetadataNegativeTestJSON-452243307 tempest-ServerMetadataNegativeTestJSON-452243307-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 718.871748] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] [instance: 837197c0-9ff8-45a2-8bf0-730158a43a17] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 718.872247] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 718.872337] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 718.872548] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fa825ce6-9ad4-453b-8cd9-56c310cbc466 tempest-ServerRescueTestJSON-743816201 tempest-ServerRescueTestJSON-743816201-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 720.961329] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['56471a78-08cd-4d1a-b3f5-d1eac277183e'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 720.961631] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 720.961830] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.962035] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.962247] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 720.962430] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 721.003157] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.003548] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.003817] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.015255] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.015255] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.015255] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.016904] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.017237] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.017839] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:42Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 721.018616] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 721.018616] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 721.018803] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 721.019117] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 721.020019] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 721.020019] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.020019] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.020540] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.020964] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.filters [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 721.023798] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Attempting to claim resources in the placement API for instance 56471a78-08cd-4d1a-b3f5-d1eac277183e {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 721.093459] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] [instance: 56471a78-08cd-4d1a-b3f5-d1eac277183e] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 721.093717] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 721.093984] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 721.094218] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-94fe6431-1bb6-476e-9e72-7a5409337850 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.437734] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Starting to schedule for instances: ['1240824e-c5f1-4517-b182-20245311c687'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 725.438182] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 725.438262] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.438402] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.438619] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.438859] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 725.485872] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.486117] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.486290] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.492939] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.493166] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.493344] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.495576] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.495779] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.496175] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=7,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='1',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:42Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 725.496469] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 725.496639] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 725.496800] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Update host state with instances: ['30c40353-01fe-407d-8d56-0f6c166d12e3', '130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 725.496963] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.497232] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 725.497435] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.497686] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.497808] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.497977] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.498149] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.498314] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.498475] nova-scheduler[52393]: DEBUG nova.filters [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.498631] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 725.498795] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 725.498968] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Attempting to claim resources in the placement API for instance 1240824e-c5f1-4517-b182-20245311c687 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 725.566018] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] [instance: 1240824e-c5f1-4517-b182-20245311c687] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 725.566018] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.566018] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.566018] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d74c6efc-892d-47d0-bc6e-18c31d9337a2 tempest-ServerDiagnosticsV248Test-746765673 tempest-ServerDiagnosticsV248Test-746765673-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 730.996717] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Starting to schedule for instances: ['daf1f034-cac9-44a9-8fdd-0c4c2d8eaa84'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 730.996717] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 730.996717] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.996717] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.997179] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 730.997179] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 731.050345] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.050345] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.051866] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.059440] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.059440] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.059560] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.070673] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.070981] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.071307] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='1',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='0',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='3',num_task_spawning='6',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:57Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=9) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 731.071600] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 731.071777] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 731.071936] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Update host state with instances: ['130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 731.072122] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 731.072385] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 731.072578] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.072763] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.072960] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.073142] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.073306] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.073471] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.073631] nova-scheduler[52396]: DEBUG nova.filters [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 731.073794] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 731.073964] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 731.074247] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Attempting to claim resources in the placement API for instance daf1f034-cac9-44a9-8fdd-0c4c2d8eaa84 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 731.205629] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] [instance: daf1f034-cac9-44a9-8fdd-0c4c2d8eaa84] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 731.207612] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 731.207612] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 731.207759] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b4c28495-2ae6-4055-b784-b74f117db807 tempest-ServersV294TestFqdnHostnames-541059978 tempest-ServersV294TestFqdnHostnames-541059978-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.388252] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Starting to schedule for instances: ['b6cdc3c0-d5a6-4e9f-bd90-b38355c74c88'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 735.388554] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 735.388716] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.388894] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.390930] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.391194] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 735.443645] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.443914] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.444080] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.452855] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.453077] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.453255] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.457303] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.457537] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.457916] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='0',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:58Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 735.458229] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 735.458405] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 735.458570] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Update host state with instances: ['130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 735.458743] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.459055] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 735.459286] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.459473] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.459723] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.459895] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.460070] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.460239] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.460402] nova-scheduler[52393]: DEBUG nova.filters [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.460605] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 735.460789] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 735.460967] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Attempting to claim resources in the placement API for instance b6cdc3c0-d5a6-4e9f-bd90-b38355c74c88 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 735.528548] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] [instance: b6cdc3c0-d5a6-4e9f-bd90-b38355c74c88] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 735.528884] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.529113] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.529316] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-fabd4c09-225b-4eab-a60c-c4ab202262a4 tempest-ImagesOneServerNegativeTestJSON-855426412 tempest-ImagesOneServerNegativeTestJSON-855426412-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.664854] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Starting to schedule for instances: ['49aaf98b-945e-4c5d-8158-641b8650a8a7'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 735.665150] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 735.665315] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.665490] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.665785] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 735.665852] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 735.709161] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.709395] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.709677] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.718085] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.718085] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.718320] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.722446] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.722446] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.722446] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='0',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:58Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 735.722446] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 735.722446] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 735.722446] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Update host state with instances: ['130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 735.723662] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.723662] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.724153] nova-scheduler[52396]: DEBUG nova.filters [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 735.724307] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 735.724469] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 735.725700] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Attempting to claim resources in the placement API for instance 49aaf98b-945e-4c5d-8158-641b8650a8a7 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 735.774941] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] [instance: 49aaf98b-945e-4c5d-8158-641b8650a8a7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 735.775252] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 735.775457] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 735.775651] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-ef4b706f-4629-44f3-be39-af08c87a8497 tempest-ImagesOneServerTestJSON-749254656 tempest-ImagesOneServerTestJSON-749254656-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 737.180394] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Starting to schedule for instances: ['cb7a8413-4414-4de6-8d4f-9ac4f1784f35'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 737.180663] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 737.180751] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 737.180943] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 737.181338] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 737.181338] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 737.225243] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 737.225482] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 737.225649] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 737.232958] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 737.233515] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 737.233515] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 737.235683] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 737.235884] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 737.236277] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='0',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:58Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 737.236557] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 737.237295] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 737.237295] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Update host state with instances: ['130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 737.237295] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 737.237295] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 737.237636] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238178] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238178] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238290] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238404] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238620] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238790] nova-scheduler[52393]: DEBUG nova.filters [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 737.238948] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 737.239131] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 737.239308] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Attempting to claim resources in the placement API for instance cb7a8413-4414-4de6-8d4f-9ac4f1784f35 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 737.288304] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] [instance: cb7a8413-4414-4de6-8d4f-9ac4f1784f35] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 737.288605] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 737.288823] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 737.289099] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-bb0f1347-ba84-4ee0-b6e1-a08a8a353154 tempest-ServerTagsTestJSON-1401197038 tempest-ServerTagsTestJSON-1401197038-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.858159] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting to schedule for instances: ['01b62d6f-6718-45b4-8f67-cdb77c5f4bd0'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 740.858159] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 740.860760] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.860760] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.860760] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.860760] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 740.903285] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.903841] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.904185] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.911842] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.912117] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.912886] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.914620] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.914889] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.915407] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='2',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_a7835207110449299e6f867f379be296='0',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='4',num_task_spawning='6',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:35:58Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 740.915777] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 740.916069] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 740.916328] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with instances: ['130961ce-1e22-4320-abc9-30fc5f652be3', '4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 740.916550] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.916849] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 740.917136] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.917386] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.917663] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.917902] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.918135] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.918377] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.918601] nova-scheduler[52396]: DEBUG nova.filters [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.918821] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 740.919053] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 740.919295] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Attempting to claim resources in the placement API for instance 01b62d6f-6718-45b4-8f67-cdb77c5f4bd0 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 740.972825] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] [instance: 01b62d6f-6718-45b4-8f67-cdb77c5f4bd0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 740.973282] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.973593] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.973878] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f6e0da48-d31d-4d57-a3a8-7b964135e1c7 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.291387] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting to schedule for instances: ['a8e0d6fc-d68b-431e-a74a-2bf6dba5c0c6'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 788.291690] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 788.291871] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.292092] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.292296] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.292477] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 788.334131] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.334372] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.334542] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.342823] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.343389] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.343565] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.348622] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.348622] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.348622] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 788.348622] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 788.348622] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 788.348622] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 788.348915] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.348915] nova-scheduler[52393]: DEBUG nova.filters [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 788.348981] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 81.212008 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 788.349138] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 788.349256] nova-scheduler[52393]: INFO nova.filters [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filter ComputeFilter returned 0 hosts [ 788.349403] nova-scheduler[52393]: DEBUG nova.filters [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID 'a8e0d6fc-d68b-431e-a74a-2bf6dba5c0c6'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 788.349551] nova-scheduler[52393]: INFO nova.filters [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID 'a8e0d6fc-d68b-431e-a74a-2bf6dba5c0c6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 788.349712] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 788.350246] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-f6e5b367-fa5f-498b-b38c-929821a3d339 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 790.562986] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting to schedule for instances: ['993ecf40-e9c3-4ba2-9d5c-82e8e8ddd7bd'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 790.563309] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 790.563474] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.563655] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.564915] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 790.564915] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 790.606691] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.606691] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.606691] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.612981] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.614109] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.614109] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.615829] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 790.616150] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 790.616661] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 790.617115] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 790.617419] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 790.618748] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 790.618748] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 790.618748] nova-scheduler[52396]: DEBUG nova.filters [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 790.618748] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 83.481449 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 790.618748] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 790.618748] nova-scheduler[52396]: INFO nova.filters [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filter ComputeFilter returned 0 hosts [ 790.619218] nova-scheduler[52396]: DEBUG nova.filters [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID '993ecf40-e9c3-4ba2-9d5c-82e8e8ddd7bd'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 790.619470] nova-scheduler[52396]: INFO nova.filters [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID '993ecf40-e9c3-4ba2-9d5c-82e8e8ddd7bd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 790.619773] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 790.620049] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-f2afcbf0-4d59-41e4-9c65-df9025bddaee tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 792.189903] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting to schedule for instances: ['c003d4d1-71eb-4c47-958b-cc4c3e7209ea'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 792.190348] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 792.190527] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.190751] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.190951] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.191152] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 792.235651] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.235894] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.236082] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.243964] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.243964] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.243964] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.246701] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.246701] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.246701] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 792.246701] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 792.246701] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 792.246998] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 792.246998] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.248025] nova-scheduler[52393]: DEBUG nova.filters [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 792.248025] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 85.110466 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 792.248025] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 792.248025] nova-scheduler[52393]: INFO nova.filters [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filter ComputeFilter returned 0 hosts [ 792.248025] nova-scheduler[52393]: DEBUG nova.filters [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID 'c003d4d1-71eb-4c47-958b-cc4c3e7209ea'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 792.248025] nova-scheduler[52393]: INFO nova.filters [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID 'c003d4d1-71eb-4c47-958b-cc4c3e7209ea'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 792.248335] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 792.248335] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-da6ca001-3076-414d-8603-f6c14cd5be77 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 794.456344] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting to schedule for instances: ['73e4e0b7-5fe8-4ee7-809d-30a2dd6dcbb1'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 794.456702] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 794.458303] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.458303] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.458303] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 794.458303] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 794.496376] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.496591] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.496754] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.503765] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.505492] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.505492] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.506399] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 794.506597] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 794.506961] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 794.507238] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 794.507489] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 794.507638] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 794.507801] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 794.508063] nova-scheduler[52396]: DEBUG nova.filters [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 794.508270] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 87.371328 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 794.508423] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 794.508573] nova-scheduler[52396]: INFO nova.filters [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filter ComputeFilter returned 0 hosts [ 794.508718] nova-scheduler[52396]: DEBUG nova.filters [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID '73e4e0b7-5fe8-4ee7-809d-30a2dd6dcbb1'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 794.508851] nova-scheduler[52396]: INFO nova.filters [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtering removed all hosts for the request with instance ID '73e4e0b7-5fe8-4ee7-809d-30a2dd6dcbb1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 794.508993] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 794.509147] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-14b89004-6098-4793-9d72-6749f0019dc3 tempest-ImagesTestJSON-52580012 tempest-ImagesTestJSON-52580012-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 799.509775] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Starting to schedule for instances: ['3a5267f7-690e-4fa2-890d-d7491ab365b5'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 799.510149] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 799.510334] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.510558] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.510774] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 799.510959] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 799.550561] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.550959] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.551243] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.557702] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.557930] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.558118] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.560630] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 799.560630] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 799.560961] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 799.561256] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 799.561429] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 799.561592] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 799.561762] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 799.562016] nova-scheduler[52393]: DEBUG nova.filters [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 799.562229] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 92.42528 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 799.562457] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 799.562540] nova-scheduler[52393]: INFO nova.filters [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Filter ComputeFilter returned 0 hosts [ 799.562692] nova-scheduler[52393]: DEBUG nova.filters [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Filtering removed all hosts for the request with instance ID '3a5267f7-690e-4fa2-890d-d7491ab365b5'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 799.562829] nova-scheduler[52393]: INFO nova.filters [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Filtering removed all hosts for the request with instance ID '3a5267f7-690e-4fa2-890d-d7491ab365b5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 799.562973] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 799.563168] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6e683fad-4f3a-430d-8a4d-a59b12b6d38b tempest-ServersAaction247Test-1710864051 tempest-ServersAaction247Test-1710864051-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 804.297582] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Starting to schedule for instances: ['1a4d0102-500e-494f-977e-322e51e79d95'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 804.298276] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 804.298591] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.299078] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.302017] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 804.302017] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 804.347455] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.347455] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.347455] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.353613] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.354887] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.354887] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.356554] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 804.356901] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='3',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_367973317efd4063b56c3f337ad62856='0',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='1',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:36:46Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 35, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', 'a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 804.359026] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.filters [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 804.359026] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:35:34. Elapsed time is 97.221759 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 804.359496] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 804.359496] nova-scheduler[52396]: INFO nova.filters [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Filter ComputeFilter returned 0 hosts [ 804.360570] nova-scheduler[52396]: DEBUG nova.filters [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Filtering removed all hosts for the request with instance ID '1a4d0102-500e-494f-977e-322e51e79d95'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 804.360896] nova-scheduler[52396]: INFO nova.filters [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Filtering removed all hosts for the request with instance ID '1a4d0102-500e-494f-977e-322e51e79d95'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 804.363573] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 804.363573] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e96c8610-3a48-4598-aa08-8005c37c57c2 tempest-ServersNegativeTestJSON-954031117 tempest-ServersNegativeTestJSON-954031117-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 823.456666] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.456922] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.457094] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.457211] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.457264] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.457312] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 823.457430] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.457559] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 823.457719] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 823.457793] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 823.460778] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 823.460906] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 823.460981] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 823.461051] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-b1c129fe-87ac-44f0-92fb-e0ec9e66b190 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 839.396581] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Starting to schedule for instances: ['19881c50-a8ff-411f-b570-d4dc9ef3b0dc'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 839.397068] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 839.397246] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 839.397432] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 839.397670] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 839.397881] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 839.438070] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 839.438365] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 839.438573] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 839.447779] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 839.448079] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 839.448299] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 839.450913] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 839.451168] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 839.451607] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='4',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_d62d59712e2f4a1db623289edd1f497a='0',num_proj_f8c98a74b81e4f658a4a0ee9e97d8ab0='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_spawning='9',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:37:35Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 839.452047] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 839.452267] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 839.452472] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Update host state with instances: ['a45f24ab-afe1-4ffd-a917-11b68a0b29ec', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00', '35630c7b-fdf4-4d6d-8e5a-0045f1387f93'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 839.452677] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 839.453046] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 839.453504] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.453742] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.453999] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.454253] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.454451] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.454712] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.454942] nova-scheduler[52393]: DEBUG nova.filters [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 839.455167] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 839.455446] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 839.455672] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Attempting to claim resources in the placement API for instance 19881c50-a8ff-411f-b570-d4dc9ef3b0dc {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 839.512864] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] [instance: 19881c50-a8ff-411f-b570-d4dc9ef3b0dc] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 839.513178] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 839.513387] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 839.513589] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-836c245e-34e4-4725-a8f7-488797972e2e tempest-ServerActionsTestJSON-973878157 tempest-ServerActionsTestJSON-973878157-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.193384] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.193623] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.193776] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 879.194205] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 879.194507] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.003s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 879.194679] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-cc6d3dfe-f8ea-452b-89bf-32e56cdd5ca7 tempest-ServerDiagnosticsTest-1589092301 tempest-ServerDiagnosticsTest-1589092301-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 886.707628] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Starting to schedule for instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 886.707930] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 886.709845] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.709845] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.709845] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 886.709845] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 886.751755] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 886.752085] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 886.752182] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 886.759045] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 886.759045] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 886.759418] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 886.759418] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 886.759530] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 886.759754] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 886.759923] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 886.760182] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 886.760384] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.760661] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.760875] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.761075] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.761252] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.761424] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.761587] nova-scheduler[52396]: DEBUG nova.filters [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 886.761746] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 886.761929] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 886.762144] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Attempting to claim resources in the placement API for instance 0257c136-6f30-43ae-8f8d-e8f23d8328ef {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 886.815882] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] [instance: 0257c136-6f30-43ae-8f8d-e8f23d8328ef] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 886.815882] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 886.815882] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 886.815882] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6351ee06-cea0-4ee6-921b-037b51068a0e tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 910.002916] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting to schedule for instances: ['9fd550e6-9589-4bb9-bcd2-0ef316185e24'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 910.003224] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 910.003390] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 910.003572] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 910.003786] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 910.003993] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 910.044182] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 910.044492] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 910.044696] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 910.051897] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 910.054023] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 910.054023] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 910.054023] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 910.054023] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 910.054023] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 910.054023] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 910.054023] nova-scheduler[52393]: DEBUG nova.filters [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 910.054422] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 82.91689 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 910.054422] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 910.054422] nova-scheduler[52393]: INFO nova.filters [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filter ComputeFilter returned 0 hosts [ 910.054422] nova-scheduler[52393]: DEBUG nova.filters [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtering removed all hosts for the request with instance ID '9fd550e6-9589-4bb9-bcd2-0ef316185e24'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 910.054616] nova-scheduler[52393]: INFO nova.filters [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtering removed all hosts for the request with instance ID '9fd550e6-9589-4bb9-bcd2-0ef316185e24'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 910.054653] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 910.054805] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-d92aa39b-8c05-4472-81c7-67bc40731e20 tempest-AttachVolumeNegativeTest-209289787 tempest-AttachVolumeNegativeTest-209289787-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 918.675621] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['bf274d0d-f866-4789-a6ce-295d6722381c'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 918.675903] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 918.679799] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.680064] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.680286] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 918.680475] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 918.734895] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 918.735149] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 918.735320] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 918.743756] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 918.743968] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 918.744602] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 918.744907] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 918.745156] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 918.745331] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 918.745500] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 918.745823] nova-scheduler[52396]: DEBUG nova.filters [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 918.746179] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 91.609094 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 918.746386] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 918.746566] nova-scheduler[52396]: INFO nova.filters [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 918.746723] nova-scheduler[52396]: DEBUG nova.filters [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID 'bf274d0d-f866-4789-a6ce-295d6722381c'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 918.746866] nova-scheduler[52396]: INFO nova.filters [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID 'bf274d0d-f866-4789-a6ce-295d6722381c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 918.747025] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 918.747195] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-89084f6f-fb2a-4134-b87e-23bf25ab8705 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 921.039488] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['2eff9915-37bb-4a67-8fbf-8f9d7cb20e9a'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 921.045169] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 921.045169] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 921.045169] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 921.045169] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 921.045169] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 921.083911] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 921.084170] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 921.084634] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 921.092303] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 921.092479] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 921.092843] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 921.093129] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 921.093303] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 921.093466] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 921.093634] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 921.093894] nova-scheduler[52393]: DEBUG nova.filters [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 921.094654] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 93.957151 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 921.094654] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 921.094654] nova-scheduler[52393]: INFO nova.filters [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 921.094654] nova-scheduler[52393]: DEBUG nova.filters [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '2eff9915-37bb-4a67-8fbf-8f9d7cb20e9a'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 921.094859] nova-scheduler[52393]: INFO nova.filters [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '2eff9915-37bb-4a67-8fbf-8f9d7cb20e9a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 921.094859] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 921.094972] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6b86d7f8-e5b4-48a1-b63f-ef3bdb6703fd tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 922.325113] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['97f63dea-99b0-462d-9840-7f0bc7539253'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 922.325396] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 922.325560] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 922.325741] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 922.325940] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 922.326142] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 922.370837] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 922.371082] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 922.371259] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 922.382558] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 922.382558] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 922.382870] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 922.383495] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 922.383495] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 922.383495] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 922.383824] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 922.383824] nova-scheduler[52396]: DEBUG nova.filters [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 922.384747] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 95.247088 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 922.385803] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 922.385803] nova-scheduler[52396]: INFO nova.filters [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 922.385803] nova-scheduler[52396]: DEBUG nova.filters [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '97f63dea-99b0-462d-9840-7f0bc7539253'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 922.385803] nova-scheduler[52396]: INFO nova.filters [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '97f63dea-99b0-462d-9840-7f0bc7539253'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 922.385803] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 922.385803] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a14dbcea-f122-41b6-aa6c-84535d414af0 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 925.141871] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['991d5899-397e-4697-b189-c0f4efe06749'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 925.143291] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 925.143291] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 925.143291] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 925.143291] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 925.143291] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 925.297705] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 925.298107] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 925.298329] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 925.306126] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 925.306424] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 925.306940] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 925.307262] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 925.307776] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 925.307776] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 925.307776] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 925.308037] nova-scheduler[52393]: DEBUG nova.filters [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 925.308218] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 98.171276 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 925.308371] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 925.308517] nova-scheduler[52393]: INFO nova.filters [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 925.308661] nova-scheduler[52393]: DEBUG nova.filters [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '991d5899-397e-4697-b189-c0f4efe06749'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 925.308824] nova-scheduler[52393]: INFO nova.filters [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '991d5899-397e-4697-b189-c0f4efe06749'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 925.308982] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 925.309482] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-2cfba475-889c-44e0-843f-f5ba1618ff43 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 927.210583] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Starting to schedule for instances: ['e47179d7-479b-460f-897e-c1cdb450f1ae'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 927.210868] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 927.211041] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.211229] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.211425] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.211618] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 927.260925] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 927.261194] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 927.261369] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 927.272016] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 927.272016] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 927.272388] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 927.272787] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 927.272978] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 927.273180] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 927.273353] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 927.273674] nova-scheduler[52396]: DEBUG nova.filters [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 927.273912] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 100.136947 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 927.274284] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 927.274476] nova-scheduler[52396]: INFO nova.filters [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filter ComputeFilter returned 0 hosts [ 927.275012] nova-scheduler[52396]: DEBUG nova.filters [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtering removed all hosts for the request with instance ID 'e47179d7-479b-460f-897e-c1cdb450f1ae'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 927.275198] nova-scheduler[52396]: INFO nova.filters [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtering removed all hosts for the request with instance ID 'e47179d7-479b-460f-897e-c1cdb450f1ae'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 927.275361] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 927.275685] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-497b6f5c-a7f1-45a3-93e4-f3007a741289 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 927.636941] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Starting to schedule for instances: ['dd37da0a-066c-4513-ac35-eaf6ced29db2'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 927.638481] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 927.638481] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.638481] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.638481] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 927.638481] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 927.693761] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 927.693761] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 927.693761] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 927.698485] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 927.698692] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 927.699050] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=10,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='5',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='1',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='3',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:38:31Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 927.699318] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 927.701989] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 927.701989] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 927.701989] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 927.701989] nova-scheduler[52393]: DEBUG nova.filters [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 927.701989] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 100.563293 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 927.701989] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 927.701989] nova-scheduler[52393]: INFO nova.filters [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filter ComputeFilter returned 0 hosts [ 927.701989] nova-scheduler[52393]: DEBUG nova.filters [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtering removed all hosts for the request with instance ID 'dd37da0a-066c-4513-ac35-eaf6ced29db2'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 927.701989] nova-scheduler[52393]: INFO nova.filters [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtering removed all hosts for the request with instance ID 'dd37da0a-066c-4513-ac35-eaf6ced29db2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 927.701989] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 927.701989] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-72d56085-e9c9-424b-959f-1ba195f6f3c5 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 928.391130] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['14d6f3f3-bd46-4e39-ab08-acf8290c8808'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 928.391442] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 928.391442] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 928.391573] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 928.391764] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 928.391955] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 928.446393] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 928.446665] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 928.446963] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 928.453928] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 928.453928] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 928.454185] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='5',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:14Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=9) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 928.454462] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 928.454552] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 928.456279] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'cc1d534d-6a43-4575-895d-c3bef84d772e', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 928.456279] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 928.456279] nova-scheduler[52396]: DEBUG nova.filters [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 928.456279] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 101.318364 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 928.456279] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 has not been heard from in a while [ 928.456279] nova-scheduler[52396]: INFO nova.filters [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 928.456279] nova-scheduler[52396]: DEBUG nova.filters [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '14d6f3f3-bd46-4e39-ab08-acf8290c8808'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 928.456279] nova-scheduler[52396]: INFO nova.filters [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '14d6f3f3-bd46-4e39-ab08-acf8290c8808'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 928.456279] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 928.456279] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-250b3355-3099-449b-9d78-fad31feb5ee4 tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 928.776071] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 928.776284] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 928.776460] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 928.782411] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 928.782641] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 928.782804] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-535b3fef-8a08-4a03-b175-5102731937ce tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 929.612695] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Starting to schedule for instances: ['051ba276-b0ad-4895-bb4f-7d8b998fa81f'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 929.612695] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 929.614664] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.614961] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.615288] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 929.615394] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 929.663289] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 929.663525] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 929.663690] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 929.673197] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 929.673561] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 929.673739] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 929.674034] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 929.674180] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 929.674336] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 929.674494] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 929.674740] nova-scheduler[52393]: DEBUG nova.filters [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 929.674944] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 102.538007 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 929.675768] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 929.676017] nova-scheduler[52393]: INFO nova.filters [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filter ComputeFilter returned 0 hosts [ 929.676232] nova-scheduler[52393]: DEBUG nova.filters [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filtering removed all hosts for the request with instance ID '051ba276-b0ad-4895-bb4f-7d8b998fa81f'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 929.676509] nova-scheduler[52393]: INFO nova.filters [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filtering removed all hosts for the request with instance ID '051ba276-b0ad-4895-bb4f-7d8b998fa81f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 929.676583] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 929.676727] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-dfff668f-a86c-4533-b360-f7c910eff82b tempest-MigrationsAdminTest-620644018 tempest-MigrationsAdminTest-620644018-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 931.226251] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting to schedule for instances: ['169c39b4-b78f-4051-8025-87cc7be85e73'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 931.226563] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 931.226768] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 931.227030] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 931.227499] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 931.227693] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 931.283026] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 931.283026] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 931.283026] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 931.290631] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 931.290983] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 931.291617] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 931.292088] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 931.292365] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 931.292758] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 931.293066] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 931.293523] nova-scheduler[52396]: DEBUG nova.filters [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 931.294148] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 104.156862 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 931.294930] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 931.294930] nova-scheduler[52396]: INFO nova.filters [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filter ComputeFilter returned 0 hosts [ 931.294930] nova-scheduler[52396]: DEBUG nova.filters [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '169c39b4-b78f-4051-8025-87cc7be85e73'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 931.294930] nova-scheduler[52396]: INFO nova.filters [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtering removed all hosts for the request with instance ID '169c39b4-b78f-4051-8025-87cc7be85e73'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 931.295503] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 931.295845] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-3ff97f10-6e7a-4f71-b406-b22b271da97c tempest-DeleteServersTestJSON-1895503581 tempest-DeleteServersTestJSON-1895503581-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 932.682259] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Starting to schedule for instances: ['18cb3ab9-4875-45fe-9ee2-041ae14dabac'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 932.682555] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 932.682716] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 932.682895] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 932.683162] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 932.683533] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 932.728962] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 932.729930] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 932.730063] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 932.742225] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 932.742320] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 932.742842] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 932.743099] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 932.743242] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 932.743552] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 932.743670] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 932.744077] nova-scheduler[52393]: DEBUG nova.filters [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 932.744298] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 105.607198 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 932.744675] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 932.744938] nova-scheduler[52393]: INFO nova.filters [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filter ComputeFilter returned 0 hosts [ 932.745191] nova-scheduler[52393]: DEBUG nova.filters [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtering removed all hosts for the request with instance ID '18cb3ab9-4875-45fe-9ee2-041ae14dabac'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 932.745422] nova-scheduler[52393]: INFO nova.filters [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtering removed all hosts for the request with instance ID '18cb3ab9-4875-45fe-9ee2-041ae14dabac'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 932.745669] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 932.745842] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e13fb1b4-50a9-4d85-9e65-d038a38c3055 tempest-AttachVolumeShelveTestJSON-459987434 tempest-AttachVolumeShelveTestJSON-459987434-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 933.056117] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Starting to schedule for instances: ['b2f955f3-1f2d-4a1a-a583-d77ac46193a6'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 933.056493] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 933.056659] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.056838] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.057868] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 933.057868] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 933.105640] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.105904] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.106030] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.112796] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 933.112982] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 933.113353] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 933.114153] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 933.114377] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 933.114549] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 933.114707] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 933.114952] nova-scheduler[52396]: DEBUG nova.filters [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 933.115188] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 105.978221 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 933.115346] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 933.115497] nova-scheduler[52396]: INFO nova.filters [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filter ComputeFilter returned 0 hosts [ 933.115642] nova-scheduler[52396]: DEBUG nova.filters [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtering removed all hosts for the request with instance ID 'b2f955f3-1f2d-4a1a-a583-d77ac46193a6'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 933.115849] nova-scheduler[52396]: INFO nova.filters [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtering removed all hosts for the request with instance ID 'b2f955f3-1f2d-4a1a-a583-d77ac46193a6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 933.116012] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 933.116102] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bfc9ea79-747b-4d88-bccc-a6473554ef36 tempest-ServersTestMultiNic-825955807 tempest-ServersTestMultiNic-825955807-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 934.484221] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Starting to schedule for instances: ['52645255-a8f6-4934-abe7-c2f96bc04fad'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 934.484571] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 934.484752] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 934.484962] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 934.485218] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 934.485415] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 934.528718] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 934.528946] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 934.529135] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 934.536250] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 934.536454] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 934.537130] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 934.537437] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 934.537607] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 934.537767] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 934.537932] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 934.538199] nova-scheduler[52393]: DEBUG nova.filters [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 934.538408] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 107.401467 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 934.538567] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 934.538712] nova-scheduler[52393]: INFO nova.filters [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Filter ComputeFilter returned 0 hosts [ 934.538857] nova-scheduler[52393]: DEBUG nova.filters [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Filtering removed all hosts for the request with instance ID '52645255-a8f6-4934-abe7-c2f96bc04fad'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 934.538992] nova-scheduler[52393]: INFO nova.filters [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Filtering removed all hosts for the request with instance ID '52645255-a8f6-4934-abe7-c2f96bc04fad'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 934.539210] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 934.539366] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-59c7098a-723c-4620-a86e-b670b84408d7 tempest-ServersAdminNegativeTestJSON-788745189 tempest-ServersAdminNegativeTestJSON-788745189-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 938.022247] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting to schedule for instances: ['c01ad677-201e-40d3-9c4e-db84e34899d9'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 938.022525] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 938.022693] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.022866] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.029273] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 938.029273] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 938.076429] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 938.076429] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 938.076429] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 938.082043] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 938.082349] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 938.082826] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 938.083126] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 938.083291] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 938.084030] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 938.084030] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 938.084030] nova-scheduler[52396]: DEBUG nova.filters [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 938.084280] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 110.947107 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 938.084280] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 938.084588] nova-scheduler[52396]: INFO nova.filters [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeFilter returned 0 hosts [ 938.084588] nova-scheduler[52396]: DEBUG nova.filters [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID 'c01ad677-201e-40d3-9c4e-db84e34899d9'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 938.084694] nova-scheduler[52396]: INFO nova.filters [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID 'c01ad677-201e-40d3-9c4e-db84e34899d9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 938.084786] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 938.084926] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6adf0b78-09b9-413a-8dfc-f960db4ba732 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 940.826083] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting to schedule for instances: ['fb2d61a8-d380-4296-b1d7-8c61e775e465'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 940.826506] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 940.826506] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.828973] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.828973] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 940.828973] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 940.875075] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 940.875318] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 940.875492] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 940.882132] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 940.882363] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 940.882721] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 940.883027] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 940.883202] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 940.883371] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with instances: ['4540cd82-440c-41e3-8bfa-b384da6fc964', '65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05', 'f202a181-b5ea-4b06-91ad-86356b51e088', '63151ec9-f383-46cc-ac57-c3f7f1569410', 'c5b391a9-7969-4119-9bc6-b0e1fe7a9713', '95f71b47-73c8-4a82-b806-f6f2ed9cdbb3', '7476fb96-5247-472c-ab92-ef7e5916cb00'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 940.883518] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 940.883761] nova-scheduler[52393]: DEBUG nova.filters [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 940.883968] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 113.747028 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 940.884146] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 940.884308] nova-scheduler[52393]: INFO nova.filters [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeFilter returned 0 hosts [ 940.884455] nova-scheduler[52393]: DEBUG nova.filters [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID 'fb2d61a8-d380-4296-b1d7-8c61e775e465'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 940.884590] nova-scheduler[52393]: INFO nova.filters [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID 'fb2d61a8-d380-4296-b1d7-8c61e775e465'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 940.884734] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 940.884874] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-6edc534a-cf9c-4003-b4bd-805cd01d6e78 tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 942.946969] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 942.947797] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 942.947797] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 942.947797] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 942.947978] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 942.949267] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 942.950720] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 942.954463] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 942.954463] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 942.954463] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 942.954618] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-2914805b-fd71-493e-a758-1339494e29ef None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 942.954618] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.007s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 942.957569] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-2914805b-fd71-493e-a758-1339494e29ef None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 942.957768] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2914805b-fd71-493e-a758-1339494e29ef None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.008s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 943.309690] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting to schedule for instances: ['8cba964e-05b8-4781-9f5e-ca6c2d33f824'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 943.309966] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 943.310707] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 943.310914] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 943.311141] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 943.311343] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 943.381653] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 943.381880] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 943.382089] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 943.393582] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 943.393582] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 943.393582] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 943.397701] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 943.398158] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 943.399016] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 943.399016] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 943.399155] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 943.400360] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 943.401266] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 943.401266] nova-scheduler[52396]: DEBUG nova.filters [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 943.401266] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 116.264121 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 943.401266] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 943.401563] nova-scheduler[52396]: INFO nova.filters [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeFilter returned 0 hosts [ 943.401597] nova-scheduler[52396]: DEBUG nova.filters [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID '8cba964e-05b8-4781-9f5e-ca6c2d33f824'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 943.401713] nova-scheduler[52396]: INFO nova.filters [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID '8cba964e-05b8-4781-9f5e-ca6c2d33f824'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 943.401857] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 943.402010] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-1277c37e-3d1e-4f61-b982-ae895636fb2c tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 944.164512] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['6432f12e-c265-4237-a867-166a57a109fe'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 944.164913] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 944.164913] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 944.167747] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 944.167747] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 944.167747] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 944.213022] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 944.213288] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 944.213460] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 944.220030] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 944.220668] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 944.220668] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 944.222520] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 944.222719] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 944.223098] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 944.223382] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 944.223548] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 944.223706] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 944.223864] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 944.224123] nova-scheduler[52393]: DEBUG nova.filters [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 944.224329] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 117.087389 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 944.224484] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 944.224638] nova-scheduler[52393]: INFO nova.filters [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 944.224789] nova-scheduler[52393]: DEBUG nova.filters [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID '6432f12e-c265-4237-a867-166a57a109fe'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 944.224926] nova-scheduler[52393]: INFO nova.filters [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID '6432f12e-c265-4237-a867-166a57a109fe'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 944.225101] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 944.225266] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-e10a74b2-83bf-48d8-a781-607adc980fdf tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 945.296211] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting to schedule for instances: ['9d0b5c30-4228-42f1-802a-41e175a83a8c'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 945.296211] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 945.296659] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 945.297732] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 945.297732] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 945.297732] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 945.347775] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 945.348008] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 945.348179] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 945.358895] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 945.359131] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 945.359297] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 945.365175] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 945.365175] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 945.365175] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=9,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=190,free_ram_mb=194798,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=10,mapped=1,memory_mb=196590,memory_mb_used=1792,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=10,service_id=None,stats={failed_builds='9',io_workload='10',num_instances='10',num_os_type_None='10',num_proj_2140598201444851ab98084d07307c86='1',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_64df375499704a52a28c8e3086612623='1',num_proj_69b9135b39df41b49fbd80c72a9cab5c='0',num_proj_6cd208d1e842468ea334e506728ad9d4='1',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_b3917aae625b4cfd9a0ab45ad226a4cb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_task_None='1',num_task_deleting='2',num_task_spawning='7',num_vm_building='10'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:16Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=10) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 945.366229] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 945.366408] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 945.366562] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 945.366724] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.004s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 945.366977] nova-scheduler[52396]: DEBUG nova.filters [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 945.367198] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 118.230258 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 945.367364] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194798MB disk: 194560MB io_ops: 10 instances: 10, allocation_candidates: 1 has not been heard from in a while [ 945.367524] nova-scheduler[52396]: INFO nova.filters [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filter ComputeFilter returned 0 hosts [ 945.367698] nova-scheduler[52396]: DEBUG nova.filters [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID '9d0b5c30-4228-42f1-802a-41e175a83a8c'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 945.367971] nova-scheduler[52396]: INFO nova.filters [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtering removed all hosts for the request with instance ID '9d0b5c30-4228-42f1-802a-41e175a83a8c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 945.367971] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 945.368157] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-a53c243e-9f38-4e63-bc71-71aa9cd1a5fe tempest-ServerDiskConfigTestJSON-1201106396 tempest-ServerDiskConfigTestJSON-1201106396-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 946.449082] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['e155b852-ea2a-4c17-8308-3829681a8a16'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 946.449442] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 946.449689] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.449884] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.450253] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 946.450253] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 946.497997] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 946.497997] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 946.497997] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 946.504620] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 946.504829] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 946.504986] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 946.507177] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 946.507374] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 946.507729] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 946.507999] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 946.508177] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 946.508328] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 946.508486] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 946.508730] nova-scheduler[52393]: DEBUG nova.filters [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 946.508987] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 119.371999 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 946.509209] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 946.509367] nova-scheduler[52393]: INFO nova.filters [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 946.509510] nova-scheduler[52393]: DEBUG nova.filters [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'e155b852-ea2a-4c17-8308-3829681a8a16'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 946.509680] nova-scheduler[52393]: INFO nova.filters [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'e155b852-ea2a-4c17-8308-3829681a8a16'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 946.509833] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 946.509976] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9f2aaa17-a573-470a-bce1-469f2f45d45e tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 947.010713] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['f71f47e8-7766-4989-87eb-9d2873caba9c'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 947.011045] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 947.011230] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.011417] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.011614] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.011912] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 947.054845] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.055103] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.055273] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.066165] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.066381] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.066548] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.069088] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.069292] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.069676] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 947.069963] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 947.070151] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 947.070319] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 947.070511] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.070765] nova-scheduler[52396]: DEBUG nova.filters [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 947.070974] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 119.934033 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 947.071142] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 947.071297] nova-scheduler[52396]: INFO nova.filters [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 947.071443] nova-scheduler[52396]: DEBUG nova.filters [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'f71f47e8-7766-4989-87eb-9d2873caba9c'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 947.071578] nova-scheduler[52396]: INFO nova.filters [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'f71f47e8-7766-4989-87eb-9d2873caba9c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 947.071857] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 947.071966] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-43eb21c9-5352-4f4c-850f-5eec3443d8a2 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 947.532721] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Starting to schedule for instances: ['82fd048a-29e9-4f9b-8a98-183595a0d930'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 947.533099] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 947.533342] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.533598] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.533844] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 947.534108] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 947.586689] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.586996] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.587252] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.593785] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.593982] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.594158] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.596055] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 947.596239] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 947.596584] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 947.596851] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 947.597329] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 37, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 947.597329] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 947.597329] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 947.597674] nova-scheduler[52393]: DEBUG nova.filters [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 947.597761] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:37:34. Elapsed time is 120.460815 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 947.597915] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 947.598090] nova-scheduler[52393]: INFO nova.filters [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Filter ComputeFilter returned 0 hosts [ 947.598290] nova-scheduler[52393]: DEBUG nova.filters [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Filtering removed all hosts for the request with instance ID '82fd048a-29e9-4f9b-8a98-183595a0d930'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 947.598366] nova-scheduler[52393]: INFO nova.filters [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Filtering removed all hosts for the request with instance ID '82fd048a-29e9-4f9b-8a98-183595a0d930'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 947.598578] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 947.598631] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-3418ca53-4d13-485b-9a3f-f25fcca56526 tempest-InstanceActionsV221TestJSON-662584722 tempest-InstanceActionsV221TestJSON-662584722-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 948.920201] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['b5ad6145-8bf0-4aed-951b-eb11dd87ed7d'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 948.920506] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 948.920650] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.920837] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.921044] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 948.921225] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 948.967294] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 948.967649] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 948.967898] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 948.975066] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 948.975703] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 948.975703] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 948.977760] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 948.977962] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 948.978448] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 948.978739] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 948.978923] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 948.979134] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 948.979293] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 948.979536] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 948.979741] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.979922] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980129] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980294] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980489] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980677] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980840] nova-scheduler[52396]: DEBUG nova.filters [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 948.980997] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 948.981178] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 948.981356] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Attempting to claim resources in the placement API for instance b5ad6145-8bf0-4aed-951b-eb11dd87ed7d {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 949.032317] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] [instance: b5ad6145-8bf0-4aed-951b-eb11dd87ed7d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 949.032646] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 949.032862] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 949.033075] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7f62efef-7994-4253-9212-0d5293f44bef tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.326795] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Starting to schedule for instances: ['c6ee7d41-5522-4019-9da9-8503ec99e2b5'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 951.327122] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 951.327286] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.327465] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.327687] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.327881] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 951.367679] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.367945] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.368125] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.374681] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.374885] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.375042] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.377153] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.377353] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.377720] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 951.378012] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 951.378184] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 951.378337] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 951.378498] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.378815] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 951.379027] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.379211] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.379403] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.379565] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.379932] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.380161] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.418909] nova-scheduler[52393]: DEBUG nova.filters [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.418909] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 951.418909] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 951.418909] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Attempting to claim resources in the placement API for instance c6ee7d41-5522-4019-9da9-8503ec99e2b5 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 951.548419] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Starting to schedule for instances: ['d97a55c5-f248-482a-9986-212e84bdd0b0'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 951.548738] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 951.548794] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] [instance: c6ee7d41-5522-4019-9da9-8503ec99e2b5] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 951.548960] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.549085] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.549158] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.549299] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.549356] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 951.549505] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-1f531249-ae54-4a41-a4d7-9533b7be56ed tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.549553] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 951.590396] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.590622] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.590782] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.597190] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.597441] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.597654] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.599597] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.599923] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.600358] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 951.600501] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 951.600597] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 951.600744] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 951.600901] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 951.601208] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 951.601502] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.601778] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.602126] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.602420] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.602684] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.602963] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.603289] nova-scheduler[52396]: DEBUG nova.filters [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 951.603530] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 951.603746] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 951.603933] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Attempting to claim resources in the placement API for instance d97a55c5-f248-482a-9986-212e84bdd0b0 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 951.646451] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] [instance: d97a55c5-f248-482a-9986-212e84bdd0b0] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 951.646777] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 951.646988] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 951.647212] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-bc3dd74e-b01b-42fa-9b0c-efa2ef8ce8e8 tempest-ServerShowV247Test-1963305943 tempest-ServerShowV247Test-1963305943-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 963.354439] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Starting to schedule for instances: ['311eb356-b844-4b1b-a0f0-ed7da6bb9f1d'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 963.354769] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 963.354936] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 963.355133] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 963.355350] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 963.355541] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 963.391870] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 963.392150] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 963.392330] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 963.398580] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 963.398772] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 963.398935] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 963.401056] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 963.401256] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 963.401600] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='9',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_deleting='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:39:33Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 963.401875] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 963.402076] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 963.402235] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Update host state with instances: ['65bf8cf0-825c-42d8-bd78-62a6277d29d7', 'e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 963.402394] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 963.402636] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 963.402835] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403013] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403206] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403369] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403527] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403686] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403844] nova-scheduler[52393]: DEBUG nova.filters [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 963.403997] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 963.404176] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 963.404348] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Attempting to claim resources in the placement API for instance 311eb356-b844-4b1b-a0f0-ed7da6bb9f1d {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 963.451328] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] [instance: 311eb356-b844-4b1b-a0f0-ed7da6bb9f1d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 963.451603] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 963.451802] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 963.452040] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 977.461146] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 977.461420] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 977.461552] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 977.461631] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 977.461838] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 977.462127] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-f4f513fe-b892-48b1-8990-4093ad79658d tempest-ServerExternalEventsTest-116321567 tempest-ServerExternalEventsTest-116321567-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 982.800446] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Starting to schedule for instances: ['e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 982.800745] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 982.800913] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 982.801377] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 982.801625] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 982.801814] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 982.843147] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 982.843308] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 982.843481] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 982.851038] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 982.851038] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 982.851038] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='13',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_6e5c7d3736204e8eafce9963fa2a28eb='0',num_proj_bf64f2b352e24fe39bc883bbca0e091e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='1',num_task_None='1',num_task_deleting='1',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:40:04Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=2) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 982.851325] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 982.851496] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 982.851651] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Update host state with instances: ['e4f0342a-4169-40aa-b234-a2e2340d5b05'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 982.851820] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 982.852135] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 982.852352] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.852537] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.852732] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.852901] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.853119] nova-scheduler[52396]: DEBUG nova.scheduler.filters.affinity_filter [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Group affinity: check if cpu-1 in [] {{(pid=52396) host_passes /opt/stack/nova/nova/scheduler/filters/affinity_filter.py:152}} [ 982.853269] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.853435] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.853592] nova-scheduler[52396]: DEBUG nova.filters [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 982.853747] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 982.853920] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 982.854106] nova-scheduler[52396]: DEBUG nova.scheduler.utils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Attempting to claim resources in the placement API for instance e924a9ab-71c1-4efe-a217-b036ec785dc8 {{(pid=52396) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 982.906540] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] [instance: e924a9ab-71c1-4efe-a217-b036ec785dc8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=52396) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 982.906997] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 982.907344] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 982.907665] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e1386e7d-41ed-4b89-977f-4611b40d6790 tempest-ServerGroupTestJSON-1525229369 tempest-ServerGroupTestJSON-1525229369-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1028.952399] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1028.952678] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1028.952823] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1028.952882] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1028.952937] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1028.952982] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7d935374-e183-4a03-b795-fbe4cedc3ae5 tempest-ServerActionsTestOtherB-1863421808 tempest-ServerActionsTestOtherB-1863421808-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1035.715195] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Starting to schedule for instances: ['a429b005-fe11-43b6-a07a-d508c9a10ed4'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1035.715472] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1035.715472] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1035.715666] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1035.715876] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1035.716197] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1035.761760] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1035.762174] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1035.762463] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1035.770074] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1035.770314] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1035.770729] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=189,free_ram_mb=194542,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=11,mapped=1,memory_mb=196590,memory_mb_used=2048,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=12,service_id=None,stats={failed_builds='19',io_workload='12',num_instances='12',num_os_type_None='12',num_proj_2140598201444851ab98084d07307c86='1',num_proj_2549d966f11047368e896d5354721163='2',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_a1fb7769ccc2463094e0dd138a59226e='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_bf64f2b352e24fe39bc883bbca0e091e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='0',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_None='11',num_task_deleting='0',num_task_spawning='1',num_vm_building='12'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:40:59Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=12) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1035.771082] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1035.771294] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1035.771496] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Update host state with instances: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1035.771698] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1035.772013] nova-scheduler[52393]: DEBUG nova.filters [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1035.772301] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:39:34. Elapsed time is 88.635288 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1035.772481] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194542MB disk: 193536MB io_ops: 12 instances: 12, allocation_candidates: 1 has not been heard from in a while [ 1035.772636] nova-scheduler[52393]: INFO nova.filters [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Filter ComputeFilter returned 0 hosts [ 1035.772788] nova-scheduler[52393]: DEBUG nova.filters [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Filtering removed all hosts for the request with instance ID 'a429b005-fe11-43b6-a07a-d508c9a10ed4'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1035.772927] nova-scheduler[52393]: INFO nova.filters [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Filtering removed all hosts for the request with instance ID 'a429b005-fe11-43b6-a07a-d508c9a10ed4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1035.773127] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1035.773334] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-22d88010-187b-4c3f-949e-30e5b1055e2b tempest-ServerRescueTestJSONUnderV235-1763884815 tempest-ServerRescueTestJSONUnderV235-1763884815-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1038.983140] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1038.983140] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1038.983140] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1038.983444] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.update_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1038.983444] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.update_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1038.983444] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-136093ad-9777-4432-b06f-c4b00dd320dd tempest-ServersTestBootFromVolume-387843988 tempest-ServersTestBootFromVolume-387843988-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.update_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1039.497026] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Starting to schedule for instances: ['16c2dd48-f6ce-4b10-89c8-1d7039a5b71b'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1039.497340] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1039.497501] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1039.497810] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1039.498119] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1039.498365] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1039.536806] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1039.537121] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1039.537324] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1039.543799] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1039.544035] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1039.544397] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=189,free_ram_mb=194542,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=11,mapped=1,memory_mb=196590,memory_mb_used=2048,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=12,service_id=None,stats={failed_builds='19',io_workload='12',num_instances='12',num_os_type_None='12',num_proj_2140598201444851ab98084d07307c86='1',num_proj_2549d966f11047368e896d5354721163='2',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_a1fb7769ccc2463094e0dd138a59226e='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_bf64f2b352e24fe39bc883bbca0e091e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='0',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_None='11',num_task_deleting='0',num_task_spawning='1',num_vm_building='12'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:40:59Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=12) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1039.544718] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1039.544893] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1039.545066] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Update host state with instances: ['e924a9ab-71c1-4efe-a217-b036ec785dc8', '311eb356-b844-4b1b-a0f0-ed7da6bb9f1d'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1039.545231] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1039.545469] nova-scheduler[52396]: DEBUG nova.filters [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1039.545673] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:39:34. Elapsed time is 92.40873 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1039.545828] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194542MB disk: 193536MB io_ops: 12 instances: 12, allocation_candidates: 1 has not been heard from in a while [ 1039.545992] nova-scheduler[52396]: INFO nova.filters [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Filter ComputeFilter returned 0 hosts [ 1039.546307] nova-scheduler[52396]: DEBUG nova.filters [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Filtering removed all hosts for the request with instance ID '16c2dd48-f6ce-4b10-89c8-1d7039a5b71b'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1039.546307] nova-scheduler[52396]: INFO nova.filters [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Filtering removed all hosts for the request with instance ID '16c2dd48-f6ce-4b10-89c8-1d7039a5b71b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1039.546458] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1039.546605] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-2175cf4f-037f-4449-bcb5-c3ea6836a983 tempest-ServerShowV254Test-330546274 tempest-ServerShowV254Test-330546274-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1063.059077] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Starting to schedule for instances: ['327e66f0-a884-45a2-9bb6-581e53dc75cf'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1063.059547] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1063.059805] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1063.060041] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1063.060257] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1063.060445] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1063.102640] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1063.102640] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1063.102640] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1063.108329] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1063.108538] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1063.108888] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=189,free_ram_mb=194542,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=11,mapped=1,memory_mb=196590,memory_mb_used=2048,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=12,service_id=None,stats={failed_builds='19',io_workload='12',num_instances='12',num_os_type_None='12',num_proj_2140598201444851ab98084d07307c86='1',num_proj_2549d966f11047368e896d5354721163='2',num_proj_4714528fb7fb41eb908a9bda448bdffc='1',num_proj_5981d0de9a5545a4b2db5ab222672012='1',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_a1fb7769ccc2463094e0dd138a59226e='1',num_proj_abdf2b93a0a241ae9fa1b395f41da87e='1',num_proj_bf64f2b352e24fe39bc883bbca0e091e='1',num_proj_c2d9ebe5ad8545b9ade33e18b6092a47='0',num_proj_fc9e7dc1863d455c98d44991ab5be2bc='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_None='11',num_task_deleting='0',num_task_spawning='1',num_vm_building='12'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:40:59Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=12) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1063.109172] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1063.109339] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 4, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 39, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1063.109492] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Update host state with instances: ['311eb356-b844-4b1b-a0f0-ed7da6bb9f1d'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1063.109671] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1063.109930] nova-scheduler[52393]: DEBUG nova.filters [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1063.110152] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:39:34. Elapsed time is 115.973192 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1063.110307] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194542MB disk: 193536MB io_ops: 12 instances: 12, allocation_candidates: 1 has not been heard from in a while [ 1063.110454] nova-scheduler[52393]: INFO nova.filters [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Filter ComputeFilter returned 0 hosts [ 1063.110600] nova-scheduler[52393]: DEBUG nova.filters [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Filtering removed all hosts for the request with instance ID '327e66f0-a884-45a2-9bb6-581e53dc75cf'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1063.110787] nova-scheduler[52393]: INFO nova.filters [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Filtering removed all hosts for the request with instance ID '327e66f0-a884-45a2-9bb6-581e53dc75cf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1063.110947] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1063.111125] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-9b00ae4f-d8b5-4164-8f3d-63f8070cbb65 tempest-InstanceActionsTestJSON-85834196 tempest-InstanceActionsTestJSON-85834196-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1065.951991] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1065.952256] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1065.952401] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1065.952609] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1065.952787] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1065.953038] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1065.953516] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1065.953904] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1065.954109] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1065.954274] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1065.956074] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1065.956255] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1065.957199] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1065.957475] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-4e6f60f1-9e6d-4bef-aafd-4fb22e4508ba None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1145.067384] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['b3115175-7069-4f36-ba74-4a22abd5634c'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1145.067721] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1145.067943] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1145.068150] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1145.068349] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1145.068527] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1145.108743] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1145.108963] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1145.109142] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1145.115652] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1145.115851] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1145.116022] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1145.117968] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1145.118180] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1145.118527] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1145.118797] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1145.118989] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1145.119181] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef', 'c6ee7d41-5522-4019-9da9-8503ec99e2b5', 'd97a55c5-f248-482a-9986-212e84bdd0b0', 'e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1145.119345] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1145.119597] nova-scheduler[52396]: DEBUG nova.filters [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1145.119823] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 77.982858 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1145.119983] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1145.120152] nova-scheduler[52396]: INFO nova.filters [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 1145.120301] nova-scheduler[52396]: DEBUG nova.filters [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'b3115175-7069-4f36-ba74-4a22abd5634c'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1145.120438] nova-scheduler[52396]: INFO nova.filters [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'b3115175-7069-4f36-ba74-4a22abd5634c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1145.120581] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1145.120734] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-d07ded15-b762-4e12-975b-d68abe8ad379 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1146.876914] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['4a3e9546-f0e1-46ba-b1a5-6db5be881b22'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1146.877232] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1146.877395] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.877571] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.877792] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1146.877988] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1146.916220] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1146.916497] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1146.916715] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.923296] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1146.923545] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1146.923799] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.925909] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1146.926172] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1146.926563] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1146.926884] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1146.927106] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1146.927306] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef', 'c6ee7d41-5522-4019-9da9-8503ec99e2b5', 'd97a55c5-f248-482a-9986-212e84bdd0b0', 'e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1146.927504] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1146.927812] nova-scheduler[52393]: DEBUG nova.filters [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1146.928088] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 79.791113 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1146.928290] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1146.928488] nova-scheduler[52393]: INFO nova.filters [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 1146.928679] nova-scheduler[52393]: DEBUG nova.filters [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID '4a3e9546-f0e1-46ba-b1a5-6db5be881b22'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1146.928853] nova-scheduler[52393]: INFO nova.filters [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID '4a3e9546-f0e1-46ba-b1a5-6db5be881b22'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1146.928973] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1146.929174] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-62168fc1-06bb-426c-a913-935f89cd12f5 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1148.550303] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting to schedule for instances: ['b702411c-4f1e-467b-acdf-fbbc5217b284'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1148.550582] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1148.550750] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1148.550956] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1148.551177] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1148.551535] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1148.591666] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1148.592043] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1148.592111] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1148.599103] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1148.599583] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1148.599583] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1148.601666] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1148.601865] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1148.602239] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1148.602521] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1148.602728] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1148.602905] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef', 'e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1148.603083] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1148.603330] nova-scheduler[52396]: DEBUG nova.filters [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1148.603533] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 81.466594 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1148.603691] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1148.603848] nova-scheduler[52396]: INFO nova.filters [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filter ComputeFilter returned 0 hosts [ 1148.603998] nova-scheduler[52396]: DEBUG nova.filters [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'b702411c-4f1e-467b-acdf-fbbc5217b284'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1148.604339] nova-scheduler[52396]: INFO nova.filters [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtering removed all hosts for the request with instance ID 'b702411c-4f1e-467b-acdf-fbbc5217b284'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1148.604401] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1148.604540] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-c6637ec6-9a88-4a06-b3ff-87389f626ce6 tempest-ServersTestJSON-1437394991 tempest-ServersTestJSON-1437394991-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Starting to schedule for instances: ['b86d2634-94f7-4baa-b597-75a29a89de0d'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1155.080028] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1155.128032] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1155.128032] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1155.128032] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1155.134757] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1155.134964] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1155.135140] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1155.137615] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1155.137818] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1155.138633] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1155.138933] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1155.139119] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1155.139279] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef', 'e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1155.139440] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1155.139745] nova-scheduler[52393]: DEBUG nova.filters [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1155.139959] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 88.002999 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1155.140129] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1155.140286] nova-scheduler[52393]: INFO nova.filters [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filter ComputeFilter returned 0 hosts [ 1155.140430] nova-scheduler[52393]: DEBUG nova.filters [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtering removed all hosts for the request with instance ID 'b86d2634-94f7-4baa-b597-75a29a89de0d'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1155.140565] nova-scheduler[52393]: INFO nova.filters [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtering removed all hosts for the request with instance ID 'b86d2634-94f7-4baa-b597-75a29a89de0d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1155.140770] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1155.140929] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-4802071c-8d79-4e1c-bd4d-80bde42a0775 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1157.558776] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Starting to schedule for instances: ['c9fa757a-be92-4daa-9c5d-2f5a3269cff6'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1157.559172] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1157.559383] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1157.559567] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1157.559892] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1157.560097] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1157.601228] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1157.601464] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1157.601633] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1157.609196] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1157.609405] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1157.609570] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1157.611765] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1157.611970] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1157.612388] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1157.612684] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1157.612884] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1157.613091] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef', 'e924a9ab-71c1-4efe-a217-b036ec785dc8'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1157.613260] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1157.613513] nova-scheduler[52396]: DEBUG nova.filters [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1157.613726] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 90.47678 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1157.613885] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1157.614049] nova-scheduler[52396]: INFO nova.filters [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filter ComputeFilter returned 0 hosts [ 1157.614213] nova-scheduler[52396]: DEBUG nova.filters [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtering removed all hosts for the request with instance ID 'c9fa757a-be92-4daa-9c5d-2f5a3269cff6'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1157.614396] nova-scheduler[52396]: INFO nova.filters [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtering removed all hosts for the request with instance ID 'c9fa757a-be92-4daa-9c5d-2f5a3269cff6'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1157.614884] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1157.614884] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-6d46eac3-dede-41be-830f-9d5d3016dbc3 tempest-AttachVolumeTestJSON-862023644 tempest-AttachVolumeTestJSON-862023644-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1183.672917] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Starting to schedule for instances: ['a3891b54-2b32-468e-8933-403309c68eb2'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1183.673297] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1183.673482] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1183.673688] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1183.674032] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1183.674285] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1183.718034] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1183.718171] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1183.718375] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1183.724811] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1183.725018] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1183.725183] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1183.727832] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1183.727935] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1183.728292] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1183.728596] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1183.728776] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1183.728956] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1183.729135] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1183.729382] nova-scheduler[52393]: DEBUG nova.filters [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1183.729590] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 116.592646 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1183.729804] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1183.729983] nova-scheduler[52393]: INFO nova.filters [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filter ComputeFilter returned 0 hosts [ 1183.730160] nova-scheduler[52393]: DEBUG nova.filters [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtering removed all hosts for the request with instance ID 'a3891b54-2b32-468e-8933-403309c68eb2'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1183.730302] nova-scheduler[52393]: INFO nova.filters [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtering removed all hosts for the request with instance ID 'a3891b54-2b32-468e-8933-403309c68eb2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1183.730449] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1183.730593] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-7da890ac-f4db-4458-a510-c750d0760102 tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1184.016947] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Starting to schedule for instances: ['b7617a02-0451-4555-b24b-bce5103e741c'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1184.016947] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1184.016947] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1184.017244] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1184.017354] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1184.017567] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1184.065656] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1184.065656] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1184.065656] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1184.072920] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1184.072920] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1184.072920] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1184.074523] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1184.074907] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1184.076504] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1184.076504] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1184.076504] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 5, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 41, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1184.076504] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef'] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1184.076504] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1184.076504] nova-scheduler[52396]: DEBUG nova.filters [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1184.077252] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:41:34. Elapsed time is 116.94026 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1184.077544] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 1184.077897] nova-scheduler[52396]: INFO nova.filters [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filter ComputeFilter returned 0 hosts [ 1184.078825] nova-scheduler[52396]: DEBUG nova.filters [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtering removed all hosts for the request with instance ID 'b7617a02-0451-4555-b24b-bce5103e741c'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1184.078825] nova-scheduler[52396]: INFO nova.filters [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtering removed all hosts for the request with instance ID 'b7617a02-0451-4555-b24b-bce5103e741c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1184.078825] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1184.078825] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-dbe585a7-d83c-4fe8-9c93-0b817a21982b tempest-ServerRescueNegativeTestJSON-289200803 tempest-ServerRescueNegativeTestJSON-289200803-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1187.968106] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1187.968413] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1187.968647] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1187.968703] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1187.968751] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1187.968838] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1187.968902] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1187.969031] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1187.969091] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1187.969198] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1187.971899] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-e4572761-7449-4525-bc27-733668b7e14a None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1187.972134] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1187.974418] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-e4572761-7449-4525-bc27-733668b7e14a None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1187.974418] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-e4572761-7449-4525-bc27-733668b7e14a None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.006s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1192.166088] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Starting to schedule for instances: ['f114d70b-3524-4f1c-b1af-71ae3235d040'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1192.166380] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1192.166546] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1192.167128] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1192.167128] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1192.167914] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1192.215504] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1192.215734] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1192.215899] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1192.222614] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1192.222821] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1192.222986] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1192.224976] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1192.225477] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1192.225615] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='1',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_2549d966f11047368e896d5354721163='2',num_proj_6c15bcc07e0a4e4fa73b77d300814d00='1',num_proj_6d40db2e2f5c492f92f6943a058f1412='1',num_proj_ff882dc15f1f43358391269a424d2893='1',num_task_deleting='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:42:38Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=5) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1192.225829] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1192.226187] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 6, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1192.226359] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Update host state with instances: ['0257c136-6f30-43ae-8f8d-e8f23d8328ef'] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1192.226526] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1192.226768] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1192.226971] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.227162] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.227372] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.227535] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.227694] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.227951] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.228145] nova-scheduler[52393]: DEBUG nova.filters [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 1192.228306] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1192.228473] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 1192.228645] nova-scheduler[52393]: DEBUG nova.scheduler.utils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Attempting to claim resources in the placement API for instance f114d70b-3524-4f1c-b1af-71ae3235d040 {{(pid=52393) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1253}} [ 1192.289162] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] [instance: f114d70b-3524-4f1c-b1af-71ae3235d040] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=52393) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 1192.289480] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1192.290233] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1192.290233] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-29ed356a-f239-4acf-b1cb-4cb2453bd2c4 tempest-ServersNegativeTestMultiTenantJSON-459744605 tempest-ServersNegativeTestMultiTenantJSON-459744605-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1276.320443] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1276.320739] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1276.320838] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1276.322887] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1276.323152] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1276.323334] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-c1ca1cf6-2c7e-4ee0-a6f5-1b2038693288 tempest-FloatingIPsAssociationNegativeTestJSON-971461043 tempest-FloatingIPsAssociationNegativeTestJSON-971461043-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1281.201046] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Starting to schedule for instances: ['20828633-5581-41da-ad0c-bf9f0b798042'] {{(pid=52396) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1281.201371] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52396) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1281.201534] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1281.201709] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1281.201904] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52396) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1281.202095] nova-scheduler[52396]: DEBUG nova.scheduler.request_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] ephemeral_encryption_filter skipped {{(pid=52396) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1281.302025] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1281.302267] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1281.302440] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1281.309451] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1281.309662] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1281.310090] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='4',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_07237bcd8b47450cae1f09b3c693038e='1',num_proj_ff882dc15f1f43358391269a424d2893='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:45:02Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=1) {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1281.310366] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Update host state with aggregates: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1281.310535] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 6, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1281.310708] nova-scheduler[52396]: DEBUG nova.scheduler.host_manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Update host state with instances: [] {{(pid=52396) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1281.310859] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1281.311136] nova-scheduler[52396]: DEBUG nova.filters [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Starting with 1 host(s) {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1281.311361] nova-scheduler[52396]: DEBUG nova.servicegroup.drivers.db [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:43:34. Elapsed time is 94.174409 {{(pid=52396) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1281.311516] nova-scheduler[52396]: WARNING nova.scheduler.filters.compute_filter [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 1281.311662] nova-scheduler[52396]: INFO nova.filters [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Filter ComputeFilter returned 0 hosts [ 1281.311809] nova-scheduler[52396]: DEBUG nova.filters [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Filtering removed all hosts for the request with instance ID '20828633-5581-41da-ad0c-bf9f0b798042'. Filter results: [('ComputeFilter', None)] {{(pid=52396) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1281.311950] nova-scheduler[52396]: INFO nova.filters [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Filtering removed all hosts for the request with instance ID '20828633-5581-41da-ad0c-bf9f0b798042'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1281.312111] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] Filtered [] {{(pid=52396) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1281.312257] nova-scheduler[52396]: DEBUG nova.scheduler.manager [None req-645482c2-f528-4832-a327-ba7cbb5479c9 tempest-ServerAddressesTestJSON-831818212 tempest-ServerAddressesTestJSON-831818212-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52396) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1286.956993] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Starting to schedule for instances: ['9b4f102f-ed35-4635-8568-f8f58c6697d3'] {{(pid=52393) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 1286.957303] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=52393) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 1286.957466] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1286.957648] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1286.957956] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=52393) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 1286.958164] nova-scheduler[52393]: DEBUG nova.scheduler.request_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] ephemeral_encryption_filter skipped {{(pid=52393) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 1286.998287] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1286.998417] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1286.998629] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1287.005192] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1287.005422] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1287.005771] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-08-29T04:33:29Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='4',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_07237bcd8b47450cae1f09b3c693038e='1',num_proj_ff882dc15f1f43358391269a424d2893='0',num_task_deleting='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-08-29T04:45:02Z,uuid=a29934a0-6a74-4b6e-8edf-44d7a53db1dc,vcpus=48,vcpus_used=1) {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 1287.006047] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Update host state with aggregates: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 1287.007026] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Update host state with service dict: {'id': 7, 'uuid': '67492a73-c3c5-436b-9c4b-74e4d59786d4', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 6, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 8, 29, 4, 33, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 8, 29, 4, 43, 34, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 1287.007026] nova-scheduler[52393]: DEBUG nova.scheduler.host_manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Update host state with instances: [] {{(pid=52393) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 1287.007026] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1287.007026] nova-scheduler[52393]: DEBUG nova.filters [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Starting with 1 host(s) {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 1287.007026] nova-scheduler[52393]: DEBUG nova.servicegroup.drivers.db [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-08-29 04:43:34. Elapsed time is 99.870032 {{(pid=52393) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 1287.007361] nova-scheduler[52393]: WARNING nova.scheduler.filters.compute_filter [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 has not been heard from in a while [ 1287.007361] nova-scheduler[52393]: INFO nova.filters [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Filter ComputeFilter returned 0 hosts [ 1287.007459] nova-scheduler[52393]: DEBUG nova.filters [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Filtering removed all hosts for the request with instance ID '9b4f102f-ed35-4635-8568-f8f58c6697d3'. Filter results: [('ComputeFilter', None)] {{(pid=52393) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 1287.007544] nova-scheduler[52393]: INFO nova.filters [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Filtering removed all hosts for the request with instance ID '9b4f102f-ed35-4635-8568-f8f58c6697d3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 1287.007759] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] Filtered [] {{(pid=52393) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 1287.007856] nova-scheduler[52393]: DEBUG nova.scheduler.manager [None req-919b1e3f-2563-40a3-8902-f1b660e6d8f3 tempest-ServerMetadataTestJSON-301977506 tempest-ServerMetadataTestJSON-301977506-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=52393) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 1310.942024] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1310.942281] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1310.942406] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1310.942450] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1310.942593] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1310.942636] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Acquiring lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 1310.942769] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1310.942819] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 1310.942932] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1310.942986] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "d0ae54bd-e0f8-43cb-838f-391ff3e34a72" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1310.945917] nova-scheduler[52396]: INFO nova.scheduler.host_manager [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1310.946034] nova-scheduler[52393]: INFO nova.scheduler.host_manager [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 1310.946116] nova-scheduler[52396]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52396) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 1310.946219] nova-scheduler[52393]: DEBUG oslo_concurrency.lockutils [None req-efefaa47-84ed-41bc-ad55-c471c4e3e452 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=52393) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}