[ 481.517682] nova-scheduler[50384]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. [ 482.593454] nova-scheduler[50384]: INFO oslo_service.periodic_task [-] Skipping periodic task _discover_hosts_in_cells because its interval is negative [ 482.604403] nova-scheduler[50384]: DEBUG oslo_db.sqlalchemy.engines [None req-1d8d84f2-cade-4509-8025-9afe7082353c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50384) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 482.718405] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-1d8d84f2-cade-4509-8025-9afe7082353c None None] Found 1 cells: b3c1ceaa-bc48-48ee-8b60-930585e76a41 {{(pid=50384) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:746}} [ 482.718627] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-1d8d84f2-cade-4509-8025-9afe7082353c None None] Found 0 disabled cells: {{(pid=50384) refresh_cells_caches /opt/stack/nova/nova/scheduler/host_manager.py:758}} [ 482.748912] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-1d8d84f2-cade-4509-8025-9afe7082353c None None] START:_async_init_instance_info {{(pid=50384) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:427}} [ 482.751291] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 482.751291] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 482.752288] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 482.758735] nova-scheduler[50384]: DEBUG oslo_db.sqlalchemy.engines [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50384) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 482.767500] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Total number of compute nodes: 0 {{(pid=50384) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:440}} [ 482.767835] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 482.768041] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 482.768203] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 482.819529] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] Adding 0 instances for hosts 10-20 {{(pid=50384) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:459}} [ 482.820101] nova-scheduler[50384]: DEBUG nova.scheduler.host_manager [None req-2299f3a7-cd80-4e0f-8c8c-621b1ea64631 None None] END:_async_init_instance_info {{(pid=50384) _async_init_instance_info /opt/stack/nova/nova/scheduler/host_manager.py:470}} [ 482.858650] nova-scheduler[50384]: DEBUG nova.context [None req-1d8d84f2-cade-4509-8025-9afe7082353c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b3c1ceaa-bc48-48ee-8b60-930585e76a41(cell1) {{(pid=50384) load_cells /opt/stack/nova/nova/context.py:464}} [ 482.858650] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 482.858841] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 482.859511] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 482.859868] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 482.860060] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 482.860218] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=50384) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 482.867922] nova-scheduler[50384]: DEBUG oslo_db.sqlalchemy.engines [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=50384) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 482.873577] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Acquiring lock "singleton_lock" {{(pid=50384) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} [ 482.873750] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Acquired lock "singleton_lock" {{(pid=50384) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} [ 482.873986] nova-scheduler[50384]: DEBUG oslo_concurrency.lockutils [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Releasing lock "singleton_lock" {{(pid=50384) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} [ 482.874219] nova-scheduler[50384]: INFO oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Starting 2 workers [ 482.881254] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Started child 51488 {{(pid=50384) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 482.884650] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Started child 51491 {{(pid=50384) _start_child /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:575}} [ 482.885291] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Full set of CONF: {{(pid=50384) wait /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:649}} [ 482.885477] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ******************************************************************************** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} [ 482.885620] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] Configuration options gathered from: {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} [ 482.885786] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] command line args: ['--config-file', '/etc/nova/nova.conf'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} [ 482.886146] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] config files: ['/etc/nova/nova.conf'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} [ 482.886285] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ================================================================================ {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} [ 482.886580] nova-scheduler[51488]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 482.886810] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] allow_resize_to_same_host = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.886866] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] arq_binding_timeout = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.887046] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] block_device_allocate_retries = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.887228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] block_device_allocate_retries_interval = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.887355] nova-scheduler[51491]: INFO nova.service [-] Starting scheduler node (version 0.1.0) [ 482.887550] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cert = self.pem {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.887615] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute_driver = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.887859] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute_monitors = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.888454] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] config_dir = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.888652] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] config_drive_format = iso9660 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.888795] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] config_file = ['/etc/nova/nova.conf'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] config_source = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889240] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] console_host = devstack {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889428] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] control_exchange = nova {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889624] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cpu_allocation_ratio = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889794] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] daemon = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.889987] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] debug = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.890164] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] default_access_ip_network_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.890346] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] default_availability_zone = nova {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.890632] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] default_ephemeral_format = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.890774] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] default_schedule_zone = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] disk_allocation_ratio = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891324] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] enable_new_services = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891542] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] enabled_apis = ['osapi_compute'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891740] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] enabled_ssl_apis = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.891922] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] flat_injected = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.892103] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] force_config_drive = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.892271] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] force_raw_images = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.892436] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] graceful_shutdown_timeout = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.892587] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] heal_instance_info_cache_interval = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.893092] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] host = devstack {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.893225] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] initial_cpu_allocation_ratio = 4.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.893405] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] initial_disk_allocation_ratio = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.893608] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] initial_ram_allocation_ratio = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894242] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894242] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_build_timeout = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894242] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_delete_interval = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894383] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_format = [instance: %(uuid)s] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894553] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_name_template = instance-%08x {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894734] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_usage_audit = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.894926] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_usage_audit_period = month {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.895353] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.895547] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] instances_path = /opt/stack/data/nova/instances {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.895709] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] internal_service_availability_zone = internal {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] key = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] live_migration_retry_count = 30 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_config_append = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_dir = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_options = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897572] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_rotate_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897572] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_rotate_interval_type = days {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897572] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] log_rotation_type = none {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897656] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.897781] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898353] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898353] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898353] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898523] nova-scheduler[51491]: DEBUG oslo_db.sqlalchemy.engines [None req-b244d035-17f5-426c-b315-37aa64378daa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 482.898572] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] long_rpc_timeout = 1800 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898572] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_concurrent_builds = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898717] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_concurrent_live_migrations = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.898901] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_concurrent_snapshots = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899071] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_local_block_devices = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899221] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_logfile_count = 30 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899370] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] max_logfile_size_mb = 200 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899556] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] maximum_instance_delete_attempts = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899723] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metadata_listen = 0.0.0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.899975] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metadata_listen_port = 8775 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.900478] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metadata_workers = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.900478] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] migrate_max_retries = -1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.900560] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] mkisofs_cmd = genisoimage {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] my_block_storage_ip = 10.180.1.21 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] my_ip = 10.180.1.21 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] network_allocate_retries = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] osapi_compute_listen = 0.0.0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.901967] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] osapi_compute_listen_port = 8774 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902170] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] osapi_compute_unique_server_name_scope = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902170] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] osapi_compute_workers = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902170] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] password_length = 12 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902983] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] periodic_enable = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902983] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] periodic_fuzzy_delay = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.902983] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] pointer_model = usbtablet {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] preallocate_images = none {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] publish_errors = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] pybasedir = /opt/stack/nova {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904341] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-eaaa1aca-2f62-4971-8bd9-ed8b70ee40a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51488) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 482.904382] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ram_allocation_ratio = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904527] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rate_limit_burst = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904714] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rate_limit_except_level = CRITICAL {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.904987] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rate_limit_interval = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.905186] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reboot_timeout = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.905343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reclaim_instance_interval = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.905513] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] record = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.905796] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reimage_timeout_per_gb = 20 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.905978] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] report_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.906581] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rescue_timeout = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.906581] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reserved_host_cpus = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.906581] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reserved_host_disk_mb = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.906725] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reserved_host_memory_mb = 512 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.906833] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] reserved_huge_pages = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907014] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] resize_confirm_window = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907197] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] resize_fs_using_block_device = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907357] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] resume_guests_state_on_host_boot = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907541] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907702] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] run_external_periodic_tasks = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.907865] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] running_deleted_instance_action = reap {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908026] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] running_deleted_instance_poll_interval = 1800 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908187] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] running_deleted_instance_timeout = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908341] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler_instance_sync_interval = 120 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_down_time = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908695] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] servicegroup_driver = db {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.908850] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] shelved_offload_time = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.909103] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] shelved_poll_interval = 3600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.909353] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] shutdown_timeout = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.909533] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] source_is_ipv6 = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.909718] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ssl_only = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.909910] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] state_path = /opt/stack/data/nova {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.910338] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] sync_power_state_interval = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.910452] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] sync_power_state_pool_size = 1000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.910637] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] syslog_log_facility = LOG_USER {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.910901] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] tempdir = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.911071] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] timeout_nbd = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.911253] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] transport_url = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] update_resources_interval = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_cow_images = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_eventlog = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_journal = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_json = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_rootwrap_daemon = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.914992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_stderr = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] use_syslog = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vcpu_pin_set = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vif_plugging_is_fatal = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vif_plugging_timeout = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] virt_mkfs = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] volume_usage_poll_interval = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915228] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] watch_log_file = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915385] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] web = /usr/share/spice-html5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} [ 482.915385] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_concurrency.disable_process_locking = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.915385] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.915454] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.auth_strategy = keystone {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.915651] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.compute_link_prefix = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.915813] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916119] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.dhcp_domain = novalocal {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916188] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.enable_instance_password = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916335] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.glance_link_prefix = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916492] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916656] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916816] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.instance_list_per_project_cells = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.916971] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.list_records_by_skipping_down_cells = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.917148] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.local_metadata_per_cell = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.917590] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.max_limit = 1000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.917590] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.metadata_cache_expiration = 15 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.917684] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.neutron_default_tenant_id = default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.917838] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.use_forwarded_for = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918027] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.use_neutron_default_nets = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918367] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918526] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918692] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_dynamic_ssl_certfile = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.918859] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_dynamic_targets = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.919021] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_jsonfile_path = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.919218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api.vendordata_providers = ['StaticJSON'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.919460] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.backend = dogpile.cache.memcached {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.backend_argument = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.config_prefix = cache.oslo {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.dead_timeout = 60.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.debug_cache_backend = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.enable_retry_client = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.enable_socket_keepalive = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.enabled = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.expiration_time = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.hashclient_retry_attempts = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.hashclient_retry_delay = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_dead_retry = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921659] nova-scheduler[51491]: DEBUG nova.service [None req-b244d035-17f5-426c-b315-37aa64378daa None None] Creating RPC server for service scheduler {{(pid=51491) start /opt/stack/nova/nova/service.py:182}} [ 482.921710] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_password = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.921844] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922311] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922311] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_pool_maxsize = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922396] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922490] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_sasl_enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922660] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922823] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_socket_timeout = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.922982] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.memcache_username = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.923176] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.proxies = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.923333] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.retry_attempts = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.923522] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.retry_delay = 0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.923708] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.socket_keepalive_count = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.923869] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.socket_keepalive_idle = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924039] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.socket_keepalive_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924193] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.tls_allowed_ciphers = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.tls_cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.tls_certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924643] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.tls_enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.924790] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cache.tls_keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925190] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.auth_type = password {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925376] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925579] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.catalog_info = volumev3::publicURL {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925752] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.925919] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.926105] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.cross_az_attach = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.926263] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.debug = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.926415] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.endpoint_template = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.926593] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.http_retries = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.927280] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.928089] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.928316] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.os_region_name = RegionOne {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.928491] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.928741] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cinder.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929322] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929322] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.cpu_dedicated_set = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929322] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.cpu_shared_set = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929456] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.image_type_exclude_list = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929612] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.929817] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.max_concurrent_disk_ops = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.930048] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.max_disk_devices_to_attach = -1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.resource_provider_association_refresh = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.shutdown_retry_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] conductor.workers = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932253] nova-scheduler[51488]: DEBUG nova.service [None req-eaaa1aca-2f62-4971-8bd9-ed8b70ee40a7 None None] Creating RPC server for service scheduler {{(pid=51488) start /opt/stack/nova/nova/service.py:182}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] console.allowed_origins = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] console.ssl_ciphers = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] console.ssl_minimum_version = default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] consoleauth.token_ttl = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932454] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932491] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932761] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.932823] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.service_type = accelerator {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.934034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] cyborg.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.backend = sqlalchemy {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.connection = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935582] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.connection_debug = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935582] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.connection_parameters = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935663] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.connection_recycle_time = 3600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935781] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.connection_trace = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.935950] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.db_inc_retry_interval = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936103] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.db_max_retries = 20 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936475] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.db_max_retry_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936475] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.db_retry_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936568] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.max_overflow = 50 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936757] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.max_pool_size = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.936936] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.max_retries = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.937290] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.mysql_enable_ndb = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.937290] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.937483] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.mysql_wsrep_sync_wait = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.937573] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.pool_timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938043] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.retry_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938043] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.slave_connection = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938043] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.sqlite_synchronous = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938197] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] database.use_db_reconnect = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938371] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.backend = sqlalchemy {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938536] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.connection = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938832] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.connection_debug = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.938888] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.connection_parameters = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939010] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.connection_recycle_time = 3600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939168] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.connection_trace = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939320] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.db_inc_retry_interval = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939482] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.db_max_retries = 20 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939689] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.db_max_retry_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.939853] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.db_retry_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940034] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.max_overflow = 50 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940190] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.max_pool_size = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940350] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.max_retries = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940503] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.mysql_enable_ndb = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940661] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.mysql_sql_mode = TRADITIONAL {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940811] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.940965] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.pool_timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941133] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.retry_interval = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941283] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.slave_connection = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941439] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] api_database.sqlite_synchronous = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941630] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] devices.enabled_mdev_types = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941800] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.941953] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ephemeral_storage_encryption.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942149] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942336] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.api_servers = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942503] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942683] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942837] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.942988] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943155] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943309] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.debug = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943469] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.default_trusted_certificate_ids = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943650] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.enable_certificate_validation = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943808] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.enable_rbd_download = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.943957] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.944122] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.944297] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.944447] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.944619] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.944777] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.num_retries = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945468] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.rbd_ceph_conf = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945468] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.rbd_connect_timeout = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945468] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.rbd_pool = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945468] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.rbd_user = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945623] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945847] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.945899] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.service_type = image {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946267] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946267] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946452] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946544] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946721] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.946890] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.verify_glance_signatures = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.947063] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] glance.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.947252] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] guestfs.debug = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.947443] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.config_drive_cdrom = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.947608] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.config_drive_inject_password = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948172] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.dynamic_memory_ratio = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948172] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.enable_instance_metrics_collection = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948172] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.enable_remotefx = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948297] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.instances_path_share = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948495] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.iscsi_initiator_list = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948646] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.limit_cpu_features = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948818] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.948972] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.power_state_check_timeframe = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949701] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.use_multipath_io = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949774] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.volume_attach_retry_count = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.949928] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.950109] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.vswitch_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.950280] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.950485] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] mks.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.951612] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.951612] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.manager_interval = 2400 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.951612] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.precache_concurrency = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.951894] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.remove_unused_base_images = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.951894] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.952525] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.952525] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] image_cache.subdirectory_name = _base {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.952525] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.api_max_retries = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.952525] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.api_retry_interval = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.952673] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.auth_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.953782] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954114] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954114] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954114] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954269] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954416] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954610] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.partition_key = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954775] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.peer_list = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.954924] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955092] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.serial_console_state_timeout = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955281] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955413] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.service_type = baremetal {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955760] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955760] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.955878] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956025] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956497] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956497] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ironic.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956589] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956731] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] key_manager.fixed_key = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.956951] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957252] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.barbican_api_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957484] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.barbican_endpoint = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957484] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.barbican_endpoint_type = public {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957736] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.barbican_region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957785] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.957943] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958132] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958288] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958436] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958672] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.number_of_retries = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958763] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.retry_delay = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.958964] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.send_service_user_token = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959146] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959397] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.verify_ssl = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959583] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican.verify_ssl_path = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959966] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.959966] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.auth_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960101] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960254] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960416] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960573] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960733] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.960893] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961093] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] barbican_service_user.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961243] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.approle_role_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961506] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.approle_secret_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961569] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961691] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.961850] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.962026] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.962171] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.962354] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.kv_mountpoint = secret {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.962621] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.kv_version = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.962682] nova-scheduler[51491]: DEBUG nova.service [None req-b244d035-17f5-426c-b315-37aa64378daa None None] Join ServiceGroup membership for this service scheduler {{(pid=51491) start /opt/stack/nova/nova/service.py:199}} [ 482.962719] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.namespace = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.963099] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-b244d035-17f5-426c-b315-37aa64378daa None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51491) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 482.963362] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.root_token_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.963362] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.963362] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.ssl_ca_crt_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.963362] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964138] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.use_ssl = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964138] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964138] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964138] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964267] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964391] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964475] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964659] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964825] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.964923] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965204] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965274] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965385] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965537] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965739] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.service_type = identity {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.965915] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966079] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966323] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966379] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966547] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966708] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] keystone.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.966744] nova-scheduler[51488]: DEBUG nova.service [None req-eaaa1aca-2f62-4971-8bd9-ed8b70ee40a7 None None] Join ServiceGroup membership for this service scheduler {{(pid=51488) start /opt/stack/nova/nova/service.py:199}} [ 482.966999] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.connection_uri = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967069] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-eaaa1aca-2f62-4971-8bd9-ed8b70ee40a7 None None] DB_Driver: join new ServiceGroup member devstack to the scheduler group, service = {{(pid=51488) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} [ 482.967129] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_mode = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967293] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_model_extra_flags = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967454] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_models = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967742] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_power_governor_high = performance {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967797] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_power_governor_low = powersave {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.967925] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_power_management = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.968130] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.968319] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.device_detach_attempts = 8 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.968477] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.device_detach_timeout = 20 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.968639] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.disk_cachemodes = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.968821] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.disk_prefix = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969085] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.enabled_perf_events = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969198] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.file_backed_memory = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969359] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.gid_maps = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969534] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.hw_disk_discard = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969689] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.hw_machine_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.969853] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_rbd_ceph_conf = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970033] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970338] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970397] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_rbd_glance_store_name = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970688] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_rbd_pool = rbd {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970753] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_type = default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.970853] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.images_volume_group = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971019] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.inject_key = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971180] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.inject_partition = -2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971334] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.inject_password = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971546] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.iscsi_iface = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971712] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.iser_use_multipath = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.971876] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_bandwidth = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972050] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_downtime = 500 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972368] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972734] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972734] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_inbound_addr = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972837] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.972988] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_permit_post_copy = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.973178] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_scheme = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.973357] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_timeout_action = abort {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.973545] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_tunnelled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.973704] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_uri = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.973866] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.live_migration_with_native_tls = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.974054] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.max_queues = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.974216] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.974369] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.nfs_mount_options = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.974648] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_iser_scan_tries = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975227] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_memory_encrypted_guests = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975363] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975419] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_pcie_ports = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975607] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.num_volume_scan_tries = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975848] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.pmem_namespaces = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.975931] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.quobyte_client_cfg = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.976193] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.976357] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rbd_connect_timeout = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.976516] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.976703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.976858] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rbd_secret_uuid = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.977019] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rbd_user = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.977180] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.977346] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.remote_filesystem_transport = ssh {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rescue_image_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rescue_kernel_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rescue_ramdisk_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978018] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rng_dev_path = /dev/urandom {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978153] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.rx_queue_size = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978265] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.smbfs_mount_options = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978917] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978917] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.snapshot_compression = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.978917] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.snapshot_image_format = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979038] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979192] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.sparse_logical_volumes = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979821] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.swtpm_enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979821] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.swtpm_group = tss {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979821] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.swtpm_user = tss {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979821] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.sysinfo_serial = unique {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.979976] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.tx_queue_size = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980638] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.uid_maps = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980638] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.use_virtio_for_bridges = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980638] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.virt_type = kvm {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980638] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.volume_clear = zero {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980797] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.volume_clear_size = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.980952] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.volume_use_multipath = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981120] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_cache_path = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981716] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981716] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_mount_group = qemu {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981716] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_mount_opts = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981847] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_mount_perms = 0770 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.981969] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982153] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.vzstorage_mount_user = stack {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982311] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982480] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982651] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.auth_type = password {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982803] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.982958] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983649] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.default_floating_pool = public {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983818] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.983980] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.extension_sync_interval = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984153] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.http_retries = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984307] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984669] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984669] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984797] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.984951] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985133] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.ovs_bridge = br-int {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985718] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.physnets = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985718] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.region_name = RegionOne {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985718] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.service_metadata_proxy = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985825] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.985907] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.service_type = network {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986078] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986515] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986515] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986515] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986692] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.986851] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] neutron.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987022] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] notifications.bdms_in_notifications = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987271] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] notifications.default_level = INFO {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987369] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] notifications.notification_format = unversioned {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987545] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] notifications.notify_on_state_change = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987735] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.987913] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] pci.alias = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.988088] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] pci.device_spec = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.988245] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] pci.report_in_placement = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.988448] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.988620] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.auth_type = password {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.988791] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.auth_url = http://10.180.1.21/identity {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989072] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989135] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989279] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989432] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989584] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989807] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.default_domain_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.989887] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.default_domain_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990054] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.domain_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990202] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.domain_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990356] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990510] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990663] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990812] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.990962] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991133] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.password = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991286] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.project_domain_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991466] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.project_domain_name = Default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991636] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.project_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991803] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.project_name = service {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.991966] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.region_name = RegionOne {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992137] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992298] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.service_type = placement {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992455] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992607] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992757] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.992913] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.system_scope = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.trust_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993365] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.user_domain_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993562] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.user_domain_name = Default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993725] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.user_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.993886] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.username = placement {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994201] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.valid_interfaces = ['internal', 'public'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994247] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] placement.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994773] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.cores = 20 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994773] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.count_usage_from_placement = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994773] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.driver = nova.quota.DbQuotaDriver {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.994902] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.injected_file_content_bytes = 10240 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995086] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.injected_file_path_length = 255 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995241] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.injected_files = 5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995402] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.instances = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995593] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.key_pairs = 100 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995794] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.metadata_items = 128 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.995925] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.ram = 51200 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.996098] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.recheck_quota = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.996260] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.server_group_members = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.996419] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] quota.server_groups = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.996586] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rdp.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.996898] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.997135] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.997323] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.997508] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.image_metadata_prefilter = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.997693] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.997875] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.max_attempts = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998047] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.max_placement_results = 1000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998366] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.query_placement_for_availability_zone = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998524] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.query_placement_for_image_type_support = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998705] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.998886] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] scheduler.workers = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.999087] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.999258] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.999453] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.999661] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 482.999847] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000032] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000425] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000632] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.host_subset_size = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000744] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.000901] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.001073] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.isolated_hosts = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.001231] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.isolated_images = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.001386] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.001561] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.001718] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.pci_in_placement = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003012] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003198] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.track_instance_changes = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003198] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003198] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metrics.required = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003336] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metrics.weight_multiplier = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003493] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metrics.weight_of_unavailable = -10000.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003691] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] metrics.weight_setting = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.003998] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.004179] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.004365] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.port_range = 10000:20000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.004600] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.004748] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.004918] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] serial_console.serialproxy_port = 6083 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.005122] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.005300] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.auth_type = password {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.005457] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.005607] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.005799] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006058] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006090] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006258] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.send_service_user_token = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006698] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006698] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] service_user.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006698] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.agent_enabled = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.006883] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.007264] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.html5proxy_host = 0.0.0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.html5proxy_port = 6082 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.image_compression = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.jpeg_compression = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.playback_compression = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.server_listen = 127.0.0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011017] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.streaming_mode = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] spice.zlib_compression = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] upgrade_levels.baseapi = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] upgrade_levels.cert = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] upgrade_levels.compute = auto {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] upgrade_levels.conductor = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011302] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] upgrade_levels.scheduler = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.auth_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011496] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vendordata_dynamic_auth.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.api_retry_count = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.ca_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.cache_prefix = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.cluster_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011703] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.connection_pool_size = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.011875] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.console_delay_seconds = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012065] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.datastore_regex = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012165] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.host_ip = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012314] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.host_password = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012471] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.host_port = 443 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012626] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.host_username = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.012775] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013094] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.integration_bridge = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013094] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.maximum_objects = 100 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013226] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.pbm_default_policy = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013440] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.pbm_enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013537] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.pbm_wsdl_location = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013705] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.013857] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.serial_port_proxy_uri = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014023] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.serial_port_service_uri = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014193] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.task_poll_interval = 0.5 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014343] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.use_linked_clone = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014518] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.vnc_keymap = en-us {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014693] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.vnc_port = 5900 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.014842] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vmware.vnc_port_total = 10000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.015055] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.auth_schemes = ['none'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.015217] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.enabled = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.015537] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.015728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.novncproxy_host = 0.0.0.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.015891] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.novncproxy_port = 6080 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016073] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.server_listen = 127.0.0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.vencrypt_ca_certs = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.vencrypt_client_cert = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] vnc.vencrypt_client_key = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.016859] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017088] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_deep_image_inspection = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017614] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017614] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_group_policy_check_upcall = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017614] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017731] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.disable_rootwrap = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017793] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.enable_numa_live_migration = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.017958] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.018126] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.018280] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.018433] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.libvirt_disable_apic = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019024] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019024] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019024] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019024] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019192] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019339] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019494] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019680] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.019859] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020029] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020233] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020400] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.client_socket_timeout = 900 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020561] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.default_pool_size = 1000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020723] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.keep_alive = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.020884] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.max_header_line = 16384 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021051] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.secure_proxy_ssl_header = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021207] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.ssl_ca_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021365] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.ssl_cert_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021521] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.ssl_key_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021681] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.tcp_keepidle = 600 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.021852] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022019] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] zvm.ca_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022176] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] zvm.cloud_connector_url = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022746] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022746] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] zvm.reachable_timeout = 300 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022845] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.022928] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.023106] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.023269] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.023438] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.023694] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.enforce_new_defaults = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.023872] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.enforce_scope = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024054] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.policy_default_rule = default {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024249] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024428] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.policy_file = policy.yaml {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024640] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024807] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.024962] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.025129] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.025287] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.025480] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.025654] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.025862] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.connection_string = messaging:// {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026033] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.enabled = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026218] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.es_doc_type = notification {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026396] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.es_scroll_size = 10000 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026560] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.es_scroll_time = 2m {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026717] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.filter_error_trace = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.026873] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.hmac_keys = SECRET_KEY {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027041] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.sentinel_service_name = mymaster {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027229] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.socket_timeout = 0.1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027361] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] profiler.trace_sqlalchemy = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027523] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] remote_debug.host = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027678] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] remote_debug.port = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.027861] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028029] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028193] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028347] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028916] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028916] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.028916] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029099] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029099] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029574] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.029891] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030059] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030232] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030390] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030545] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030728] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.030887] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031053] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031212] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031369] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031564] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031731] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.031895] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032073] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032239] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032396] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032557] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032778] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_rabbit.ssl_version = {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.032934] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.033112] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_notifications.retry = -1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.033317] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.033510] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_messaging_notifications.transport_url = **** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.033911] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.auth_section = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.033911] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.auth_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034072] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.cafile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034229] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.certfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034387] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.collect_timing = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034541] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.connect_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034693] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.connect_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034842] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.endpoint_id = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.034992] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.endpoint_override = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035160] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.insecure = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035311] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.keyfile = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035476] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.max_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035645] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.min_version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035800] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.region_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.035952] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.service_name = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036115] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.service_type = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036267] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.split_loggers = False {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036418] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.status_code_retries = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036571] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.status_code_retry_delay = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036722] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.timeout = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.036929] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.valid_interfaces = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.037028] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_limit.version = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.037221] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_reports.file_event_handler = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.037383] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.037540] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] oslo_reports.log_dir = None {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} [ 483.037666] nova-scheduler[50384]: DEBUG oslo_service.service [None req-3023758e-b4be-4fbf-81b7-e33084af3a7f None None] ******************************************************************************** {{(pid=50384) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} [ 609.766344] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Starting to schedule for instances: ['31aed7b3-ea4a-4db4-b919-5d754f4c3b17'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 609.767132] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 609.767215] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.767509] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.768813] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 609.768813] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 610.532045] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.532045] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.532369] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.537035] nova-scheduler[51491]: DEBUG oslo_db.sqlalchemy.engines [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51491) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 610.553651] nova-scheduler[51491]: DEBUG oslo_db.sqlalchemy.engines [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Parent process 50384 forked (51491) with an open database connection, which is being discarded and recreated. {{(pid=51491) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 610.565075] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.565075] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.565075] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.567139] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.567340] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.568590] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:12Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=0) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 610.569145] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 610.569339] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 610.569575] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Update host state with instances: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 610.569672] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.570216] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 610.570728] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.571086] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.571401] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.571616] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.571797] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.571980] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.572248] nova-scheduler[51491]: DEBUG nova.filters [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.572452] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 610.572726] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 610.572969] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Attempting to claim resources in the placement API for instance 31aed7b3-ea4a-4db4-b919-5d754f4c3b17 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 610.648172] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Starting to schedule for instances: ['de589259-86c5-4830-8507-2de7ad76c034'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 610.648819] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 610.650028] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.650028] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.650028] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 610.650028] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 610.656401] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] [instance: 31aed7b3-ea4a-4db4-b919-5d754f4c3b17] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 610.658130] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.658130] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.658130] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e9c433d9-3dfe-422d-a983-2cb49936d076 tempest-ServerExternalEventsTest-1363802782 tempest-ServerExternalEventsTest-1363802782-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.720220] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.720514] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.724068] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.727288] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_AUTO_CREATE_USER,NO_ENGINE_SUBSTITUTION {{(pid=51488) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} [ 610.747363] nova-scheduler[51488]: DEBUG oslo_db.sqlalchemy.engines [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Parent process 50384 forked (51488) with an open database connection, which is being discarded and recreated. {{(pid=51488) checkout /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:434}} [ 610.755029] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.755029] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.755219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.758266] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.758475] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.759652] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:12Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 610.760149] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 610.760331] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 610.760481] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 610.760657] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 610.761042] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 610.761327] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.761542] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.761819] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.762070] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.762240] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.762402] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.762589] nova-scheduler[51488]: DEBUG nova.filters [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 610.762764] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 610.763043] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 610.763326] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Attempting to claim resources in the placement API for instance de589259-86c5-4830-8507-2de7ad76c034 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 610.840345] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] [instance: de589259-86c5-4830-8507-2de7ad76c034] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 610.840695] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 610.840991] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 610.841716] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a857b6cb-517f-46be-9e11-f046c46dffa7 tempest-ServerDiagnosticsNegativeTest-1742310921 tempest-ServerDiagnosticsNegativeTest-1742310921-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.689362] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Starting to schedule for instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 611.689824] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 611.691020] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.691020] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.691202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 611.691235] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 611.748534] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.752020] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.752020] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.762082] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.762306] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.762517] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.766491] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.766703] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.767089] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='0',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_127a3eb5002944c5a51c17c72f860bca='1',num_proj_72a0c826169d4687ab1a83684f443d9a='1',num_task_None='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:49Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 611.767382] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 611.767548] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 611.767699] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Update host state with instances: ['31aed7b3-ea4a-4db4-b919-5d754f4c3b17', 'de589259-86c5-4830-8507-2de7ad76c034'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 611.767859] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 611.768124] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 611.768347] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.771902] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.772189] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.772478] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.772548] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.772694] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.772852] nova-scheduler[51491]: DEBUG nova.filters [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 611.773022] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 611.773218] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 611.773406] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Attempting to claim resources in the placement API for instance 21e37459-3ce1-41e7-8317-b98edafb15d4 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 611.836144] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] [instance: 21e37459-3ce1-41e7-8317-b98edafb15d4] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 611.836462] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 611.836672] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 611.836872] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9165ad98-f77c-4d6a-907a-01a0c824e14e tempest-ServerDiagnosticsV248Test-2090958171 tempest-ServerDiagnosticsV248Test-2090958171-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.892746] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Starting to schedule for instances: ['17c89372-97f2-4ffa-a13e-606d4f31b08f'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 613.893195] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 613.893358] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.893611] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.893986] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 613.896581] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 613.948858] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.949090] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.949255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.957559] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.957759] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.957922] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.960154] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 613.960350] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 613.960709] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_127a3eb5002944c5a51c17c72f860bca='1',num_proj_72a0c826169d4687ab1a83684f443d9a='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:50Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 613.960983] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 613.961169] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 613.961321] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Update host state with instances: ['31aed7b3-ea4a-4db4-b919-5d754f4c3b17', 'de589259-86c5-4830-8507-2de7ad76c034', '21e37459-3ce1-41e7-8317-b98edafb15d4'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 613.961482] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 613.961726] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 613.961962] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.962112] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.962392] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.963662] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.963662] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.963662] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.963662] nova-scheduler[51488]: DEBUG nova.filters [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 613.963662] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 613.963869] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 613.963869] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Attempting to claim resources in the placement API for instance 17c89372-97f2-4ffa-a13e-606d4f31b08f {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 614.038932] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] [instance: 17c89372-97f2-4ffa-a13e-606d4f31b08f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 614.039269] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 614.039476] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 614.039676] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b939a52d-a082-4bd3-8122-f8977f528894 tempest-ServerDiagnosticsTest-1815847417 tempest-ServerDiagnosticsTest-1815847417-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.509861] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Starting to schedule for instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 618.510213] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 618.510363] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.510544] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.511262] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 618.511262] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 618.572037] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.572783] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.573176] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.582203] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.582652] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.582901] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.590667] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.593291] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.593291] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='0',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_127a3eb5002944c5a51c17c72f860bca='1',num_proj_72a0c826169d4687ab1a83684f443d9a='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_c1f3e5c6ab1a4a5baf037e03c6f22934='1',num_task_None='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:52Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 618.593458] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:44:52Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=1,metadata={},name='tempest-test_aggregate-1134912078',updated_at=None,uuid=43bb2710-a811-4845-bea9-cef6393ca9ff)] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 618.593458] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 618.593458] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Update host state with instances: ['31aed7b3-ea4a-4db4-b919-5d754f4c3b17', 'de589259-86c5-4830-8507-2de7ad76c034', '21e37459-3ce1-41e7-8317-b98edafb15d4', '17c89372-97f2-4ffa-a13e-606d4f31b08f'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 618.593592] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 618.593592] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 618.593592] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.593592] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.593713] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.593870] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.596023] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.596809] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.596809] nova-scheduler[51491]: DEBUG nova.filters [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 618.596809] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 618.598668] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 618.598668] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Attempting to claim resources in the placement API for instance b7ab8792-137d-4053-9df9-3d560aa5e411 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 618.659059] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] [instance: b7ab8792-137d-4053-9df9-3d560aa5e411] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 618.659059] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 618.659218] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 618.659603] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7433848e-4986-4c55-8422-99a785e77d8e tempest-ServerShowV254Test-1863856496 tempest-ServerShowV254Test-1863856496-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.009285] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Starting to schedule for instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 620.010619] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 620.010965] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.012270] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.012541] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 620.012761] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 620.077488] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.077650] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.077921] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.084382] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.084588] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.084752] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.086965] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.087205] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.087566] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='0',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_127a3eb5002944c5a51c17c72f860bca='0',num_proj_72a0c826169d4687ab1a83684f443d9a='0',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_c1f3e5c6ab1a4a5baf037e03c6f22934='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:58Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 620.087848] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 620.088025] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 620.088184] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', '17c89372-97f2-4ffa-a13e-606d4f31b08f', 'b7ab8792-137d-4053-9df9-3d560aa5e411'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 620.088360] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 620.088608] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 620.088805] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.088979] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.090882] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.090882] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.090882] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.090882] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.090882] nova-scheduler[51488]: DEBUG nova.filters [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 620.091245] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 620.091245] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 620.091245] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Attempting to claim resources in the placement API for instance 5c575e05-5a7c-49b8-b914-9b4a4e347bfc {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 620.198634] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] [instance: 5c575e05-5a7c-49b8-b914-9b4a4e347bfc] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 620.198924] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 620.199150] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 620.199349] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-856a5074-044d-46a2-b268-e5d3bf702adf tempest-ServersAaction247Test-1504655183 tempest-ServersAaction247Test-1504655183-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.057862] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Starting to schedule for instances: ['11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 624.058884] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 624.058884] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.059014] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.059220] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 624.059413] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 624.193804] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.194053] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.194226] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.204545] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.204763] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.204957] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.214291] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.214291] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.214402] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='2',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_127a3eb5002944c5a51c17c72f860bca='0',num_proj_72a0c826169d4687ab1a83684f443d9a='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_c1f3e5c6ab1a4a5baf037e03c6f22934='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:44:59Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 624.214567] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 624.214740] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 624.214901] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 624.215080] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 624.215371] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 624.215592] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.215779] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.215977] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.218162] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.218398] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.218590] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.218756] nova-scheduler[51491]: DEBUG nova.filters [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 624.218915] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 624.219099] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 624.219273] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Attempting to claim resources in the placement API for instance 11f468ba-a807-4490-9dd5-58eaad007865 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 624.299024] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] [instance: 11f468ba-a807-4490-9dd5-58eaad007865] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 624.299024] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 624.299024] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 624.299024] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5ceb329e-e806-49d1-8534-99e1585182e9 tempest-ServersAdmin275Test-194307288 tempest-ServersAdmin275Test-194307288-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.208519] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Starting to schedule for instances: ['fddaa828-8da4-4d5d-80d5-484ccf2ab6b8'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 627.210297] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 627.210297] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.210804] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.210878] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 627.211093] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 627.270471] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.270748] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.270922] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.283170] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.283385] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.283561] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.286089] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.286794] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.286794] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='3',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:05Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 627.287013] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 627.287229] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 627.287591] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 627.287591] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 627.287810] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 627.288393] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.288976] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289058] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289211] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289373] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289553] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289696] nova-scheduler[51488]: DEBUG nova.filters [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 627.289864] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 627.290029] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 627.290213] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Attempting to claim resources in the placement API for instance fddaa828-8da4-4d5d-80d5-484ccf2ab6b8 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 627.363916] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] [instance: fddaa828-8da4-4d5d-80d5-484ccf2ab6b8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 627.364346] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 627.365044] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 627.365044] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-be654e08-8ac1-4963-a18f-499ccfd52a46 tempest-InstanceActionsV221TestJSON-1809115902 tempest-InstanceActionsV221TestJSON-1809115902-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.771550] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Starting to schedule for instances: ['a5eb8727-e918-4a86-9e40-fe20817ca13c'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 630.773442] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 630.773442] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.773442] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.773442] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 630.773442] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 630.838429] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.838826] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.838826] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.849149] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.849149] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.849149] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.852628] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.852628] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.852816] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='3',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_1951f850b8e14cf783d324d2842664b8='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 630.852816] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 630.852918] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 630.852969] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', 'fddaa828-8da4-4d5d-80d5-484ccf2ab6b8'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 630.853875] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 630.853875] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 630.853875] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.853875] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854078] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854589] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854589] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854589] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854766] nova-scheduler[51491]: DEBUG nova.filters [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 630.854893] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 630.855065] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 630.855454] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Attempting to claim resources in the placement API for instance a5eb8727-e918-4a86-9e40-fe20817ca13c {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 630.920570] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] [instance: a5eb8727-e918-4a86-9e40-fe20817ca13c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 630.920824] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 630.921045] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 630.921260] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-457641b5-38a3-4e74-abd8-79b7f8e5a784 tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.596871] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Starting to schedule for instances: ['34ac1a4c-c729-458f-853f-593e0c935f4c'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 635.597126] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 635.597496] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.597496] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.598091] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.598091] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 635.665059] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.665808] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.665808] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.677689] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.678417] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.678417] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.684351] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.684351] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.684512] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='3',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_1951f850b8e14cf783d324d2842664b8='1',num_proj_38e80b51cffa497d967daa587f7880af='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='2',num_task_spawning='4',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:09Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 635.684512] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 635.684610] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 635.684610] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', 'fddaa828-8da4-4d5d-80d5-484ccf2ab6b8', 'a5eb8727-e918-4a86-9e40-fe20817ca13c'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 635.684714] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.684714] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 635.684838] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685031] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685237] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685401] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685585] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685751] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.685908] nova-scheduler[51488]: DEBUG nova.filters [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 635.686771] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 635.687067] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 635.687247] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Attempting to claim resources in the placement API for instance 34ac1a4c-c729-458f-853f-593e0c935f4c {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 635.714561] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Starting to schedule for instances: ['a5a50925-a2b3-403b-8c0e-b36be3da27be'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 635.717338] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 635.717338] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.717338] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.717338] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 635.717338] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 635.782073] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] [instance: 34ac1a4c-c729-458f-853f-593e0c935f4c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 635.782454] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.782699] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.782967] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6f5cd38c-1f19-4576-b385-6d5f7753d8c3 tempest-VolumesAssistedSnapshotsTest-1696972646 tempest-VolumesAssistedSnapshotsTest-1696972646-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.804075] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.804940] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.808044] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.822567] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.823636] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.823950] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.827835] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 635.829605] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 635.829764] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='3',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_1951f850b8e14cf783d324d2842664b8='1',num_proj_38e80b51cffa497d967daa587f7880af='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='2',num_task_spawning='4',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:09Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 635.830100] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 635.830349] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 635.830540] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', 'fddaa828-8da4-4d5d-80d5-484ccf2ab6b8', 'a5eb8727-e918-4a86-9e40-fe20817ca13c'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 635.830734] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 635.831051] nova-scheduler[51491]: DEBUG nova.filters [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 635.834584] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 60.108674 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 635.834584] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 635.834584] nova-scheduler[51491]: INFO nova.filters [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Filter ComputeFilter returned 0 hosts [ 635.834584] nova-scheduler[51491]: DEBUG nova.filters [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Filtering removed all hosts for the request with instance ID 'a5a50925-a2b3-403b-8c0e-b36be3da27be'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 635.834584] nova-scheduler[51491]: INFO nova.filters [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Filtering removed all hosts for the request with instance ID 'a5a50925-a2b3-403b-8c0e-b36be3da27be'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 635.834948] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 635.834948] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b4cffcf7-43ac-42c4-aaa0-b87fe1f095c8 tempest-ServerActionsTestOtherA-1047399784 tempest-ServerActionsTestOtherA-1047399784-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 638.527985] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Starting to schedule for instances: ['ff9fa823-03c3-4b80-b06a-ca7d4aed62a5'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 638.529813] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 638.529997] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.530205] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.530415] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 638.530599] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 638.583467] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.583707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.583874] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.599652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.599652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.599652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.601729] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 638.602128] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 638.602670] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='3',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='2',num_task_spawning='4',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:14Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 638.603165] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 638.604072] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 638.604072] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', 'a5eb8727-e918-4a86-9e40-fe20817ca13c', '34ac1a4c-c729-458f-853f-593e0c935f4c'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 638.604203] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 638.604203] nova-scheduler[51488]: DEBUG nova.filters [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 638.604617] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 62.881918 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 638.604943] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 638.605238] nova-scheduler[51488]: INFO nova.filters [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Filter ComputeFilter returned 0 hosts [ 638.605534] nova-scheduler[51488]: DEBUG nova.filters [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Filtering removed all hosts for the request with instance ID 'ff9fa823-03c3-4b80-b06a-ca7d4aed62a5'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 638.605819] nova-scheduler[51488]: INFO nova.filters [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Filtering removed all hosts for the request with instance ID 'ff9fa823-03c3-4b80-b06a-ca7d4aed62a5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 638.606095] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 638.607652] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d14c37c8-3098-455a-94b8-5e9d20a37799 tempest-FloatingIPsAssociationNegativeTestJSON-531196839 tempest-FloatingIPsAssociationNegativeTestJSON-531196839-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 640.627951] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Starting to schedule for instances: ['191495fb-521b-42bc-889c-17b7b48776f7'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 640.628400] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 640.628483] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.628621] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.628823] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 640.630330] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 640.686314] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.689054] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.689054] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.697737] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.697737] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.697881] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.700627] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 640.700742] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 640.701491] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='4',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='1',num_task_spawning='4',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:18Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 640.701491] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 640.701683] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 640.701737] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '34ac1a4c-c729-458f-853f-593e0c935f4c'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 640.701954] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 640.702152] nova-scheduler[51491]: DEBUG nova.filters [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 640.702351] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 64.979748 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 640.702557] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 640.708307] nova-scheduler[51491]: INFO nova.filters [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Filter ComputeFilter returned 0 hosts [ 640.709214] nova-scheduler[51491]: DEBUG nova.filters [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Filtering removed all hosts for the request with instance ID '191495fb-521b-42bc-889c-17b7b48776f7'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 640.709214] nova-scheduler[51491]: INFO nova.filters [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Filtering removed all hosts for the request with instance ID '191495fb-521b-42bc-889c-17b7b48776f7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 640.709214] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 640.709214] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-e7d5cb5c-fd56-43d9-b417-ddd5c8e5de8e tempest-ServersWithSpecificFlavorTestJSON-1295992508 tempest-ServersWithSpecificFlavorTestJSON-1295992508-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 644.119467] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Starting to schedule for instances: ['8cc49d4d-3c8b-41a5-afaa-23f90a45e18a'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 644.119767] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 644.119932] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.120463] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.120896] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 644.121259] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 644.172156] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.172231] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.172428] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.181078] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.181078] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.181078] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.183609] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 644.184192] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 644.184447] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 644.184743] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 644.184977] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 644.185179] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 644.185410] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 644.185731] nova-scheduler[51488]: DEBUG nova.filters [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 644.185996] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 68.463356 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 644.186261] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 644.186409] nova-scheduler[51488]: INFO nova.filters [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ComputeFilter returned 0 hosts [ 644.186598] nova-scheduler[51488]: DEBUG nova.filters [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filtering removed all hosts for the request with instance ID '8cc49d4d-3c8b-41a5-afaa-23f90a45e18a'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 644.186776] nova-scheduler[51488]: INFO nova.filters [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filtering removed all hosts for the request with instance ID '8cc49d4d-3c8b-41a5-afaa-23f90a45e18a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 644.187075] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 644.187481] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0d1fe599-76bf-49c4-840a-42171f76a5e7 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 646.413702] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Starting to schedule for instances: ['6f2f45ab-c57e-40e7-aaa3-789533cec95a'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 646.414685] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 646.414685] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.414685] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.414685] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 646.414914] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 646.467893] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.468161] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.468453] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.481445] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.481445] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.481445] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.484202] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 646.484202] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 646.484391] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 646.484391] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 646.484492] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 646.484492] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 646.484492] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 646.484628] nova-scheduler[51491]: DEBUG nova.filters [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 646.484628] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 70.761364 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 646.484628] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 646.484628] nova-scheduler[51491]: INFO nova.filters [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filter ComputeFilter returned 0 hosts [ 646.484628] nova-scheduler[51491]: DEBUG nova.filters [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtering removed all hosts for the request with instance ID '6f2f45ab-c57e-40e7-aaa3-789533cec95a'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 646.484766] nova-scheduler[51491]: INFO nova.filters [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtering removed all hosts for the request with instance ID '6f2f45ab-c57e-40e7-aaa3-789533cec95a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 646.484766] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 646.484822] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9bea4cac-3f43-41d7-bd5f-8c0d4eca91a6 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 647.232727] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Starting to schedule for instances: ['b280463d-455f-4ccd-b8c8-4451c764a8b9'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 647.233797] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 647.233797] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.233797] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.233797] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 647.233797] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 647.304887] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.306674] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.306882] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.315642] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.315717] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.315873] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.318828] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 647.318828] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 647.319071] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 647.319511] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 647.320832] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 647.320832] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 647.320832] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 647.321590] nova-scheduler[51488]: DEBUG nova.filters [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 647.321590] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 71.597918 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 647.321590] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 647.321590] nova-scheduler[51488]: INFO nova.filters [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Filter ComputeFilter returned 0 hosts [ 647.321590] nova-scheduler[51488]: DEBUG nova.filters [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Filtering removed all hosts for the request with instance ID 'b280463d-455f-4ccd-b8c8-4451c764a8b9'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 647.321805] nova-scheduler[51488]: INFO nova.filters [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Filtering removed all hosts for the request with instance ID 'b280463d-455f-4ccd-b8c8-4451c764a8b9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 647.321805] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 647.321805] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bc88ed1b-88b6-443f-9ef3-543814d53d8c tempest-AttachInterfacesUnderV243Test-1695532587 tempest-AttachInterfacesUnderV243Test-1695532587-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 648.553625] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Starting to schedule for instances: ['4333c7c7-1354-4718-affb-4a5d8e85c8b8'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 648.554385] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 648.559202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.559202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.559202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 648.559202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 648.620128] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.620373] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.620548] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.628072] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.628286] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.628446] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.630746] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 648.630949] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 648.631334] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 648.631621] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 648.631775] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 648.631927] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 648.632104] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 648.632963] nova-scheduler[51491]: DEBUG nova.filters [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 648.632963] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 72.909953 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 648.632963] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 648.632963] nova-scheduler[51491]: INFO nova.filters [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filter ComputeFilter returned 0 hosts [ 648.633159] nova-scheduler[51491]: DEBUG nova.filters [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtering removed all hosts for the request with instance ID '4333c7c7-1354-4718-affb-4a5d8e85c8b8'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 648.633159] nova-scheduler[51491]: INFO nova.filters [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtering removed all hosts for the request with instance ID '4333c7c7-1354-4718-affb-4a5d8e85c8b8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 648.633303] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 648.633443] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b2e5abed-f3bb-442c-83c8-34540b13dbd8 tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 650.265345] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Starting to schedule for instances: ['39813970-ac66-4859-bd6f-d5fcfc905cf7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 650.265824] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 650.266050] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.266278] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.268508] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.268749] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 650.326782] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.327140] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.327379] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.339451] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.339451] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.339451] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.342216] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.342946] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.343073] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 650.344030] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 650.344030] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 650.344321] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 650.344491] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.344788] nova-scheduler[51488]: DEBUG nova.filters [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 650.344972] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 74.622359 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 650.345145] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 650.345305] nova-scheduler[51488]: INFO nova.filters [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filter ComputeFilter returned 0 hosts [ 650.345456] nova-scheduler[51488]: DEBUG nova.filters [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtering removed all hosts for the request with instance ID '39813970-ac66-4859-bd6f-d5fcfc905cf7'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 650.346417] nova-scheduler[51488]: INFO nova.filters [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtering removed all hosts for the request with instance ID '39813970-ac66-4859-bd6f-d5fcfc905cf7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 650.346417] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 650.346417] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-01bb32f7-f61b-4f1a-a2a8-453f90ee6694 tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 650.416431] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Starting to schedule for instances: ['d77b4c95-2b73-4752-923a-c503843ee63a'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 650.416431] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 650.416431] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.416431] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.416732] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 650.416829] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 650.472677] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.472677] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.472677] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.479916] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.480158] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.480328] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.482443] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 650.482651] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 650.483023] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 650.483313] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 650.483482] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 650.483671] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 650.483842] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 650.484105] nova-scheduler[51491]: DEBUG nova.filters [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 650.485223] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 74.7617 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 650.485223] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 650.485223] nova-scheduler[51491]: INFO nova.filters [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Filter ComputeFilter returned 0 hosts [ 650.485223] nova-scheduler[51491]: DEBUG nova.filters [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Filtering removed all hosts for the request with instance ID 'd77b4c95-2b73-4752-923a-c503843ee63a'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 650.485223] nova-scheduler[51491]: INFO nova.filters [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Filtering removed all hosts for the request with instance ID 'd77b4c95-2b73-4752-923a-c503843ee63a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 650.485223] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 650.485223] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-cc6b45e1-6a18-4995-b2a6-ddb3bd8e28ee tempest-ServersTestFqdnHostnames-424581684 tempest-ServersTestFqdnHostnames-424581684-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 652.394920] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Starting to schedule for instances: ['ea77fc31-2f6f-4724-b885-68f9c2823b97'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 652.395520] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 652.395520] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.395614] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.398283] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 652.398283] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 652.450735] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.450735] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.450735] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.460403] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.460403] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.460403] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.468702] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 652.468702] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 652.468702] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 652.468702] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 652.468936] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 652.468993] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 652.469218] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 652.469517] nova-scheduler[51488]: DEBUG nova.filters [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 652.469992] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 76.74712 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 652.470053] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 652.470213] nova-scheduler[51488]: INFO nova.filters [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filter ComputeFilter returned 0 hosts [ 652.470383] nova-scheduler[51488]: DEBUG nova.filters [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtering removed all hosts for the request with instance ID 'ea77fc31-2f6f-4724-b885-68f9c2823b97'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 652.470640] nova-scheduler[51488]: INFO nova.filters [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtering removed all hosts for the request with instance ID 'ea77fc31-2f6f-4724-b885-68f9c2823b97'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 652.470697] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 652.470828] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6fe357e6-4474-4872-9e40-7846fb2cd19c tempest-ServersAdminTestJSON-2079283119 tempest-ServersAdminTestJSON-2079283119-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 653.756941] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Starting to schedule for instances: ['0c93fe4a-0c24-42f9-b8be-9e037707910c'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 653.756941] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 653.758751] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.759744] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.762833] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 653.763081] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 653.807628] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.809337] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.809605] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.818940] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.818940] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.818940] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.822520] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 653.822904] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 653.824116] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 653.824116] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 653.824838] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 653.825074] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 653.825449] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 653.825794] nova-scheduler[51491]: DEBUG nova.filters [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 653.826094] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 78.103391 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 653.826187] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 653.826343] nova-scheduler[51491]: INFO nova.filters [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filter ComputeFilter returned 0 hosts [ 653.826491] nova-scheduler[51491]: DEBUG nova.filters [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtering removed all hosts for the request with instance ID '0c93fe4a-0c24-42f9-b8be-9e037707910c'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 653.826682] nova-scheduler[51491]: INFO nova.filters [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtering removed all hosts for the request with instance ID '0c93fe4a-0c24-42f9-b8be-9e037707910c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 653.826869] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 653.827047] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9a438798-dac3-404e-9394-4538cf46ec5b tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 655.170017] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Starting to schedule for instances: ['7d4695d2-b371-45ac-b167-4e1c9e2258b8'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 655.170017] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 655.170815] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.170930] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.171404] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 655.171404] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 655.230439] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.231418] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.231418] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.241714] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.242952] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.242952] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.245781] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 655.246524] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 655.246524] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 655.246747] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 655.246886] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 655.247133] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 655.247229] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 655.247479] nova-scheduler[51488]: DEBUG nova.filters [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 655.247698] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 79.525075 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 655.247855] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 655.248014] nova-scheduler[51488]: INFO nova.filters [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filter ComputeFilter returned 0 hosts [ 655.248167] nova-scheduler[51488]: DEBUG nova.filters [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtering removed all hosts for the request with instance ID '7d4695d2-b371-45ac-b167-4e1c9e2258b8'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 655.249023] nova-scheduler[51488]: INFO nova.filters [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtering removed all hosts for the request with instance ID '7d4695d2-b371-45ac-b167-4e1c9e2258b8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 655.249023] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 655.249023] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-00d2871a-97b4-451b-8c2e-fefe11af7dbd tempest-ListImageFiltersTestJSON-1511818971 tempest-ListImageFiltersTestJSON-1511818971-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 656.110139] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Starting to schedule for instances: ['52ed178b-2e1e-437b-8fbd-c5a6854c7216'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 656.110449] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 656.112977] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.112977] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.112977] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 656.112977] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 656.170058] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.170296] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.170490] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.180307] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.180601] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.180781] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.185156] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 656.185156] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 656.185156] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 656.185156] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 656.185156] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 656.185156] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 656.185156] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 656.185708] nova-scheduler[51491]: DEBUG nova.filters [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 656.185708] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 80.462799 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 656.185708] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 656.185805] nova-scheduler[51491]: INFO nova.filters [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filter ComputeFilter returned 0 hosts [ 656.185895] nova-scheduler[51491]: DEBUG nova.filters [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filtering removed all hosts for the request with instance ID '52ed178b-2e1e-437b-8fbd-c5a6854c7216'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 656.186071] nova-scheduler[51491]: INFO nova.filters [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filtering removed all hosts for the request with instance ID '52ed178b-2e1e-437b-8fbd-c5a6854c7216'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 656.186386] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 656.186386] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-785c2bdc-f924-4f7e-94e9-eefd2afbedab tempest-MigrationsAdminTest-1959481632 tempest-MigrationsAdminTest-1959481632-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 659.524574] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Starting to schedule for instances: ['3307e380-73e7-4d90-8dea-58c219b8447c'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 659.524868] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 659.525129] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.525370] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.525586] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 659.525807] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 659.571119] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.571355] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.571522] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.578804] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.578804] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.578804] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.580697] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 659.580907] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 659.581351] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 659.581576] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 659.581743] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 659.581904] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 659.582420] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 659.582420] nova-scheduler[51488]: DEBUG nova.filters [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 659.582552] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 83.859904 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 659.582654] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 659.582808] nova-scheduler[51488]: INFO nova.filters [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filter ComputeFilter returned 0 hosts [ 659.582955] nova-scheduler[51488]: DEBUG nova.filters [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtering removed all hosts for the request with instance ID '3307e380-73e7-4d90-8dea-58c219b8447c'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 659.583104] nova-scheduler[51488]: INFO nova.filters [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtering removed all hosts for the request with instance ID '3307e380-73e7-4d90-8dea-58c219b8447c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 659.583250] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 659.583394] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-678ce3a0-91a0-43d1-a744-01bdbb8e629e tempest-VolumesAdminNegativeTest-2121041050 tempest-VolumesAdminNegativeTest-2121041050-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 660.532767] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Starting to schedule for instances: ['b2bbc2d6-4faa-4972-8d1e-2bf5c37dcd64'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 660.534912] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 660.534912] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.534912] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.534912] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 660.535168] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 660.584956] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.585458] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.585458] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.592157] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.594378] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.594378] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.598989] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 660.599756] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 660.600307] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='5',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='1',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='4',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:22Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 660.600778] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 660.601099] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 660.601400] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Update host state with instances: ['21e37459-3ce1-41e7-8317-b98edafb15d4', 'b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 660.601703] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 660.602326] nova-scheduler[51491]: DEBUG nova.filters [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 660.602672] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 84.880022 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 660.602948] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 has not been heard from in a while [ 660.603220] nova-scheduler[51491]: INFO nova.filters [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Filter ComputeFilter returned 0 hosts [ 660.604075] nova-scheduler[51491]: DEBUG nova.filters [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Filtering removed all hosts for the request with instance ID 'b2bbc2d6-4faa-4972-8d1e-2bf5c37dcd64'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 660.604357] nova-scheduler[51491]: INFO nova.filters [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Filtering removed all hosts for the request with instance ID 'b2bbc2d6-4faa-4972-8d1e-2bf5c37dcd64'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 660.604624] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 660.604893] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-84d61112-fda5-426b-b554-af5c6f22ec88 tempest-ImagesNegativeTestJSON-47176368 tempest-ImagesNegativeTestJSON-47176368-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 667.835105] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Starting to schedule for instances: ['3d11098b-555c-4cbd-8878-0822a22faf0b'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 667.835470] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 667.835678] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.836167] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.836407] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 667.836755] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 667.911632] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.911973] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.912079] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.925694] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.925979] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.926124] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.929214] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 667.929214] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 667.930397] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 667.930397] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:45:42Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-873921131',updated_at=None,uuid=e3bb9d56-0308-430d-8b95-f94331401371)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 667.930397] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 667.930397] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 667.930713] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 667.930713] nova-scheduler[51488]: DEBUG nova.filters [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 667.930943] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 92.208312 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 667.931109] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 667.931265] nova-scheduler[51488]: INFO nova.filters [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filter ComputeFilter returned 0 hosts [ 667.931409] nova-scheduler[51488]: DEBUG nova.filters [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtering removed all hosts for the request with instance ID '3d11098b-555c-4cbd-8878-0822a22faf0b'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 667.931585] nova-scheduler[51488]: INFO nova.filters [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtering removed all hosts for the request with instance ID '3d11098b-555c-4cbd-8878-0822a22faf0b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 667.931686] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 667.931911] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-788ec1e5-5162-4641-aa68-4ff2bcaac733 tempest-ServersTestMultiNic-2066705161 tempest-ServersTestMultiNic-2066705161-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 668.362891] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Starting to schedule for instances: ['d4ba25c9-fca4-4661-9875-d925c09cbdcf'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 668.363211] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 668.363466] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.364424] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.364424] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 668.364424] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 668.410522] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.410892] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.410892] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.417672] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.417895] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.419527] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.420351] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 668.420623] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 668.421041] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 668.421431] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:45:42Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-873921131',updated_at=None,uuid=e3bb9d56-0308-430d-8b95-f94331401371)] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 668.421611] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 668.424170] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 668.424170] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 668.424170] nova-scheduler[51491]: DEBUG nova.filters [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 668.424170] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 92.699836 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 668.424170] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 668.424170] nova-scheduler[51491]: INFO nova.filters [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Filter ComputeFilter returned 0 hosts [ 668.424170] nova-scheduler[51491]: DEBUG nova.filters [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Filtering removed all hosts for the request with instance ID 'd4ba25c9-fca4-4661-9875-d925c09cbdcf'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 668.424170] nova-scheduler[51491]: INFO nova.filters [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Filtering removed all hosts for the request with instance ID 'd4ba25c9-fca4-4661-9875-d925c09cbdcf'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 668.424170] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 668.424170] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6e7562f0-e2f7-486d-bd9c-cd1c05590c6a tempest-ServerMetadataNegativeTestJSON-1931250371 tempest-ServerMetadataNegativeTestJSON-1931250371-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 669.873629] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Starting to schedule for instances: ['9b993bc5-cd0d-45e3-9fa7-4439269be3df'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 669.874020] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 669.874916] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.875177] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.875517] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.875751] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting to schedule for instances: ['19055e4d-3f21-4aee-b505-925ba3345c1d'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 669.918635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 669.928685] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.928926] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.929219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.936785] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.937682] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.937682] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.943180] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.943180] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:45:42Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-873921131',updated_at=None,uuid=e3bb9d56-0308-430d-8b95-f94331401371)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 669.947019] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.filters [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 669.947019] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 94.222178 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 669.947632] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 669.947632] nova-scheduler[51488]: INFO nova.filters [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Filter ComputeFilter returned 0 hosts [ 669.947632] nova-scheduler[51488]: DEBUG nova.filters [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Filtering removed all hosts for the request with instance ID '9b993bc5-cd0d-45e3-9fa7-4439269be3df'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 669.947632] nova-scheduler[51488]: INFO nova.filters [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Filtering removed all hosts for the request with instance ID '9b993bc5-cd0d-45e3-9fa7-4439269be3df'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 669.947632] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 669.947632] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-65ba9ed4-3fcb-494b-8fda-6443ee1747cf tempest-ServerMetadataTestJSON-384392309 tempest-ServerMetadataTestJSON-384392309-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 669.980111] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.984716] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.984716] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.995729] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.996048] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.996228] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 669.998793] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 669.999010] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 669.999941] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 669.999941] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:45:42Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-873921131',updated_at=None,uuid=e3bb9d56-0308-430d-8b95-f94331401371)] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 669.999941] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 670.000277] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 670.000277] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 670.001566] nova-scheduler[51491]: DEBUG nova.filters [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 670.001566] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 94.278058 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 670.001566] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 670.001566] nova-scheduler[51491]: INFO nova.filters [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ComputeFilter returned 0 hosts [ 670.001566] nova-scheduler[51491]: DEBUG nova.filters [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filtering removed all hosts for the request with instance ID '19055e4d-3f21-4aee-b505-925ba3345c1d'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 670.001566] nova-scheduler[51491]: INFO nova.filters [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filtering removed all hosts for the request with instance ID '19055e4d-3f21-4aee-b505-925ba3345c1d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 670.001566] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 670.001973] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5e09a2c6-7b3a-4ac2-8630-6039246876a5 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 671.025355] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Starting to schedule for instances: ['44d4750f-ceea-4c0b-b809-216fd0764a7f'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 671.025953] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 671.026192] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.026595] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.026595] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 671.026759] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 671.084727] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.084959] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.085674] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.098816] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.102566] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.102566] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.102566] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 671.102566] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 671.102566] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 671.102566] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Update host state with aggregates: [Aggregate(created_at=2024-10-23T14:45:42Z,deleted=False,deleted_at=None,hosts=['cpu-1'],id=7,metadata={},name='tempest-test_aggregate-873921131',updated_at=None,uuid=e3bb9d56-0308-430d-8b95-f94331401371)] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 671.104999] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 671.104999] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 671.104999] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 671.106246] nova-scheduler[51488]: DEBUG nova.filters [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 671.106246] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 95.382841 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 671.106246] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 671.106246] nova-scheduler[51488]: INFO nova.filters [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Filter ComputeFilter returned 0 hosts [ 671.106246] nova-scheduler[51488]: DEBUG nova.filters [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Filtering removed all hosts for the request with instance ID '44d4750f-ceea-4c0b-b809-216fd0764a7f'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 671.106246] nova-scheduler[51488]: INFO nova.filters [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Filtering removed all hosts for the request with instance ID '44d4750f-ceea-4c0b-b809-216fd0764a7f'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 671.106580] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 671.108645] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0a17b3db-dfd5-4dbe-bfb0-9577e6a2c1d5 tempest-ServerGroupTestJSON-1199456404 tempest-ServerGroupTestJSON-1199456404-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 674.909730] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Starting to schedule for instances: ['4d31e50e-8770-4509-af35-9c7666c23c8b'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 674.912773] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 674.912773] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.912773] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.912773] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 674.912773] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 674.981743] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.981961] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.982146] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.992518] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.992640] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.993324] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.996370] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 674.996370] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 674.996549] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 674.996864] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 674.997156] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 674.997274] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 674.997487] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 674.997671] nova-scheduler[51491]: DEBUG nova.filters [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 674.997845] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 99.275224 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 674.999251] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 674.999251] nova-scheduler[51491]: INFO nova.filters [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Filter ComputeFilter returned 0 hosts [ 674.999251] nova-scheduler[51491]: DEBUG nova.filters [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Filtering removed all hosts for the request with instance ID '4d31e50e-8770-4509-af35-9c7666c23c8b'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 674.999251] nova-scheduler[51491]: INFO nova.filters [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Filtering removed all hosts for the request with instance ID '4d31e50e-8770-4509-af35-9c7666c23c8b'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 674.999251] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 674.999251] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6765486c-84d9-4c58-aba0-a4ae1e55eb3e tempest-ServerAddressesNegativeTestJSON-854539167 tempest-ServerAddressesNegativeTestJSON-854539167-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 676.662622] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Starting to schedule for instances: ['f2071807-f1ec-42bd-9f52-5eca825e59d2', 'bc9618cf-02fe-45d3-8bd2-39b2b0635a95', 'ea8819b2-776d-42ca-aed5-efeb2e362d74'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 676.662622] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 676.662622] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.663416] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.663912] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 676.664333] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 676.709626] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.709859] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.710046] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.716723] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.716936] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.717116] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.719367] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 676.719558] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 676.721247] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.filters [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 676.721247] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 100.998533 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 676.721676] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 676.721676] nova-scheduler[51488]: INFO nova.filters [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Filter ComputeFilter returned 0 hosts [ 676.721676] nova-scheduler[51488]: DEBUG nova.filters [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Filtering removed all hosts for the request with instance ID 'f2071807-f1ec-42bd-9f52-5eca825e59d2'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 676.721773] nova-scheduler[51488]: INFO nova.filters [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Filtering removed all hosts for the request with instance ID 'f2071807-f1ec-42bd-9f52-5eca825e59d2'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 676.721909] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 676.722071] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-dd650ef2-0a0b-400b-8667-d29749a52938 tempest-ListServersNegativeTestJSON-1742549799 tempest-ListServersNegativeTestJSON-1742549799-project-member] There are 0 hosts available but 3 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 677.096115] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Starting to schedule for instances: ['b4e392ba-2c92-4f9d-9997-2fc133559b81'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 677.096420] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 677.096576] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.096764] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.097417] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 677.098182] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 677.147032] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.147560] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.147878] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.164104] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.164104] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.164104] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.168525] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 677.168715] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 677.169157] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 677.170163] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 677.170163] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 677.170163] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 677.170163] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 677.170516] nova-scheduler[51491]: DEBUG nova.filters [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 677.170516] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 101.447912 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 677.170665] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 677.170815] nova-scheduler[51491]: INFO nova.filters [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filter ComputeFilter returned 0 hosts [ 677.170954] nova-scheduler[51491]: DEBUG nova.filters [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtering removed all hosts for the request with instance ID 'b4e392ba-2c92-4f9d-9997-2fc133559b81'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 677.171292] nova-scheduler[51491]: INFO nova.filters [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtering removed all hosts for the request with instance ID 'b4e392ba-2c92-4f9d-9997-2fc133559b81'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 677.171458] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 677.171602] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-d33b2a99-9e99-4c75-8fad-588db2b7bc29 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 681.007751] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Starting to schedule for instances: ['959e648a-8d1c-4453-988d-cd405f43be58'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 681.008580] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 681.008580] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.008580] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.008580] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 681.008890] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 681.058287] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.058530] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.058696] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.065323] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.065970] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.065970] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.068373] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 681.068373] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 681.069253] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 681.069253] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 681.069253] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 681.069559] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 681.069559] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 681.069738] nova-scheduler[51488]: DEBUG nova.filters [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 681.069943] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 105.347333 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 681.070110] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 681.070384] nova-scheduler[51488]: INFO nova.filters [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Filter ComputeFilter returned 0 hosts [ 681.070446] nova-scheduler[51488]: DEBUG nova.filters [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Filtering removed all hosts for the request with instance ID '959e648a-8d1c-4453-988d-cd405f43be58'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 681.070554] nova-scheduler[51488]: INFO nova.filters [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Filtering removed all hosts for the request with instance ID '959e648a-8d1c-4453-988d-cd405f43be58'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 681.070665] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 681.070804] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-d34d37c0-f3a5-4ee4-9540-0c7dc3643882 tempest-ServersTestJSON-1611326517 tempest-ServersTestJSON-1611326517-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 683.261952] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Starting to schedule for instances: ['1133fdb1-446b-4f7a-8594-23dd35a35b78'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 683.262283] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 683.262502] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.262696] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.262898] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 683.263822] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 683.309198] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.309440] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.309609] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.316144] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.316373] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.316537] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.318514] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 683.318713] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 683.319076] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 683.319359] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 683.319527] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 683.319681] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 683.319839] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 683.320103] nova-scheduler[51491]: DEBUG nova.filters [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 683.320312] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 107.597697 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 683.320480] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 683.320642] nova-scheduler[51491]: INFO nova.filters [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filter ComputeFilter returned 0 hosts [ 683.320787] nova-scheduler[51491]: DEBUG nova.filters [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtering removed all hosts for the request with instance ID '1133fdb1-446b-4f7a-8594-23dd35a35b78'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 683.320922] nova-scheduler[51491]: INFO nova.filters [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtering removed all hosts for the request with instance ID '1133fdb1-446b-4f7a-8594-23dd35a35b78'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 683.321200] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 683.321364] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9fc3964e-fff0-4513-ac48-480751e1d772 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 684.371296] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Starting to schedule for instances: ['e91125dd-2352-4914-a269-e98db0479dc1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 684.371296] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 684.371296] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.373219] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.373452] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 684.373647] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 684.428166] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.428166] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.428166] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.436514] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.436514] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.436809] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.439200] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 684.439326] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 684.440240] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='6',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_1951f850b8e14cf783d324d2842664b8='0',num_proj_38e80b51cffa497d967daa587f7880af='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a46c26434cd94ea2bcea9461abb7f359='0',num_proj_d020d014854949569b330b6a18e177dc='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:45:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 684.440240] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 684.440240] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 684.440419] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 684.440458] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 684.440687] nova-scheduler[51488]: DEBUG nova.filters [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 684.440893] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 108.718281 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 684.441148] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 684.441347] nova-scheduler[51488]: INFO nova.filters [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filter ComputeFilter returned 0 hosts [ 684.441525] nova-scheduler[51488]: DEBUG nova.filters [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtering removed all hosts for the request with instance ID 'e91125dd-2352-4914-a269-e98db0479dc1'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 684.441704] nova-scheduler[51488]: INFO nova.filters [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtering removed all hosts for the request with instance ID 'e91125dd-2352-4914-a269-e98db0479dc1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 684.442597] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 684.442597] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-45faf100-3da9-4af5-b020-26ec15714260 tempest-ServerRescueNegativeTestJSON-1122600575 tempest-ServerRescueNegativeTestJSON-1122600575-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 687.223786] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.223786] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.224018] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.224047] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.225129] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.225418] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.225747] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 687.225931] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 687.226144] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.227723] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.231035] nova-scheduler[51488]: INFO nova.scheduler.host_manager [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 687.231342] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.006s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 687.231511] nova-scheduler[51491]: INFO nova.scheduler.host_manager [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Received a sync request from an unknown host 'cpu-1'. Re-created its InstanceList. [ 687.231566] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-92489ef9-6e08-477e-86ee-b4c3108bfa07 None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.008s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.192421] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Starting to schedule for instances: ['f4d61950-5a7c-45bf-b93e-c2e80530fdde'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 688.192716] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 688.192899] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.196826] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.196826] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.196826] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.247944] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.248738] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.249073] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.257238] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting to schedule for instances: ['a5ec11ef-3476-44e0-b3d7-7a2b56f3b279'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 688.257620] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 688.257696] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.257871] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.258888] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 688.261540] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 688.261800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.261800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.261800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.264390] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.264686] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.265727] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.265727] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.265727] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.265727] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.265727] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.266042] nova-scheduler[51491]: DEBUG nova.filters [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.266214] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 112.543574 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 688.266367] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 688.266518] nova-scheduler[51491]: INFO nova.filters [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Filter ComputeFilter returned 0 hosts [ 688.266670] nova-scheduler[51491]: DEBUG nova.filters [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Filtering removed all hosts for the request with instance ID 'f4d61950-5a7c-45bf-b93e-c2e80530fdde'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 688.266868] nova-scheduler[51491]: INFO nova.filters [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Filtering removed all hosts for the request with instance ID 'f4d61950-5a7c-45bf-b93e-c2e80530fdde'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 688.266977] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.267135] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-36351400-2291-4cfa-a130-bb1f920f2533 tempest-ServerActionsTestOtherB-121839142 tempest-ServerActionsTestOtherB-121839142-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 688.310834] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.311098] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.311278] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.318894] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.319541] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.319541] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.322175] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 688.322935] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 688.323317] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 688.323614] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 688.323801] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 688.324054] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 688.324521] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 688.324521] nova-scheduler[51488]: DEBUG nova.filters [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 688.324668] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 112.60199 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 688.324763] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 688.324992] nova-scheduler[51488]: INFO nova.filters [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeFilter returned 0 hosts [ 688.325193] nova-scheduler[51488]: DEBUG nova.filters [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtering removed all hosts for the request with instance ID 'a5ec11ef-3476-44e0-b3d7-7a2b56f3b279'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 688.325298] nova-scheduler[51488]: INFO nova.filters [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtering removed all hosts for the request with instance ID 'a5ec11ef-3476-44e0-b3d7-7a2b56f3b279'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 688.325445] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 688.325631] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-07b3546e-4521-464d-8f2a-a476d772cc7d tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 689.210253] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Starting to schedule for instances: ['49e3e619-7fa6-4dee-a447-b72668fca5d4'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 689.210253] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 689.210253] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.210253] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.210253] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 689.210503] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 689.270079] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.270334] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.270508] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.277758] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.277953] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.278132] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.280466] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 689.280669] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 689.281476] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 689.281791] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 689.281972] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 689.282139] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 689.282305] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 689.282556] nova-scheduler[51491]: DEBUG nova.filters [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 689.282770] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 113.560148 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 689.283179] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 689.283179] nova-scheduler[51491]: INFO nova.filters [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ComputeFilter returned 0 hosts [ 689.283272] nova-scheduler[51491]: DEBUG nova.filters [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filtering removed all hosts for the request with instance ID '49e3e619-7fa6-4dee-a447-b72668fca5d4'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 689.283357] nova-scheduler[51491]: INFO nova.filters [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filtering removed all hosts for the request with instance ID '49e3e619-7fa6-4dee-a447-b72668fca5d4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 689.283508] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 689.283650] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a2db66a2-09bb-4cb0-a9a6-be3b396adc76 tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 690.602910] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Starting to schedule for instances: ['c537a7d4-6618-4cfa-afd5-209b99692d65'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 690.603237] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 690.603392] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.603565] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.603755] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 690.603925] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 690.671213] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.671394] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.671558] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.686909] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.686909] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.687055] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.689319] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 690.689517] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 690.689868] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 690.690160] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 690.690328] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 690.690480] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 690.690639] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 690.693353] nova-scheduler[51488]: DEBUG nova.filters [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 690.693645] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 114.970971 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 690.693829] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 690.694017] nova-scheduler[51488]: INFO nova.filters [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filter ComputeFilter returned 0 hosts [ 690.694196] nova-scheduler[51488]: DEBUG nova.filters [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtering removed all hosts for the request with instance ID 'c537a7d4-6618-4cfa-afd5-209b99692d65'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 690.694597] nova-scheduler[51488]: INFO nova.filters [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtering removed all hosts for the request with instance ID 'c537a7d4-6618-4cfa-afd5-209b99692d65'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 690.694793] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 690.696805] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-0ec03996-4122-4954-93d2-c98ecdb0db25 tempest-ServerShowV247Test-556280072 tempest-ServerShowV247Test-556280072-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 693.805863] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Starting to schedule for instances: ['56ff71b7-3b44-4860-8ce8-8b75757a569c'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 693.806183] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 693.806345] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.806513] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.806704] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 693.806877] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 693.861441] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.861704] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.861913] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.875013] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.875013] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.876489] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.878964] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 693.879317] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 693.879633] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 693.880030] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 693.880621] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 693.880621] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 693.880621] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 693.880766] nova-scheduler[51491]: DEBUG nova.filters [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 693.883692] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 118.159292 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 693.883692] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 693.883692] nova-scheduler[51491]: INFO nova.filters [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Filter ComputeFilter returned 0 hosts [ 693.883692] nova-scheduler[51491]: DEBUG nova.filters [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Filtering removed all hosts for the request with instance ID '56ff71b7-3b44-4860-8ce8-8b75757a569c'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 693.883692] nova-scheduler[51491]: INFO nova.filters [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Filtering removed all hosts for the request with instance ID '56ff71b7-3b44-4860-8ce8-8b75757a569c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 693.883692] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 693.883692] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-6d337fe4-b5d0-4d83-a8ef-8b2decf79164 tempest-ImagesOneServerTestJSON-66817639 tempest-ImagesOneServerTestJSON-66817639-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 695.264232] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Starting to schedule for instances: ['39a71a25-3fb7-4fbf-a778-a3fe135dc3c1'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 695.264506] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 695.264668] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.264846] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.265655] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 695.265894] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 695.324245] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.324460] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.324622] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.334016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.334016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.334016] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.334164] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 695.334762] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 695.334762] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 695.334922] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 695.335075] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 1, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 44, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 695.335227] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 695.335413] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 695.335687] nova-scheduler[51488]: DEBUG nova.filters [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 695.335885] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:44:14. Elapsed time is 119.613273 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 695.337564] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 695.337564] nova-scheduler[51488]: INFO nova.filters [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Filter ComputeFilter returned 0 hosts [ 695.337564] nova-scheduler[51488]: DEBUG nova.filters [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Filtering removed all hosts for the request with instance ID '39a71a25-3fb7-4fbf-a778-a3fe135dc3c1'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 695.337564] nova-scheduler[51488]: INFO nova.filters [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Filtering removed all hosts for the request with instance ID '39a71a25-3fb7-4fbf-a778-a3fe135dc3c1'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 695.337564] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 695.337564] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-a31e40b8-7003-4f1a-9167-3faca6b641b6 tempest-FloatingIPsAssociationTestJSON-489888283 tempest-FloatingIPsAssociationTestJSON-489888283-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting to schedule for instances: ['67b01666-6233-4af8-a0ec-a4e938b82606'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 696.368703] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 696.419103] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.419103] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.419103] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.427382] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.427701] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.427922] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.431017] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.431092] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.431501] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='7',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:06Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 696.431857] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 696.432097] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 696.432299] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 696.432500] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 696.432888] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 696.433690] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.433961] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.filters [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 696.435190] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 696.435610] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Attempting to claim resources in the placement API for instance 67b01666-6233-4af8-a0ec-a4e938b82606 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 696.507135] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] [instance: 67b01666-6233-4af8-a0ec-a4e938b82606] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 696.507643] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 696.507933] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 696.508250] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fcdf030-5581-4c31-b555-6f450d6c557c tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.147724] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Starting to schedule for instances: ['37331817-f277-4f32-8d5a-11e1cf63f2b7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.148973] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.152648] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.152648] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.152648] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.152648] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 700.204978] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.205141] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.205316] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.212013] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.212227] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.212392] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.214477] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.214654] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.215031] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='7',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:15Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 700.215312] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 700.215480] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 700.215634] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 700.215790] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.216044] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 700.216272] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.216454] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.216650] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.216810] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.216968] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.217148] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.217335] nova-scheduler[51488]: DEBUG nova.filters [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.217464] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 700.217626] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 700.217798] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Attempting to claim resources in the placement API for instance 37331817-f277-4f32-8d5a-11e1cf63f2b7 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 700.277895] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] [instance: 37331817-f277-4f32-8d5a-11e1cf63f2b7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 700.278216] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.278504] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.278716] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1f805b44-4a24-4176-9eaa-856adf31a9c4 tempest-ServerRescueTestJSONUnderV235-1094407707 tempest-ServerRescueTestJSONUnderV235-1094407707-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.303746] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Starting to schedule for instances: ['5b59d527-232e-4ef1-bc83-4e8671607db1'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 700.304028] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 700.308021] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.308021] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.308021] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 700.308021] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 700.377998] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.377998] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.377998] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.388231] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.388437] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.388596] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.393601] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.393813] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.394223] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='7',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='1',num_task_spawning='3',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:15Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 700.394676] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 700.394749] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 700.394849] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 700.395032] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 700.395286] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 700.395459] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.395656] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.395872] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.395992] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.396191] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.396363] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.396520] nova-scheduler[51491]: DEBUG nova.filters [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 700.397057] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 700.397154] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 700.401117] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Attempting to claim resources in the placement API for instance 5b59d527-232e-4ef1-bc83-4e8671607db1 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 700.484498] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] [instance: 5b59d527-232e-4ef1-bc83-4e8671607db1] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 700.485297] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 700.485297] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 700.485297] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-842661e4-47db-40b6-a177-abdbb515f635 tempest-SecurityGroupsTestJSON-1410390636 tempest-SecurityGroupsTestJSON-1410390636-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.142351] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['5ad1fabc-bae4-47cb-9b27-42c86c4b02e8'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 702.142634] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 702.142788] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.142997] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.143216] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 702.143396] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 702.207891] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.208171] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.208314] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.219430] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.219860] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.219860] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.226140] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.226140] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.226603] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='7',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='3',num_task_spawning='3',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:19Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 702.226731] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 702.226804] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 702.226957] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606', '37331817-f277-4f32-8d5a-11e1cf63f2b7', '5b59d527-232e-4ef1-bc83-4e8671607db1'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 702.227178] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 702.227474] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 702.227681] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.228819] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.228819] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.228952] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.filters [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 702.230908] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Attempting to claim resources in the placement API for instance 5ad1fabc-bae4-47cb-9b27-42c86c4b02e8 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 702.295022] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] [instance: 5ad1fabc-bae4-47cb-9b27-42c86c4b02e8] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 702.295348] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 702.295561] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 702.295762] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-165b5755-201c-4c41-b1f1-5918d30a4aa7 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.390772] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Starting to schedule for instances: ['db69e0d0-724b-4a87-80f5-390cfc395ee9'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 705.391740] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 705.391740] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.391740] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.391740] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.391907] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 705.439358] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.439594] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.439766] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.446912] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.448160] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.448160] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.450033] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.450269] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.450658] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='7',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='4',num_task_spawning='3',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:21Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 705.451365] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 705.451365] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 705.451365] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606', '37331817-f277-4f32-8d5a-11e1cf63f2b7', '5b59d527-232e-4ef1-bc83-4e8671607db1', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 705.451551] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.451693] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.filters [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 705.454496] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Attempting to claim resources in the placement API for instance db69e0d0-724b-4a87-80f5-390cfc395ee9 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 705.517301] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] [instance: db69e0d0-724b-4a87-80f5-390cfc395ee9] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 705.517548] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.517757] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.517968] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-789599d9-f56b-442a-8a42-a313d99e721a tempest-AttachInterfacesV270Test-1791144961 tempest-AttachInterfacesV270Test-1791144961-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting to schedule for instances: ['29c85bbf-553e-4b82-ad7c-5341ffc5af63'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 705.771527] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 705.816449] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.816652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.816825] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.824364] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.824573] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.824857] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.827219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.827421] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.828056] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='7',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='4',num_task_spawning='3',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:21Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 705.828162] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 705.828248] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 705.828400] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606', '37331817-f277-4f32-8d5a-11e1cf63f2b7', '5b59d527-232e-4ef1-bc83-4e8671607db1', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 705.828871] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 705.828871] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 705.829475] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.829799] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.829971] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.830646] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.830881] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.830940] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.831080] nova-scheduler[51488]: DEBUG nova.filters [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 705.831302] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 705.831493] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 705.831671] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Attempting to claim resources in the placement API for instance 29c85bbf-553e-4b82-ad7c-5341ffc5af63 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 705.891197] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] [instance: 29c85bbf-553e-4b82-ad7c-5341ffc5af63] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 705.891504] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 705.891711] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 705.891964] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-5982f57f-94e2-4ede-9a1d-e83cf71740be tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.612870] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Starting to schedule for instances: ['40115f76-28d8-4f39-9dca-59401f52f22f'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 706.613225] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 706.613359] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.613551] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.613844] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 706.614331] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 706.663177] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.663424] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.663595] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.670812] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.671078] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.671485] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.674368] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.674565] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.674926] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='7',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='1',num_proj_3a9c7dc4e938463781dbded4e5382286='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:24Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=9) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 706.675218] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 706.675387] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 706.675542] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '67b01666-6233-4af8-a0ec-a4e938b82606', '37331817-f277-4f32-8d5a-11e1cf63f2b7', '5b59d527-232e-4ef1-bc83-4e8671607db1', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9', '29c85bbf-553e-4b82-ad7c-5341ffc5af63'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 706.675702] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 706.675946] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 706.676159] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.676369] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.676593] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.676733] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.676891] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.677421] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.677686] nova-scheduler[51491]: DEBUG nova.filters [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 706.677861] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 706.678048] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 706.678228] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Attempting to claim resources in the placement API for instance 40115f76-28d8-4f39-9dca-59401f52f22f {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 706.733819] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] [instance: 40115f76-28d8-4f39-9dca-59401f52f22f] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 706.734169] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 706.734376] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 706.734583] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-351a22bd-9494-43d8-8f43-a244c82dba0a tempest-DeleteServersAdminTestJSON-14307472 tempest-DeleteServersAdminTestJSON-14307472-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.261334] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Starting to schedule for instances: ['6576c530-0b88-453e-bace-70a4f1c76d3c'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 709.261679] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 709.261922] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.262180] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.262420] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 709.262691] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 709.317427] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.317515] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.320034] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.327264] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.331327] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.331771] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.334628] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.334901] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.335184] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='7',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:26Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=9) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 709.335495] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 709.335856] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 709.336233] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '37331817-f277-4f32-8d5a-11e1cf63f2b7', '5b59d527-232e-4ef1-bc83-4e8671607db1', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9', '29c85bbf-553e-4b82-ad7c-5341ffc5af63', '40115f76-28d8-4f39-9dca-59401f52f22f'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 709.336514] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 709.337503] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 709.337503] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.337503] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.337633] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.337891] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.338599] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.338599] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.338599] nova-scheduler[51488]: DEBUG nova.filters [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 709.338739] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 709.338888] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 709.339113] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Attempting to claim resources in the placement API for instance 6576c530-0b88-453e-bace-70a4f1c76d3c {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 709.398356] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] [instance: 6576c530-0b88-453e-bace-70a4f1c76d3c] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 709.398652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 709.399408] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 709.399408] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-94b330c4-ecff-4ffd-bb83-bde2e7c2fd79 tempest-InstanceActionsNegativeTestJSON-638305230 tempest-InstanceActionsNegativeTestJSON-638305230-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.628415] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Starting to schedule for instances: ['0fc5de88-13a6-498a-848c-35beb772be65'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 711.628664] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 711.628763] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.632335] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.632335] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 711.632335] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 711.689301] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.689301] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.689301] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.696550] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.696766] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.696941] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.700177] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.700177] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.700177] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='8',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8349984ea81841b8880696d0a1326b35='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:28Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=9) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 711.700177] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 711.700435] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 711.700493] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9', '29c85bbf-553e-4b82-ad7c-5341ffc5af63', '40115f76-28d8-4f39-9dca-59401f52f22f', '6576c530-0b88-453e-bace-70a4f1c76d3c'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 711.700776] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702032] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702252] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.702389] nova-scheduler[51491]: DEBUG nova.filters [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 711.703388] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 711.703388] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 711.703388] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Attempting to claim resources in the placement API for instance 0fc5de88-13a6-498a-848c-35beb772be65 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 711.774680] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] [instance: 0fc5de88-13a6-498a-848c-35beb772be65] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 711.775155] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 711.775404] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 711.775619] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-c1d11cad-307c-40df-932b-ba04eaee1bd5 tempest-ServersNegativeTestJSON-1843437481 tempest-ServersNegativeTestJSON-1843437481-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.241206] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Starting to schedule for instances: ['c573864b-774a-4e4d-be80-5bc9bbd1659d'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 713.241559] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 713.241664] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.241846] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.244374] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 713.244496] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 713.285242] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.285565] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.285646] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.292640] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.293185] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.293185] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.295754] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.295958] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.296406] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='9',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_8349984ea81841b8880696d0a1326b35='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:30Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=9) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 713.296739] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 713.296865] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 713.297465] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9', '29c85bbf-553e-4b82-ad7c-5341ffc5af63', '40115f76-28d8-4f39-9dca-59401f52f22f', '6576c530-0b88-453e-bace-70a4f1c76d3c', '0fc5de88-13a6-498a-848c-35beb772be65'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 713.297679] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 713.297933] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 713.298174] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.298364] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.298663] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.298982] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.298982] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.299656] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.299656] nova-scheduler[51488]: DEBUG nova.filters [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 713.299656] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 713.299833] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 713.299958] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Attempting to claim resources in the placement API for instance c573864b-774a-4e4d-be80-5bc9bbd1659d {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 713.373316] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] [instance: c573864b-774a-4e4d-be80-5bc9bbd1659d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 713.373316] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 713.373316] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 713.373586] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-e3feb433-423a-40b9-872b-b16336325131 tempest-ServersTestManualDisk-1748827388 tempest-ServersTestManualDisk-1748827388-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.131090] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Starting to schedule for instances: ['72b94cae-d12d-4228-8ca0-20fde3095c38'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 716.133329] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 716.133329] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.133329] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.133329] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 716.133329] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 716.182962] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.183701] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.183847] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.191568] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.191839] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.192450] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.195621] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.196107] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.196634] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=191,free_ram_mb=194926,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=9,mapped=1,memory_mb=196590,memory_mb_used=1664,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=9,service_id=None,stats={failed_builds='10',io_workload='9',num_instances='9',num_os_type_None='9',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='1',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='1',num_proj_8349984ea81841b8880696d0a1326b35='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='1',num_task_None='6',num_task_spawning='3',num_vm_building='9'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:33Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=9) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 716.197133] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 716.197369] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 716.197652] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '5ad1fabc-bae4-47cb-9b27-42c86c4b02e8', 'db69e0d0-724b-4a87-80f5-390cfc395ee9', '40115f76-28d8-4f39-9dca-59401f52f22f', '6576c530-0b88-453e-bace-70a4f1c76d3c', '0fc5de88-13a6-498a-848c-35beb772be65', 'c573864b-774a-4e4d-be80-5bc9bbd1659d'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 716.197937] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 716.198993] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 716.198993] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.198993] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.199215] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.199604] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.199604] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.199924] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.200152] nova-scheduler[51491]: DEBUG nova.filters [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 716.200351] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 716.200556] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 716.200772] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Attempting to claim resources in the placement API for instance 72b94cae-d12d-4228-8ca0-20fde3095c38 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 716.247906] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] [instance: 72b94cae-d12d-4228-8ca0-20fde3095c38] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 194926MB disk: 195584MB io_ops: 9 instances: 9, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 716.248240] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 716.248457] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 716.248670] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1ce0733e-98f4-4e73-9f1a-6e131beaf4ff tempest-ServersNegativeTestMultiTenantJSON-1136815640 tempest-ServersNegativeTestMultiTenantJSON-1136815640-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.801627] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['4e0befc8-76e7-484d-957e-55b0aaedc2c6'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 723.803642] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 723.803642] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.803642] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.803642] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 723.803642] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 723.851964] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.851964] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.852357] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.860155] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.860381] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.860867] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.863335] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.865811] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.865811] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='14',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='1',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:40Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 723.865811] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 723.865811] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 723.865811] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '0fc5de88-13a6-498a-848c-35beb772be65', 'c573864b-774a-4e4d-be80-5bc9bbd1659d', '72b94cae-d12d-4228-8ca0-20fde3095c38'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 723.865811] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 723.865811] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866274] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866458] nova-scheduler[51488]: DEBUG nova.filters [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 723.866826] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 723.866826] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 723.866928] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Attempting to claim resources in the placement API for instance 4e0befc8-76e7-484d-957e-55b0aaedc2c6 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 723.933178] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] [instance: 4e0befc8-76e7-484d-957e-55b0aaedc2c6] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 723.933474] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 723.933683] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 723.933884] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f3fae9dc-6421-49a5-8a23-c9e688e54ee2 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.292519] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting to schedule for instances: ['8d391d2c-ea85-47d4-a140-03ea6da1c101'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 724.296222] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 724.296222] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.296222] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.296222] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 724.296222] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 724.348685] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.348925] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.349118] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.364579] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.364797] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.364963] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.371389] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.371620] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.372012] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='14',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='1',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:40Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 724.373021] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 724.373021] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 724.373021] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '0fc5de88-13a6-498a-848c-35beb772be65', 'c573864b-774a-4e4d-be80-5bc9bbd1659d', '72b94cae-d12d-4228-8ca0-20fde3095c38', '4e0befc8-76e7-484d-957e-55b0aaedc2c6'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 724.373021] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 724.373252] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 724.373288] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.373448] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.373641] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.373802] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.373955] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.374371] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.374559] nova-scheduler[51491]: DEBUG nova.filters [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 724.374713] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 724.374876] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 724.375060] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Attempting to claim resources in the placement API for instance 8d391d2c-ea85-47d4-a140-03ea6da1c101 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 724.447960] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] [instance: 8d391d2c-ea85-47d4-a140-03ea6da1c101] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 724.448427] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 724.448571] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 724.449052] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a7c0fadb-3571-4334-bb7d-e78c411a7862 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.857838] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Starting to schedule for instances: ['26aa196e-e745-494d-814f-7da3cf18ec14'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 725.858926] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 725.858926] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.858926] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.859095] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 725.859348] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 725.904975] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.905846] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.906172] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.914575] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.915043] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.915877] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.917883] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.918199] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.919058] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='16',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='1',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='1',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_b868df8009cd4d07b50856808eceb007='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='5',num_task_spawning='2',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:43Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 725.919058] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 725.919217] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 725.919358] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '0fc5de88-13a6-498a-848c-35beb772be65', 'c573864b-774a-4e4d-be80-5bc9bbd1659d', '72b94cae-d12d-4228-8ca0-20fde3095c38', '4e0befc8-76e7-484d-957e-55b0aaedc2c6', '8d391d2c-ea85-47d4-a140-03ea6da1c101'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 725.919526] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 725.919783] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 725.919986] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.920184] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.920392] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.920553] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.920710] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.920871] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.921039] nova-scheduler[51488]: DEBUG nova.filters [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 725.921193] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 725.921358] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 725.921532] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Attempting to claim resources in the placement API for instance 26aa196e-e745-494d-814f-7da3cf18ec14 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 725.982668] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] [instance: 26aa196e-e745-494d-814f-7da3cf18ec14] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 725.982986] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 725.983192] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 725.983390] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3fa7d77c-06a7-4676-968d-f39c83e8a7bb tempest-ServerShowV257Test-1815500896 tempest-ServerShowV257Test-1815500896-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Starting to schedule for instances: ['949f98a2-9316-4cbd-b1e3-b05d08a68997'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 726.952035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 727.015132] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.015409] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.015584] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.027630] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.027630] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.027630] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.032142] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.032142] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.032326] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='16',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='1',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_b868df8009cd4d07b50856808eceb007='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='5',num_task_spawning='2',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:45Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 727.032776] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 727.032776] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 727.032907] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', 'c573864b-774a-4e4d-be80-5bc9bbd1659d', '72b94cae-d12d-4228-8ca0-20fde3095c38', '4e0befc8-76e7-484d-957e-55b0aaedc2c6', '8d391d2c-ea85-47d4-a140-03ea6da1c101', '26aa196e-e745-494d-814f-7da3cf18ec14'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 727.033602] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 727.033602] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 727.033602] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.033755] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.033889] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.filters [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 727.035044] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Attempting to claim resources in the placement API for instance 949f98a2-9316-4cbd-b1e3-b05d08a68997 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 727.110907] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] [instance: 949f98a2-9316-4cbd-b1e3-b05d08a68997] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 727.111241] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 727.111449] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 727.111936] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-7ca2c827-b9a2-49cc-a651-983ad4ad11f6 tempest-ServerRescueTestJSON-1441311787 tempest-ServerRescueTestJSON-1441311787-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.804434] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting to schedule for instances: ['197488cc-ac6b-4561-8d57-f372c6493573'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 728.804643] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 728.804782] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.804961] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.805476] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 728.806460] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 728.860514] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.860781] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.861106] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.868344] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.868545] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.868711] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.870828] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.871050] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.871426] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='16',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_b868df8009cd4d07b50856808eceb007='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='5',num_task_spawning='2',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:46Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 728.871706] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 728.871876] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 728.872046] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '72b94cae-d12d-4228-8ca0-20fde3095c38', '4e0befc8-76e7-484d-957e-55b0aaedc2c6', '8d391d2c-ea85-47d4-a140-03ea6da1c101', '26aa196e-e745-494d-814f-7da3cf18ec14', '949f98a2-9316-4cbd-b1e3-b05d08a68997'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 728.872213] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 728.872460] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 728.872690] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.872887] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873108] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873281] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873443] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873607] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873766] nova-scheduler[51488]: DEBUG nova.filters [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 728.873923] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 728.874105] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 728.874282] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Attempting to claim resources in the placement API for instance 197488cc-ac6b-4561-8d57-f372c6493573 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 728.927774] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] [instance: 197488cc-ac6b-4561-8d57-f372c6493573] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 728.930089] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 728.930369] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 728.930604] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b35cc747-764c-4412-8f6e-d8b750bccc22 tempest-AttachInterfacesTestJSON-287887941 tempest-AttachInterfacesTestJSON-287887941-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 738.961632] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Starting to schedule for instances: ['ac74db4e-ee8d-4aab-96bc-b41bc30d371b'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 738.961923] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 738.963991] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.963991] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.963991] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 738.964870] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 739.016127] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.016573] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.016909] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.024665] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.025040] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.025472] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.031017] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.031017] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.031017] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='21',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='2',num_task_spawning='2',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:56Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 739.031017] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 739.031017] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 739.031017] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '26aa196e-e745-494d-814f-7da3cf18ec14', '949f98a2-9316-4cbd-b1e3-b05d08a68997'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 739.031395] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.filters [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 739.031395] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 739.032009] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Attempting to claim resources in the placement API for instance ac74db4e-ee8d-4aab-96bc-b41bc30d371b {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 739.100693] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] [instance: ac74db4e-ee8d-4aab-96bc-b41bc30d371b] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 739.100693] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 739.100693] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 739.100693] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0eeb4a79-86a1-491d-8c66-e215cb3f9c23 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.863329] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Starting to schedule for instances: ['963513ec-2280-475b-87a0-045df892e8b4'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 740.863329] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 740.863548] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.863578] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.863779] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 740.864072] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 740.919783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.919783] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.920288] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.928707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.928968] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.929194] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.931835] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.931962] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.932390] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=196,free_ram_mb=195566,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=4,mapped=1,memory_mb=196590,memory_mb_used=1024,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=4,service_id=None,stats={failed_builds='22',io_workload='4',num_instances='4',num_os_type_None='4',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_51cca17e80d947b495de9f644e67bb98='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='2',num_task_spawning='2',num_vm_building='4'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:59Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=4) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 740.932752] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 740.932974] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 740.933888] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '26aa196e-e745-494d-814f-7da3cf18ec14', 'ac74db4e-ee8d-4aab-96bc-b41bc30d371b'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 740.933888] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 740.933888] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 740.934609] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.934609] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.934798] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.935032] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.935219] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.935437] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.935651] nova-scheduler[51488]: DEBUG nova.filters [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 740.935831] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 740.936056] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 740.936264] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Attempting to claim resources in the placement API for instance 963513ec-2280-475b-87a0-045df892e8b4 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 740.989971] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] [instance: 963513ec-2280-475b-87a0-045df892e8b4] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195566MB disk: 200704MB io_ops: 4 instances: 4, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 740.990112] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 740.990233] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 740.990443] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-1bee8ed7-c957-4e88-9a2a-796e47b7abe1 tempest-ServerPasswordTestJSON-1808313117 tempest-ServerPasswordTestJSON-1808313117-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.113636] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting to schedule for instances: ['f12524a7-21b9-4e35-b15b-955627d58c7a'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 743.114238] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 743.114582] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.114989] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.115088] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.115552] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 743.115942] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['bb9c495d-4f2f-4d2a-9af9-4d0ae62fe88d'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 743.117635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 743.117635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.117635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.117635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 743.117635] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 743.158572] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.158572] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.158572] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.162388] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.162388] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.162388] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.167255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.167589] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.167828] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.171202] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.171202] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.171202] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.171319] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.171319] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.171670] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='22',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_51cca17e80d947b495de9f644e67bb98='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:59Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 743.172247] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '26aa196e-e745-494d-814f-7da3cf18ec14', 'ac74db4e-ee8d-4aab-96bc-b41bc30d371b', '963513ec-2280-475b-87a0-045df892e8b4'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 743.174183] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174183] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174611] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174611] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.174669] nova-scheduler[51488]: DEBUG nova.filters [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.175124] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 743.175356] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 743.175751] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Attempting to claim resources in the placement API for instance f12524a7-21b9-4e35-b15b-955627d58c7a {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 743.178327] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.178327] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.178327] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='22',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_51cca17e80d947b495de9f644e67bb98='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_b868df8009cd4d07b50856808eceb007='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='3',num_task_spawning='2',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:46:59Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 743.178327] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 743.178327] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 743.178327] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865', '26aa196e-e745-494d-814f-7da3cf18ec14', 'ac74db4e-ee8d-4aab-96bc-b41bc30d371b', '963513ec-2280-475b-87a0-045df892e8b4'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 743.178710] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.178710] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 743.178813] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.178997] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.179210] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.179375] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.179534] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.179699] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.179857] nova-scheduler[51491]: DEBUG nova.filters [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 743.180022] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 743.180542] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 743.180778] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Attempting to claim resources in the placement API for instance bb9c495d-4f2f-4d2a-9af9-4d0ae62fe88d {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 743.228707] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] [instance: f12524a7-21b9-4e35-b15b-955627d58c7a] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 743.228707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.228707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.228707] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f5dc14c3-7cfa-42da-b2ca-ce318c544e89 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 743.246000] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] [instance: bb9c495d-4f2f-4d2a-9af9-4d0ae62fe88d] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 743.246000] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 743.246000] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 743.246000] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-330226e4-1da1-4ca3-b279-713522d5f42c tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.371879] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.372145] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.372284] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 746.372949] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.delete_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 746.373185] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 746.373381] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-2ce8ad72-7513-4a44-b900-0fb4886cac5b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.delete_instance_info" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.512106] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['507d89fc-2083-4575-9a9c-f7f350741ef3'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 749.512422] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 749.512581] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.512994] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.512994] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 749.513544] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 749.556275] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.556704] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.556704] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.563112] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.563324] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.563680] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='23',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_0ca4a4d35bf24c4888af9ba6b2f4717b='0',num_proj_257f2e74ff3341ffbc4982cb07c324fa='0',num_proj_3794741ad1ea4973b8fbab68114f28c3='0',num_proj_38f2b7c76cb04e49b1b8ac75980011b2='0',num_proj_3a9c7dc4e938463781dbded4e5382286='0',num_proj_51cca17e80d947b495de9f644e67bb98='1',num_proj_6448dab5c83b44e48c3ea2bd37691788='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='1',num_proj_6f4d626262ba4bdf905536d0a5919b61='0',num_proj_8349984ea81841b8880696d0a1326b35='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_8ff7f4f6340440dfbe17b4c3b7a33c1d='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_b868df8009cd4d07b50856808eceb007='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_proj_db69c56463ff4c458b8adf0fe0ba520a='0',num_task_None='4',num_task_spawning='2',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:02Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 749.563945] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 749.564133] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 749.564287] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 749.564453] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 749.564798] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 749.564945] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565137] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565418] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565525] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565653] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565810] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.565962] nova-scheduler[51491]: DEBUG nova.filters [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 749.566262] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 749.566343] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 749.566461] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Attempting to claim resources in the placement API for instance 507d89fc-2083-4575-9a9c-f7f350741ef3 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 749.613858] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] [instance: 507d89fc-2083-4575-9a9c-f7f350741ef3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 749.614166] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 749.614366] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 749.614567] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-81a5ffc2-9b5f-44bf-bbc6-66d5436cbb1b tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.207823] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Starting to schedule for instances: ['f3b9789c-ecc6-4b1a-96ec-2c71dba363f7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 751.208133] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 751.208133] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.208974] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.208974] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 751.208974] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 751.257478] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.257851] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.258151] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.267064] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.267064] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.267064] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='24',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_spawning='6',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:09Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 751.267259] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 751.267362] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 751.267523] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 751.267702] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 751.267977] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 751.268203] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.268387] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.268584] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.268751] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.268936] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.269176] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.269418] nova-scheduler[51488]: DEBUG nova.filters [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 751.269585] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 751.269756] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 751.269950] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Attempting to claim resources in the placement API for instance f3b9789c-ecc6-4b1a-96ec-2c71dba363f7 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 751.332209] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] [instance: f3b9789c-ecc6-4b1a-96ec-2c71dba363f7] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 751.332573] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 751.333055] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 751.333416] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ecd91ce7-7a4e-4855-aa37-b44768b4b5e5 tempest-ServersAdminNegativeTestJSON-505936840 tempest-ServersAdminNegativeTestJSON-505936840-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.393333] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Starting to schedule for instances: ['3835af93-7a47-4d3c-9296-256aadddc3b3'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 752.393646] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 752.393838] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 752.398239] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 752.398715] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 752.398787] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 752.455233] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.455454] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.455628] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.462684] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.462901] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.463270] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=6,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='24',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='1',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_None='1',num_task_spawning='6',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:10Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 752.463545] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 752.467118] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.467118] nova-scheduler[51491]: DEBUG nova.filters [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 752.468656] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 752.468656] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 752.468656] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Attempting to claim resources in the placement API for instance 3835af93-7a47-4d3c-9296-256aadddc3b3 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 752.536388] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] [instance: 3835af93-7a47-4d3c-9296-256aadddc3b3] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 752.536716] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 752.536928] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 752.537154] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-0ad111bf-e577-4fe7-b842-b72f4e356f96 tempest-TenantUsagesTestJSON-1384199689 tempest-TenantUsagesTestJSON-1384199689-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.063015] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Starting to schedule for instances: ['67b672b6-c6cb-4dc2-9d75-fb028195a0dd'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 753.063330] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 753.063492] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.063667] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.063859] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 753.064064] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 753.112754] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.113039] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.113213] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.133889] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.134159] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.134535] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=5,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='25',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='1',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_None='2',num_task_spawning='5',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:11Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 753.134820] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 753.138020] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 753.138020] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 753.138020] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 753.138020] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 753.138020] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.138020] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.139787] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.140054] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.140231] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.140397] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.140583] nova-scheduler[51488]: DEBUG nova.filters [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 753.140734] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 753.140877] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 753.141059] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Attempting to claim resources in the placement API for instance 67b672b6-c6cb-4dc2-9d75-fb028195a0dd {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 753.198274] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] [instance: 67b672b6-c6cb-4dc2-9d75-fb028195a0dd] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 753.198567] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 753.198775] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 753.198999] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f2feffbd-4cf4-49c3-bb61-a8840deeb00f tempest-ServerActionsTestJSON-260710802 tempest-ServerActionsTestJSON-260710802-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.278254] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting to schedule for instances: ['acfe2649-fd7c-41e0-9cb1-8e139fb9e6bd'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 759.278540] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 759.278694] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.278861] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.279129] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 759.279323] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 759.332139] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 759.332367] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 759.332530] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.341738] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 759.341738] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 759.341876] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='26',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='1',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_None='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:14Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 759.342173] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 759.342330] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 759.342479] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 759.342635] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 759.346371] nova-scheduler[51491]: DEBUG nova.filters [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 759.346600] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 63.623963 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 759.346814] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 759.346983] nova-scheduler[51491]: INFO nova.filters [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filter ComputeFilter returned 0 hosts [ 759.347141] nova-scheduler[51491]: DEBUG nova.filters [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtering removed all hosts for the request with instance ID 'acfe2649-fd7c-41e0-9cb1-8e139fb9e6bd'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 759.347275] nova-scheduler[51491]: INFO nova.filters [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtering removed all hosts for the request with instance ID 'acfe2649-fd7c-41e0-9cb1-8e139fb9e6bd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 759.347415] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 759.347555] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-ad25ccfb-c153-48de-9a11-cfc40c830b56 tempest-ServerDiskConfigTestJSON-927379070 tempest-ServerDiskConfigTestJSON-927379070-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 760.405777] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['e668518b-9b9e-4fb4-8db2-3e0197b78fb0'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.409110] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.409110] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.409110] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.409110] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.409110] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 760.460451] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.460819] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.462239] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.471224] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.471530] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.472054] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=193,free_ram_mb=195182,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=7,mapped=1,memory_mb=196590,memory_mb_used=1408,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=7,service_id=None,stats={failed_builds='26',io_workload='7',num_instances='7',num_os_type_None='7',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='1',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_None='3',num_task_spawning='4',num_vm_building='7'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:14Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=7) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 760.472482] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 760.472853] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 760.475511] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 760.476883] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.477331] nova-scheduler[51488]: DEBUG nova.filters [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 760.477660] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 64.754951 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 760.477902] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195182MB disk: 197632MB io_ops: 7 instances: 7, allocation_candidates: 1 has not been heard from in a while [ 760.478142] nova-scheduler[51488]: INFO nova.filters [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 760.478369] nova-scheduler[51488]: DEBUG nova.filters [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'e668518b-9b9e-4fb4-8db2-3e0197b78fb0'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 760.478606] nova-scheduler[51488]: INFO nova.filters [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'e668518b-9b9e-4fb4-8db2-3e0197b78fb0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 760.478844] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 760.479126] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-7bca7402-5bc7-4f86-b128-23509c34a6c3 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 760.754935] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Starting to schedule for instances: ['ce96198a-57c1-4423-8105-d5cdcd2de4cd'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 760.755219] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 760.755343] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.755513] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.755706] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 760.756166] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 760.808581] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.808581] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.808581] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.815800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 760.815800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 760.815989] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=4,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=194,free_ram_mb=195310,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=6,mapped=1,memory_mb=196590,memory_mb_used=1280,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=6,service_id=None,stats={failed_builds='27',io_workload='6',num_instances='6',num_os_type_None='6',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='1',num_task_None='2',num_task_spawning='4',num_vm_building='6'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:18Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=6) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 760.816297] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 760.816446] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 760.816654] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 760.816779] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 760.817049] nova-scheduler[51491]: DEBUG nova.filters [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 760.817264] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 65.094649 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 760.817437] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195310MB disk: 198656MB io_ops: 6 instances: 6, allocation_candidates: 1 has not been heard from in a while [ 760.817598] nova-scheduler[51491]: INFO nova.filters [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Filter ComputeFilter returned 0 hosts [ 760.817745] nova-scheduler[51491]: DEBUG nova.filters [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Filtering removed all hosts for the request with instance ID 'ce96198a-57c1-4423-8105-d5cdcd2de4cd'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 760.817878] nova-scheduler[51491]: INFO nova.filters [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Filtering removed all hosts for the request with instance ID 'ce96198a-57c1-4423-8105-d5cdcd2de4cd'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 760.821121] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 760.821275] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3877f559-7f41-4558-be4c-2a32fc6ba8ed tempest-ServersTestBootFromVolume-1821255316 tempest-ServersTestBootFromVolume-1821255316-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 761.775541] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Starting to schedule for instances: ['d667e8c7-300e-44bf-93e1-e8adc8d562a4'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 761.775812] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 761.775996] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.779645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.779645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 761.779645] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 761.845566] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.845809] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.845978] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.856082] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 761.856615] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 761.858173] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=195,free_ram_mb=195438,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=5,mapped=1,memory_mb=196590,memory_mb_used=1152,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=5,service_id=None,stats={failed_builds='27',io_workload='5',num_instances='5',num_os_type_None='5',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='1',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='1',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='2',num_task_spawning='3',num_vm_building='5'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:19Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=5) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 761.858173] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 761.858173] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 761.859196] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 761.861837] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 761.861837] nova-scheduler[51488]: DEBUG nova.filters [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 761.861837] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 66.137248 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 761.861837] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195438MB disk: 199680MB io_ops: 5 instances: 5, allocation_candidates: 1 has not been heard from in a while [ 761.861837] nova-scheduler[51488]: INFO nova.filters [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filter ComputeFilter returned 0 hosts [ 761.861837] nova-scheduler[51488]: DEBUG nova.filters [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filtering removed all hosts for the request with instance ID 'd667e8c7-300e-44bf-93e1-e8adc8d562a4'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 761.861837] nova-scheduler[51488]: INFO nova.filters [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filtering removed all hosts for the request with instance ID 'd667e8c7-300e-44bf-93e1-e8adc8d562a4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 761.861837] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 761.861837] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-c9f92269-dfe5-4076-ab5a-358a15c1fa39 tempest-AttachVolumeShelveTestJSON-1182673235 tempest-AttachVolumeShelveTestJSON-1182673235-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 763.886072] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting to schedule for instances: ['b475ab55-63b9-452d-ad4f-7bf7797ee83e'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 763.886565] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 763.886565] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.886740] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.888137] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 763.888137] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 763.942869] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.942869] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.943773] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.954860] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 763.954860] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 763.954860] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='29',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:20Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 763.954860] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 763.954860] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 763.954860] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 763.954860] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 763.954860] nova-scheduler[51491]: DEBUG nova.filters [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 763.955540] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 68.231167 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 763.955540] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 763.955540] nova-scheduler[51491]: INFO nova.filters [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filter ComputeFilter returned 0 hosts [ 763.955540] nova-scheduler[51491]: DEBUG nova.filters [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID 'b475ab55-63b9-452d-ad4f-7bf7797ee83e'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 763.955540] nova-scheduler[51491]: INFO nova.filters [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID 'b475ab55-63b9-452d-ad4f-7bf7797ee83e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 763.955674] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 763.955831] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-02f4123d-7094-4a25-9772-d45c42fdfd76 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 764.018763] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['4e35329d-fd40-4a21-85c9-048ccdc69a9d'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 764.020644] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 764.020644] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.020644] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.020644] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 764.020644] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 764.062165] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.062445] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.062619] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.070827] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 764.071095] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 764.072140] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='29',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:20Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 764.072140] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 764.072140] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 764.072757] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 764.072757] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 764.072757] nova-scheduler[51488]: DEBUG nova.filters [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 764.073659] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 68.350156 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 764.073659] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 764.073659] nova-scheduler[51488]: INFO nova.filters [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 0 hosts [ 764.073659] nova-scheduler[51488]: DEBUG nova.filters [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID '4e35329d-fd40-4a21-85c9-048ccdc69a9d'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 764.073659] nova-scheduler[51488]: INFO nova.filters [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID '4e35329d-fd40-4a21-85c9-048ccdc69a9d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 764.073659] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 764.073659] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-abb72766-e422-4ed1-b8d6-ce7b902b4754 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 765.256887] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Starting to schedule for instances: ['9da4f04d-730f-4974-8b5f-f0a2d8d35a65'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 765.257919] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 765.258037] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.258202] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.259534] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 765.259713] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 765.331154] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.331478] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.332015] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.347959] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 765.347959] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 765.347959] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=3,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=197,free_ram_mb=195694,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=3,mapped=1,memory_mb=196590,memory_mb_used=896,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=3,service_id=None,stats={failed_builds='29',io_workload='3',num_instances='3',num_os_type_None='3',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='1',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='3',num_vm_building='3'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:20Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=3) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 765.347959] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 765.347959] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 765.347959] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 765.347959] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 765.348424] nova-scheduler[51491]: DEBUG nova.filters [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 765.348424] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 69.625509 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 765.348424] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195694MB disk: 201728MB io_ops: 3 instances: 3, allocation_candidates: 1 has not been heard from in a while [ 765.348515] nova-scheduler[51491]: INFO nova.filters [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Filter ComputeFilter returned 0 hosts [ 765.349024] nova-scheduler[51491]: DEBUG nova.filters [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Filtering removed all hosts for the request with instance ID '9da4f04d-730f-4974-8b5f-f0a2d8d35a65'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 765.349024] nova-scheduler[51491]: INFO nova.filters [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Filtering removed all hosts for the request with instance ID '9da4f04d-730f-4974-8b5f-f0a2d8d35a65'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 765.349024] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 765.349024] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-9e130f23-87ec-4be6-9063-0dbc4ece5d02 tempest-ServerTagsTestJSON-1545938283 tempest-ServerTagsTestJSON-1545938283-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 766.495088] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['c102ba14-4e5d-409a-8c15-003a30290638'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 766.495316] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 766.495438] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.495739] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.495985] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 766.497513] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 766.540674] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.540911] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.541103] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.550185] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 766.550382] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 766.550607] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 766.550884] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 766.551054] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 766.551352] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 766.551352] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 766.551611] nova-scheduler[51488]: DEBUG nova.filters [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 766.551836] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 70.829205 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 766.551963] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 766.555228] nova-scheduler[51488]: INFO nova.filters [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 766.555407] nova-scheduler[51488]: DEBUG nova.filters [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'c102ba14-4e5d-409a-8c15-003a30290638'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 766.555590] nova-scheduler[51488]: INFO nova.filters [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'c102ba14-4e5d-409a-8c15-003a30290638'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 766.555699] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 766.555844] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b1bf82b5-ad3b-4787-ab76-0773949b23ee tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.142985] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting to schedule for instances: ['474d025d-7a80-458d-ae4b-8ae16d6a9fff'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.142985] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.142985] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.145381] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.145381] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.145520] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.198186] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.198418] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.198582] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.206053] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.208684] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.208684] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.filters [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.208684] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 71.485199 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.209280] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 767.209280] nova-scheduler[51491]: INFO nova.filters [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filter ComputeFilter returned 0 hosts [ 767.209280] nova-scheduler[51491]: DEBUG nova.filters [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID '474d025d-7a80-458d-ae4b-8ae16d6a9fff'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.209280] nova-scheduler[51491]: INFO nova.filters [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID '474d025d-7a80-458d-ae4b-8ae16d6a9fff'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.209280] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.209280] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-1023dba8-6047-4e73-9d20-986e106b8264 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 767.846218] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['ce9ebfd1-ebbb-4d68-af21-c2d8d39893e0'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 767.846515] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 767.846673] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.846877] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.847189] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 767.847452] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 767.897546] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.897801] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.897967] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.904352] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 767.904570] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 767.904924] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 767.905326] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 767.905495] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 767.905648] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 767.905810] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 767.906065] nova-scheduler[51488]: DEBUG nova.filters [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 767.906272] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 72.183658 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 767.906424] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 767.906571] nova-scheduler[51488]: INFO nova.filters [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 0 hosts [ 767.906745] nova-scheduler[51488]: DEBUG nova.filters [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID 'ce9ebfd1-ebbb-4d68-af21-c2d8d39893e0'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 767.906881] nova-scheduler[51488]: INFO nova.filters [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID 'ce9ebfd1-ebbb-4d68-af21-c2d8d39893e0'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 767.907044] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 767.907202] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6161f1a7-542c-4e3d-96bf-91e2389fcf00 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 768.842051] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['92161e7e-0d3e-4041-9194-0d2abe17fe22'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 768.842371] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 768.842526] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.842908] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.842908] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 768.843125] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 768.892140] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.892380] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.892548] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.899573] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 768.899701] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 768.900079] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 768.900349] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 768.900513] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 768.902137] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 768.902137] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 768.902137] nova-scheduler[51491]: DEBUG nova.filters [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 768.902137] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 73.178666 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 768.902137] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 768.902137] nova-scheduler[51491]: INFO nova.filters [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 768.902137] nova-scheduler[51491]: DEBUG nova.filters [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '92161e7e-0d3e-4041-9194-0d2abe17fe22'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 768.902137] nova-scheduler[51491]: INFO nova.filters [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '92161e7e-0d3e-4041-9194-0d2abe17fe22'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 768.902137] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 768.902569] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-28c1d084-4924-4b54-8c63-35fc1a715240 tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.343102] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting to schedule for instances: ['818cd3e9-8ba6-46e1-8450-3513e444f7d7'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.343551] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.343722] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.343900] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.344118] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.344289] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.399132] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.399662] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.399846] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.413113] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.413402] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.415081] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.415378] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.415544] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.415696] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.415854] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.416854] nova-scheduler[51488]: DEBUG nova.filters [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.417135] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 74.694479 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.417568] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 770.417802] nova-scheduler[51488]: INFO nova.filters [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filter ComputeFilter returned 0 hosts [ 770.417981] nova-scheduler[51488]: DEBUG nova.filters [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID '818cd3e9-8ba6-46e1-8450-3513e444f7d7'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.418132] nova-scheduler[51488]: INFO nova.filters [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID '818cd3e9-8ba6-46e1-8450-3513e444f7d7'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.418278] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.418419] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-bdff6f9b-c4d0-4dbc-8a2e-78fe3e75ab53 tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting to schedule for instances: ['f4bdf956-060f-48ba-a4e7-95120d879dd9'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 770.909436] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 770.958777] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.959015] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.959183] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.966635] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 770.966823] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 770.967831] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 770.967831] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 770.967831] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 770.967831] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 770.968121] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 770.968214] nova-scheduler[51491]: DEBUG nova.filters [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 770.968450] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 75.2458 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 770.968552] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 770.968692] nova-scheduler[51491]: INFO nova.filters [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filter ComputeFilter returned 0 hosts [ 770.968828] nova-scheduler[51491]: DEBUG nova.filters [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID 'f4bdf956-060f-48ba-a4e7-95120d879dd9'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 770.968954] nova-scheduler[51491]: INFO nova.filters [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtering removed all hosts for the request with instance ID 'f4bdf956-060f-48ba-a4e7-95120d879dd9'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 770.969534] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 770.969723] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5fea3243-a26e-4a8b-97d8-8137313a5644 tempest-DeleteServersTestJSON-1609465879 tempest-DeleteServersTestJSON-1609465879-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 772.329715] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['94365c52-b51b-47c0-a45d-e9239537b462'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 772.330086] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 772.330310] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.330523] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.330743] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 772.331322] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 772.389814] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.390087] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.390259] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.398327] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 772.398327] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 772.398725] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 772.399962] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 772.399962] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 772.399962] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 772.399962] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 772.399962] nova-scheduler[51488]: DEBUG nova.filters [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 772.400220] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 76.677377 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 772.400220] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 772.400283] nova-scheduler[51488]: INFO nova.filters [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 772.400427] nova-scheduler[51488]: DEBUG nova.filters [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '94365c52-b51b-47c0-a45d-e9239537b462'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 772.400556] nova-scheduler[51488]: INFO nova.filters [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '94365c52-b51b-47c0-a45d-e9239537b462'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 772.401239] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 772.401239] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-80f3d131-4a42-4a14-9c8b-86e47a72396f tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 773.060613] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting to schedule for instances: ['c17b4bf5-b954-410e-b2e6-0d348b0e3953'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 773.060613] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 773.060613] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.060613] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.061432] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 773.061432] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 773.114835] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.115193] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.115370] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 773.123861] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 773.124083] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 773.124438] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 773.124704] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 773.125268] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 773.125721] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 773.125928] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 773.126290] nova-scheduler[51491]: DEBUG nova.filters [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 773.126494] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 77.403884 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 773.126642] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 773.126800] nova-scheduler[51491]: INFO nova.filters [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filter ComputeFilter returned 0 hosts [ 773.126956] nova-scheduler[51491]: DEBUG nova.filters [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID 'c17b4bf5-b954-410e-b2e6-0d348b0e3953'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 773.127102] nova-scheduler[51491]: INFO nova.filters [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtering removed all hosts for the request with instance ID 'c17b4bf5-b954-410e-b2e6-0d348b0e3953'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 773.127239] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 773.127375] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-bbd195fa-4b75-45ae-8488-5a968d26f87a tempest-ImagesTestJSON-939914451 tempest-ImagesTestJSON-939914451-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 774.610709] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['a1a7b595-20fd-43d8-bff2-286cecd1a83e'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 774.610709] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 774.612865] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.612913] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.613673] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 774.613673] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 774.670652] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.671186] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.671186] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.679255] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 774.679464] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 774.681023] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.filters [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 774.681023] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 78.958363 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 774.681421] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 774.681421] nova-scheduler[51488]: INFO nova.filters [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 774.681421] nova-scheduler[51488]: DEBUG nova.filters [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'a1a7b595-20fd-43d8-bff2-286cecd1a83e'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 774.681556] nova-scheduler[51488]: INFO nova.filters [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'a1a7b595-20fd-43d8-bff2-286cecd1a83e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 774.681645] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 774.681787] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-6aa78579-554e-4c0e-97a5-7017c80c244c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 775.438024] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Starting to schedule for instances: ['59c2fc7d-69ef-470a-890b-f3b6a34be63e', '6f18732c-44b2-46af-ad1e-b6c88c8c964e'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 775.438317] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 775.438505] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.438638] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.438988] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 775.438988] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 775.484347] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.486696] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.486696] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.496816] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 775.497059] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 775.497412] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 775.497678] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 775.497882] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 775.498132] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 775.498303] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 775.498629] nova-scheduler[51491]: DEBUG nova.filters [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 775.500565] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 79.776147 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 775.500565] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 775.500565] nova-scheduler[51491]: INFO nova.filters [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filter ComputeFilter returned 0 hosts [ 775.500565] nova-scheduler[51491]: DEBUG nova.filters [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtering removed all hosts for the request with instance ID '59c2fc7d-69ef-470a-890b-f3b6a34be63e'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 775.500565] nova-scheduler[51491]: INFO nova.filters [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtering removed all hosts for the request with instance ID '59c2fc7d-69ef-470a-890b-f3b6a34be63e'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 775.500565] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 775.500565] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-dcb95ac3-8864-4982-9473-5af261f5f61a tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Starting to schedule for instances: ['6c957aea-91da-4b60-9903-17427c14ab47'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.252236] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 776.304243] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.304945] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.305219] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.312982] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.313256] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.313668] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 776.314014] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 776.314244] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 776.314493] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 776.314704] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.315017] nova-scheduler[51488]: DEBUG nova.filters [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 776.315295] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 80.592656 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 776.315514] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 776.315696] nova-scheduler[51488]: INFO nova.filters [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Filter ComputeFilter returned 0 hosts [ 776.315892] nova-scheduler[51488]: DEBUG nova.filters [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Filtering removed all hosts for the request with instance ID '6c957aea-91da-4b60-9903-17427c14ab47'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 776.316111] nova-scheduler[51488]: INFO nova.filters [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Filtering removed all hosts for the request with instance ID '6c957aea-91da-4b60-9903-17427c14ab47'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 776.316588] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 776.316804] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-ae75a83b-a5f6-47db-874a-5ee589dcf3d7 tempest-ServerAddressesTestJSON-1433732937 tempest-ServerAddressesTestJSON-1433732937-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 776.583215] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['6277a04d-f0df-4d1a-bf41-a181ce69aa84'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 776.585600] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 776.585600] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.585600] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.585600] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 776.586617] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 776.650207] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.651157] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.651157] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.660019] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 776.660019] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 776.660019] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 776.660019] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 776.660019] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 776.660019] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 776.660019] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 776.660426] nova-scheduler[51491]: DEBUG nova.filters [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 776.660426] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 80.937711 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 776.660518] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 776.660643] nova-scheduler[51491]: INFO nova.filters [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 776.660740] nova-scheduler[51491]: DEBUG nova.filters [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '6277a04d-f0df-4d1a-bf41-a181ce69aa84'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 776.660871] nova-scheduler[51491]: INFO nova.filters [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID '6277a04d-f0df-4d1a-bf41-a181ce69aa84'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 776.661017] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 776.661332] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-a0e98da1-83d5-4d1c-b47d-63d0611b765c tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 778.091777] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Starting to schedule for instances: ['8a28beac-40e2-4384-a3fb-7a01a1d54af4', 'b290344b-0ad7-47d3-9aa0-a6467ae85397'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 778.093487] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 778.093487] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.093487] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.093487] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.093487] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 778.146894] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.147212] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.147384] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.158149] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.159528] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.159975] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 778.160216] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 778.160379] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 778.160524] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 778.160686] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.160962] nova-scheduler[51488]: DEBUG nova.filters [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 778.162441] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 82.439731 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 778.162617] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 778.162803] nova-scheduler[51488]: INFO nova.filters [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filter ComputeFilter returned 0 hosts [ 778.163166] nova-scheduler[51488]: DEBUG nova.filters [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtering removed all hosts for the request with instance ID '8a28beac-40e2-4384-a3fb-7a01a1d54af4'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 778.163166] nova-scheduler[51488]: INFO nova.filters [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtering removed all hosts for the request with instance ID '8a28beac-40e2-4384-a3fb-7a01a1d54af4'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 778.163313] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 778.163442] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9a3ab43e-0af9-40de-8c7e-a6330e91050b tempest-MultipleCreateTestJSON-285117607 tempest-MultipleCreateTestJSON-285117607-project-member] There are 0 hosts available but 2 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 778.696768] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting to schedule for instances: ['abe85928-f968-4b2b-9f28-fb7b8344d0a5'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 778.697115] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 778.697250] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.697428] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.697618] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.697791] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 778.742146] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting to schedule for instances: ['c0697d6a-a483-4c9f-a7c5-410a1bfe58c8'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 778.742447] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 778.742600] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.742799] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.742962] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 778.743182] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 778.750261] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.751924] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.751924] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.763039] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.763039] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.763358] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 778.763823] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 778.764143] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 778.767325] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 778.767325] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.767325] nova-scheduler[51491]: DEBUG nova.filters [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 778.767325] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 83.042757 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 778.767325] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 778.767325] nova-scheduler[51491]: INFO nova.filters [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filter ComputeFilter returned 0 hosts [ 778.767325] nova-scheduler[51491]: DEBUG nova.filters [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'abe85928-f968-4b2b-9f28-fb7b8344d0a5'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 778.767325] nova-scheduler[51491]: INFO nova.filters [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtering removed all hosts for the request with instance ID 'abe85928-f968-4b2b-9f28-fb7b8344d0a5'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 778.767325] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 778.767325] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-8fcb91b7-ee58-4909-9bb8-7cfee0000c4a tempest-ServersTestJSON-855635163 tempest-ServersTestJSON-855635163-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 778.792979] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.792979] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.792979] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.799329] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 778.799567] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 778.800540] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 778.800804] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 778.800908] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 778.801084] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 778.801250] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 778.801507] nova-scheduler[51488]: DEBUG nova.filters [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 778.803038] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 83.079103 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 778.803038] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 778.803038] nova-scheduler[51488]: INFO nova.filters [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filter ComputeFilter returned 0 hosts [ 778.803038] nova-scheduler[51488]: DEBUG nova.filters [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'c0697d6a-a483-4c9f-a7c5-410a1bfe58c8'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 778.803038] nova-scheduler[51488]: INFO nova.filters [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'c0697d6a-a483-4c9f-a7c5-410a1bfe58c8'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 778.803038] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 778.803038] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-f0028133-1f87-4714-a85b-92702cda1420 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 779.247031] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting to schedule for instances: ['c8f5f4e9-a4d9-4849-9051-c26c00cc5b9a'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 779.247031] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 779.247031] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.250350] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.250945] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.250945] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 779.298112] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Starting to schedule for instances: ['4d9c5b48-3113-406f-ab15-1ca6d7cf408d'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 779.298677] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 779.298677] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.298789] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.298999] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.299214] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 779.306029] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.306265] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.306430] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.313800] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.314028] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.314375] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 779.314647] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 779.314810] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 779.314962] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 779.317793] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.318087] nova-scheduler[51491]: DEBUG nova.filters [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 779.318618] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 83.595683 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 779.318618] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 779.318724] nova-scheduler[51491]: INFO nova.filters [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filter ComputeFilter returned 0 hosts [ 779.318844] nova-scheduler[51491]: DEBUG nova.filters [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'c8f5f4e9-a4d9-4849-9051-c26c00cc5b9a'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 779.319022] nova-scheduler[51491]: INFO nova.filters [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'c8f5f4e9-a4d9-4849-9051-c26c00cc5b9a'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 779.319220] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 779.319387] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-507349e2-512d-4db4-878e-7b83ee990d81 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 779.358671] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.361254] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.361254] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.367138] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.368445] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.368445] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 779.368775] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 779.369148] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 779.369609] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 779.369972] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.003s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.370318] nova-scheduler[51488]: DEBUG nova.filters [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 779.371033] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 83.647928 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 779.371033] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 779.371134] nova-scheduler[51488]: INFO nova.filters [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Filter ComputeFilter returned 0 hosts [ 779.371354] nova-scheduler[51488]: DEBUG nova.filters [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Filtering removed all hosts for the request with instance ID '4d9c5b48-3113-406f-ab15-1ca6d7cf408d'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 779.371579] nova-scheduler[51488]: INFO nova.filters [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Filtering removed all hosts for the request with instance ID '4d9c5b48-3113-406f-ab15-1ca6d7cf408d'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 779.371784] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 779.371998] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-b21b7d60-06a4-433e-88b6-ffb8ddfb5da6 tempest-ServersV294TestFqdnHostnames-786105790 tempest-ServersV294TestFqdnHostnames-786105790-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 779.672645] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting to schedule for instances: ['a1fb0eab-4052-430a-b069-23e400279698'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 779.672947] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 779.675666] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.675666] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.675666] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 779.675666] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 779.726175] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.726175] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.726175] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.733543] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 779.733639] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 779.734277] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 779.734277] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 779.734452] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 779.734593] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 779.734721] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 779.734981] nova-scheduler[51491]: DEBUG nova.filters [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 779.735202] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 84.012589 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 779.735365] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 779.735527] nova-scheduler[51491]: INFO nova.filters [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filter ComputeFilter returned 0 hosts [ 779.735691] nova-scheduler[51491]: DEBUG nova.filters [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'a1fb0eab-4052-430a-b069-23e400279698'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 779.735862] nova-scheduler[51491]: INFO nova.filters [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtering removed all hosts for the request with instance ID 'a1fb0eab-4052-430a-b069-23e400279698'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 779.735937] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 779.736089] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-3dcd2b45-5821-4196-8e41-95a8a2c02aa3 tempest-ListServerFiltersTestJSON-1383070416 tempest-ListServerFiltersTestJSON-1383070416-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 785.318127] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Starting to schedule for instances: ['39d41b8b-bbaa-4712-a7fd-5105051795c3'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 785.322016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 785.322016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.322016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.322016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 785.322016] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 785.373072] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 785.373419] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 785.373666] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 785.382611] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 785.382902] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 785.383441] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 785.383831] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 785.384089] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 785.384324] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 785.384561] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.002s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 785.384920] nova-scheduler[51488]: DEBUG nova.filters [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 785.385243] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 89.662529 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 785.385477] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 785.385700] nova-scheduler[51488]: INFO nova.filters [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filter ComputeFilter returned 0 hosts [ 785.385915] nova-scheduler[51488]: DEBUG nova.filters [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtering removed all hosts for the request with instance ID '39d41b8b-bbaa-4712-a7fd-5105051795c3'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 785.386137] nova-scheduler[51488]: INFO nova.filters [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtering removed all hosts for the request with instance ID '39d41b8b-bbaa-4712-a7fd-5105051795c3'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 785.386355] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 785.386587] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-fa89575e-2216-408b-82bd-01138ca2f3d6 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 788.078505] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Starting to schedule for instances: ['74099d79-f2be-4790-b247-4e8028f61633'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 788.078989] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 788.079063] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.079249] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.079488] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 788.079721] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 788.121107] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.121335] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.121496] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.128068] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 788.128277] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 788.128624] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 788.128950] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 788.129148] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 788.129304] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 788.129460] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 788.129699] nova-scheduler[51491]: DEBUG nova.filters [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 788.129900] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 92.407292 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 788.130065] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 788.130213] nova-scheduler[51491]: INFO nova.filters [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filter ComputeFilter returned 0 hosts [ 788.130355] nova-scheduler[51491]: DEBUG nova.filters [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtering removed all hosts for the request with instance ID '74099d79-f2be-4790-b247-4e8028f61633'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 788.130487] nova-scheduler[51491]: INFO nova.filters [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtering removed all hosts for the request with instance ID '74099d79-f2be-4790-b247-4e8028f61633'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 788.130627] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 788.130779] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5adaf985-c005-4d8b-aa86-bae8048ba6d7 tempest-AttachVolumeTestJSON-1073652285 tempest-AttachVolumeTestJSON-1073652285-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 792.663202] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Starting to schedule for instances: ['e9c006ea-e917-4f88-b332-324e32c00839'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 792.663517] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 792.663670] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.663848] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.664053] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 792.664250] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 792.704436] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.704685] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.704859] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.711782] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 792.711996] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 792.712378] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=2,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=198,free_ram_mb=195822,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=2,mapped=1,memory_mb=196590,memory_mb_used=768,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=2,service_id=None,stats={failed_builds='31',io_workload='2',num_instances='2',num_os_type_None='2',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_27d36caa344f42aca3919c92d468bbd6='0',num_proj_6a76486869574011a18c114d723d40aa='1',num_proj_6dda5a654e88441fa1c1f01d1435fda8='0',num_proj_8a8269fa65f541b098ed07cc3679e448='0',num_proj_a9e33b2e4b8c439a8e8a557ddda22fce='0',num_proj_bb0823f51ed044b7ad68386fb1f60fb5='0',num_proj_c884340032e64abcbc9e405b7da4cb6f='0',num_proj_d742fb05f93f44a9b9c8207f47e77730='0',num_task_None='0',num_task_spawning='2',num_vm_building='2'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:47:23Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=2) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 792.712650] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 792.712820] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 2, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 46, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 792.712978] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Update host state with instances: ['b7ab8792-137d-4053-9df9-3d560aa5e411', '5c575e05-5a7c-49b8-b914-9b4a4e347bfc', '11f468ba-a807-4490-9dd5-58eaad007865'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 792.713158] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 792.713402] nova-scheduler[51488]: DEBUG nova.filters [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 792.713606] nova-scheduler[51488]: DEBUG nova.servicegroup.drivers.db [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:46:14. Elapsed time is 96.990994 {{(pid=51488) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 792.713773] nova-scheduler[51488]: WARNING nova.scheduler.filters.compute_filter [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195822MB disk: 202752MB io_ops: 2 instances: 2, allocation_candidates: 1 has not been heard from in a while [ 792.713938] nova-scheduler[51488]: INFO nova.filters [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Filter ComputeFilter returned 0 hosts [ 792.714099] nova-scheduler[51488]: DEBUG nova.filters [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Filtering removed all hosts for the request with instance ID 'e9c006ea-e917-4f88-b332-324e32c00839'. Filter results: [('ComputeFilter', None)] {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 792.714352] nova-scheduler[51488]: INFO nova.filters [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Filtering removed all hosts for the request with instance ID 'e9c006ea-e917-4f88-b332-324e32c00839'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 792.714545] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] Filtered [] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 792.714803] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-9e578bd6-479a-4d09-bda0-ac16ea7b2eb9 tempest-ServerActionsV293TestJSON-1433800374 tempest-ServerActionsV293TestJSON-1433800374-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51488) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}} [ 811.849589] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.849897] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Acquiring lock "host_instance" by "nova.scheduler.host_manager.HostManager.sync_instance_info" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.849897] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.850088] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "host_instance" acquired by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.850167] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.850213] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 811.850333] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.850389] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 811.850486] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.850545] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.853259] nova-scheduler[51488]: INFO nova.scheduler.host_manager [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 811.853361] nova-scheduler[51491]: INFO nova.scheduler.host_manager [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] The instance sync for host 'cpu-1' did not match. Re-created its InstanceList. [ 811.853444] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 811.853484] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-64cd2b2e-0703-4a04-b49d-500be9694f0c None None] Lock "host_instance" "released" by "nova.scheduler.host_manager.HostManager.sync_instance_info" :: held 0.004s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 820.179857] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Starting to schedule for instances: ['e0c34b27-f25b-48b8-8ace-0bbe5380a336'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 820.180170] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 820.180370] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 820.180589] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 820.180818] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 820.181059] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 820.221376] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 820.222030] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 820.222030] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 820.228437] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 820.228632] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 820.228791] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 820.230819] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 820.231033] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 820.231389] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='32',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_6a76486869574011a18c114d723d40aa='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:48:14Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=1) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 820.231686] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 820.231859] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 820.232025] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Update host state with instances: ['26aa196e-e745-494d-814f-7da3cf18ec14'] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 820.232192] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 820.232438] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 820.232637] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.232812] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233008] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233178] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233335] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233492] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233646] nova-scheduler[51491]: DEBUG nova.filters [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 820.233796] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 820.233957] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 820.234142] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Attempting to claim resources in the placement API for instance e0c34b27-f25b-48b8-8ace-0bbe5380a336 {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 820.285787] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] [instance: e0c34b27-f25b-48b8-8ace-0bbe5380a336] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 820.286107] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 820.286315] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 820.286538] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-27f3a826-1482-4da4-b09f-2c822483cff2 tempest-ImagesOneServerNegativeTestJSON-1831759335 tempest-ImagesOneServerNegativeTestJSON-1831759335-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.722435] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Starting to schedule for instances: ['4e0763e1-7348-472a-8838-648991382724'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 827.722764] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 827.723215] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 827.723215] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 827.723311] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 827.723464] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 827.770686] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.771040] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.771232] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.777595] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.777786] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.777943] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.779970] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.780171] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.780527] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=1,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=199,free_ram_mb=195950,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=1,mapped=1,memory_mb=196590,memory_mb_used=640,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=1,service_id=None,stats={failed_builds='33',io_workload='1',num_instances='1',num_os_type_None='1',num_proj_02855237761b401fbd41810098ed77e9='1',num_proj_599a0d1dc613482c952b7bc2c9024674='0',num_proj_6a76486869574011a18c114d723d40aa='0',num_task_None='0',num_task_spawning='1',num_vm_building='1'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:48:21Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=1) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 827.780797] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 827.780962] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 827.781128] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Update host state with instances: ['26aa196e-e745-494d-814f-7da3cf18ec14'] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 827.781286] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 827.781526] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 827.781720] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.781895] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782097] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782258] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782419] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782575] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782731] nova-scheduler[51488]: DEBUG nova.filters [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 827.782884] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 827.783067] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 827.783241] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Attempting to claim resources in the placement API for instance 4e0763e1-7348-472a-8838-648991382724 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 827.834568] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] [instance: 4e0763e1-7348-472a-8838-648991382724] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 195950MB disk: 203776MB io_ops: 1 instances: 1, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 827.834916] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 827.835200] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 827.835448] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-825429ae-cfdc-4552-b852-fd153618f151 tempest-InstanceActionsTestJSON-1277579837 tempest-InstanceActionsTestJSON-1277579837-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.516224] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting to schedule for instances: ['4d789e06-d563-46a0-80fc-0040ce074bff'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 868.516559] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 868.518035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 868.518035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 868.518035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 868.518035] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 868.559040] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.559272] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.559434] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.566406] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.566594] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.566745] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.568785] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.568975] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.569343] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='35',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_02855237761b401fbd41810098ed77e9='0',num_proj_2b0a5316a9ae491c985d1f21a2ae77e1='0',num_proj_599a0d1dc613482c952b7bc2c9024674='0',num_proj_6a76486869574011a18c114d723d40aa='0',num_task_None='0',num_task_spawning='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:49:02Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=0) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 868.569615] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 868.569782] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 868.569932] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with instances: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 868.570109] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 868.570350] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 868.570549] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.570728] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.570917] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.571094] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.571253] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.571415] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.571576] nova-scheduler[51491]: DEBUG nova.filters [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 868.571730] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 868.571889] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 868.572068] nova-scheduler[51491]: DEBUG nova.scheduler.utils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Attempting to claim resources in the placement API for instance 4d789e06-d563-46a0-80fc-0040ce074bff {{(pid=51491) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 868.622507] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] [instance: 4d789e06-d563-46a0-80fc-0040ce074bff] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51491) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 868.622900] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 868.623154] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 868.623363] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-5bbfd84e-652d-4116-947c-a9bb40e07d62 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.079275] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting to schedule for instances: ['305bd6dd-1e6c-4f5b-b6c2-1f5dd6a24165'] {{(pid=51488) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 873.079570] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51488) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 873.079732] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 873.079910] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 873.080125] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51488) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 873.080306] nova-scheduler[51488]: DEBUG nova.scheduler.request_filter [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] ephemeral_encryption_filter skipped {{(pid=51488) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 873.118143] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.118370] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.118568] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.125032] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.125229] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.125391] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.127445] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.127580] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.127885] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='37'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:49:10Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=0) {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 873.128174] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with aggregates: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 873.128342] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 873.128493] nova-scheduler[51488]: DEBUG nova.scheduler.host_manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with instances: [] {{(pid=51488) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 873.128658] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 873.128898] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting with 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 873.129113] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ComputeFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.129296] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ComputeCapabilitiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.129486] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ImagePropertiesFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.129646] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ServerGroupAntiAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.129803] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ServerGroupAffinityFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.129962] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter SameHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.130134] nova-scheduler[51488]: DEBUG nova.filters [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter DifferentHostFilter returned 1 host(s) {{(pid=51488) get_filtered_objects /opt/stack/nova/nova/filters.py:102}} [ 873.130288] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filtered [(cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 873.130452] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Weighed [WeighedHost [host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1, weight: 0.0]] {{(pid=51488) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:697}} [ 873.130622] nova-scheduler[51488]: DEBUG nova.scheduler.utils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Attempting to claim resources in the placement API for instance 305bd6dd-1e6c-4f5b-b6c2-1f5dd6a24165 {{(pid=51488) claim_resources /opt/stack/nova/nova/scheduler/utils.py:1264}} [ 873.172647] nova-scheduler[51488]: DEBUG nova.scheduler.manager [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] [instance: 305bd6dd-1e6c-4f5b-b6c2-1f5dd6a24165] Selected host: (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 {{(pid=51488) _consume_selected_host /opt/stack/nova/nova/scheduler/manager.py:557}} [ 873.172940] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 873.173180] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: waited 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 873.173386] nova-scheduler[51488]: DEBUG oslo_concurrency.lockutils [None req-3552d8a9-9963-4869-9fb4-73a73b5816c4 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.consume_from_request.._locked" :: held 0.000s {{(pid=51488) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.847542] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting to schedule for instances: ['59354370-8fc9-4933-ba88-f2886434eb5c'] {{(pid=51491) select_destinations /opt/stack/nova/nova/scheduler/manager.py:142}} [ 877.847875] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] compute_status_filter request filter added forbidden trait COMPUTE_STATUS_DISABLED {{(pid=51491) compute_status_filter /opt/stack/nova/nova/scheduler/request_filter.py:255}} [ 877.848174] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'compute_status_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.848404] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'accelerators_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.848634] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Request filter 'remote_managed_ports_filter' took 0.0 seconds {{(pid=51491) wrapper /opt/stack/nova/nova/scheduler/request_filter.py:46}} [ 877.848848] nova-scheduler[51491]: DEBUG nova.scheduler.request_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] ephemeral_encryption_filter skipped {{(pid=51491) ephemeral_encryption_filter /opt/stack/nova/nova/scheduler/request_filter.py:412}} [ 877.951228] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 877.951464] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 877.951628] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.958342] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 877.958538] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 877.958708] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "b3c1ceaa-bc48-48ee-8b60-930585e76a41" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.960707] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Acquiring lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" by "nova.scheduler.host_manager.HostState.update.._locked_update" {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} [ 877.960903] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" acquired by "nova.scheduler.host_manager.HostState.update.._locked_update" :: waited 0.000s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} [ 877.961260] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state from compute node: ComputeNode(cpu_allocation_ratio=4.0,cpu_info='',created_at=2024-10-23T14:44:08Z,current_workload=0,deleted=False,deleted_at=None,disk_allocation_ratio=1.0,disk_available_least=None,free_disk_gb=200,free_ram_mb=196078,host='cpu-1',host_ip=10.180.1.21,hypervisor_hostname='domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28',hypervisor_type='VMware vCenter Server',hypervisor_version=7000003,id=1,local_gb=200,local_gb_used=0,mapped=1,memory_mb=196590,memory_mb_used=512,metrics='[]',numa_topology=None,pci_device_pools=PciDevicePoolList,ram_allocation_ratio=1.0,running_vms=0,service_id=None,stats={failed_builds='37',io_workload='0',num_instances='0',num_os_type_None='0',num_proj_1aa856aa79e94290acfdb44c20d4a028='0',num_task_None='0',num_vm_building='0'},supported_hv_specs=[HVSpec,HVSpec],updated_at=2024-10-23T14:49:13Z,uuid=80c650ad-13a5-4d4e-96b3-a14b31abfa11,vcpus=48,vcpus_used=0) {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:169}} [ 877.961531] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with aggregates: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:172}} [ 877.961701] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with service dict: {'id': 7, 'uuid': '36310963-e055-4270-a672-67536b3b8c36', 'host': 'cpu-1', 'binary': 'nova-compute', 'topic': 'compute', 'report_count': 3, 'disabled': False, 'disabled_reason': None, 'last_seen_up': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'forced_down': False, 'version': 66, 'created_at': datetime.datetime(2024, 10, 23, 14, 44, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2024, 10, 23, 14, 48, 14, tzinfo=datetime.timezone.utc), 'deleted_at': None, 'deleted': False} {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:175}} [ 877.961857] nova-scheduler[51491]: DEBUG nova.scheduler.host_manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Update host state with instances: [] {{(pid=51491) _locked_update /opt/stack/nova/nova/scheduler/host_manager.py:178}} [ 877.962024] nova-scheduler[51491]: DEBUG oslo_concurrency.lockutils [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Lock "('cpu-1', 'domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28')" "released" by "nova.scheduler.host_manager.HostState.update.._locked_update" :: held 0.001s {{(pid=51491) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} [ 877.962270] nova-scheduler[51491]: DEBUG nova.filters [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Starting with 1 host(s) {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:70}} [ 877.962471] nova-scheduler[51491]: DEBUG nova.servicegroup.drivers.db [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Seems service nova-compute on host cpu-1 is down. Last heartbeat was 2024-10-23 14:48:14. Elapsed time is 62.239859 {{(pid=51491) is_up /opt/stack/nova/nova/servicegroup/drivers/db.py:76}} [ 877.962622] nova-scheduler[51491]: WARNING nova.scheduler.filters.compute_filter [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] (cpu-1, domain-c8.fc996f14-c53b-4953-92e3-bdfa48f5cc28) ram: 196078MB disk: 204800MB io_ops: 0 instances: 0, allocation_candidates: 1 has not been heard from in a while [ 877.962781] nova-scheduler[51491]: INFO nova.filters [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filter ComputeFilter returned 0 hosts [ 877.962969] nova-scheduler[51491]: DEBUG nova.filters [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filtering removed all hosts for the request with instance ID '59354370-8fc9-4933-ba88-f2886434eb5c'. Filter results: [('ComputeFilter', None)] {{(pid=51491) get_filtered_objects /opt/stack/nova/nova/filters.py:114}} [ 877.963119] nova-scheduler[51491]: INFO nova.filters [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filtering removed all hosts for the request with instance ID '59354370-8fc9-4933-ba88-f2886434eb5c'. Filter results: ['ComputeFilter: (start: 1, end: 0)'] [ 877.963264] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] Filtered [] {{(pid=51491) _get_sorted_hosts /opt/stack/nova/nova/scheduler/manager.py:675}} [ 877.963407] nova-scheduler[51491]: DEBUG nova.scheduler.manager [None req-b9f8a191-842e-41be-8097-d8f0ec79c619 tempest-AttachVolumeNegativeTest-1762778477 tempest-AttachVolumeNegativeTest-1762778477-project-member] There are 0 hosts available but 1 instances requested to build. {{(pid=51491) _ensure_sufficient_hosts /opt/stack/nova/nova/scheduler/manager.py:494}}